Detail
After configuring the Aerospike Monitoring Stack (AMS) it is noticed the dashboards provided by Aerospike are not displaying any data, but executing raw queries directly from Grafana return data as expected.
Answer
The dashboard json files contain expressions (expr) to query the Prometheus server for the scraped data from the node(s). The expression contains a hardcoded value of "job=aerospike" and if the prometheus.yml is configured for a different job_name it will fail to retrieve the metrics.
If you plan to use the default dashboards provided by Aerospike you must ensure the prometheus.yml has the job_name configured as "aerospike".
Example expression in cluster.json dashboard file:
"expr": "sum(aerospike_node_up{job=\"aerospike\", cluster_name=~\"$cluster\"})",
Example configuration section in prometheus.yml:
# A scrape configuration containing three endpoints to scrape: scrape_configs: # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config. - job_name: "aerospike" static_configs: - targets: ["10.6.3.101:9145", "10.6.3.102:9145", "10.6.3.103:9145"]