Need help with Cloudwatch custom metrics

Grafana Configuration
1

Hi Guys,

Need help! thank you in advance for helping me with this issue.

What Grafana version are you using?
4.2.0
What datasource are you using?
cloudwatch (cloudwatch custom metrics to be more specific)
What OS are you running grafana on?
Ubuntu

What did you do?
I am reporting server custom metrics to cloudwatch using a cron job that is running on my ubuntu server every 5 min (see full command below).

~/aws-scripts-mon/mon-put-instance-data.pl --mem-util --mem-used --mem-avail --swap-util --swap-used --disk-space-util --disk-space-used --disk-space-avail --disk-path=/ --from-cron

I can see the data appearing in cloudwatch and I can build dashboard using these metrics. I am also able to query this data from cloudwatch using cli using the following command.

aws cloudwatch get-metric-statistics --region us-east-1 --metric-name “DiskSpaceUtilization” --start-time 2017-05-05T16:00:27 --end-time 2017-05-05T16:15:27 --period 300 --namespace “System/Linux” --dimensions Name=Filesystem,Value=/dev/xvda1 Name=InstanceId,Value=i-0494f751a488a8fd0 Name=MountPath,Value=/ --statistics Average

However, no data is showing when I do the query using Grafana.

Here are couple of things that I think is important in this investigation.

  1. IAM:
    Same IAM policy is attached to IAM user whose key and secret is used for grafana datasource as ec2 role (where I ran cli get queries see above).

{
“Version”: “2012-10-17”,
“Statement”: [
{
“Sid”: “Stmt1493822141000”,
“Effect”: “Allow”,
“Action”: [
“cloudwatch:GetMetricStatistics”,
“cloudwatch:ListMetrics”,
“cloudwatch:PutMetricData”
],
“Resource”: [
“"
]
},
{
“Sid”: “Stmt1493822224000”,
“Effect”: “Allow”,
“Action”: [
“ec2:DescribeTags”
],
“Resource”: [
"”
]
}
]
}
2. Namespace:
I have used the same namespace name while configuring the grafana query as I did while running the cli command above.
screenshot1:

datasource.png446×568 27.7 KB

  1. Dimensions:
    I have configured the correct dimensions in exactly same order as in the cli command.
    –dimensions Name=Filesystem,Value=/dev/xvda1 Name=InstanceId,Value=i-0494f751a488a8fd0 Name=MountPath,Value=/
    screenshot2:
    grafana query dimensions.png1257×679 52.4 KB

    Whereas if I select exactly the same thing in cloudwatch, I can see data.

More over, in grafana query builder if I select memory utilisation then correct dimensions doesn’t showup in the dimentions.
In cloudwatch, these dimensions are shown.
In Grafana:
As you can see one of the dimensions “Instance Name” doesn’t appear.

Thanks again, I would really appreciate if you can help. If you need any more information, please let me know.

**I had to take some screenshots out because of restriction.

2

Can you try setting Draw Modes to Points so that you can see if any data is being returned.

image.png693×301 20.4 KB

Also, if you check the response, is there any data being returned (here is a guide on how to do check the response)?

3

Hi,

I know this is a quite old thread but I am having the same problem.
Unable to show custom metrics from CloudWatch in Grafana.
Data is showing in cloudwatch…
I get metric listing / auto complete but no data.

Any clue ?

PS: using version 6.2.1

Thanks