Connecting Grafana to Prometheus

zohar · July 8, 2017, 9:47am

Thanks a lot for the effort.

container_cpu_user_seconds_total - Return data container_cpu_user_seconds_total{id=“/”,instance=“10.0.4.70:8080”,job=“cAdvisor”} 656.14
rate(container_cpu_user_seconds_total[1m]) - Return data
{id=“/”,instance=“10.0.4.70:8080”,job=“cAdvisor”} 0.0007272595043719863

3.rate(container_cpu_user_seconds_total{image!=“”}[1m]) - Return no data
4. sum(rate(container_cpu_user_seconds_total{image!=“”}[1m])) - Return no data
5. sort_desc(sum(rate(container_cpu_user_seconds_total{image!=“”}[1m]))) - Return no data

I will be happy to understand what that means and what has to be done to fix it.

daniellee · July 8, 2017, 10:04am

There is no image label for container_cpu_user_seconds_total. It has id, instance and job labels. Why have you got image!="" in the query?

zohar · July 8, 2017, 10:16am

You are correct!!! I just installed for the first time Grafana and used some of the dashboards referred there for docker. These dashboards are with pre build queries.
So I have removed the image part and it is working!!!Thanks a lot!!!
Any idea why did they added the image part?

daniellee · July 8, 2017, 10:32am

I took a quick look at cAdvisor and it seems like it should add an image label by default:

github.com

google/cadvisor/blob/689b91c1f27cdd56d007a2041e97b8b6142c89d8/metrics/prometheus.go#L740


const (
	// ContainerLabelPrefix is the prefix added to all container labels.
	ContainerLabelPrefix = "container_label_"
	// ContainerEnvPrefix is the prefix added to all env variable labels.
	ContainerEnvPrefix = "container_env_"
	// LabelID is the name of the id label.
	LabelID = "id"
	// LabelName is the name of the name label.
	LabelName = "name"
	// LabelImage is the name of the image label.
	LabelImage = "image"
)


// DefaultContainerLabels implements ContainerLabelsFunc. It exports the
// container name, first alias, image name as well as all its env and label
// values.
func DefaultContainerLabels(container *info.ContainerInfo) map[string]string {
	set := map[string]string{LabelID: container.Name}
	if len(container.Aliases) > 0 {
		set[LabelName] = container.Aliases[0]
	}

Might be worth asking there or googling some more on how to configure cAdvisor.

zohar · July 8, 2017, 10:46am

I will add additional docker instance and will se it it has any impact.
Also I will check there as well.

Thanks a lot it was a great help!!

Topic		Replies	Views
(First) Prometheus data source fails Prometheus	5	3319	May 30, 2023
Cant add a new Data Source Installation	4	719	May 13, 2021
Connection error for data source Prometheus with grafana using Docker windows Configuration docker , configuration , windows , datasource , prometheus	6	4456	August 9, 2022
Grafana Dashboard displaying empty graphs, not data coming Configuration	7	17036	February 21, 2023
Connect Prometheus to Grafana Prometheus	1	463	June 13, 2019

Connecting Grafana to Prometheus

Related topics