Data disappears when grouping a count by a term

Grafana Elasticsearch
1

I have an existing query that shows plenty of data:

Looking in elasticsearch, we can see that each result has a value in the proxy_upstream_name term.

image.png810×1171 84.2 KB

But when I try to group my Grafana query by proxy_upstream_name, all the data in my chart disappears.

image.png803×944 57.4 KB

I expected it to appear similar to the “Expected” image above, but with a line and legend entry for “mad-pig-apicontent-80” and all other proxy_upstream_name values .

What am I doing wrong here?

2

Can you investigate the query sent to Elasticsearch and elasticsearch response? Chrome dev tools network tab. Maybe there is something wrong with the query or the ES response

3

How to troubleshoot metric queries:

https://localhost:3000/t/how-to-troubleshoot-metric-query-issues/50

4

Thanks for the pointers! Elasticsearch response showed the following error message:

Fielddata is disabled on text fields by default. Set fielddata=true on [proxy_upstream_name] in order to load fielddata in memory by uninverting the inverted index. Note that this can however use significant memory.

Which lead me to this Elasticsearch page and then I queried my logstash-* mappings in elasticsearch like so:

curl https://my-elasticsearch.us-east-1.es.amazonaws.com:443/logstash-*

Looked at the mapping for proxy_upstream_name:

"proxy_upstream_name": {
    "fields": {
        "keyword": {
            "ignore_above": 256,
            "type": "keyword"
        }
    },
    "type": "text"

Saw that it already had a keyword, so I merely had to change my group by term name to proxy_upstream_name.keyword and groupings worked! Hooray.

image.png770×696 45.7 KB

1 Like