Install Grafana mqtt-datasource on Ubuntu - plug-in not showing up on search

[antonio79]

Hi!

I’m trying to install the Grafana mqtt-datasource plugin on my Ubuntu 20.04 machine to collect data via MQTT source on the same network:

I followed the detailed instructions here:

grafana/mqtt-datasource/blob/main/README.md

AND here

Building and installing the MQTT plugin

The prerequisits seems to have installed successfully, all to the end.

However, when I try to search for the MQTT plug-in within the Grafana desktop environment, it does not appear in the search results (the last set of instructions). I don’t know if I incorrectly configured the config file or if it was an install issue?

Here are some snippets of for the config file:

For the path:

# Directory where grafana will automatically scan and look for plugins
;plugins = /var/lib/grafana/plugins
plugins = /grafana-plugins/

For the above path, I tried also insert hostname/pi/ before the /grafana-plugins/ path, and that didnt work either.

For the plugin:

[plugins]
;enable_alpha = false
;app_tls_skip_verify_insecure = false
# Enter a comma-separated list of plugin identifiers to identify plugins to load even if they are unsigned. Plugins with modified signatures are never loade>
allow_loading_unsigned_plugins = mqtt-datasource

for the plugin, since I named the folder “mqtt-datasource”, in “grafana-plugins”, so put it as that, in addition to what the isntructions say, “grafana-mqtt-datasource”, neither of them worked.

and here is the folder where i did the build and install along with path:

Now, when Im in the desktop environment, I simply search for mqtt and it simply doesn’t show up.

any help would be greatly appreciated!

[grant2]

I too struggled with getting the MQTT datasource working, but never did get it to work. Here is my error-laden experience: Help building backend datasource (MQTT for streaming data)

If you do get it working and can explain it here, I will personally nominate you to be the President of the Grafana Forums.

[antonio79]

lol i don’t know, if i can get this work…its too bad to hear that you also were not sucessfull.

I’m the president of copying and pasting into the terminal line

[antonio79]

I’m sure someone has got this to work using Ubuntu 20.04!

Anybody care to share their experience?

[atifshoukatali]

@antonio79 @grant2

looking into this i was able to run it locally on my Ubuntu machine - but can think of a couple things that would make it not work in some cases - can you please share the grafana logs - will help with the debugging - also can you share how the mqtt-datasource/dist dir looks for you locally - also would be helpful to see the output of the commands for building the plugin (yarn install; yarn build) - and a copy of your config.ini would be useful too - appreciate your help

[antonio79]

Thanks @atifshoukatali for your help!

I’ll try to give you everything you need here
Here’s the mqtt-datasource/dist dir looks like

Here’s the yarn install output commands:

And here’s the yarn build commands

As for the config file, I only edited two parts (the rest of the file is default for my version Grafana v8.3.3 (30bb7a93ca) . These are the exact entries i edited:

# Directory where grafana will automatically scan and look for plugins
;plugins = /var/lib/grafana/plugins
plugins = /home/antonio/grafana-plugins

and

# Enter a comma-separated list of plugin identifiers to identify plugins to load even if they are unsigned. Plugins with modified signatures are never loade>
allow_loading_unsigned_plugins = grafana-mqtt-datasource

As for the log files, there were a few logs files, heres the last 1.5 days. You may see the plugins folder path change from /home/antonio/grafana-plugins to /home/antonio/grafana-plugins2 OR /home/antonio/grafana-plugins3, this is me changing the paths after doing some experimenting to get this to work.

I don’t know if the below is helpful or not, I can get specific parts if you ask me where to look or if I can attach files here…please let me know!

t=2022-01-06T12:49:38-0700 lvl=info msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=GET path=/api/live/ws status=0 remote_addr=12>
t=2022-01-06T12:57:36-0700 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/datasources/new status=302 remote_addr=[>
t=2022-01-06T12:57:36-0700 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/ status=302 remote_addr=[::1] time_ms=1 >
t=2022-01-06T12:57:50-0700 lvl=info msg="Successful Login" logger=http.server User=admin@localhost
t=2022-01-06T12:58:05-0700 lvl=info msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=GET path=/api/live/ws status=0 remote_addr=[:>
t=2022-01-05T22:46:46-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:46:46-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=2.949536ms
t=2022-01-05T22:46:46-0700 lvl=info msg="Initialising plugins" logger=plugin.manager
t=2022-01-05T22:46:46-0700 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input
t=2022-01-05T22:46:46-0700 lvl=info msg="Live Push Gateway initialization" logger=live.push_http
t=2022-01-05T22:46:46-0700 lvl=info msg="Writing PID file" logger=server path=/run/grafana/grafana-server.pid pid=3615
t=2022-01-05T22:46:46-0700 lvl=info msg="warming cache for startup" logger=ngalert
t=2022-01-05T22:46:46-0700 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager
t=2022-01-05T22:46:46-0700 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=http subUrl= socket=
t=2022-01-05T22:47:18-0700 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated"
t=2022-01-05T22:49:27-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:49:27-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:49:27-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-05T22:49:27-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:49:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:49:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:49:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:49:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:49:27-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:49:27-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:49:27-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:49:27-0700 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins
t=2022-01-05T22:49:27-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:49:27-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:49:27-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:49:28-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:49:28-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=1.35482ms
t=2022-01-05T22:49:28-0700 lvl=info msg="Initialising plugins" logger=plugin.manager
t=2022-01-05T22:49:32-0700 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input
t=2022-01-05T22:49:32-0700 lvl=info msg="Live Push Gateway initialization" logger=live.push_http
t=2022-01-05T22:49:35-0700 lvl=info msg="Writing PID file" logger=server path=/run/grafana/grafana-server.pid pid=1007
t=2022-01-05T22:49:35-0700 lvl=info msg="warming cache for startup" logger=ngalert
t=2022-01-05T22:49:36-0700 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager
t=2022-01-05T22:49:36-0700 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=http subUrl= socket=
t=2022-01-05T22:50:46-0700 lvl=eror msg="Failed to look up user based on cookie" logger=context error="user token not found"
t=2022-01-05T22:50:46-0700 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/ status=302 remote_addr=127.0.0.1 time_m>
t=2022-01-05T22:50:46-0700 lvl=eror msg="Failed to look up user based on cookie" logger=context error="user token not found"
t=2022-01-05T22:50:58-0700 lvl=eror msg="Failed to look up user based on cookie" logger=context error="user token not found"
t=2022-01-05T22:50:58-0700 lvl=info msg="Successful Login" logger=http.server User=admin@localhost
t=2022-01-05T22:52:08-0700 lvl=info msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=GET path=/api/live/ws status=0 remote_addr=12>
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Plugins" logger=settings path=/home/antonio/grafana-plugins3
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:23:27-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:23:27-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:23:27-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:23:27-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=1.353132ms
t=2022-01-05T22:23:28-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:23:28-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:23:28-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-05T22:23:28-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:23:28-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:23:28-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:23:28-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:23:28-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:23:28-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:23:28-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:23:28-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:23:28-0700 lvl=info msg="Path Plugins" logger=settings path=/home/antonio/grafana-plugins3
t=2022-01-05T22:23:28-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:23:28-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:23:28-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:23:28-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:23:28-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=1.949645ms
t=2022-01-05T22:46:46-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:46:46-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:46:46-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-05T22:46:46-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:46:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:46:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:46:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:46:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:46:46-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:46:46-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:46:46-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:46:46-0700 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins
t=2022-01-05T22:46:46-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:46:46-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:46:46-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:23:26-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Plugins" logger=settings path=/home/antonio/grafana-plugins3
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:23:26-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:23:26-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:23:26-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:23:26-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=1.934079ms
t=2022-01-05T22:23:27-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:23:27-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:23:27-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-05T22:23:27-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Plugins" logger=settings path=/home/antonio/grafana-plugins3
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:23:27-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:23:27-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:23:27-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:23:27-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=1.48807ms
t=2022-01-05T22:23:27-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:23:27-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:23:27-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-05T22:23:27-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:23:27-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:23:27-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:11:16-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:11:17-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:11:17-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=4.305368ms
t=2022-01-05T22:11:17-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:11:17-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:11:17-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-05T22:11:17-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:11:17-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:11:17-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:11:17-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:11:17-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:11:17-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:11:17-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:11:17-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:11:17-0700 lvl=info msg="Path Plugins" logger=settings path=/home/antonio/grafana-plugins3
t=2022-01-05T22:11:17-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:11:17-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:11:17-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:11:17-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:11:17-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=1.40797ms
t=2022-01-05T22:23:26-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:23:26-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:23:26-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-05T22:23:26-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-05T22:23:26-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Plugins" logger=settings path=/home/antonio/grafana-plugins3
t=2022-01-05T22:23:26-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-05T22:23:26-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-05T22:23:26-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-05T22:23:26-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-05T22:23:26-0700 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=1.33652ms
t=2022-01-05T22:23:26-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-05T22:23:26-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-05T22:23:26-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini

[atifshoukatali]

@antonio79 which ini file are you making these changes into? is it the default.ini or grafana.ini? also can you set the logger level to debug (Configuration | Grafana Labs) in the ini file and then restart grafana and share the logs after that restart?

[antonio79]

@atifshoukatali thanks for your further instructions.

I am making the changes in the /etc/grafana/grafana.ini file.

After making the changes to the logger to debug, I restarted the computer and opened up grafana’

Is there a way that I can share the file with you? the post is saying I’ve reached my 30,000 character limit…also, since restarting my computer, the grafana-server failed to start, but noticed this message below when I checked the status of the server…it says the plug-in folder…permissions is denied…not sure why the server would go down though?

 grafana-server.service - Grafana instance
     Loaded: loaded (/lib/systemd/system/grafana-server.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Thu 2022-01-06 21:52:57 MST; 29min ago
       Docs: http://docs.grafana.org
    Process: 1413 ExecStart=/usr/sbin/grafana-server --config=${CONF_FILE} --pidfile=${PID_FILE_DIR}/grafana-server.pid --packaging=deb cfg:default.paths.lo>
   Main PID: 1413 (code=exited, status=1/FAILURE)

Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1384]: t=2022-01-06T21:52:57-0700 lvl=info msg="migrations completed" logger=migrator performed=0 >
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1384]: t=2022-01-06T21:52:57-0700 lvl=dbug msg="Ensuring main org and admin user exist" logger=sql>
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1384]: Failed to start grafana. error: stat /home/antonio/grafana-plugins: permission denied
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1384]: stat /home/antonio/grafana-plugins: permission denied
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1413]: t=2022-01-06T21:52:57-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migra>
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1413]: t=2022-01-06T21:52:57-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migra>
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1413]: t=2022-01-06T21:52:57-0700 lvl=info msg="migrations completed" logger=migrator performed=0 >
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1413]: t=2022-01-06T21:52:57-0700 lvl=dbug msg="Ensuring main org and admin user exist" logger=sql>
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1413]: Failed to start grafana. error: stat /home/antonio/grafana-plugins: permission denied
Jan 06 21:52:58 antonio-GC676AA-ABA-m8150n grafana-server[1413]: stat /home/antonio/grafana-plugins: permission denied

EDIT: changing the plug-in path to “/home/antonio/grafana-plugins” and restarting the server, fixed the server issue.

and parts of the log file here

t=2022-01-06T12:49:38-0700 lvl=info msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=GET path=/api/live/ws status=0 remote_addr=12>
t=2022-01-06T12:57:36-0700 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/datasources/new status=302 remote_addr=[>
t=2022-01-06T12:57:36-0700 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/ status=302 remote_addr=[::1] time_ms=1 >
t=2022-01-06T12:57:50-0700 lvl=info msg="Successful Login" logger=http.server User=admin@localhost
t=2022-01-06T12:58:05-0700 lvl=info msg="Request Completed" logger=context userId=1 orgId=1 uname=admin method=GET path=/api/live/ws status=0 remote_addr=[:>
t=2022-01-06T21:22:45-0700 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated"
t=2022-01-06T21:24:46-0700 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrati>
t=2022-01-06T21:24:46-0700 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alert>
t=2022-01-06T21:24:46-0700 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini
t=2022-01-06T21:24:46-0700 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini
t=2022-01-06T21:24:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.data=/var/lib/grafana"
t=2022-01-06T21:24:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.logs=/var/log/grafana"
t=2022-01-06T21:24:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.plugins=/var/lib/grafana/plugins"
t=2022-01-06T21:24:46-0700 lvl=info msg="Config overridden from command line" logger=settings arg="default.paths.provisioning=/etc/grafana/provisioning"
t=2022-01-06T21:24:46-0700 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana
t=2022-01-06T21:24:46-0700 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana
t=2022-01-06T21:24:46-0700 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana
t=2022-01-06T21:24:46-0700 lvl=info msg="Path Plugins" logger=settings path=/home/antonio/grafana-plugins
t=2022-01-06T21:24:46-0700 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning
t=2022-01-06T21:24:46-0700 lvl=info msg="App mode production" logger=settings
t=2022-01-06T21:24:46-0700 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3
t=2022-01-06T21:24:48-0700 lvl=dbug msg="Found 0 legacy alerts in the database. Unified alerting enabled is true" logger=migrator
t=2022-01-06T21:24:50-0700 lvl=info msg="Starting DB migrations" logger=migrator
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create migration_log table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create user table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index user.login"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index user.email"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index UQE_user_login - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index UQE_user_email - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table user to user_v1 - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create user table v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_user_login - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_user_email - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy data_source v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Drop old table user_v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column help_flags1 to user table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update user table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add last_seen_at column to user"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add missing user data"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add is_disabled column to user"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add index user.login/user.email"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add is_disabled column to user"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add index user.login/user.email"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add is_service_account column to user"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create temp user table v1-7"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_email - v1-7"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_org_id - v1-7"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_code - v1-7"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_status - v1-7"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update temp_user table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index IDX_temp_user_email - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index IDX_temp_user_org_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index IDX_temp_user_code - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index IDX_temp_user_status - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create temp_user v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_email - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_org_id - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_code - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_temp_user_status - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy temp_user v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop temp_user_tmp_qwerty"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Set created for temp users that will otherwise prematurel>
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create star table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index star.user_id_dashboard_id"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create org table v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_org_name - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create org_user table v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_org_user_org_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_org_user_org_id_user_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_org_user_user_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update org table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update org_user table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Migrate all Read Only Viewers to Viewers"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index dashboard.account_id"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index dashboard_account_id_slug"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard_tag table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index dashboard_tag.dasboard_id_term"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table dashboard to dashboard_v1 - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table dashboard to dashboard_v1 - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_dashboard_org_id - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_dashboard_org_id_slug - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy dashboard v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop table dashboard_v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="alter dashboard.data to mediumtext v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column updated_by in dashboard - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column created_by in dashboard - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column gnetId in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add index for gnetId in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column plugin_id in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add index for plugin_id in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add index for dashboard_id in dashboard_tag"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update dashboard table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update dashboard_tag table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column folder_id in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column isFolder in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column has_acl in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column uid in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update uid column values in dashboard"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add unique index dashboard_org_id_uid"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Remove unique index org_id_slug"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update dashboard title length"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard_provisioning"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisio>
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard_provisioning v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name>
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy dashboard_provisioning v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop dashboard_provisioning_tmp_qwerty"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add check_sum column"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add index for dashboard_title"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="delete tags for deleted dashboards"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="delete stars for deleted dashboards"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add index for dashboard_is_folder"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create data_source table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index data_source.account_id"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index data_source.account_id_name"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index IDX_data_source_account_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index data_source.account_id_name"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index IDX_data_source_account_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index UQE_data_source_account_id_name - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table data_source to data_source_v1 - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create data_source table v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_data_source_org_id - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_data_source_org_id_name - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy data_source v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Drop old table data_source_v1 #2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column with_credentials"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add secure json data column"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update data_source table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update initial version to 1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add read_only data column"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Migrate logging ds to loki ds"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update json_data with nulls"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add uid column"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update uid value"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add unique index datasource_org_id_uid"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add unique index datasource_org_id_is_default"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create api_key table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index api_key.account_id"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index api_key.key"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index api_key.account_id_name"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index IDX_api_key_account_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index UQE_api_key_key - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index UQE_api_key_account_id_name - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table api_key to api_key_v1 - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create api_key table v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_api_key_org_id - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_api_key_key - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_api_key_org_id_name - v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy api_key v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Drop old table api_key_v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update api_key table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add expires to api_key table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add service account foreign key"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard_snapshot table v4"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop table dashboard_snapshot_v4 #1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard_snapshot table v5 #2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_dashboard_snapshot_key - v5"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create dashboard_snapshot table v5 #2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_dashboard_snapshot_key - v5"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="alter dashboard_snapshot to mediumtext v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update dashboard_snapshot table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column external_delete_url to dashboard_snapshots tab>
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add encrypted dashboard json column"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create quota table v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update quota table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create plugin_setting table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column plugin_version to plugin_settings"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update plugin_setting table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create session table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Drop old table playlist table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Drop old table playlist_item table"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create playlist table v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create playlist item table v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update playlist table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update playlist_item table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop preferences table v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop preferences table v3"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create preferences table v3"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update preferences table charset"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column team_id in preferences"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update team_id column values in preferences"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column week_start in preferences"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create alert table v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index alert org_id & id "
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index alert state"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index alert dashboard_id"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Create alert_rule_tag table v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Create alert_rule_tag table v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add uni>
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy alert_rule_tag v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add uni>
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="copy alert_rule_tag v1 to v2"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="drop table alert_rule_tag_v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="create alert_notification table v1"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column is_default"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column frequency"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column send_reminder"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Add column disable_resolve_message"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="add index alert_notification org_id & name"
t=2022-01-06T21:24:50-0700 lvl=dbug msg="Skipping migration: Already executed" logger=migrator id="Update alert table charset"
t=202

[atifshoukatali]

@antonio79

i think this should be enough info - lets try fixing the permission issue here that is probably why the plugin is not working - we can try two things here:

1. try fixing the plugin dir permission - related issue: Failed to start - plugin folder permission denied - #2 by fadjar340
2. or just use the default plugins dir to clone and build the mqtt-datasource plugin: /var/lib/grafana/plugins

can you look into these two things and report back?
you can change the log level back to the default if needed to get the server running

[antonio79]

hi @atifshoukatali

So i went the route to build the plug-in in the /var/lib/grafana/plugins directory.

$ mkdir grafana-plugins
$ cd grafana-plugins
$ git clone https://github.com/grafana/mqtt-datasource.git
$ cd mqtt-datasource
$ yarn install
$ yarn build

problem is, it complains now that mage is not installed (or found) when I ‘yarn build’ here’s the screen shots for both yarn commands:

Does mage need to be reconfigured? It was orignally installed like this:

$ go get -u -d github.com/magefile/mage
$ cd $GOPATH/src/github.com/magefile/mage
$ go run bootstrap.go
$ mage -version
Mage Build Tool v1.11.0-2-g4cf3cfc
Build Date: 2021-08-03T11:57:28-07:00
Commit: 4cf3cfc
built with: go1.13.8

[atifshoukatali]

@antonio79

can you try just copying over the built package with the same permissions as the parent dir itself? i think mage is just not accessible due to permission differences too

[antonio79]

yes!! It works now!! Thank you very much!!

So, it was just a permission issue with the plug-path. Thank tyou for the awesome support.

[antonio79]

@atifshoukatali

so, now that I got all this data coming in from the MQTT broker, is there a way to automatically log the data, like in csv format? I see that I can export it manually, but related to my next question sometimes the data disappears from the plot, simply by navigating to a different screen in Grafana, and the plot(s) start all over. Should this happen?

cheers

[grant2]

As I understand it, the MQTT data you see on the panel is ephemeral. If you want to go back and view the dataset at a prior time, I think you would need to have the data in time series database (like InfluxDB). Besides the MQTT datasource plug in, have you created any other datasources? It would not be too difficult to set up a routine / program whereby the data is streamed via MQTT and stored into the database.

[antonio79]

thanks, @grant2 for this information.
No, I do not have any other datasource, only the MQTT-datasource.

I see that InfluxDB is an actual approved plug in for Grafana. Would it be just a matter installing and setting it up? Does it use MQTT as the data input? Would I be able to keep the MQTT-datasouce plug-in running at the same time?

EDIT: also, I should mention I have a Rasperry Pi Zero 2 W which is acting as the data sender source via MQTT to the broker (Ubuntu machine). I presume I have to do some configuration on the RPi, hopefully not install too much software on it due to limited resources.

thanks

[grant2]

OK, talkin’ my language now! The RPi Zero is fine for the data sender and one can also set it up to send the data to Influx. However, I do not think you should set up the actual Influx database on the Pi, simply due to the limited space and processing power. Do you have another computer (that stays on 24x7) on your network where you could install Influx? You could also set up Influx on a free cloud service, but that will present more hoops to jump through.

[antonio79]

great, @grant2

So, this is what I have (all runining 24/7):

Rasperry Pi Zero 2 W with Raspian Lite
Ubuntu 20 PC

The RPi communitcates with bluethooth modules to collect data and then sends it to the broker (Ubuntu PC) on the same network. The Ubuntu PC is the broker and has Grafana running.

I’d rather try to get this all locally installed, with using cloud services only if I have to.

You think this would work to set up a database with logging on the Ubuntu PC via the MQTT broker?

[grant2]

OK (I had forgot about the Ubuntu machine). You can definitely get this rocking in no time…

First install InfluxDB on the Ubuntu machine. There are 2 versions: 1.8 and 2.0. 2.0 is uses the Flux query language, but it’s not as difficult as some make it out to be. Both versions work fine with Grafana, but 2.0 is obviously the more “future proof” product, so I would install that. More on that here.

Second, to get the data from MQTT to Influx, you have a few options:
A. Using the Telegraf plugin for Influx. I have never done it, but know from the various forums that it’s a very tried-and-true method.
OR
B. Use Node-RED (which is already installed and running on your RPi). This is how I do it (so I know it works). Happy to provide you some more guidance on getting that going if that is what you decide to do.

Once the above are done, your MQTT data will flow to 2 different locations: Grafana (with MQTT datasource) to view the live feed, and Influx to save the historical data. As you noted, Grafana supports Influx data very well, so you’d just create another datasource called Influx and then build your graphs from there.

Before we go any further, about how many data streams (i.e. measurement feeds) are you gathering, and do you intend to do any fancy alarming, computations, etc. on this data?

[atifshoukatali]

as @grant2 mentioned the data is indeed ephemeral due to the nature of how grafana live api is being used in the plugin right now also the live setup will support some basic history (but definitely not long-term persistent storage - it just does not make sense to do it there) in the later releases - and no currently there are no plans to support exporting to csv within the plugin

[antonio79]

OK (I had forgot about the Ubuntu machine). You can definitely get this rocking in no time…

First install InfluxDB on the Ubuntu machine. There are 2 versions: 1.8 and 2.0. 2.0 is uses the Flux query language, but it’s not as difficult as some make it out to be. Both versions work fine with Grafana, but 2.0 is obviously the more “future proof” product, so I would install that. More on that here .

Second, to get the data from MQTT to Influx, you have a few options:
A. Using the Telegraf plugin for Influx. I have never done it, but know from the various forums that it’s a very tried-and-true method.
OR
B. Use Node-RED (which is already installed and running on your RPi). This is how I do it (so I know it works). Happy to provide you some more guidance on getting that going if that is what you decide to do.

Once the above are done, your MQTT data will flow to 2 different locations: Grafana (with MQTT datasource) to view the live feed, and Influx to save the historical data. As you noted, Grafana supports Influx data very well, so you’d just create another datasource called Influx and then build your graphs from there.

Before we go any further, about how many data streams (i.e. m

Thank you very much @grant2 for not only suggesting this but also setting it up for me. This is an elegant solution for viewing and storing the data in the Grafana environment with MQTT data source, InfluxD and Node-RED, all on my local server.

Thanks again @atifshoukatali for sorting out the MQTT data-source error.

Great support from this community!