Grafana Service Not Starting

dpell352 · January 9, 2023, 4:01pm

What Grafana version and what operating system are you using?
Grafana version - NA

OS Fedora Linux

What are you trying to achieve?
Start Grafana after reboot
How are you trying to achieve it?
Reboot and manually start
What happened?
Starting the grafana-server.service failed
What did you expect to happen?
Can you copy/paste the configuration(s) that you are having problems with?
Did you receive any errors in the Grafana UI or in related logs? If so, please tell us exactly what they were.

Job for grafana-server.service failed because the control process exited with error code.
grafana-server.service: Start request repeated too quickly.
grafana-server.service: Failed with result ‘exit-code’.

Did you follow any online instructions? If so, what is the URL?

antonio · January 10, 2023, 10:16am

welcome to the community @dpell352

could you list the installation steps you followed and in what order please?

dpell352 · January 10, 2023, 10:28am

Unfortunately, I don’t have that information. I inherited this system from a former employee who set the system up. It was working until a recent system reboot.

usman.ahmad · January 10, 2023, 11:17am

Hi @dpell352

Please change the default log level to debug mode. To do this go to the server where grafana is installed and edit the configuration file (/etc/grafana/grafana.ini)
There you will this section;

#################################### Logging ##########################
[log]
# Either "console", "file", "syslog". Default is console and  file
# Use space to separate multiple modes, e.g. "console file"
;mode = console file

# Either "debug", "info", "warn", "error", "critical", default is "info"
;level = info

Set the parameter level to debug and remove the colon in the beginning i.e.

level = debug

Then restart the grafana service and resent the logs once the issue occurs again.

dpell352 · January 10, 2023, 11:28am

Thanks. I’ll send the log when it’s complete.

dpell352 · January 10, 2023, 11:32am

This is all I’m seeing in Grafana.log

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.457469663-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=4>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.459278576-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=4>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.464896666-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=4>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.466167572-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=4>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.505683019-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.508589069-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=40>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.511760902-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=40>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.512761695-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=40>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.542468192-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=40>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.543293932-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=40>

logger=context userId=0 orgId=0 uname= t=2023-01-06T08:57:34.571457709-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=40>

logger=cleanup t=2023-01-06T08:59:37.934330167-05:00 level=info msg="Completed cleanup jobs" duration=140.734484ms

logger=cleanup t=2023-01-06T09:09:37.931728634-05:00 level=info msg="Completed cleanup jobs" duration=138.426633ms

logger=context userId=0 orgId=0 uname= t=2023-01-06T09:14:47.871094257-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ir>

logger=context userId=0 orgId=0 uname= t=2023-01-06T09:15:04.650606254-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature>

logger=cleanup t=2023-01-06T09:19:37.91246629-05:00 level=info msg="Completed cleanup jobs" duration=118.958888ms

logger=cleanup t=2023-01-06T09:29:37.926491179-05:00 level=info msg="Completed cleanup jobs" duration=133.662499ms

logger=cleanup t=2023-01-06T09:39:37.882212966-05:00 level=info msg="Completed cleanup jobs" duration=89.57595ms

logger=context userId=0 orgId=0 uname= t=2023-01-06T09:44:48.395140552-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ir>

logger=context userId=0 orgId=0 uname= t=2023-01-06T09:45:05.216555467-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature>

logger=cleanup t=2023-01-06T09:49:37.921153699-05:00 level=info msg="Completed cleanup jobs" duration=128.495513ms

logger=cleanup t=2023-01-06T09:59:37.893311365-05:00 level=info msg="Completed cleanup jobs" duration=100.65203ms

logger=cleanup t=2023-01-06T10:09:37.932718957-05:00 level=info msg="Completed cleanup jobs" duration=139.31008ms

logger=context userId=0 orgId=0 uname= t=2023-01-06T10:14:48.927203827-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ir>

logger=context userId=0 orgId=0 uname= t=2023-01-06T10:15:05.753862495-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature>

logger=cleanup t=2023-01-06T10:19:37.904664342-05:00 level=info msg="Completed cleanup jobs" duration=111.86552ms

logger=cleanup t=2023-01-06T10:29:37.910698169-05:00 level=info msg="Completed cleanup jobs" duration=117.333726ms

logger=cleanup t=2023-01-06T10:39:37.899870595-05:00 level=info msg="Completed cleanup jobs" duration=107.068824ms

logger=context userId=0 orgId=0 uname= t=2023-01-06T10:44:49.477231087-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ir>

logger=context userId=0 orgId=0 uname= t=2023-01-06T10:45:06.291987994-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature>

logger=cleanup t=2023-01-06T10:49:38.038800055-05:00 level=info msg="Completed cleanup jobs" duration=246.2496ms

logger=cleanup t=2023-01-06T10:59:37.886230957-05:00 level=info msg="Completed cleanup jobs" duration=92.800627ms

logger=cleanup t=2023-01-06T11:09:37.916801517-05:00 level=info msg="Completed cleanup jobs" duration=123.435136ms

logger=context userId=0 orgId=0 uname= t=2023-01-06T11:14:50.004149945-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ir>

logger=context userId=0 orgId=0 uname= t=2023-01-06T11:15:06.85830048-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature->

logger=cleanup t=2023-01-06T11:19:37.930907161-05:00 level=info msg="Completed cleanup jobs" duration=137.487827ms

logger=http.server t=2023-01-06T11:20:07.587335008-05:00 level=info msg="Successful Login" User=admin@localhost

logger=context userId=1 orgId=1 uname=admin t=2023-01-06T11:20:12.014878786-05:00 level=info msg="Request Completed" method=GET path=/api/live/ws status>

logger=cleanup t=2023-01-06T11:29:37.886272-05:00 level=info msg="Completed cleanup jobs" duration=92.887411ms

logger=cleanup t=2023-01-06T11:39:37.925713855-05:00 level=info msg="Completed cleanup jobs" duration=132.226691ms

logger=context userId=0 orgId=0 uname= t=2023-01-06T11:44:50.540907349-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ir>

logger=context userId=0 orgId=0 uname= t=2023-01-06T11:45:07.383673874-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature>

logger=cleanup t=2023-01-06T11:49:37.90625375-05:00 level=info msg="Completed cleanup jobs" duration=113.177455ms

logger=cleanup t=2023-01-06T11:59:37.895299173-05:00 level=info msg="Completed cleanup jobs" duration=101.990411ms

logger=context t=2023-01-06T12:00:13.788151078-05:00 level=warn msg="failed to look up session from cookie" error="user token not found"

logger=context userId=0 orgId=0 uname= t=2023-01-06T12:00:13.788437805-05:00 level=info msg="Request Completed" method=POST path=/api/ds/query status=40>

logger=context userId=0 orgId=0 uname= t=2023-01-06T12:00:13.809064538-05:00 level=info msg="Request Completed" method=GET path=/api/login/ping status=4>

logger=context userId=0 orgId=0 uname= t=2023-01-06T12:00:13.951003808-05:00 level=info msg="Request Completed" method=GET path=/d/78H_EfOnz/stations-ir>

logger=context userId=1 orgId=1 uname=admin t=2023-01-06T12:00:14.053008157-05:00 level=info msg="Request Completed" method=GET path=/login status=302 r>

logger=context userId=1 orgId=1 uname=admin t=2023-01-06T12:00:14.249604953-05:00 level=info msg="Request Completed" method=GET path=/api/live/ws status>

logger=cleanup t=2023-01-06T12:09:37.901043254-05:00 level=info msg="Completed cleanup jobs" duration=107.99092ms

logger=context userId=0 orgId=0 uname= t=2023-01-06T12:14:51.093986316-05:00 level=info msg="Request Completed" method=GET path=/d/mgMkEBO7k/stations-ir>

logger=context userId=0 orgId=0 uname= t=2023-01-06T12:15:07.907802874-05:00 level=info msg="Request Completed" method=GET path=/d/P7aiA0W4z/temperature>

logger=cleanup t=2023-01-06T12:19:37.872912035-05:00 level=info msg="Completed cleanup jobs" duration=80.199626ms

logger=cleanup t=2023-01-06T12:29:38.045722835-05:00 level=info msg="Completed cleanup jobs" duration=252.069475ms

usman.ahmad · January 10, 2023, 11:59am

Ok so the log level is still info (which is the default)

Did you set restart the grafana service after setting

level = debug

in the grafana.conf file?

Also, what Operating System you are using?

dpell352 · January 10, 2023, 12:15pm

The OS is Fedora 36. I’m not able to find the Grafana.conf file. Where would it be located?

usman.ahmad · January 10, 2023, 12:33pm

Ok I made a typo mistake in the file path (in my initial post to change the log level to debug mode)

So on my CentOS machine (which is v.similar to Fedora)

[root@grafana ~]# whereis grafana
grafana: /etc/grafana /usr/share/grafana

Then I go into this directory

[root@grafana ~]# cd /etc/grafana/
[root@grafana grafana]# ls -l
total 60
-rw-r----- 1 root grafana 47149 Jan  5 11:02 grafana.ini

Now, this is the default configuration file. Open it in an editor and change the log level to debug mode (as explained earlier).

Restart the grafana service

[root@grafana grafana]# systemctl restart grafana-server

Check the status after the restart

[root@grafana grafana]# systemctl status grafana-server

(Paste all the data here)

Then getting and pasting the logs from /var/log/grafana/grafana.log

dpell352 · January 10, 2023, 12:47pm

Ok. I’ll give it a try.

Thanks

dpell352 · January 10, 2023, 12:55pm

w[eng@ewswi30000511 /]$ whereis grafana

grafana: /etc/grafana /usr/share/grafana

[eng@ewswi30000511 /]$ cd /etc/grafana/

[eng@ewswi30000511 grafana]$ ls -l

total 120

-rw-r--r--. 1 root grafana 66121 Jan 9 10:32 grafana.ini

-rw-r-----. 1 root grafana 48282 Dec 30 14:22 grafana.ini.save

-rw-r-----. 1 root grafana 2376 Aug 24 12:49 ldap.toml

drwxr-xr-x. 1 root grafana 118 Aug 24 12:49 provisioning

[eng@ewswi30000511 grafana]$ sudo nano grafana.ini

[sudo] password for eng:

[eng@ewswi30000511 grafana]$ sudo systemctl restart grafana-server

Job for grafana-server.service failed because the control process exited with error code.

See "systemctl status grafana-server.service" and "journalctl -xeu grafana-server.service" for details.

[eng@ewswi30000511 grafana]$ sudo systemctl status grafan-server

Unit grafan-server.service could not be found.

[eng@ewswi30000511 grafana]$

Here’s the end of the log file:

logger=settings t=2023-01-06T14:52:54.983264603-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:52:55.472081827-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:52:55.764607025-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:52:56.231602354-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:53:10.219152547-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:53:10.483694934-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:53:10.972308835-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:53:11.264154418-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:53:11.764957648-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:57:51.906686891-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:57:52.267987831-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:57:52.73822074-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:57:53.225562097-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T14:57:53.730400105-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T15:03:52.602798972-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T15:03:52.995415075-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T15:03:53.488726431-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T15:03:53.949697133-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T15:03:54.23912038-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T15:03:54.744774774-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-06T15:03:55.244311129-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:36:28.667699667-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:36:28.971554316-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:36:29.453208415-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:36:29.751605947-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:36:30.208351076-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:38:52.41756135-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:38:52.752390439-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:38:53.212127891-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:38:53.710341503-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:38:54.247908232-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:42:16.946690186-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:42:17.251450687-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:42:17.713997949-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:42:18.247359418-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:42:18.708813752-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:49:37.426990794-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:49:37.755183028-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:49:38.206756138-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:49:38.453988023-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T10:49:38.745880662-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:25.822715278-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:26.151830991-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:26.520282501-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:27.020560261-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:27.507266248-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:28.025114804-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:28.506160911-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:29.024544982-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:29.488470923-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-09T12:26:29.87925403-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-10T07:52:13.628242191-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-10T07:52:13.992084647-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-10T07:52:14.52671851-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-10T07:52:14.979760297-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

logger=settings t=2023-01-10T07:52:15.24110717-05:00 level=error msg="failed to parse \"/etc/grafana/grafana.ini\": key-value delimiter not found: afs boot etc lib lost+found >

usman.ahmad · January 10, 2023, 2:57pm

This is a very strange message as never seen such a thing before.

Please run the command and paste the output;

journalctl -xeu grafana-server.service

Also check if you have enough disk space (command is df -h) on the server and enough free memory (command is free -mh)

dpell352 · January 10, 2023, 5:49pm

[eng@ewswi30000511 grafana]$ sudo journalctl -xeu grafana-server.service
[sudo] password for eng:
Jan 10 07:52:15  systemd[1]: grafana-server.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░
░░ The unit grafana-server.service has entered the 'failed' state with result 'exit-code'.
Jan 10 07:52:15  systemd[1]: Failed to start grafana-server.service - Grafana instance.
░░ Subject: A start job for unit grafana-server.service has failed
░░ Defined-By: systemd
░░
░░ A start job for unit grafana-server.service has finished with a failure.
░░
░░ The job identifier is 6356 and the job result is failed.
Jan 10 07:52:15  systemd[1]: grafana-server.service: Scheduled restart job, restart counter>
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░
░░ Automatic restarting of the unit grafana-server.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Jan 10 07:52:15  systemd[1]: Stopped grafana-server.service - Grafana instance.
░░ Subject: A stop job for unit grafana-server.service has finished
░░ Defined-By: systemd
░░
░░ A stop job for unit grafana-server.service has finished.
░░
░░ The job identifier is 6470 and the job result is done.
Jan 10 07:52:15  systemd[1]: grafana-server.service: Start request repeated too quickly.
Jan 10 07:52:15  systemd[1]: grafana-server.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ The unit grafana-server.service has entered the 'failed' state with result 'exit-code'.
Jan 10 07:52:15  systemd[1]: Failed to start grafana-server.service - Grafana instance.
░░ Subject: A start job for unit grafana-server.service has failed
░░ Defined-By: systemd
░░ 
░░ A start job for unit grafana-server.service has finished with a failure.
░░
░░ The job identifier is 6470 and the job result is failed.

[eng@ewswi30000511 grafana]$ df -h
Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        4.0M     0  4.0M   0% /dev
tmpfs           7.8G     0  7.8G   0% /dev/shm
tmpfs           3.1G  1.2M  3.1G   1% /run
/dev/sda3       930G  6.2G  923G   1% /
tmpfs           7.8G     0  7.8G   0% /tmp
/dev/sda3       930G  6.2G  923G   1% /home
/dev/sda2       974M  267M  640M  30% /boot
/dev/sda1       599M   18M  582M   3% /boot/efi
tmpfs           1.6G   48K  1.6G   1% /run/user/988
tmpfs           1.6G   48K  1.6G   1% /run/user/1000

[eng@ewswi30000511 grafana]$ free -mh
               total        used        free      shared  buff/cache   available
Mem:            15Gi       830Mi        11Gi        12Mi       3.1Gi        14Gi
Swap:          8.0Gi          0B       8.0Gi

yosiasz · January 10, 2023, 5:51pm

please post your grafana.ini content minus sensitive stuff

what version grafana is it? And does it use grafana.db sqllite?

usman.ahmad · January 11, 2023, 10:50am

Ok, both disk space and memory look good.

I think then the issue is definitely with your grafana.ini configuration file. Somewhere there is a line which is not recognizable by the service.

I found this similar post where your error message is looks like a match. Please have a look and I think you understand it too that either uncommenting a line in the grafana.ini file did not go correctly.

If you can’t figure it out then as @yosiasz suggested, post your complete grafana.ini file so we can view it.

codlord · January 11, 2023, 11:05am

As the previous poster said - you have an error in your grafana.ini

Search the file for afs boot etc lib as that is where the error is.

dpell352 · January 11, 2023, 11:15am

Thanks. I’ll have a look and update the post.

dpell352 · January 11, 2023, 11:15am

Thanks. I’ll have a look.

dpell352 · January 11, 2023, 3:40pm

Thanks for all the help. The system is up and running. I looked at grafana.ini and didn’t see anything out of order. I created a new file to replace the existing. After replacing it, everything worked as it should.
Again, thanks for the assistance.

Topic		Replies	Views
Status showing failed state	2	483	January 13, 2021
Grafana-server.service failed to start Configuration	2	7595	October 31, 2022
Grafana service paused. Can not start the service Configuration windows	2	373	November 4, 2022
Grafana failed to start (10.0.1) Installation	3	159	July 14, 2023
Systemctl start grafana-server --- Fail Configuration	7	22210	December 3, 2020

Grafana Service Not Starting

Related topics