Actions
Bug #54086
closedPermission denied when trying to unlink and open /var/log/ntpstats/...
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):
Description
We haven't experienced this issue on past runs because ntp.service never loaded in the first place:
Sample good runs:
/a/yuriw-2022-01-28_16:09:05-rados-wip-master-1.27.22-distro-default-smithi/6646655
/a/yuriw-2022-01-21_19:17:29-rados-wip-yuri2-testing-2022-01-21-0949-pacific-distro-default-smithi/6632651/
2022-01-28T21:37:36.568 DEBUG:teuthology.orchestra.run.smithi185:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2022-01-28T21:37:36.595 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded.
Now, we are loading ntp.service, but this leads to permission problems:
Sample bad run:
/a/yuriw-2022-01-27_14:57:16-rados-wip-yuri-testing-2022-01-26-1810-pacific-distro-default-smithi/6643389
022-01-27T15:30:35.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2022-01-27T15:30:35.983 INFO:teuthology.orchestra.run:Running command with timeout 360
2022-01-27T15:30:35.984 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true
2022-01-27T15:30:36.013 INFO:teuthology.orchestra.run.smithi164.stdout:27 Jan 15:30:36 ntpd[9926]: ntpd 4.2.8p12@1.3728-o (1): Starting
2022-01-27T15:30:36.014 INFO:teuthology.orchestra.run.smithi164.stdout:27 Jan 15:30:36 ntpd[9926]: Command line: ntpd -gq
2022-01-27T15:30:36.026 INFO:teuthology.orchestra.run.smithi189.stdout:27 Jan 15:30:36 ntpd[9833]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6df1%5]:123
2022-01-27T15:30:36.026 INFO:teuthology.orchestra.run.smithi189.stdout:27 Jan 15:30:36 ntpd[9833]: Listening on routing socket on fd #22 for interface updates
2022-01-27T15:30:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:27 Jan 15:30:37 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
2022-01-27T15:30:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:27 Jan 15:30:37 ntpd[9926]: can't open /var/log/ntpstats/rawstats.20220127: Permission denied
2022-01-27T15:30:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:27 Jan 15:30:37 ntpd[9926]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied
"Permission denied" errors continue on various directories...
2022-01-27T15:30:43.024 INFO:teuthology.orchestra.run.smithi189.stderr:27 Jan 15:30:43 ntpd[9833]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied
2022-01-27T15:30:43.024 INFO:teuthology.orchestra.run.smithi189.stderr:27 Jan 15:30:43 ntpd[9833]: can't open /var/log/ntpstats/peerstats.20220127: Permission denied
2022-01-27T15:30:43.024 INFO:teuthology.orchestra.run.smithi189.stdout:27 Jan 15:30:43 ntpd[9833]: ntpd: time slew +0.008085 s
2022-01-27T15:30:43.025 INFO:teuthology.orchestra.run.smithi189.stdout:ntpd: time slew +0.008085s
2022-01-27T15:30:43.025 INFO:teuthology.orchestra.run.smithi189.stderr:27 Jan 15:30:43 ntpd[9833]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied
2022-01-27T15:30:43.026 INFO:teuthology.orchestra.run.smithi189.stderr:27 Jan 15:30:43 ntpd[9833]: can't open /var/log/ntpstats/loopstats.20220127: Permission denied
2022-01-27T15:30:43.089 INFO:teuthology.orchestra.run.smithi189.stdout: remote refid st t when poll reach delay offset jitter
2022-01-27T15:30:43.089 INFO:teuthology.orchestra.run.smithi189.stdout:==============================================================================
2022-01-27T15:30:43.089 INFO:teuthology.orchestra.run.smithi189.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
2022-01-27T15:30:43.090 INFO:teuthology.orchestra.run.smithi189.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
2022-01-27T15:30:43.090 INFO:teuthology.orchestra.run.smithi189.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
2022-01-27T15:30:43.090 INFO:teuthology.orchestra.run.smithi189.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
2022-01-27T15:30:43.104 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter
2022-01-27T15:30:43.104 INFO:teuthology.orchestra.run.smithi164.stdout:==============================================================================
2022-01-27T15:30:43.105 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
2022-01-27T15:30:43.105 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
2022-01-27T15:30:43.105 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
2022-01-27T15:30:43.105 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000
Actions