Project

General

Profile

Bug #45454

cephadm: teardown: hang at sudo systemctl stop ceph-453d3962-9141-11ea-a068-001a4aab830c@mgr.x

Added by Sebastian Wagner almost 4 years ago. Updated over 3 years ago.

Status:
Can't reproduce
Priority:
Low
Assignee:
-
Category:
cephadm (binary)
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://pulpito.ceph.com/swagner-2020-05-08_13:52:54-rados-wip-swagner3-testing-2020-05-08-1329-distro-basic-smithi/

2020-05-08T15:49:01.061 INFO:tasks.cephadm:Teardown begin
2020-05-08T15:49:01.062 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:01.069 INFO:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring
2020-05-08T15:49:01.125 INFO:teuthology.orchestra.run.smithi175:> true
2020-05-08T15:49:01.132 INFO:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring
2020-05-08T15:49:01.148 INFO:tasks.cephadm:Cleaning up testdir ceph.* files...
2020-05-08T15:49:01.149 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:01.155 INFO:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub
2020-05-08T15:49:01.162 INFO:teuthology.orchestra.run.smithi175:> true
2020-05-08T15:49:01.195 INFO:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub
2020-05-08T15:49:01.202 INFO:tasks.cephadm:Stopping all daemons...
2020-05-08T15:49:01.202 INFO:tasks.cephadm.mon.a:Stopping mon.a...
2020-05-08T15:49:01.203 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:01.212 INFO:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-453d3962-9141-11ea-a068-001a4aab830c@mon.a
2020-05-08T15:49:01.662 INFO:ceph.mon.a.smithi017.stdout:May 08 15:49:01 smithi017 systemd[1]: Stopping Ceph mon.a for 453d3962-9141-11ea-a068-001a4aab830c...
2020-05-08T15:49:01.662 INFO:ceph.mon.a.smithi017.stdout:May 08 15:49:01 smithi017 bash[11147]: debug 2020-05-08T15:49:01.427+0000 7f107ce44700 -1 received  signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0
2020-05-08T15:49:01.662 INFO:ceph.mon.a.smithi017.stdout:May 08 15:49:01 smithi017 bash[11147]: debug 2020-05-08T15:49:01.427+0000 7f107ce44700 -1 mon.a@0(leader) e3 *** Got Signal Terminated ***
2020-05-08T15:49:02.910 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:02.916 INFO:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-453d3962-9141-11ea-a068-001a4aab830c@mon.a.service'
2020-05-08T15:49:03.034 DEBUG:teuthology.orchestra.run:got remote process result: None
2020-05-08T15:49:03.035 INFO:tasks.cephadm.mon.a:Stopped mon.a
2020-05-08T15:49:03.035 INFO:tasks.cephadm.mon.c:Stopping mon.c...
2020-05-08T15:49:03.035 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:03.039 INFO:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-453d3962-9141-11ea-a068-001a4aab830c@mon.c
2020-05-08T15:49:03.207 INFO:ceph.mon.c.smithi017.stdout:May 08 15:49:03 smithi017 systemd[1]: Stopping Ceph mon.c for 453d3962-9141-11ea-a068-001a4aab830c...
2020-05-08T15:49:03.538 INFO:ceph.mon.c.smithi017.stdout:May 08 15:49:03 smithi017 bash[14363]: debug 2020-05-08T15:49:03.235+0000 7f6b5bd73700 -1 received  signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0
2020-05-08T15:49:03.538 INFO:ceph.mon.c.smithi017.stdout:May 08 15:49:03 smithi017 bash[14363]: debug 2020-05-08T15:49:03.235+0000 7f6b5bd73700 -1 mon.c@1(peon) e3 *** Got Signal Terminated ***
2020-05-08T15:49:04.444 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:04.451 INFO:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-453d3962-9141-11ea-a068-001a4aab830c@mon.c.service'
2020-05-08T15:49:04.564 DEBUG:teuthology.orchestra.run:got remote process result: None
2020-05-08T15:49:04.565 INFO:tasks.cephadm.mon.c:Stopped mon.c
2020-05-08T15:49:04.565 INFO:tasks.cephadm.mon.b:Stopping mon.b...
2020-05-08T15:49:04.566 INFO:teuthology.orchestra.run.smithi175:> true
2020-05-08T15:49:04.573 INFO:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-453d3962-9141-11ea-a068-001a4aab830c@mon.b
2020-05-08T15:49:04.936 INFO:ceph.mon.b.smithi175.stdout:May 08 15:49:04 smithi175 systemd[1]: Stopping Ceph mon.b for 453d3962-9141-11ea-a068-001a4aab830c...
2020-05-08T15:49:04.937 INFO:ceph.mon.b.smithi175.stdout:May 08 15:49:04 smithi175 bash[11177]: debug 2020-05-08T15:49:04.718+0000 7f90d0871700 -1 received  signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0
2020-05-08T15:49:04.937 INFO:ceph.mon.b.smithi175.stdout:May 08 15:49:04 smithi175 bash[11177]: debug 2020-05-08T15:49:04.718+0000 7f90d0871700 -1 mon.b@2(peon) e3 *** Got Signal Terminated ***
2020-05-08T15:49:06.157 INFO:teuthology.orchestra.run.smithi175:> true
2020-05-08T15:49:06.161 INFO:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-453d3962-9141-11ea-a068-001a4aab830c@mon.b.service'
2020-05-08T15:49:06.266 DEBUG:teuthology.orchestra.run:got remote process result: None
2020-05-08T15:49:06.267 INFO:tasks.cephadm.mon.b:Stopped mon.b
2020-05-08T15:49:06.267 INFO:tasks.cephadm.mgr.y:Stopping mgr.y...
2020-05-08T15:49:06.267 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:06.274 INFO:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-453d3962-9141-11ea-a068-001a4aab830c@mgr.y
2020-05-08T15:49:06.650 INFO:ceph.mgr.y.smithi017.stdout:May 08 15:49:06 smithi017 systemd[1]: Stopping Ceph mgr.y for 453d3962-9141-11ea-a068-001a4aab830c...
2020-05-08T15:49:06.650 INFO:ceph.mgr.y.smithi017.stdout:May 08 15:49:06 smithi017 bash[11372]: debug 2020-05-08T15:49:06.395+0000 7f9760aff700 -1 received  signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0
2020-05-08T15:49:06.650 INFO:ceph.mgr.y.smithi017.stdout:May 08 15:49:06 smithi017 bash[11372]: debug 2020-05-08T15:49:06.395+0000 7f9760aff700 -1 mgr handle_mgr_signal  *** Got signal Terminated ***
2020-05-08T15:49:07.223 INFO:teuthology.orchestra.run.smithi017:> true
2020-05-08T15:49:07.229 INFO:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-453d3962-9141-11ea-a068-001a4aab830c@mgr.y.service'
2020-05-08T15:49:07.381 DEBUG:teuthology.orchestra.run:got remote process result: None
2020-05-08T15:49:07.382 INFO:tasks.cephadm.mgr.y:Stopped mgr.y
2020-05-08T15:49:07.382 INFO:tasks.cephadm.mgr.x:Stopping mgr.x...
2020-05-08T15:49:07.383 INFO:teuthology.orchestra.run.smithi175:> true
2020-05-08T15:49:07.393 INFO:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-453d3962-9141-11ea-a068-001a4aab830c@mgr.x
2020-05-08T15:49:07.751 INFO:ceph.mgr.x.smithi175.stdout:May 08 15:49:07 smithi175 systemd[1]: Stopping Ceph mgr.x for 453d3962-9141-11ea-a068-001a4aab830c...
^^^^ this is the end of the log. nothing afterwards. (still running, but stuck)

Related issues

Related to Orchestrator - Bug #46247: cephadm mon failure: Error: no container with name or ID ... no such container Can't reproduce

History

#1 Updated by Sebastian Wagner almost 4 years ago

  • Source set to Q/A

#2 Updated by Deepika Upadhyay over 3 years ago

  • Related to Bug #46247: cephadm mon failure: Error: no container with name or ID ... no such container added

#3 Updated by Sebastian Wagner over 3 years ago

  • Priority changed from Normal to Low

#4 Updated by Sebastian Wagner over 3 years ago

  • Status changed from New to Can't reproduce

Also available in: Atom PDF