Actions
Bug #43883
closedcephadm: Found left-over process 15516 (podman) in control group while starting unit. Ignoring.
Added by Sage Weil over 4 years ago. Updated about 4 years ago.
Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
cephadm (binary)
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Description
2020-01-29T01:08:23.454 INFO:teuthology.orchestra.run.smithi107.stderr:INFO:cephadm:Restarting the monitor... 2020-01-29T01:08:23.469 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 systemd[1]: Stopping Ceph daemon for ba7b91a4-4233-11ea-99dd-001a4aab830c... 2020-01-29T01:08:23.543 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 bash[6247]: debug 2020-01-29T01:08:23.557+0000 7f6757c4d700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-01-29T01:08:23.543 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 bash[6247]: debug 2020-01-29T01:08:23.557+0000 7f6757c4d700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2020-01-29T01:08:23.799 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 podman[6636]: 2020-01-29 01:08:23.812991583 +0000 UTC m=+0.311206280 container died 59c2ecd1ead0f41d029b2a4422f22d631b8a5f24f51c5e2f081ece82ee234eb8 (image=quay.io/ceph-ci/ceph:4a2d31eb0d933b5d27064dd3ad6e69b917f999a0, name=ceph-ba7b 91a4-4233-11ea-99dd-001a4aab830c-mon.a) 2020-01-29T01:08:23.821 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 podman[6636]: 2020-01-29 01:08:23.837398534 +0000 UTC m=+0.335613223 container stop 59c2ecd1ead0f41d029b2a4422f22d631b8a5f24f51c5e2f081ece82ee234eb8 (image=quay.io/ceph-ci/ceph:4a2d31eb0d933b5d27064dd3ad6e69b917f999a0, name=ceph-ba7b 91a4-4233-11ea-99dd-001a4aab830c-mon.a) 2020-01-29T01:08:23.822 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 podman[6636]: 59c2ecd1ead0f41d029b2a4422f22d631b8a5f24f51c5e2f081ece82ee234eb8 2020-01-29T01:08:23.849 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 systemd[1]: Stopped Ceph daemon for ba7b91a4-4233-11ea-99dd-001a4aab830c. 2020-01-29T01:08:23.849 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:23 smithi107 systemd[1]: Starting Ceph daemon for ba7b91a4-4233-11ea-99dd-001a4aab830c... 2020-01-29T01:08:24.053 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:24 smithi107 podman[6677]: Error: no container with name or ID ceph-ba7b91a4-4233-11ea-99dd-001a4aab830c-mon.a found: no such container 2020-01-29T01:08:24.076 INFO:ceph.mon.a.smithi107.stdout:Jan 29 01:08:24 smithi107 systemd[1]: Started Ceph daemon for ba7b91a4-4233-11ea-99dd-001a4aab830c.
/a/sage-2020-01-28_23:42:06-rados-wip-sage-testing-2020-01-28-1413-distro-basic-smithi/4715193
Updated by Sage Weil over 4 years ago
- Subject changed from cephadm: bootstrap mon restart failed to cephadm: bootstrap mon restart failed (ceph-mon got mystery SIGTERM)
- Priority changed from Urgent to High
2020-01-29T01:08:23.557+0000 7f6757c4d700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-01-29T01:08:23.557+0000 7f6757c4d700 -1 mon.a@0(leader) e1 *** Got Signal Terminated ***
not sure where that came from.. someone apparently ran kill, but i see nothing suspicious in kern.log.
downgrading this for now until we see it again, i guess!
Updated by Sage Weil over 4 years ago
ok, a similar problem:
2020-01-29T23:35:13.154 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:12 smithi083 systemd[1]: Stopping Ceph mon.a for e19d945a-42ef-11ea-99dd-001a4aab830c... 2020-01-29T23:35:13.154 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:12 smithi083 bash[25985]: debug 2020-01-29T23:35:12.962+0000 7f0a93260700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-01-29T23:35:13.154 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:12 smithi083 bash[25985]: debug 2020-01-29T23:35:12.962+0000 7f0a93260700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2020-01-29T23:35:13.154 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 podman[26366]: 2020-01-29 23:35:13.125301893 +0000 UTC m=+0.193954815 container died e235dd20363d15a860a28e084ec9c0b909a585cf9b6eee92dc87deb10288fe5d (image=quay.io/ceph-ci/ceph:bdb47f1438a010f91574a6f000bee01682c5c2eb, name=ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a) 2020-01-29T23:35:13.154 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 podman[26366]: 2020-01-29 23:35:13.148784596 +0000 UTC m=+0.217437490 container stop e235dd20363d15a860a28e084ec9c0b909a585cf9b6eee92dc87deb10288fe5d (image=quay.io/ceph-ci/ceph:bdb47f1438a010f91574a6f000bee01682c5c2eb, name=ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a) 2020-01-29T23:35:13.155 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 podman[26366]: e235dd20363d15a860a28e084ec9c0b909a585cf9b6eee92dc87deb10288fe5d 2020-01-29T23:35:13.538 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 systemd[1]: Stopped Ceph mon.a for e19d945a-42ef-11ea-99dd-001a4aab830c. 2020-01-29T23:35:13.538 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Found left-over process 25987 (podman) in control group while starting unit. Ignoring. 2020-01-29T23:35:13.539 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2020-01-29T23:35:13.539 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 systemd[1]: Starting Ceph mon.a for e19d945a-42ef-11ea-99dd-001a4aab830c... 2020-01-29T23:35:13.539 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 podman[26404]: Error: no container with name or ID ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a found: no such container 2020-01-29T23:35:13.792 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Found left-over process 25987 (podman) in control group while starting unit. Ignoring. 2020-01-29T23:35:13.792 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2020-01-29T23:35:13.792 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 systemd[1]: Started Ceph mon.a for e19d945a-42ef-11ea-99dd-001a4aab830c. 2020-01-29T23:35:13.792 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 podman[25987]: 2020-01-29 23:35:13.62957475 +0000 UTC m=+4.901750601 container remove e235dd20363d15a860a28e084ec9c0b909a585cf9b6eee92dc87deb10288fe5d (image=quay.io/ceph-ci/ceph:bdb47f1438a010f91574a6f000bee01682c5c2eb, name=ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a) 2020-01-29T23:35:13.793 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 bash[25985]: time="2020-01-29T23:35:13Z" level=error msg="Error forwarding signal 15 to container e235dd20363d15a860a28e084ec9c0b909a585cf9b6eee92dc87deb10288fe5d: container has already been removed" 2020-01-29T23:35:13.793 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 bash[25985]: time="2020-01-29T23:35:13Z" level=error msg="Error forwarding signal 18 to container e235dd20363d15a860a28e084ec9c0b909a585cf9b6eee92dc87deb10288fe5d: container has already been removed" 2020-01-29T23:35:14.177 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:13 smithi083 podman[26428]: 2020-01-29 23:35:13.790324177 +0000 UTC m=+0.222689470 container create db243f4f9ef966f3ece22bc78dceff4b5cd174dafeff027d769d20d6b36ab471 (image=quay.io/ceph-ci/ceph:bdb47f1438a010f91574a6f000bee01682c5c2eb, name=ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a) ... 2020-01-29T23:35:21.949 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:21 smithi083 podman[26428]: 2020-01-29 23:35:21.697080321 +0000 UTC m=+8.129445661 container remove db243f4f9ef966f3ece22bc78dceff4b5cd174dafeff027d769d20d6b36ab471 (image=quay.io/ceph-ci/ceph:bdb47f1438a010f91574a6f000bee01682c5c2eb, name=ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a) 2020-01-29T23:35:21.949 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:21 smithi083 bash[26427]: time="2020-01-29T23:35:21Z" level=error msg="unable to remove container db243f4f9ef966f3ece22bc78dceff4b5cd174dafeff027d769d20d6b36ab471 after failing to start and attach to it" 2020-01-29T23:35:21.950 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:21 smithi083 bash[26427]: Error: container_linux.go:345: starting container process caused "exec: \"/usr/bin/ceph-mon\": stat /usr/bin/ceph-mon: no such file or directory" 2020-01-29T23:35:21.950 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:21 smithi083 bash[26427]: : OCI runtime error 2020-01-29T23:35:21.950 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:21 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Main process exited, code=exited, status=127/n/a 2020-01-29T23:35:21.950 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:21 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Failed with result 'exit-code'. ... 2020-01-29T23:35:32.297 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Service RestartSec=10s expired, scheduling restart. 2020-01-29T23:35:32.297 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Scheduled restart job, restart counter is at 1. 2020-01-29T23:35:32.297 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 systemd[1]: Stopped Ceph mon.a for e19d945a-42ef-11ea-99dd-001a4aab830c. 2020-01-29T23:35:32.298 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 systemd[1]: Starting Ceph mon.a for e19d945a-42ef-11ea-99dd-001a4aab830c... 2020-01-29T23:35:32.298 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 podman[26763]: Error: no container with name or ID ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a found: no such container 2020-01-29T23:35:32.298 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 systemd[1]: Started Ceph mon.a for e19d945a-42ef-11ea-99dd-001a4aab830c. 2020-01-29T23:35:32.298 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 bash[26779]: Error: error creating container storage: the container name "ceph-e19d945a-42ef-11ea-99dd-001a4aab830c-mon.a" is already in use by "db243f4f9ef966f3ece22bc78dceff4b5cd174dafeff027d769d20d6b36ab471". You have to remove that container to be able to reuse that name.: that name is already in use 2020-01-29T23:35:32.298 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Main process exited, code=exited, status=125/n/a 2020-01-29T23:35:32.299 INFO:ceph.mon.a.smithi083.stdout:Jan 29 23:35:31 smithi083 systemd[1]: ceph-e19d945a-42ef-11ea-99dd-001a4aab830c@mon.a.service: Failed with result 'exit-code'. ...
/a/sage-2020-01-29_22:40:09-rados-wip-sage2-testing-2020-01-29-1407-distro-basic-smithi/4718366
Updated by Sage Weil over 4 years ago
/a/sage-2020-01-29_20:14:58-rados-wip-sage-testing-2020-01-29-1034-distro-basic-smithi/4717957
Updated by Sage Weil over 4 years ago
/a/sage-2020-02-04_03:27:12-rados-wip-sage-testing-2020-02-03-1650-distro-basic-smithi/4730285
centos 7.6. others were centos 7.6, rhel 8.0. :/
2020-02-04T03:50:24.553 INFO:teuthology.orchestra.run.smithi189.stderr:INFO:cephadm:Waiting for mgr to start... 2020-02-04T03:50:24.554 INFO:teuthology.orchestra.run.smithi189.stderr:INFO:cephadm:Waiting for mgr... 2020-02-04T03:50:24.626 INFO:ceph.mgr.y.smithi189.stdout:Feb 04 03:50:24 smithi189 podman[5475]: 2020-02-04 03:50:24.621085821 +0000 UTC m=+0.328527967 container create 926464dc5471fc2652cfdb2c376a4c272f02b467f299fa47ce27da452fd67f3a (image=quay.io/ceph-ci/ceph:b0a90a51ea9bc4a103e153a415f3f253adee21c6, name=ceph-58 0fb748-4701-11ea-99e3-001a4aab830c-mgr.y) 2020-02-04T03:50:24.907 INFO:ceph.mgr.y.smithi189.stdout:Feb 04 03:50:24 smithi189 podman[5475]: 2020-02-04 03:50:24.904397694 +0000 UTC m=+0.611839848 container init 926464dc5471fc2652cfdb2c376a4c272f02b467f299fa47ce27da452fd67f3a (image=quay.io/ceph-ci/ceph:b0a90a51ea9bc4a103e153a415f3f253adee21c6, name=ceph-580f b748-4701-11ea-99e3-001a4aab830c-mgr.y) 2020-02-04T03:50:24.954 INFO:ceph.mgr.y.smithi189.stdout:Feb 04 03:50:24 smithi189 podman[5475]: 2020-02-04 03:50:24.954375755 +0000 UTC m=+0.661817888 container start 926464dc5471fc2652cfdb2c376a4c272f02b467f299fa47ce27da452fd67f3a (image=quay.io/ceph-ci/ceph:b0a90a51ea9bc4a103e153a415f3f253adee21c6, name=ceph-580 fb748-4701-11ea-99e3-001a4aab830c-mgr.y) 2020-02-04T03:50:24.955 INFO:ceph.mgr.y.smithi189.stdout:Feb 04 03:50:24 smithi189 podman[5475]: 2020-02-04 03:50:24.954435346 +0000 UTC m=+0.661877515 container attach 926464dc5471fc2652cfdb2c376a4c272f02b467f299fa47ce27da452fd67f3a (image=quay.io/ceph-ci/ceph:b0a90a51ea9bc4a103e153a415f3f253adee21c6, name=ceph-58 0fb748-4701-11ea-99e3-001a4aab830c-mgr.y) 2020-02-04T03:50:32.612 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 podman[5397]: 2020-02-04 03:50:32.610823979 +0000 UTC m=+8.623778602 container remove a8c26b6892c7d5821d30ade50aa4ad7168dc6d07eddd1852f0768a4635ccfa16 (image=quay.io/ceph-ci/ceph:b0a90a51ea9bc4a103e153a415f3f253adee21c6, name=ceph-58 0fb748-4701-11ea-99e3-001a4aab830c-mon.a) 2020-02-04T03:50:32.616 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 bash[5396]: time="2020-02-04T03:50:32Z" level=error msg="unable to remove container a8c26b6892c7d5821d30ade50aa4ad7168dc6d07eddd1852f0768a4635ccfa16 after failing to start and attach to it" 2020-02-04T03:50:32.616 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 bash[5396]: Error: container_linux.go:345: starting container process caused "exec: \"/usr/bin/ceph-mon\": stat /usr/bin/ceph-mon: no such file or directory" 2020-02-04T03:50:32.616 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 bash[5396]: : OCI runtime error 2020-02-04T03:50:32.631 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 systemd[1]: ceph-580fb748-4701-11ea-99e3-001a4aab830c@mon.a.service: main process exited, code=exited, status=127/n/a 2020-02-04T03:50:32.691 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 podman[5684]: Error: no container with name or ID ceph-580fb748-4701-11ea-99e3-001a4aab830c-mon.a found: no such container 2020-02-04T03:50:32.719 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 systemd[1]: Unit ceph-580fb748-4701-11ea-99e3-001a4aab830c@mon.a.service entered failed state. 2020-02-04T03:50:32.719 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:32 smithi189 systemd[1]: ceph-580fb748-4701-11ea-99e3-001a4aab830c@mon.a.service failed. 2020-02-04T03:50:42.819 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:42 smithi189 systemd[1]: ceph-580fb748-4701-11ea-99e3-001a4aab830c@mon.a.service holdoff time over, scheduling restart. 2020-02-04T03:50:42.820 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:42 smithi189 systemd[1]: Stopped Ceph mon.a for 580fb748-4701-11ea-99e3-001a4aab830c. 2020-02-04T03:50:42.824 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:42 smithi189 systemd[1]: Starting Ceph mon.a for 580fb748-4701-11ea-99e3-001a4aab830c... 2020-02-04T03:50:42.884 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:42 smithi189 podman[5752]: Error: no container with name or ID ceph-580fb748-4701-11ea-99e3-001a4aab830c-mon.a found: no such container 2020-02-04T03:50:42.904 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:42 smithi189 systemd[1]: Started Ceph mon.a for 580fb748-4701-11ea-99e3-001a4aab830c. 2020-02-04T03:50:43.061 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:43 smithi189 bash[5773]: Error: error creating container storage: the container name "ceph-580fb748-4701-11ea-99e3-001a4aab830c-mon.a" is already in use by "a8c26b6892c7d5821d30ade50aa4ad7168dc6d07eddd1852f0768a4635ccfa16". You have to remove tha t container to be able to reuse that name.: that name is already in use 2020-02-04T03:50:43.067 INFO:ceph.mon.a.smithi189.stdout:Feb 04 03:50:43 smithi189 systemd[1]: ceph-580fb748-4701-11ea-99e3-001a4aab830c@mon.a.service: main process exited, code=exited, status=125/n/a
Updated by Sage Weil over 4 years ago
- Subject changed from cephadm: bootstrap mon restart failed (ceph-mon got mystery SIGTERM) to cephadm: Found left-over process 15516 (podman) in control group while starting unit. Ignoring.
2020-02-06T19:58:56.178 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:55 smithi129 systemd[1]: Stopping Ceph mon.a for f6c1d5a4-491a-11ea-99e4-001a4aab830c... 2020-02-06T19:58:56.178 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:55 smithi129 bash[15513]: debug 2020-02-06T19:58:55.916+0000 7f3123ed6700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2020-02-06T19:58:56.178 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:55 smithi129 bash[15513]: debug 2020-02-06T19:58:55.916+0000 7f3123ed6700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2020-02-06T19:58:56.524 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 podman[16032]: 2020-02-06 19:58:56.178072484 +0000 UTC m=+0.315720655 container died c5771b7ffff46ecd6773ab69f2c10ee8e00e9f747deeeb16bb1e20be54696253 (image=quay.io/ceph-ci/ceph:7a9d066fdc1697a8ab3e389232b0faf448474b31, name=ceph-f6c1d5a4-491a-11ea-99e4-001a4aab830c-mon.a) 2020-02-06T19:58:56.524 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 podman[16032]: 2020-02-06 19:58:56.203372701 +0000 UTC m=+0.341020745 container stop c5771b7ffff46ecd6773ab69f2c10ee8e00e9f747deeeb16bb1e20be54696253 (image=quay.io/ceph-ci/ceph:7a9d066fdc1697a8ab3e389232b0faf448474b31, name=ceph-f6c1d5a4-491a-11ea-99e4-001a4aab830c-mon.a) 2020-02-06T19:58:56.524 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 podman[16032]: c5771b7ffff46ecd6773ab69f2c10ee8e00e9f747deeeb16bb1e20be54696253 2020-02-06T19:58:56.524 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 systemd[1]: Stopped Ceph mon.a for f6c1d5a4-491a-11ea-99e4-001a4aab830c. 2020-02-06T19:58:56.524 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 systemd[1]: ceph-f6c1d5a4-491a-11ea-99e4-001a4aab830c@mon.a.service: Found left-over process 15516 (podman) in control group while starting unit. Ignoring. 2020-02-06T19:58:56.524 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2020-02-06T19:58:56.525 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 systemd[1]: Starting Ceph mon.a for f6c1d5a4-491a-11ea-99e4-001a4aab830c... 2020-02-06T19:58:56.534 INFO:teuthology.orchestra.run.smithi129.stderr:INFO:cephadm:Creating mgr... 2020-02-06T19:58:56.796 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 podman[16080]: Error: no container with name or ID ceph-f6c1d5a4-491a-11ea-99e4-001a4aab830c-mon.a found: no such container 2020-02-06T19:58:56.796 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 systemd[1]: ceph-f6c1d5a4-491a-11ea-99e4-001a4aab830c@mon.a.service: Found left-over process 15516 (podman) in control group while starting unit. Ignoring. 2020-02-06T19:58:56.796 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2020-02-06T19:58:56.797 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 systemd[1]: Started Ceph mon.a for f6c1d5a4-491a-11ea-99e4-001a4aab830c. 2020-02-06T19:58:56.797 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 podman[15516]: 2020-02-06 19:58:56.631663923 +0000 UTC m=+5.596134355 container remove c5771b7ffff46ecd6773ab69f2c10ee8e00e9f747deeeb16bb1e20be54696253 (image=quay.io/ceph-ci/ceph:7a9d066fdc1697a8ab3e389232b0faf448474b31, name=ceph-f6c1d5a4-491a-11ea-99e4-001a4aab830c-mon.a) 2020-02-06T19:58:56.797 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 bash[15513]: time="2020-02-06T19:58:56Z" level=error msg="Error forwarding signal 15 to container c5771b7ffff46ecd6773ab69f2c10ee8e00e9f747deeeb16bb1e20be54696253: container has already been removed" 2020-02-06T19:58:56.797 INFO:ceph.mon.a.smithi129.stdout:Feb 06 19:58:56 smithi129 bash[15513]: time="2020-02-06T19:58:56Z" level=error msg="Error forwarding signal 18 to container c5771b7ffff46ecd6773ab69f2c10ee8e00e9f747deeeb16bb1e20be54696253: container has already been removed"
/a/sage-2020-02-06_19:14:34-rados-wip-sage4-testing-2020-02-06-1012-distro-basic-smithi/4739090
ubuntu 18.04
Updated by Sage Weil about 4 years ago
- Status changed from Need More Info to Fix Under Review
- Pull request ID set to 33162
Updated by Sage Weil about 4 years ago
- Status changed from Fix Under Review to Resolved
Actions