Actions
Bug #62225
openpacific upgrade test fails on 'ceph versions | jq -e' command
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
/a/yuriw-2023-07-19_14:33:14-rados-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343484
2023-07-19T16:00:36.785 INFO:teuthology.orchestra.run.smithi131.stdout:{
2023-07-19T16:00:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: "mon": {
2023-07-19T16:00:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 3
2023-07-19T16:00:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: },
2023-07-19T16:00:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: "mgr": {
2023-07-19T16:00:36.786 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 2
2023-07-19T16:00:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: },
2023-07-19T16:00:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: "osd": {
2023-07-19T16:00:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6,
2023-07-19T16:00:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 2
2023-07-19T16:00:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: },
2023-07-19T16:00:36.787 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": {},
2023-07-19T16:00:36.788 INFO:teuthology.orchestra.run.smithi131.stdout: "rgw": {
2023-07-19T16:00:36.788 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2
2023-07-19T16:00:36.788 INFO:teuthology.orchestra.run.smithi131.stdout: },
2023-07-19T16:00:36.788 INFO:teuthology.orchestra.run.smithi131.stdout: "overall": {
2023-07-19T16:00:36.789 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8,
2023-07-19T16:00:36.789 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph version 16.2.13-355-ge2018073 (e20180733e4b085d1abe55675eb8c828b0bfedec) pacific (stable)": 7
2023-07-19T16:00:36.789 INFO:teuthology.orchestra.run.smithi131.stdout: }
2023-07-19T16:00:36.789 INFO:teuthology.orchestra.run.smithi131.stdout:}
2023-07-19T16:00:37.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d9b35ffc-264b-11ee-9b34-001a4aab830c -e sha1=e20180733e4b085d1abe55675eb8c828b0bfedec -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"''
2023-07-19T16:00:37.405 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jul 19 16:00:37 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-c[134106]: cluster 2023-07-19T16:00:36.083212+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in
2023-07-19T16:00:37.406 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jul 19 16:00:37 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-c[134106]: audit 2023-07-19T16:00:36.789908+0000 mon.c (mon.1) 5 : audit [DBG] from='client.34158 172.21.15.131:0/1205111914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch
2023-07-19T16:00:37.406 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jul 19 16:00:37 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-c[134106]: cluster 2023-07-19T16:00:37.035832+0000 mon.a (mon.0) 349 : cluster [WRN] Health check update: Degraded data redundancy: 82/606 objects degraded (13.531%), 21 pgs degraded (PG_DEGRADED)
2023-07-19T16:00:37.406 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jul 19 16:00:37 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-a[132122]: cluster 2023-07-19T16:00:36.083212+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in
2023-07-19T16:00:37.406 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jul 19 16:00:37 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-a[132122]: audit 2023-07-19T16:00:36.789908+0000 mon.c (mon.1) 5 : audit [DBG] from='client.34158 172.21.15.131:0/1205111914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch
2023-07-19T16:00:37.406 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jul 19 16:00:37 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-a[132122]: cluster 2023-07-19T16:00:37.035832+0000 mon.a (mon.0) 349 : cluster [WRN] Health check update: Degraded data redundancy: 82/606 objects degraded (13.531%), 21 pgs degraded (PG_DEGRADED)
2023-07-19T16:00:37.444 INFO:journalctl@ceph.mon.b.smithi190.stdout:Jul 19 16:00:37 smithi190 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-b[125600]: cluster 2023-07-19T16:00:36.083212+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in
2023-07-19T16:00:37.445 INFO:journalctl@ceph.mon.b.smithi190.stdout:Jul 19 16:00:37 smithi190 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-b[125600]: audit 2023-07-19T16:00:36.789908+0000 mon.c (mon.1) 5 : audit [DBG] from='client.34158 172.21.15.131:0/1205111914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch
2023-07-19T16:00:37.445 INFO:journalctl@ceph.mon.b.smithi190.stdout:Jul 19 16:00:37 smithi190 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-b[125600]: cluster 2023-07-19T16:00:37.035832+0000 mon.a (mon.0) 349 : cluster [WRN] Health check update: Degraded data redundancy: 82/606 objects degraded (13.531%), 21 pgs degraded (PG_DEGRADED)
2023-07-19T16:00:38.444 INFO:journalctl@ceph.mon.b.smithi190.stdout:Jul 19 16:00:38 smithi190 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-b[125600]: cluster 2023-07-19T16:00:36.475656+0000 mgr.y (mgr.24871) 91 : cluster [DBG] pgmap v48: 129 pgs: 4 peering, 20 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 76/606 objects degraded (12.541%)
2023-07-19T16:00:38.446 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jul 19 16:00:38 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-a[132122]: cluster 2023-07-19T16:00:36.475656+0000 mgr.y (mgr.24871) 91 : cluster [DBG] pgmap v48: 129 pgs: 4 peering, 20 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 76/606 objects degraded (12.541%)
2023-07-19T16:00:38.447 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jul 19 16:00:38 smithi131 ceph-d9b35ffc-264b-11ee-9b34-001a4aab830c-mon-c[134106]: cluster 2023-07-19T16:00:36.475656+0000 mgr.y (mgr.24871) 91 : cluster [DBG] pgmap v48: 129 pgs: 4 peering, 20 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 17 MiB used, 709 GiB / 715 GiB avail; 76/606 objects degraded (12.541%)
2023-07-19T16:00:38.531 INFO:teuthology.orchestra.run.smithi131.stdout:false
2023-07-19T16:00:38.879 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-07-19T16:00:38.880 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
Actions