Bug #55606
closed[ERR] Unhandled exception from module ''devicehealth'' while running on mgr.y: unknown
0%
86fccb1331b555469509cb40ea7998ef724d7f67fa05541e6599b57aacbda12b
ac08e1ef6d35905f8dfb2e8bef5e63013092d4fd1812af45665b7a375c848d4f
41161d56a146d7bb9e51e8b458ced4b09761704adb81abc8819b2521798b5509
0e5a33107a4c9e75eb406fa58976e51f0d12e6429cd47f57338418c114c31aec
79b843397ff3a9e490e460f19f02c73f2348dcaf8946776a443641fadfd6a923
7673dfdf4352116147fdfb3a31a6dd64e8525ca1ac27047746c4d0b19a2b8ee1
1fe134bcc0da984504f6ff8534b02cfb33ee34e038f36fa318560969865ac0b8
7ea7ab36946ce7e1ee42c3db55b1f40c4e09f3f9a2cc99ffd99bb0a631c0f973
0be10189a1e1d49804974c592d340e7592230857f4ac8bc15c11845f9d829f98
1d5dd4d12786fb804db0e4c84384cc70ccc77ce77816086e0818123a91fdc1f9
c5efd9a11456f073d65f44e1fa633a76d4f99cc530cba6ab7357983ad052aa58
3ae3570ef19c6cebdcd5ece0d70c63cb0f91903c52e031c81f419514acfb656f
48c37619e84753c832296a9c285b309043d88fc3f1fc38e126054824623809b1
5e854d73b29ef14826356aacb6ea625cd128d8ed0362a0b117d0ef2b1d2736d0
1795c28174bea254aec378b8393504c5a1849bf13e04066c12af05fb82fcb054
2d141d1e83d9ea238b960e0d50bdc5f423259c1a0c58578de181aa36b942a3b5
c2da23cc7287af55584a694c0355fe8b7998d118c3c4caf81f67f2ef1c390720
b104ab4c8d1bf3668e82ed30637b204f3babe572b1a390a050df031dc65cc8e3
396bcc462c052481a3b21c9f0a35da3582e33cbca357b481453a7b6fcfd3c9da
fef0c14d68d4ab20a440219453dff6981764918b789158159adda37ad1096ccb
2dd339bceed23e489a9564f732e69cf19ffd7ffd661cbd057ea8cafbe34a6f16
a15696173b045beed5ced7efeac27d9fe556b2ed42c4a15b7d6bd204667a6d96
501850d0201c79bf70aab39cb2c732cc62854370f3572200aee926bdcd636c5a
3fb7c07e2758c3e1c64e759819d6eeba3190b628f6ed8df59865c8f9d36b3476
6a0693716901bbbd4e38c3df4a1d36b7e062ded71c9e4994f43c7b90170e79bc
244316c81aaa8c068cd3d842f6cc6aded71b94ab0ac6f51e3b2c494bcb7a2074
f8a6bd09d1ebb266b60fefdd5d6612d2c9a2f5743f7cb55e6bcb7e02bb9349f0
29336199cdba60a4e2d498feecd46dbfa1acc1685d9e2abe49847b8ffa0c3a02
e1b200da5c7a7d3c546d1fc01fec4545f9dcd0f662ac99c775e117c2ae631ac0
33e0d03b2fe6747102a652652523f61a111be84a071e2326f24a3b772c24e842
5885ab1c678da947f6e070dcc640f7e80f0283f446a9f1c18b4f4829e5969531
f034b9f04e4efb6084994eaad8c65a74e35186ee6090ed17f7fbba9ff0bbf936
Description
/home/teuthworker/archive/yuriw-2022-04-29_15:44:49-rados-wip-yuri5-testing-2022-04-28-1007-distro-default-smithi/6813955
2022-04-29T19:34:39.756 INFO:teuthology.orchestra.run.smithi169.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards.
2022-04-29T19:34:39.767 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight
2022-04-29T19:34:39.787 INFO:tasks.ceph.mgr.y.smithi155.stderr:2022-04-29T19:34:39.785+0000 7f5604101700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'devicehealth' while running on mgr.y: unknown operation
2022-04-29T19:34:39.787 INFO:tasks.ceph.mgr.y.smithi155.stderr:2022-04-29T19:34:39.785+0000 7f5604101700 -1 devicehealth.serve:
2022-04-29T19:34:39.788 INFO:tasks.ceph.mgr.y.smithi155.stderr:2022-04-29T19:34:39.785+0000 7f5604101700 -1 Traceback (most recent call last):
2022-04-29T19:34:39.788 INFO:tasks.ceph.mgr.y.smithi155.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 376, in serve
2022-04-29T19:34:39.788 INFO:tasks.ceph.mgr.y.smithi155.stderr: self.set_kv('last_scrape', last_scrape.strftime(TIME_FORMAT))
2022-04-29T19:34:39.788 INFO:tasks.ceph.mgr.y.smithi155.stderr: File "/usr/share/ceph/mgr/mgr_module.py", line 1117, in set_kv
2022-04-29T19:34:39.788 INFO:tasks.ceph.mgr.y.smithi155.stderr: self.db.execute(SQL, (key, value))
2022-04-29T19:34:39.789 INFO:tasks.ceph.mgr.y.smithi155.stderr:sqlite3.InternalError: unknown operation
2022-04-29T19:34:39.789 INFO:tasks.ceph.mgr.y.smithi155.stderr:
2022-04-29T19:34:39.834 INFO:tasks.ceph.osd.3.smithi155.stderr:2022-04-29T19:34:39.833+0000 7f38469fe700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 91832) UID: 0