Project

General

Profile

Actions
Copy link

Bug #47617

open

rebuild_mondb: daemon-helper: command failed with exit status 1

Added by Deepika Upadhyay over 3 years ago. Updated about 3 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
pacific, octopus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

/a/yuriw-2020-09-16_23:57:37-rados-wip-yuri8-testing-2020-09-16-2220-octopus-distro-basic-smithi/5441511/teuthology.log

monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2020-09-17T00:50:33.095 INFO:tasks.ceph.mgr.x.smithi136.stderr:2020-09-17T00:50:33.092+0000 7f6d77253700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2020-09-17T00:50:33.098 INFO:tasks.ceph.osd.0.smithi136.stderr:2020-09-17T00:50:33.096+0000 7f9c85103700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2020-09-17T00:50:33.130 INFO:teuthology.orchestra.run.smithi136.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused
2020-09-17T00:50:33.132 DEBUG:teuthology.orchestra.run:got remote process result: 22
2020-09-17T00:50:33.133 INFO:tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-0, ['dump_ops_in_flight']
2020-09-17T00:50:33.302 INFO:tasks.ceph.osd.0.smithi136.stderr:2020-09-17T00:50:33.300+0000 7f9c85904700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2020-09-17T00:50:33.466 INFO:tasks.ceph.osd.0.smithi136.stderr:failed to fetch mon config (--no-mon-config to skip)
...
exception getting command descriptions: [Errno 111] Connection refused
2020-09-17T00:55:15.939 DEBUG:teuthology.orchestra.run:got remote process result: 22
tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-0,

osd 0 log: 
    2020-09-17T00:49:32.184+0000 7fa16a8e7700  1 --2- v2:172.21.15.136:6806/12987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5591a00f8800 0x559│
│2020-09-17T00:49:32.184+0000 7fa1787ef700 10 NetHandler reconnect reconnect: Connection refused          
nothing noteworthy

https://sentry.ceph.com/organizations/ceph/issues/135/events/4bf5603efe294dd79f2acafc4d3102d3/events/?project=2

Actions
Copy link
 #1

Updated by Neha Ojha over 3 years ago

Deepika:
/a/yuriw-2020-09-16_23:57:37-rados-wip-yuri8-testing-2020-09-16-2220-octopus-distro-basic-smithi/5441511 and /a/yuriw-2020-11-10_16:01:13-rados-wip-yuri7-testing-2020-11-09-0731-nautilus-distro-basic-smithi/5609404 are different issues.

Simplest way to differentiate between the two is, https://pulpito.ceph.com/yuriw-2020-11-10_16:01:13-rados-wip-yuri7-testing-2020-11-09-0731-nautilus-distro-basic-smithi/5609404/ failed because of a warning in the logs (MGR_MODULE_ERROR) and https://pulpito.ceph.com/yuriw-2020-09-16_23:57:37-rados-wip-yuri8-testing-2020-09-16-2220-octopus-distro-basic-smithi/5441511/ with timeout.

Actions
Copy link
 #2

Updated by Neha Ojha about 3 years ago

/a/sage-2021-04-12_21:28:18-rados-wip-sage4-testing-2021-04-12-1414-octopus-distro-basic-smithi/6042248

Actions
Copy link
 #3

Updated by Neha Ojha about 3 years ago

/a/sage-2021-04-12_21:28:18-rados-wip-sage4-testing-2021-04-12-1414-octopus-distro-basic-smithi/6042248

2021-04-11T15:40:06.650 INFO:tasks.ceph.osd.0:Started
2021-04-11T15:40:06.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight
2021-04-11T15:40:06.719 INFO:tasks.ceph.osd.0.smithi089.stderr:2021-04-11T15:40:06.716+0000 7fef0e5ad700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2021-04-11T15:40:06.719 INFO:tasks.ceph.osd.0.smithi089.stderr:failed to fetch mon config (--no-mon-config to skip)
2021-04-11T15:40:06.720 INFO:tasks.ceph.mgr.x.smithi089.stderr:2021-04-11T15:40:06.717+0000 7f3015f87700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2021-04-11T15:40:06.720 INFO:tasks.ceph.mgr.x.smithi089.stderr:2021-04-11T15:40:06.717+0000 7f3015786700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2021-04-11T15:40:06.759 INFO:teuthology.orchestra.run.smithi089.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused
2021-04-11T15:40:06.761 DEBUG:teuthology.orchestra.run:got remote process result: 22
2021-04-11T15:40:06.762 INFO:tasks.rebuild_mondb.ceph_manager:waiting on admin_socket for osd-0, ['dump_ops_in_flight']
2021-04-11T15:40:06.905 INFO:tasks.ceph.osd.0.smithi089.stderr:daemon-helper: command failed with exit status 1
Actions
Copy link
 #4

Updated by Neha Ojha about 3 years ago

  • Subject changed from monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2] to rebuild_mondb: daemon-helper: command failed with exit status 1
  • Description updated (diff)
  • Backport set to pacific, octopus
Actions
Copy link

Also available in: Atom PDF