Project

General

Profile

Actions

Bug #9751

closed

ceph tell osd.6 version hangs

Added by Loïc Dachary over 9 years ago. Updated over 9 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

root@g3:/var/lib/ceph/osd/ceph-6/current# /etc/init.d/ceph stop osd.6
=== osd.6 === 
Stopping Ceph osd.6 on g3...kill 2217...done
root@g3:/var/lib/ceph/osd/ceph-6/current# /etc/init.d/ceph start osd.6
=== osd.6 === 
Starting Ceph osd.6 on g3...
starting osd.6 at :/0 osd_data /var/lib/ceph/osd/ceph-6 /var/lib/ceph/osd/ceph-6/journal
root@g3:/var/lib/ceph/osd/ceph-6/current# ceph tell osd.6 version 
Error ENXIO: problem getting command descriptions from osd.6
root@g3:/var/lib/ceph/osd/ceph-6/current# ceph tell osd.6 version 
Error ENXIO: problem getting command descriptions from osd.6
root@g3:/var/lib/ceph/osd/ceph-6/current# ceph tell osd.6 version 
Error ENXIO: problem getting command descriptions from osd.6
root@g3:/var/lib/ceph/osd/ceph-6/current# ceph tell osd.6 version 
Error ENXIO: problem getting command descriptions from osd.6
root@g3:/var/lib/ceph/osd/ceph-6/current# ceph tell osd.6 version 
{ "version": "ceph version 0.80.6 (f93610a4421cb670b08e974c6550ee715ac528ae)"}
root@g3:/var/lib/ceph/osd/ceph-6/current# ceph tell osd.6 version 
^CError EINTR: problem getting command descriptions from osd.6

The attached log was with
debug_osd = 20
debug_filestore = 20
debug_lockdep = 20
lockdep = true

Files

ceph-osd.6.log-3.gz (18.4 MB) ceph-osd.6.log-3.gz Loïc Dachary, 10/12/2014 10:18 AM
gdb.txt.gz (6.16 KB) gdb.txt.gz gdb osd.6 Loïc Dachary, 10/12/2014 11:20 AM
Actions #1

Updated by Greg Farnum over 9 years ago

Was the OSD already "hanging" when you generated this log?

Actions #2

Updated by Yuri Weinstein over 9 years ago

Maybe similar to #9748 and #9714 ?

Actions #3

Updated by Loïc Dachary over 9 years ago

greg : the log is from when the osd started up to the point where ceph tell hangs

Actions #4

Updated by Loïc Dachary over 9 years ago

  • Description updated (diff)
Actions #5

Updated by Loïc Dachary over 9 years ago

  • File deleted (6.gz)
Actions #6

Updated by Loïc Dachary over 9 years ago

attaching the log with lockdep = true, starting from when the osd boots up to the point where ceph tell blocks forever

Actions #7

Updated by Loïc Dachary over 9 years ago

here is the gdb output of the OSD process that fails to answer to ceph tell

Actions #8

Updated by Loïc Dachary over 9 years ago

  • Description updated (diff)
Actions #9

Updated by Samuel Just over 9 years ago

  • Status changed from New to Rejected
Actions

Also available in: Atom PDF