Project

General

Profile

Bug #3702 » ceph-osd.131.log

Justin Lott, 01/02/2013 12:39 PM

 
2013-01-02 16:05:13.987275 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is supported and appears to work
2013-01-02 16:05:13.987293 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2013-01-02 16:05:13.987653 7f5a7491b780 0 filestore(/data/osd.131) mount did NOT detect btrfs
2013-01-02 16:05:14.032881 7f5a7491b780 0 filestore(/data/osd.131) mount syncfs(2) syscall fully supported (by glibc and kernel)
2013-01-02 16:05:14.044026 7f5a7491b780 0 filestore(/data/osd.131) mount found snaps <>
2013-01-02 16:05:14.199381 7f5a7491b780 0 filestore(/data/osd.131) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2013-01-02 16:05:14.202296 7f5a7491b780 0 journal kernel version is 3.2.0
2013-01-02 16:05:14.202471 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 19: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-01-02 16:05:14.204778 7f5a7491b780 0 journal kernel version is 3.2.0
2013-01-02 16:05:14.204909 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 19: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-01-02 16:05:14.205285 7f5a7491b780 1 journal close /dev/sda_vg/osd.131-journal
2013-01-02 16:05:14.265360 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is supported and appears to work
2013-01-02 16:05:14.265381 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2013-01-02 16:05:14.265811 7f5a7491b780 0 filestore(/data/osd.131) mount did NOT detect btrfs
2013-01-02 16:05:14.364733 7f5a7491b780 0 filestore(/data/osd.131) mount syncfs(2) syscall fully supported (by glibc and kernel)
2013-01-02 16:05:14.364814 7f5a7491b780 0 filestore(/data/osd.131) mount found snaps <>
2013-01-02 16:05:14.489587 7f5a7491b780 0 filestore(/data/osd.131) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2013-01-02 16:05:14.490953 7f5a7491b780 0 journal kernel version is 3.2.0
2013-01-02 16:05:14.491046 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 28: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-01-02 16:05:14.492970 7f5a7491b780 0 journal kernel version is 3.2.0
2013-01-02 16:05:14.493213 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 28: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-01-02 16:05:17.640621 7f5a661bc700 -1 *** Caught signal (Aborted) **
in thread 7f5a661bc700

ceph version 0.48.2argonaut (commit:3e02b2fad88c2a95d9c0c86878f10d1beb780bfe)
1: /usr/bin/ceph-osd() [0x6edaba]
2: (()+0xfcb0) [0x7f5a73db8cb0]
3: (gsignal()+0x35) [0x7f5a72990425]
4: (abort()+0x17b) [0x7f5a72993b8b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f5a732e269d]
6: (()+0xb5846) [0x7f5a732e0846]
7: (()+0xb5873) [0x7f5a732e0873]
8: (()+0xb596e) [0x7f5a732e096e]
9: (ceph::buffer::list::iterator::copy(unsigned int, char*)+0x127) [0x7a94f7]
10: (OSDMap::decode(ceph::buffer::list::iterator&)+0x3f) [0x7670ff]
11: (OSDMap::decode(ceph::buffer::list&)+0x3e) [0x7681fe]
12: (OSD::handle_osd_map(MOSDMap*)+0xa2f) [0x5d38bf]
13: (OSD::_dispatch(Message*)+0x43b) [0x5d755b]
14: (OSD::ms_dispatch(Message*)+0x153) [0x5d7bb3]
15: (SimpleMessenger::DispatchQueue::entry()+0x903) [0x785f43]
16: (SimpleMessenger::dispatch_entry()+0x24) [0x786ce4]
17: (SimpleMessenger::DispatchThread::entry()+0xd) [0x74692d]
18: (()+0x7e9a) [0x7f5a73db0e9a]
19: (clone()+0x6d) [0x7f5a72a4dcbd]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-117> 2013-01-02 16:05:13.849094 7f5a7491b780 5 asok(0x200d000) register_command perfcounters_dump hook 0x2002010
-116> 2013-01-02 16:05:13.849117 7f5a7491b780 5 asok(0x200d000) register_command 1 hook 0x2002010
-115> 2013-01-02 16:05:13.849124 7f5a7491b780 5 asok(0x200d000) register_command perf dump hook 0x2002010
-114> 2013-01-02 16:05:13.849590 7f5a7491b780 5 asok(0x200d000) register_command perfcounters_schema hook 0x2002010
-113> 2013-01-02 16:05:13.849605 7f5a7491b780 5 asok(0x200d000) register_command 2 hook 0x2002010
-112> 2013-01-02 16:05:13.849614 7f5a7491b780 5 asok(0x200d000) register_command perf schema hook 0x2002010
-111> 2013-01-02 16:05:13.849619 7f5a7491b780 5 asok(0x200d000) register_command config show hook 0x2002010
-110> 2013-01-02 16:05:13.849625 7f5a7491b780 5 asok(0x200d000) register_command config set hook 0x2002010
-109> 2013-01-02 16:05:13.849628 7f5a7491b780 5 asok(0x200d000) register_command log flush hook 0x2002010
-108> 2013-01-02 16:05:13.849635 7f5a7491b780 5 asok(0x200d000) register_command log dump hook 0x2002010
-107> 2013-01-02 16:05:13.849639 7f5a7491b780 5 asok(0x200d000) register_command log reopen hook 0x2002010
-106> 2013-01-02 16:05:13.903642 7f5a7491b780 0 ceph version 0.48.2argonaut (commit:3e02b2fad88c2a95d9c0c86878f10d1beb780bfe), process ceph-osd, pid 27928
-105> 2013-01-02 16:05:13.903725 7f5a7491b780 1 -- 0.0.0.0:6824/27928 accepter.bind my_inst.addr is 0.0.0.0:6824/27928 need_addr=1
-104> 2013-01-02 16:05:13.903753 7f5a7491b780 1 -- 0.0.0.0:6825/27928 accepter.bind my_inst.addr is 0.0.0.0:6825/27928 need_addr=1
-103> 2013-01-02 16:05:13.903769 7f5a7491b780 1 -- 0.0.0.0:6826/27928 accepter.bind my_inst.addr is 0.0.0.0:6826/27928 need_addr=1
-102> 2013-01-02 16:05:13.904197 7f5a7491b780 1 finished global_init_daemonize
-101> 2013-01-02 16:05:13.907080 7f5a7491b780 5 asok(0x200d000) init /var/run/ceph/ceph-osd.131.asok
-100> 2013-01-02 16:05:13.907109 7f5a7491b780 5 asok(0x200d000) bind_and_listen /var/run/ceph/ceph-osd.131.asok
-99> 2013-01-02 16:05:13.907152 7f5a7491b780 5 asok(0x200d000) register_command 0 hook 0x20010a0
-98> 2013-01-02 16:05:13.907164 7f5a7491b780 5 asok(0x200d000) register_command version hook 0x20010a0
-97> 2013-01-02 16:05:13.907170 7f5a7491b780 5 asok(0x200d000) register_command git_version hook 0x20010a0
-96> 2013-01-02 16:05:13.907181 7f5a7491b780 5 asok(0x200d000) register_command help hook 0x20020c0
-95> 2013-01-02 16:05:13.907287 7f5a709d1700 5 asok(0x200d000) entry start
-94> 2013-01-02 16:05:13.907958 7f5a7491b780 5 filestore(/data/osd.131) basedir /data/osd.131 journal /dev/sda_vg/osd.131-journal
-93> 2013-01-02 16:05:13.987275 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is supported and appears to work
-92> 2013-01-02 16:05:13.987293 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
-91> 2013-01-02 16:05:13.987653 7f5a7491b780 0 filestore(/data/osd.131) mount did NOT detect btrfs
-90> 2013-01-02 16:05:14.032881 7f5a7491b780 0 filestore(/data/osd.131) mount syncfs(2) syscall fully supported (by glibc and kernel)
-89> 2013-01-02 16:05:14.044026 7f5a7491b780 0 filestore(/data/osd.131) mount found snaps <>
-88> 2013-01-02 16:05:14.054152 7f5a7491b780 5 filestore(/data/osd.131) mount op_seq is 2
-87> 2013-01-02 16:05:14.199381 7f5a7491b780 0 filestore(/data/osd.131) mount: enabling WRITEAHEAD journal mode: btrfs not detected
-86> 2013-01-02 16:05:14.199680 7f5a7491b780 2 journal open /dev/sda_vg/osd.131-journal fsid 6779c689-3ad1-4f4d-a317-09adeed7eb2b fs_op_seq 2
-85> 2013-01-02 16:05:14.202296 7f5a7491b780 0 journal kernel version is 3.2.0
-84> 2013-01-02 16:05:14.202471 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 19: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
-83> 2013-01-02 16:05:14.202991 7f5a7491b780 2 journal read_entry 4096 : seq 2 243 bytes
-82> 2013-01-02 16:05:14.203008 7f5a7491b780 2 journal read_entry 12288 : bad header magic, end of journal
-81> 2013-01-02 16:05:14.203025 7f5a7491b780 2 journal read_entry 12288 : bad header magic, end of journal
-80> 2013-01-02 16:05:14.203028 7f5a7491b780 3 journal journal_replay: end of journal, done.
-79> 2013-01-02 16:05:14.204778 7f5a7491b780 0 journal kernel version is 3.2.0
-78> 2013-01-02 16:05:14.204909 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 19: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
-77> 2013-01-02 16:05:14.205124 7f5a7491b780 5 filestore(/data/osd.131) umount /data/osd.131
-76> 2013-01-02 16:05:14.205177 7f5a6e1cc700 1 FileStore::op_tp worker finish
-75> 2013-01-02 16:05:14.205205 7f5a6d9cb700 1 FileStore::op_tp worker finish
-74> 2013-01-02 16:05:14.205285 7f5a7491b780 1 journal close /dev/sda_vg/osd.131-journal
-73> 2013-01-02 16:05:14.206371 7f5a7491b780 5 filestore(/data/osd.131) test_mount basedir /data/osd.131 journal /dev/sda_vg/osd.131-journal
-72> 2013-01-02 16:05:14.206407 7f5a7491b780 1 -- 0.0.0.0:6824/27928 messenger.start
-71> 2013-01-02 16:05:14.206420 7f5a7491b780 1 -- 0.0.0.0:6824/27928 accepter.start
-70> 2013-01-02 16:05:14.206484 7f5a7491b780 1 -- :/0 messenger.start
-69> 2013-01-02 16:05:14.206514 7f5a7491b780 1 -- 0.0.0.0:6826/27928 messenger.start
-68> 2013-01-02 16:05:14.206523 7f5a7491b780 1 -- 0.0.0.0:6826/27928 accepter.start
-67> 2013-01-02 16:05:14.206560 7f5a7491b780 1 -- 0.0.0.0:6825/27928 messenger.start
-66> 2013-01-02 16:05:14.206571 7f5a7491b780 1 -- 0.0.0.0:6825/27928 accepter.start
-65> 2013-01-02 16:05:14.206751 7f5a7491b780 2 osd.131 0 mounting /data/osd.131 /dev/sda_vg/osd.131-journal
-64> 2013-01-02 16:05:14.206768 7f5a7491b780 5 filestore(/data/osd.131) basedir /data/osd.131 journal /dev/sda_vg/osd.131-journal
-63> 2013-01-02 16:05:14.265360 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is supported and appears to work
-62> 2013-01-02 16:05:14.265381 7f5a7491b780 0 filestore(/data/osd.131) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
-61> 2013-01-02 16:05:14.265811 7f5a7491b780 0 filestore(/data/osd.131) mount did NOT detect btrfs
-60> 2013-01-02 16:05:14.364733 7f5a7491b780 0 filestore(/data/osd.131) mount syncfs(2) syscall fully supported (by glibc and kernel)
-59> 2013-01-02 16:05:14.364814 7f5a7491b780 0 filestore(/data/osd.131) mount found snaps <>
-58> 2013-01-02 16:05:14.364826 7f5a7491b780 5 filestore(/data/osd.131) mount op_seq is 2
-57> 2013-01-02 16:05:14.489587 7f5a7491b780 0 filestore(/data/osd.131) mount: enabling WRITEAHEAD journal mode: btrfs not detected
-56> 2013-01-02 16:05:14.489677 7f5a7491b780 2 journal open /dev/sda_vg/osd.131-journal fsid 6779c689-3ad1-4f4d-a317-09adeed7eb2b fs_op_seq 2
-55> 2013-01-02 16:05:14.490953 7f5a7491b780 0 journal kernel version is 3.2.0
-54> 2013-01-02 16:05:14.491046 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 28: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
-53> 2013-01-02 16:05:14.491463 7f5a7491b780 2 journal read_entry 4096 : seq 2 243 bytes
-52> 2013-01-02 16:05:14.491472 7f5a7491b780 2 journal read_entry 12288 : bad header magic, end of journal
-51> 2013-01-02 16:05:14.491479 7f5a7491b780 2 journal read_entry 12288 : bad header magic, end of journal
-50> 2013-01-02 16:05:14.491482 7f5a7491b780 3 journal journal_replay: end of journal, done.
-49> 2013-01-02 16:05:14.492970 7f5a7491b780 0 journal kernel version is 3.2.0
-48> 2013-01-02 16:05:14.493213 7f5a7491b780 1 journal _open /dev/sda_vg/osd.131-journal fd 28: 2571108352 bytes, block size 4096 bytes, directio = 1, aio = 0
-47> 2013-01-02 16:05:14.493502 7f5a7491b780 2 osd.131 0 boot
-46> 2013-01-02 16:05:14.509199 7f5a7491b780 2 osd.131 0 superblock: i am osd.131
-45> 2013-01-02 16:05:14.528176 7f5a7491b780 2 auth: KeyRing::load: loaded key file /data/osd.131/keyring
-44> 2013-01-02 16:05:14.528501 7f5a7491b780 1 -- 0.0.0.0:6824/27928 --> 10.30.66.13:6789/0 -- auth(proto 0 28 bytes epoch 0) v1 -- ?+0 0x2059a00 con 0x201d3c0
-43> 2013-01-02 16:05:14.529201 7f5a74903700 1 -- 10.30.66.21:6824/27928 learned my addr 10.30.66.21:6824/27928
-42> 2013-01-02 16:05:17.528302 7f5a641b8700 1 monclient(hunting): continuing hunt
-41> 2013-01-02 16:05:17.528328 7f5a641b8700 1 -- 10.30.66.21:6824/27928 mark_down 0x201d3c0 -- 0x2059c00
-40> 2013-01-02 16:05:17.528472 7f5a641b8700 1 -- 10.30.66.21:6824/27928 --> 10.30.66.12:6789/0 -- auth(proto 0 28 bytes epoch 0) v1 -- ?+0 0x2074400 con 0x201e140
-39> 2013-01-02 16:05:17.528458 7f5a631b6700 2 -- 10.30.66.21:6824/27928 >> 10.30.66.13:6789/0 pipe(0x2059c00 sd=29 pgs=79790 cs=1 l=1).reader couldn't read tag, Success
-38> 2013-01-02 16:05:17.528485 7f5a631b6700 2 -- 10.30.66.21:6824/27928 >> 10.30.66.13:6789/0 pipe(0x2059c00 sd=29 pgs=79790 cs=1 l=1).fault 0: Success
-37> 2013-01-02 16:05:17.529135 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 473 (0 -> 473)
-36> 2013-01-02 16:05:17.529192 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 33 (473 -> 506)
-35> 2013-01-02 16:05:17.529196 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 1 ==== mon_map v1 ==== 473+0+0 (3428730745 0 0) 0x2074600 con 0x201e140
-34> 2013-01-02 16:05:17.529231 7f5a661bc700 1 monclient(hunting): found mon.a
-33> 2013-01-02 16:05:17.529237 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 473 (0xb38628 -> 33)
-32> 2013-01-02 16:05:17.529245 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 2 ==== auth_reply(proto 2 0 Success) v1 ==== 33+0+0 (3389064937 0 0) 0x2059a00 con 0x201e140
-31> 2013-01-02 16:05:17.529368 7f5a661bc700 1 -- 10.30.66.21:6824/27928 --> 10.30.66.12:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- ?+0 0x2059a00 con 0x201e140
-30> 2013-01-02 16:05:17.529379 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 33 (0xb38628 -> 0)
-29> 2013-01-02 16:05:17.560785 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 206 (0 -> 206)
-28> 2013-01-02 16:05:17.560824 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 3 ==== auth_reply(proto 2 0 Success) v1 ==== 206+0+0 (3869352699 0 0) 0x2074400 con 0x201e140
-27> 2013-01-02 16:05:17.560950 7f5a661bc700 1 -- 10.30.66.21:6824/27928 --> 10.30.66.12:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- ?+0 0x2074400 con 0x201e140
-26> 2013-01-02 16:05:17.560969 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 206 (0xb38628 -> 0)
-25> 2013-01-02 16:05:17.626735 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 393 (0 -> 393)
-24> 2013-01-02 16:05:17.626797 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 4 ==== auth_reply(proto 2 0 Success) v1 ==== 393+0+0 (3211287606 0 0) 0x2059c00 con 0x201e140
-23> 2013-01-02 16:05:17.626900 7f5a661bc700 1 -- 10.30.66.21:6824/27928 --> 10.30.66.12:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x2041a80 con 0x201e140
-22> 2013-01-02 16:05:17.626922 7f5a661bc700 1 -- 10.30.66.21:6824/27928 --> 10.30.66.12:6789/0 -- mon_get_version(what=osdmap handle=2) v1 -- ?+0 0x2041e00 con 0x201e140
-21> 2013-01-02 16:05:17.626935 7f5a661bc700 1 -- 10.30.66.21:6824/27928 --> 10.30.66.12:6789/0 -- auth(proto 2 2 bytes epoch 0) v1 -- ?+0 0x2059c00 con 0x201e140
-20> 2013-01-02 16:05:17.626960 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 393 (0xb38628 -> 0)
-19> 2013-01-02 16:05:17.626961 7f5a7491b780 5 monclient: authenticate success, global_id 1881303
-18> 2013-01-02 16:05:17.627254 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 473 (0 -> 473)
-17> 2013-01-02 16:05:17.627300 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 20 (473 -> 493)
-16> 2013-01-02 16:05:17.627299 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 5 ==== mon_map v1 ==== 473+0+0 (3428730745 0 0) 0x2074c00 con 0x201e140
-15> 2013-01-02 16:05:17.627325 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 24 (493 -> 517)
-14> 2013-01-02 16:05:17.627338 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 473 (0xb38628 -> 44)
-13> 2013-01-02 16:05:17.627350 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 6 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (2640343686 0 0) 0x2041e00 con 0x201e140
-12> 2013-01-02 16:05:17.627371 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 20 (0xb38628 -> 24)
-11> 2013-01-02 16:05:17.627375 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 7 ==== mon_check_map_ack(handle=2 version=78177) v2 ==== 24+0+0 (3314986973 0 0) 0x2041a80 con 0x201e140
-10> 2013-01-02 16:05:17.627385 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 24 (0xb38628 -> 0)
-9> 2013-01-02 16:05:17.627395 7f5a639b7700 1 -- 10.30.66.21:6824/27928 --> 10.30.66.12:6789/0 -- mon_subscribe({monmap=2+,osdmap=67876}) v2 -- ?+0 0x20761c0 con 0x201e140
-8> 2013-01-02 16:05:17.637069 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 194 (0 -> 194)
-7> 2013-01-02 16:05:17.637136 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 8 ==== auth_reply(proto 2 0 Success) v1 ==== 194+0+0 (1378845359 0 0) 0x2074a00 con 0x201e140
-6> 2013-01-02 16:05:17.637239 7f5a661bc700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) put 194 (0xb38628 -> 0)
-5> 2013-01-02 16:05:17.637317 7f5a631b6700 5 throttle(msgr_dispatch_throttler-client 0x20079e0) get 40 (0 -> 40)
-4> 2013-01-02 16:05:17.637360 7f5a661bc700 1 -- 10.30.66.21:6824/27928 <== mon.0 10.30.66.12:6789/0 9 ==== osd_map(67877..67877 src has 67877..78177) v3 ==== 40+0+0 (1305197783 0 0) 0x2074800 con 0x201e140
-3> 2013-01-02 16:05:17.637418 7f5a7491b780 5 asok(0x200d000) register_command dump_ops_in_flight hook 0x20022c0
-2> 2013-01-02 16:05:17.637442 7f5a661bc700 3 osd.131 0 handle_osd_map epochs [67877,67877], i have 0, src has [67877,78177]
-1> 2013-01-02 16:05:17.637450 7f5a607af700 5 osd.131 0 heartbeat: osd_stat(33988 KB used, 2793 GB avail, 2793 GB total, peers []/[])
0> 2013-01-02 16:05:17.640621 7f5a661bc700 -1 *** Caught signal (Aborted) **
in thread 7f5a661bc700

ceph version 0.48.2argonaut (commit:3e02b2fad88c2a95d9c0c86878f10d1beb780bfe)
1: /usr/bin/ceph-osd() [0x6edaba]
2: (()+0xfcb0) [0x7f5a73db8cb0]
3: (gsignal()+0x35) [0x7f5a72990425]
4: (abort()+0x17b) [0x7f5a72993b8b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f5a732e269d]
6: (()+0xb5846) [0x7f5a732e0846]
7: (()+0xb5873) [0x7f5a732e0873]
8: (()+0xb596e) [0x7f5a732e096e]
9: (ceph::buffer::list::iterator::copy(unsigned int, char*)+0x127) [0x7a94f7]
10: (OSDMap::decode(ceph::buffer::list::iterator&)+0x3f) [0x7670ff]
11: (OSDMap::decode(ceph::buffer::list&)+0x3e) [0x7681fe]
12: (OSD::handle_osd_map(MOSDMap*)+0xa2f) [0x5d38bf]
13: (OSD::_dispatch(Message*)+0x43b) [0x5d755b]
14: (OSD::ms_dispatch(Message*)+0x153) [0x5d7bb3]
15: (SimpleMessenger::DispatchQueue::entry()+0x903) [0x785f43]
16: (SimpleMessenger::dispatch_entry()+0x24) [0x786ce4]
17: (SimpleMessenger::DispatchThread::entry()+0xd) [0x74692d]
18: (()+0x7e9a) [0x7f5a73db0e9a]
19: (clone()+0x6d) [0x7f5a72a4dcbd]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- end dump of recent events ---
(7-7/9)