Project

General

Profile

Bug #11200 ยป ceph-osd.19.log

Nikola Ciprich, 03/22/2015 10:51 AM

 
2015-03-22 11:46:40.375264 7f24830697a0 0 ceph version 0.87.1 (283c2e7cfa2457799f534744d7d549f83ea1335e), process ceph-osd, pid 26900
2015-03-22 11:46:40.397734 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) backend generic (magic 0xef53)
2015-03-22 11:46:40.398387 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is supported and appears to work
2015-03-22 11:46:40.398397 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
2015-03-22 11:46:40.398896 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: syscall(SYS_syncfs, fd) fully supported
2015-03-22 11:46:40.399383 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) limited size xattrs
2015-03-22 11:46:40.401387 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
2015-03-22 11:46:40.437078 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
2015-03-22 11:46:40.442101 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
2015-03-22 11:46:40.442359 7f24830697a0 1 journal close /var/lib/ceph/osd/ceph-19/journal
2015-03-22 11:46:40.448943 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) backend generic (magic 0xef53)
2015-03-22 11:46:40.449689 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is supported and appears to work
2015-03-22 11:46:40.449695 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
2015-03-22 11:46:40.450247 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: syscall(SYS_syncfs, fd) fully supported
2015-03-22 11:46:40.450748 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) limited size xattrs
2015-03-22 11:46:40.452109 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) mount: WRITEAHEAD journal mode explicitly enabled in conf
2015-03-22 11:46:40.471225 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
2015-03-22 11:46:40.665328 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
2015-03-22 11:46:40.668984 7f24830697a0 0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
2015-03-22 11:46:40.670565 7f24830697a0 -1 *** Caught signal (Aborted) **
in thread 7f24830697a0

ceph version 0.87.1 (283c2e7cfa2457799f534744d7d549f83ea1335e)
1: /usr/bin/ceph-osd() [0x9d6235]
2: (()+0xf710) [0x7f2482010710]
3: (gsignal()+0x35) [0x7f2480ee2625]
4: (abort()+0x175) [0x7f2480ee3e05]
5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f248179ca7d]
6: (()+0xbcbd6) [0x7f248179abd6]
7: (()+0xbcc03) [0x7f248179ac03]
8: (()+0xbcd22) [0x7f248179ad22]
9: (ceph::buffer::list::iterator::copy(unsigned int, char*)+0x13e) [0xb0acde]
10: (OSDMap::decode(ceph::buffer::list::iterator&)+0x40) [0xab8fb0]
11: (OSDMap::decode(ceph::buffer::list&)+0x47) [0xab96a7]
12: (OSDService::try_get_map(unsigned int)+0x922) [0x623c12]
13: (OSDService::get_map(unsigned int)+0xd) [0x69e68d]
14: (OSD::init()+0x17a8) [0x66e168]
15: (main()+0x3609) [0x603d19]
16: (__libc_start_main()+0xfd) [0x7f2480eced5d]
17: /usr/bin/ceph-osd() [0x5ff6c9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-95> 2015-03-22 11:46:40.373654 7f24830697a0 5 asok(0x4aa8230) register_command perfcounters_dump hook 0x4a60010
-94> 2015-03-22 11:46:40.373675 7f24830697a0 5 asok(0x4aa8230) register_command 1 hook 0x4a60010
-93> 2015-03-22 11:46:40.373681 7f24830697a0 5 asok(0x4aa8230) register_command perf dump hook 0x4a60010
-92> 2015-03-22 11:46:40.373686 7f24830697a0 5 asok(0x4aa8230) register_command perfcounters_schema hook 0x4a60010
-91> 2015-03-22 11:46:40.373690 7f24830697a0 5 asok(0x4aa8230) register_command 2 hook 0x4a60010
-90> 2015-03-22 11:46:40.373693 7f24830697a0 5 asok(0x4aa8230) register_command perf schema hook 0x4a60010
-89> 2015-03-22 11:46:40.373695 7f24830697a0 5 asok(0x4aa8230) register_command config show hook 0x4a60010
-88> 2015-03-22 11:46:40.373699 7f24830697a0 5 asok(0x4aa8230) register_command config set hook 0x4a60010
-87> 2015-03-22 11:46:40.373702 7f24830697a0 5 asok(0x4aa8230) register_command config get hook 0x4a60010
-86> 2015-03-22 11:46:40.373705 7f24830697a0 5 asok(0x4aa8230) register_command config diff hook 0x4a60010
-85> 2015-03-22 11:46:40.373708 7f24830697a0 5 asok(0x4aa8230) register_command log flush hook 0x4a60010
-84> 2015-03-22 11:46:40.373711 7f24830697a0 5 asok(0x4aa8230) register_command log dump hook 0x4a60010
-83> 2015-03-22 11:46:40.373713 7f24830697a0 5 asok(0x4aa8230) register_command log reopen hook 0x4a60010
-82> 2015-03-22 11:46:40.375264 7f24830697a0 0 ceph version 0.87.1 (283c2e7cfa2457799f534744d7d549f83ea1335e), process ceph-osd, pid 26900
-81> 2015-03-22 11:46:40.375947 7f24830697a0 1 accepter.accepter.bind my_inst.addr is 0.0.0.0:6810/26900 need_addr=1
-80> 2015-03-22 11:46:40.375965 7f24830697a0 1 accepter.accepter.bind my_inst.addr is 0.0.0.0:6811/26900 need_addr=1
-79> 2015-03-22 11:46:40.375979 7f24830697a0 1 accepter.accepter.bind my_inst.addr is 0.0.0.0:6812/26900 need_addr=1
-78> 2015-03-22 11:46:40.375990 7f24830697a0 1 accepter.accepter.bind my_inst.addr is 0.0.0.0:6813/26900 need_addr=1
-77> 2015-03-22 11:46:40.376003 7f24830697a0 1 accepter.accepter.bind my_inst.addr is 0.0.0.0:6814/26900 need_addr=1
-76> 2015-03-22 11:46:40.376330 7f24830697a0 1 finished global_init_daemonize
-75> 2015-03-22 11:46:40.397520 7f24830697a0 5 asok(0x4aa8230) init /var/run/ceph/ceph-osd.19.asok
-74> 2015-03-22 11:46:40.397535 7f24830697a0 5 asok(0x4aa8230) bind_and_listen /var/run/ceph/ceph-osd.19.asok
-73> 2015-03-22 11:46:40.397644 7f24830697a0 5 asok(0x4aa8230) register_command 0 hook 0x4a580a8
-72> 2015-03-22 11:46:40.397651 7f24830697a0 5 asok(0x4aa8230) register_command version hook 0x4a580a8
-71> 2015-03-22 11:46:40.397654 7f24830697a0 5 asok(0x4aa8230) register_command git_version hook 0x4a580a8
-70> 2015-03-22 11:46:40.397657 7f24830697a0 5 asok(0x4aa8230) register_command help hook 0x4a600b0
-69> 2015-03-22 11:46:40.397661 7f24830697a0 5 asok(0x4aa8230) register_command get_command_descriptions hook 0x4a60150
-68> 2015-03-22 11:46:40.397681 7f247eb0a700 5 asok(0x4aa8230) entry start
-67> 2015-03-22 11:46:40.397734 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) backend generic (magic 0xef53)
-66> 2015-03-22 11:46:40.398387 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is supported and appears to work
-65> 2015-03-22 11:46:40.398397 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
-64> 2015-03-22 11:46:40.398896 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: syscall(SYS_syncfs, fd) fully supported
-63> 2015-03-22 11:46:40.399383 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) limited size xattrs
-62> 2015-03-22 11:46:40.401387 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
-61> 2015-03-22 11:46:40.435481 7f24830697a0 2 journal open /var/lib/ceph/osd/ceph-19/journal fsid b3dc2fb5-f9ba-428b-9b8d-32fb80deb997 fs_op_seq 8699875
-60> 2015-03-22 11:46:40.437078 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
-59> 2015-03-22 11:46:40.439613 7f24830697a0 2 journal read_entry 4043399168 : seq 8699866 17233 bytes
-58> 2015-03-22 11:46:40.439654 7f24830697a0 2 journal read_entry 4043403264 : seq 8699867 1026 bytes
-57> 2015-03-22 11:46:40.439664 7f24830697a0 2 journal read_entry 4043407360 : seq 8699868 1026 bytes
-56> 2015-03-22 11:46:40.439673 7f24830697a0 2 journal read_entry 4043411456 : seq 8699869 1026 bytes
-55> 2015-03-22 11:46:40.439681 7f24830697a0 2 journal read_entry 4043415552 : seq 8699870 1026 bytes
-54> 2015-03-22 11:46:40.440169 7f24830697a0 2 journal read_entry 4043419648 : seq 8699871 1026 bytes
-53> 2015-03-22 11:46:40.440179 7f24830697a0 2 journal read_entry 4043423744 : seq 8699872 1026 bytes
-52> 2015-03-22 11:46:40.440187 7f24830697a0 2 journal read_entry 4043427840 : seq 8699873 1026 bytes
-51> 2015-03-22 11:46:40.440196 7f24830697a0 2 journal read_entry 4043431936 : seq 8699874 1026 bytes
-50> 2015-03-22 11:46:40.440204 7f24830697a0 2 journal read_entry 4043436032 : seq 8699875 1026 bytes
-49> 2015-03-22 11:46:40.440221 7f24830697a0 2 journal read_entry 4043444224 : seq 7384601 6609 bytes
-48> 2015-03-22 11:46:40.440235 7f24830697a0 2 journal read_entry 4043444224 : seq 7384601 6609 bytes
-47> 2015-03-22 11:46:40.440239 7f24830697a0 3 journal journal_replay: end of journal, done.
-46> 2015-03-22 11:46:40.442101 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
-45> 2015-03-22 11:46:40.442315 7f247ace3700 1 FileStore::op_tp worker finish
-44> 2015-03-22 11:46:40.442325 7f247b4e4700 1 FileStore::op_tp worker finish
-43> 2015-03-22 11:46:40.442359 7f24830697a0 1 journal close /var/lib/ceph/osd/ceph-19/journal
-42> 2015-03-22 11:46:40.442680 7f24830697a0 10 monclient(hunting): build_initial_monmap
-41> 2015-03-22 11:46:40.448681 7f24830697a0 5 adding auth protocol: cephx
-40> 2015-03-22 11:46:40.448692 7f24830697a0 5 adding auth protocol: cephx
-39> 2015-03-22 11:46:40.448777 7f24830697a0 5 asok(0x4aa8230) register_command objecter_requests hook 0x4a60200
-38> 2015-03-22 11:46:40.448824 7f24830697a0 1 -- 0.0.0.0:6810/26900 messenger.start
-37> 2015-03-22 11:46:40.448836 7f24830697a0 1 -- :/0 messenger.start
-36> 2015-03-22 11:46:40.448844 7f24830697a0 1 -- 0.0.0.0:6813/26900 messenger.start
-35> 2015-03-22 11:46:40.448851 7f24830697a0 1 -- 0.0.0.0:6812/26900 messenger.start
-34> 2015-03-22 11:46:40.448865 7f24830697a0 1 -- 0.0.0.0:6811/26900 messenger.start
-33> 2015-03-22 11:46:40.448878 7f24830697a0 1 -- 0.0.0.0:6814/26900 messenger.start
-32> 2015-03-22 11:46:40.448910 7f24830697a0 2 osd.19 0 mounting /var/lib/ceph/osd/ceph-19 /var/lib/ceph/osd/ceph-19/journal
-31> 2015-03-22 11:46:40.448943 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) backend generic (magic 0xef53)
-30> 2015-03-22 11:46:40.449689 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is supported and appears to work
-29> 2015-03-22 11:46:40.449695 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
-28> 2015-03-22 11:46:40.450247 7f24830697a0 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-19) detect_features: syscall(SYS_syncfs, fd) fully supported
-27> 2015-03-22 11:46:40.450748 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) limited size xattrs
-26> 2015-03-22 11:46:40.452109 7f24830697a0 0 filestore(/var/lib/ceph/osd/ceph-19) mount: WRITEAHEAD journal mode explicitly enabled in conf
-25> 2015-03-22 11:46:40.469354 7f24830697a0 2 journal open /var/lib/ceph/osd/ceph-19/journal fsid b3dc2fb5-f9ba-428b-9b8d-32fb80deb997 fs_op_seq 8699875
-24> 2015-03-22 11:46:40.471225 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
-23> 2015-03-22 11:46:40.474258 7f24830697a0 2 journal read_entry 4043399168 : seq 8699866 17233 bytes
-22> 2015-03-22 11:46:40.474301 7f24830697a0 2 journal read_entry 4043403264 : seq 8699867 1026 bytes
-21> 2015-03-22 11:46:40.474308 7f24830697a0 2 journal read_entry 4043407360 : seq 8699868 1026 bytes
-20> 2015-03-22 11:46:40.474313 7f24830697a0 2 journal read_entry 4043411456 : seq 8699869 1026 bytes
-19> 2015-03-22 11:46:40.474318 7f24830697a0 2 journal read_entry 4043415552 : seq 8699870 1026 bytes
-18> 2015-03-22 11:46:40.659716 7f24830697a0 2 journal read_entry 4043419648 : seq 8699871 1026 bytes
-17> 2015-03-22 11:46:40.659749 7f24830697a0 2 journal read_entry 4043423744 : seq 8699872 1026 bytes
-16> 2015-03-22 11:46:40.659758 7f24830697a0 2 journal read_entry 4043427840 : seq 8699873 1026 bytes
-15> 2015-03-22 11:46:40.659766 7f24830697a0 2 journal read_entry 4043431936 : seq 8699874 1026 bytes
-14> 2015-03-22 11:46:40.659774 7f24830697a0 2 journal read_entry 4043436032 : seq 8699875 1026 bytes
-13> 2015-03-22 11:46:40.659792 7f24830697a0 2 journal read_entry 4043444224 : seq 7384601 6609 bytes
-12> 2015-03-22 11:46:40.659802 7f24830697a0 2 journal read_entry 4043444224 : seq 7384601 6609 bytes
-11> 2015-03-22 11:46:40.659805 7f24830697a0 3 journal journal_replay: end of journal, done.
-10> 2015-03-22 11:46:40.665328 7f24830697a0 1 journal _open /var/lib/ceph/osd/ceph-19/journal fd 21: 10737418240 bytes, block size 4096 bytes, directio = 1, aio = 1
-9> 2015-03-22 11:46:40.665463 7f24830697a0 2 osd.19 0 boot
-8> 2015-03-22 11:46:40.667345 7f24830697a0 1 <cls> cls/rgw/cls_rgw.cc:1599: Loaded rgw class!
-7> 2015-03-22 11:46:40.668594 7f24830697a0 1 <cls> cls/refcount/cls_refcount.cc:231: Loaded refcount class!
-6> 2015-03-22 11:46:40.668804 7f24830697a0 1 <cls> cls/user/cls_user.cc:367: Loaded user class!
-5> 2015-03-22 11:46:40.668865 7f24830697a0 1 <cls> cls/replica_log/cls_replica_log.cc:141: Loaded replica log class!
-4> 2015-03-22 11:46:40.668925 7f24830697a0 1 <cls> cls/log/cls_log.cc:312: Loaded log class!
-3> 2015-03-22 11:46:40.668984 7f24830697a0 0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
-2> 2015-03-22 11:46:40.669042 7f24830697a0 1 <cls> cls/version/cls_version.cc:227: Loaded version class!
-1> 2015-03-22 11:46:40.669105 7f24830697a0 1 <cls> cls/statelog/cls_statelog.cc:306: Loaded log class!
0> 2015-03-22 11:46:40.670565 7f24830697a0 -1 *** Caught signal (Aborted) **
in thread 7f24830697a0

ceph version 0.87.1 (283c2e7cfa2457799f534744d7d549f83ea1335e)
1: /usr/bin/ceph-osd() [0x9d6235]
2: (()+0xf710) [0x7f2482010710]
3: (gsignal()+0x35) [0x7f2480ee2625]
4: (abort()+0x175) [0x7f2480ee3e05]
5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f248179ca7d]
6: (()+0xbcbd6) [0x7f248179abd6]
7: (()+0xbcc03) [0x7f248179ac03]
8: (()+0xbcd22) [0x7f248179ad22]
9: (ceph::buffer::list::iterator::copy(unsigned int, char*)+0x13e) [0xb0acde]
10: (OSDMap::decode(ceph::buffer::list::iterator&)+0x40) [0xab8fb0]
11: (OSDMap::decode(ceph::buffer::list&)+0x47) [0xab96a7]
12: (OSDService::try_get_map(unsigned int)+0x922) [0x623c12]
13: (OSDService::get_map(unsigned int)+0xd) [0x69e68d]
14: (OSD::init()+0x17a8) [0x66e168]
15: (main()+0x3609) [0x603d19]
16: (__libc_start_main()+0xfd) [0x7f2480eced5d]
17: /usr/bin/ceph-osd() [0x5ff6c9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 keyvaluestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
max_recent 10000
max_new 1000
log_file /var/log/ceph/ceph-osd.19.log
--- end dump of recent events ---
    (1-1/1)