Project

General

Profile

shutdown.log

Rafal Wadolowski, 04/24/2018 05:16 PM

Download (8.15 KB)

 
1
2018-04-24 13:26:07.360615 7f2f1ab1c700 -1 received  signal: Terminated from  PID: 1 task name: /sbin/init  UID: 0
2
2018-04-24 13:26:07.360626 7f2f1ab1c700 -1 osd.574 140821 *** Got signal Terminated ***
3
2018-04-24 13:26:07.360629 7f2f1ab1c700  0 osd.574 140821 prepare_to_stop telling mon we are shutting down
4
2018-04-24 13:26:07.920928 7f2f47b76700 -1 osd.574 140821 heartbeat_check: no reply from 10.11.2.4:6822 osd.241 since back 2018-04-24 13:24:31.567441 front 2018-04-24 13:24:31.567441 (cutoff 2018-04-24 13:25:47.
5
920920)
6
2018-04-24 13:26:08.517550 7f2f2dbbc700  0 osd.574 140821 got_stop_ack starting shutdown
7
2018-04-24 13:26:08.517569 7f2f1ab1c700  0 osd.574 140821 prepare_to_stop starting shutdown
8
2018-04-24 13:26:08.517574 7f2f1ab1c700 -1 osd.574 140821 shutdown
9
2018-04-24 13:26:08.531329 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
10
 got BADAUTHORIZER
11
2018-04-24 13:26:08.531415 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
12
 got BADAUTHORIZER
13
2018-04-24 13:26:08.733558 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
14
 got BADAUTHORIZER
15
2018-04-24 13:26:08.733687 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
16
 got BADAUTHORIZER
17
2018-04-24 13:26:09.137668 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
18
 got BADAUTHORIZER
19
2018-04-24 13:26:09.137797 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
20
 got BADAUTHORIZER
21
2018-04-24 13:26:09.432517 7f2f1ab1c700  1 bluestore(/var/lib/ceph/osd/ceph-574) umount
22
2018-04-24 13:26:09.941669 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
23
 got BADAUTHORIZER
24
2018-04-24 13:26:09.941798 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
25
 got BADAUTHORIZER
26
2018-04-24 13:26:11.545662 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
27
 got BADAUTHORIZER
28
2018-04-24 13:26:11.545777 7f2f4bb67700  0 -- 10.11.0.18:6848/1765485 >> 10.11.0.7:6809/5807166 conn(0x55e5ff617000 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=23333 cs=7 l=0).handle_connect_reply connect
29
 got BADAUTHORIZER
30
2018-04-24 13:26:11.885381 7f2f1ab1c700  1 stupidalloc 0x0x55e5bddc2ae0 shutdown
31
2018-04-24 13:26:11.907097 7f2f1ab1c700  1 freelist shutdown
32
2018-04-24 13:26:11.907231 7f2f1ab1c700  4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
33
2018-04-24 13:26:12.168386 7f2f1ab1c700  4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl.cc:343] Shutdown complete
34
2018-04-24 13:26:12.455651 7f2f1ab1c700  1 bluefs umount
35
2018-04-24 13:26:12.455683 7f2f1ab1c700  1 stupidalloc 0x0x55e5bdabbc60 shutdown
36
2018-04-24 13:26:12.455689 7f2f1ab1c700  1 stupidalloc 0x0x55e5bdabbcd0 shutdown
37
2018-04-24 13:26:12.455690 7f2f1ab1c700  1 stupidalloc 0x0x55e5bdabbd40 shutdown
38
2018-04-24 13:26:12.455866 7f2f1ab1c700  1 bdev(0x55e5bd835680 /var/lib/ceph/osd/ceph-574/block.wal) close
39
2018-04-24 13:26:12.881379 7f2f1ab1c700  1 bdev(0x55e5bd835200 /var/lib/ceph/osd/ceph-574/block.db) close
40
2018-04-24 13:26:13.177363 7f2f1ab1c700  1 bdev(0x55e5bd835440 /var/lib/ceph/osd/ceph-574/block) close
41
2018-04-24 13:26:13.581292 7f2f1ab1c700  1 bdev(0x55e5bd834fc0 /var/lib/ceph/osd/ceph-574/block) close
42
2018-04-24 13:26:14.826431 7fcdedeafe00  0 set uid:gid to 64045:64045 (ceph:ceph)
43
2018-04-24 13:26:14.826445 7fcdedeafe00  0 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable), process (unknown), pid 3465264
44
2018-04-24 13:26:14.845310 7fcdedeafe00  0 pidfile_write: ignore empty --pid-file
45
2018-04-24 13:26:14.851852 7fcdedeafe00  0 load: jerasure load: lrc load: isa
46
2018-04-24 13:26:14.851924 7fcdedeafe00  1 bdev create path /var/lib/ceph/osd/ceph-574/block type kernel
47
2018-04-24 13:26:14.851934 7fcdedeafe00  1 bdev(0x55b5437e0d80 /var/lib/ceph/osd/ceph-574/block) open path /var/lib/ceph/osd/ceph-574/block
48
2018-04-24 13:26:14.852178 7fcdedeafe00  1 bdev(0x55b5437e0d80 /var/lib/ceph/osd/ceph-574/block) open size 8001457295360 (0x746fc051000, 7451 GB) block_size 4096 (4096 B) rotational
49
2018-04-24 13:26:14.852399 7fcdedeafe00  1 bluestore(/var/lib/ceph/osd/ceph-574) _set_cache_sizes max 0.5 < ratio 0.99
50
2018-04-24 13:26:14.852421 7fcdedeafe00  1 bluestore(/var/lib/ceph/osd/ceph-574) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0
51
2018-04-24 13:26:14.852426 7fcdedeafe00  1 bdev(0x55b5437e0d80 /var/lib/ceph/osd/ceph-574/block) close
52
2018-04-24 13:26:15.049694 7fcdedeafe00  1 bluestore(/var/lib/ceph/osd/ceph-574) _mount path /var/lib/ceph/osd/ceph-574
53
2018-04-24 13:26:15.049910 7fcdedeafe00  1 bdev create path /var/lib/ceph/osd/ceph-574/block type kernel
54
2018-04-24 13:26:15.049917 7fcdedeafe00  1 bdev(0x55b5437e0fc0 /var/lib/ceph/osd/ceph-574/block) open path /var/lib/ceph/osd/ceph-574/block
55
2018-04-24 13:26:15.050151 7fcdedeafe00  1 bdev(0x55b5437e0fc0 /var/lib/ceph/osd/ceph-574/block) open size 8001457295360 (0x746fc051000, 7451 GB) block_size 4096 (4096 B) rotational
56
2018-04-24 13:26:15.050313 7fcdedeafe00  1 bluestore(/var/lib/ceph/osd/ceph-574) _set_cache_sizes max 0.5 < ratio 0.99
57
2018-04-24 13:26:15.050327 7fcdedeafe00  1 bluestore(/var/lib/ceph/osd/ceph-574) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0
58
2018-04-24 13:26:15.050720 7fcdedeafe00  1 bdev create path /var/lib/ceph/osd/ceph-574/block.db type kernel
59
2018-04-24 13:26:15.050729 7fcdedeafe00  1 bdev(0x55b5437e1200 /var/lib/ceph/osd/ceph-574/block.db) open path /var/lib/ceph/osd/ceph-574/block.db
60
2018-04-24 13:26:15.050921 7fcdedeafe00  1 bdev(0x55b5437e1200 /var/lib/ceph/osd/ceph-574/block.db) open size 8589934592 (0x200000000, 8192 MB) block_size 4096 (4096 B) non-rotational
61
2018-04-24 13:26:15.050929 7fcdedeafe00  1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-574/block.db size 8192 MB
62
2018-04-24 13:26:15.052301 7fcdedeafe00  1 bdev create path /var/lib/ceph/osd/ceph-574/block type kernel
63
2018-04-24 13:26:15.052312 7fcdedeafe00  1 bdev(0x55b5437e1440 /var/lib/ceph/osd/ceph-574/block) open path /var/lib/ceph/osd/ceph-574/block
64
2018-04-24 13:26:15.052567 7fcdedeafe00  1 bdev(0x55b5437e1440 /var/lib/ceph/osd/ceph-574/block) open size 8001457295360 (0x746fc051000, 7451 GB) block_size 4096 (4096 B) rotational
65
2018-04-24 13:26:15.052575 7fcdedeafe00  1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-574/block size 7451 GB
66
2018-04-24 13:26:15.052614 7fcdedeafe00  1 bdev create path /var/lib/ceph/osd/ceph-574/block.wal type kernel
67
2018-04-24 13:26:15.052621 7fcdedeafe00  1 bdev(0x55b5437e1680 /var/lib/ceph/osd/ceph-574/block.wal) open path /var/lib/ceph/osd/ceph-574/block.wal
68
2018-04-24 13:26:15.052787 7fcdedeafe00  1 bdev(0x55b5437e1680 /var/lib/ceph/osd/ceph-574/block.wal) open size 2147483648 (0x80000000, 2048 MB) block_size 4096 (4096 B) non-rotational
69
2018-04-24 13:26:15.052795 7fcdedeafe00  1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-574/block.wal size 2048 MB
70
2018-04-24 13:26:15.053338 7fcdedeafe00  1 bluefs mount
71
2018-04-24 13:26:49.620824 7fcdedeafe00 -1 /build/ceph-12.2.4/src/os/bluestore/BlueFS.cc: In function 'int BlueFS::_replay(bool)' thread 7fcdedeafe00 time 2018-04-24 13:26:49.617550
72
/build/ceph-12.2.4/src/os/bluestore/BlueFS.cc: 551: FAILED assert((log_reader->buf.pos & ~super.block_mask()) == 0)