2017-11-15 15:56:39.147143 7f662a3ece00 0 set uid:gid to 0:0 (root:root) 2017-11-15 15:56:39.147178 7f662a3ece00 0 ceph version 12.2.1 (3e7492b9ada8bdc9a5cd0feafd42fbca27f9c38e) luminous (stable), process (unknown), pid 325 starting osd.0 at - osd_data /var/lib/ceph/osd/ceph-0 /var/lib/ceph/osd/ceph-0/journal 2017-11-15 15:56:39.242226 7f662a3ece00 0 pidfile_write: ignore empty --pid-file 2017-11-15 15:56:39.249073 7f662a3ece00 0 load: jerasure load: lrc load: isa 2017-11-15 15:56:39.249658 7f662a3ece00 1 bdev create path /var/lib/ceph/osd/ceph-0/block type kernel 2017-11-15 15:56:39.249684 7f662a3ece00 1 bdev(0x560c8adf4900 /var/lib/ceph/osd/ceph-0/block) open path /var/lib/ceph/osd/ceph-0/block 2017-11-15 15:56:39.250467 7f662a3ece00 1 bdev(0x560c8adf4900 /var/lib/ceph/osd/ceph-0/block) open size 66935828480 (0xf95afb000, 63834 MB) block_size 4096 (4096 B) rotational 2017-11-15 15:56:39.294373 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _set_cache_sizes max 0.5 < ratio 0.99 2017-11-15 15:56:39.294441 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 2017-11-15 15:56:39.294451 7f662a3ece00 1 bdev(0x560c8adf4900 /var/lib/ceph/osd/ceph-0/block) close 2017-11-15 15:56:39.509736 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _mount path /var/lib/ceph/osd/ceph-0 2017-11-15 15:56:39.510170 7f662a3ece00 1 bdev create path /var/lib/ceph/osd/ceph-0/block type kernel 2017-11-15 15:56:39.510287 7f662a3ece00 1 bdev(0x560c8adf4d80 /var/lib/ceph/osd/ceph-0/block) open path /var/lib/ceph/osd/ceph-0/block 2017-11-15 15:56:39.510824 7f662a3ece00 1 bdev(0x560c8adf4d80 /var/lib/ceph/osd/ceph-0/block) open size 66935828480 (0xf95afb000, 63834 MB) block_size 4096 (4096 B) rotational 2017-11-15 15:56:39.538834 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _set_cache_sizes max 0.5 < ratio 0.99 2017-11-15 15:56:39.538900 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _set_cache_sizes cache_size 1073741824 meta 0.5 kv 0.5 data 0 2017-11-15 15:56:39.563546 7f662a3ece00 1 bdev create path /var/lib/ceph/osd/ceph-0/block.db type kernel 2017-11-15 15:56:39.563579 7f662a3ece00 1 bdev(0x560c8adf4fc0 /var/lib/ceph/osd/ceph-0/block.db) open path /var/lib/ceph/osd/ceph-0/block.db 2017-11-15 15:56:39.564496 7f662a3ece00 1 bdev(0x560c8adf4fc0 /var/lib/ceph/osd/ceph-0/block.db) open size 1073741824 (0x40000000, 1024 MB) block_size 4096 (4096 B) rotational 2017-11-15 15:56:39.564568 7f662a3ece00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-0/block.db size 1024 MB 2017-11-15 15:56:39.574179 7f662a3ece00 1 bdev create path /var/lib/ceph/osd/ceph-0/block type kernel 2017-11-15 15:56:39.574206 7f662a3ece00 1 bdev(0x560c8adf5200 /var/lib/ceph/osd/ceph-0/block) open path /var/lib/ceph/osd/ceph-0/block 2017-11-15 15:56:39.574582 7f662a3ece00 1 bdev(0x560c8adf5200 /var/lib/ceph/osd/ceph-0/block) open size 66935828480 (0xf95afb000, 63834 MB) block_size 4096 (4096 B) rotational 2017-11-15 15:56:39.574591 7f662a3ece00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-0/block size 63834 MB 2017-11-15 15:56:39.574716 7f662a3ece00 1 bdev create path /var/lib/ceph/osd/ceph-0/block.wal type kernel 2017-11-15 15:56:39.574729 7f662a3ece00 1 bdev(0x560c8adf5440 /var/lib/ceph/osd/ceph-0/block.wal) open path /var/lib/ceph/osd/ceph-0/block.wal 2017-11-15 15:56:39.575348 7f662a3ece00 1 bdev(0x560c8adf5440 /var/lib/ceph/osd/ceph-0/block.wal) open size 603979776 (0x24000000, 576 MB) block_size 4096 (4096 B) rotational 2017-11-15 15:56:39.576360 7f662a3ece00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-0/block.wal size 576 MB 2017-11-15 15:56:39.600991 7f662a3ece00 1 bluefs mount 2017-11-15 15:56:39.815492 7f662a3ece00 0 set rocksdb option compaction_readahead_size = 2097152 2017-11-15 15:56:39.815521 7f662a3ece00 0 set rocksdb option compression = kNoCompression 2017-11-15 15:56:39.815526 7f662a3ece00 0 set rocksdb option max_write_buffer_number = 4 2017-11-15 15:56:39.815530 7f662a3ece00 0 set rocksdb option min_write_buffer_number_to_merge = 1 2017-11-15 15:56:39.815533 7f662a3ece00 0 set rocksdb option recycle_log_file_num = 4 2017-11-15 15:56:39.815537 7f662a3ece00 0 set rocksdb option writable_file_max_buffer_size = 0 2017-11-15 15:56:39.815541 7f662a3ece00 0 set rocksdb option write_buffer_size = 268435456 2017-11-15 15:56:39.815563 7f662a3ece00 0 set rocksdb option compaction_readahead_size = 2097152 2017-11-15 15:56:39.815573 7f662a3ece00 0 set rocksdb option compression = kNoCompression 2017-11-15 15:56:39.815577 7f662a3ece00 0 set rocksdb option max_write_buffer_number = 4 2017-11-15 15:56:39.815580 7f662a3ece00 0 set rocksdb option min_write_buffer_number_to_merge = 1 2017-11-15 15:56:39.815583 7f662a3ece00 0 set rocksdb option recycle_log_file_num = 4 2017-11-15 15:56:39.815586 7f662a3ece00 0 set rocksdb option writable_file_max_buffer_size = 0 2017-11-15 15:56:39.815588 7f662a3ece00 0 set rocksdb option write_buffer_size = 268435456 2017-11-15 15:56:39.815745 7f662a3ece00 4 rocksdb: RocksDB version: 5.4.0 2017-11-15 15:56:39.815760 7f662a3ece00 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2017-11-15 15:56:39.815761 7f662a3ece00 4 rocksdb: Compile date Sep 26 2017 2017-11-15 15:56:39.815765 7f662a3ece00 4 rocksdb: DB SUMMARY 2017-11-15 15:56:39.815780 7f662a3ece00 4 rocksdb: CURRENT file: CURRENT 2017-11-15 15:56:39.815782 7f662a3ece00 4 rocksdb: IDENTITY file: IDENTITY 2017-11-15 15:56:39.815794 7f662a3ece00 4 rocksdb: MANIFEST file: MANIFEST-000033 size: 445 Bytes 2017-11-15 15:56:39.815803 7f662a3ece00 4 rocksdb: SST files in db dir, Total Num: 4, files: 000023.sst 000026.sst 000029.sst 000032.sst 2017-11-15 15:56:39.815808 7f662a3ece00 4 rocksdb: SST files in db.slow dir, Total Num: 2, files: 000021.sst 000037.sst 2017-11-15 15:56:39.815815 7f662a3ece00 4 rocksdb: Write Ahead Log file in db.wal: 000034.log size: 9004 ; 2017-11-15 15:56:39.815819 7f662a3ece00 4 rocksdb: Options.error_if_exists: 0 2017-11-15 15:56:39.815821 7f662a3ece00 4 rocksdb: Options.create_if_missing: 0 2017-11-15 15:56:39.815822 7f662a3ece00 4 rocksdb: Options.paranoid_checks: 1 2017-11-15 15:56:39.815824 7f662a3ece00 4 rocksdb: Options.env: 0x560c8b1552e0 2017-11-15 15:56:39.815826 7f662a3ece00 4 rocksdb: Options.info_log: 0x560c8b155800 2017-11-15 15:56:39.815827 7f662a3ece00 4 rocksdb: Options.max_open_files: -1 2017-11-15 15:56:39.815828 7f662a3ece00 4 rocksdb: Options.max_file_opening_threads: 16 2017-11-15 15:56:39.815829 7f662a3ece00 4 rocksdb: Options.use_fsync: 0 2017-11-15 15:56:39.815830 7f662a3ece00 4 rocksdb: Options.max_log_file_size: 0 2017-11-15 15:56:39.815830 7f662a3ece00 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615 2017-11-15 15:56:39.815831 7f662a3ece00 4 rocksdb: Options.log_file_time_to_roll: 0 2017-11-15 15:56:39.815833 7f662a3ece00 4 rocksdb: Options.keep_log_file_num: 1000 2017-11-15 15:56:39.815833 7f662a3ece00 4 rocksdb: Options.recycle_log_file_num: 4 2017-11-15 15:56:39.815834 7f662a3ece00 4 rocksdb: Options.allow_fallocate: 1 2017-11-15 15:56:39.815834 7f662a3ece00 4 rocksdb: Options.allow_mmap_reads: 0 2017-11-15 15:56:39.815835 7f662a3ece00 4 rocksdb: Options.allow_mmap_writes: 0 2017-11-15 15:56:39.815835 7f662a3ece00 4 rocksdb: Options.use_direct_reads: 0 2017-11-15 15:56:39.815836 7f662a3ece00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2017-11-15 15:56:39.815836 7f662a3ece00 4 rocksdb: Options.create_missing_column_families: 0 2017-11-15 15:56:39.815837 7f662a3ece00 4 rocksdb: Options.db_log_dir: 2017-11-15 15:56:39.815838 7f662a3ece00 4 rocksdb: Options.wal_dir: db.wal 2017-11-15 15:56:39.815838 7f662a3ece00 4 rocksdb: Options.table_cache_numshardbits: 6 2017-11-15 15:56:39.815839 7f662a3ece00 4 rocksdb: Options.max_subcompactions: 1 2017-11-15 15:56:39.815840 7f662a3ece00 4 rocksdb: Options.max_background_flushes: 1 2017-11-15 15:56:39.815841 7f662a3ece00 4 rocksdb: Options.WAL_ttl_seconds: 0 2017-11-15 15:56:39.815841 7f662a3ece00 4 rocksdb: Options.WAL_size_limit_MB: 0 2017-11-15 15:56:39.815843 7f662a3ece00 4 rocksdb: Options.manifest_preallocation_size: 4194304 2017-11-15 15:56:39.815843 7f662a3ece00 4 rocksdb: Options.is_fd_close_on_exec: 1 2017-11-15 15:56:39.815844 7f662a3ece00 4 rocksdb: Options.advise_random_on_open: 1 2017-11-15 15:56:39.815844 7f662a3ece00 4 rocksdb: Options.db_write_buffer_size: 0 2017-11-15 15:56:39.815845 7f662a3ece00 4 rocksdb: Options.access_hint_on_compaction_start: 1 2017-11-15 15:56:39.815845 7f662a3ece00 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1 2017-11-15 15:56:39.815846 7f662a3ece00 4 rocksdb: Options.compaction_readahead_size: 2097152 2017-11-15 15:56:39.815846 7f662a3ece00 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2017-11-15 15:56:39.815847 7f662a3ece00 4 rocksdb: Options.writable_file_max_buffer_size: 0 2017-11-15 15:56:39.815847 7f662a3ece00 4 rocksdb: Options.use_adaptive_mutex: 0 2017-11-15 15:56:39.815855 7f662a3ece00 4 rocksdb: Options.rate_limiter: (nil) 2017-11-15 15:56:39.815856 7f662a3ece00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2017-11-15 15:56:39.815857 7f662a3ece00 4 rocksdb: Options.bytes_per_sync: 0 2017-11-15 15:56:39.815857 7f662a3ece00 4 rocksdb: Options.wal_bytes_per_sync: 0 2017-11-15 15:56:39.815858 7f662a3ece00 4 rocksdb: Options.wal_recovery_mode: 0 2017-11-15 15:56:39.815858 7f662a3ece00 4 rocksdb: Options.enable_thread_tracking: 0 2017-11-15 15:56:39.815859 7f662a3ece00 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2017-11-15 15:56:39.815859 7f662a3ece00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2017-11-15 15:56:39.815860 7f662a3ece00 4 rocksdb: Options.write_thread_max_yield_usec: 100 2017-11-15 15:56:39.815860 7f662a3ece00 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2017-11-15 15:56:39.815861 7f662a3ece00 4 rocksdb: Options.row_cache: None 2017-11-15 15:56:39.815861 7f662a3ece00 4 rocksdb: Options.wal_filter: None 2017-11-15 15:56:39.815862 7f662a3ece00 4 rocksdb: Options.avoid_flush_during_recovery: 0 2017-11-15 15:56:39.815863 7f662a3ece00 4 rocksdb: Options.base_background_compactions: 1 2017-11-15 15:56:39.815863 7f662a3ece00 4 rocksdb: Options.max_background_compactions: 1 2017-11-15 15:56:39.815864 7f662a3ece00 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2017-11-15 15:56:39.815864 7f662a3ece00 4 rocksdb: Options.delayed_write_rate : 16777216 2017-11-15 15:56:39.815865 7f662a3ece00 4 rocksdb: Options.max_total_wal_size: 0 2017-11-15 15:56:39.815867 7f662a3ece00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2017-11-15 15:56:39.815868 7f662a3ece00 4 rocksdb: Options.stats_dump_period_sec: 600 2017-11-15 15:56:39.815869 7f662a3ece00 4 rocksdb: Compression algorithms supported: 2017-11-15 15:56:39.815870 7f662a3ece00 4 rocksdb: Snappy supported: 0 2017-11-15 15:56:39.815871 7f662a3ece00 4 rocksdb: Zlib supported: 0 2017-11-15 15:56:39.815872 7f662a3ece00 4 rocksdb: Bzip supported: 0 2017-11-15 15:56:39.815873 7f662a3ece00 4 rocksdb: LZ4 supported: 0 2017-11-15 15:56:39.815874 7f662a3ece00 4 rocksdb: ZSTD supported: 0 2017-11-15 15:56:39.815876 7f662a3ece00 4 rocksdb: Fast CRC32 supported: 0 2017-11-15 15:56:39.867447 7f662a3ece00 4 rocksdb: [/build/ceph-12.2.1/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000033 2017-11-15 15:56:39.867584 7f662a3ece00 4 rocksdb: [/build/ceph-12.2.1/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]: 2017-11-15 15:56:39.867612 7f662a3ece00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2017-11-15 15:56:39.867628 7f662a3ece00 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor 2017-11-15 15:56:39.867633 7f662a3ece00 4 rocksdb: Options.compaction_filter: None 2017-11-15 15:56:39.867634 7f662a3ece00 4 rocksdb: Options.compaction_filter_factory: None 2017-11-15 15:56:39.867635 7f662a3ece00 4 rocksdb: Options.memtable_factory: SkipListFactory 2017-11-15 15:56:39.867635 7f662a3ece00 4 rocksdb: Options.table_factory: BlockBasedTable 2017-11-15 15:56:39.867661 7f662a3ece00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560c8ad84168) cache_index_and_filter_blocks: 1 cache_index_and_filter_blocks_with_high_priority: 1 pin_l0_filter_and_index_blocks_in_cache: 1 index_type: 0 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x560c8b0770a0 block_cache_name: LRUCache block_cache_options: capacity : 536870912 num_shard_bits : 4 strict_capacity_limit : 0 high_pri_pool_ratio: 0.000 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 filter_policy: rocksdb.BuiltinBloomFilter whole_key_filtering: 1 format_version: 2 2017-11-15 15:56:39.867668 7f662a3ece00 4 rocksdb: Options.write_buffer_size: 268435456 2017-11-15 15:56:39.867669 7f662a3ece00 4 rocksdb: Options.max_write_buffer_number: 4 2017-11-15 15:56:39.867673 7f662a3ece00 4 rocksdb: Options.compression: NoCompression 2017-11-15 15:56:39.867674 7f662a3ece00 4 rocksdb: Options.bottommost_compression: Disabled 2017-11-15 15:56:39.867675 7f662a3ece00 4 rocksdb: Options.prefix_extractor: nullptr 2017-11-15 15:56:39.867676 7f662a3ece00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2017-11-15 15:56:39.867677 7f662a3ece00 4 rocksdb: Options.num_levels: 7 2017-11-15 15:56:39.867678 7f662a3ece00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2017-11-15 15:56:39.867679 7f662a3ece00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2017-11-15 15:56:39.867679 7f662a3ece00 4 rocksdb: Options.compression_opts.window_bits: -14 2017-11-15 15:56:39.867680 7f662a3ece00 4 rocksdb: Options.compression_opts.level: -1 2017-11-15 15:56:39.867680 7f662a3ece00 4 rocksdb: Options.compression_opts.strategy: 0 2017-11-15 15:56:39.867681 7f662a3ece00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2017-11-15 15:56:39.867681 7f662a3ece00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2017-11-15 15:56:39.867682 7f662a3ece00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2017-11-15 15:56:39.867683 7f662a3ece00 4 rocksdb: Options.level0_stop_writes_trigger: 36 2017-11-15 15:56:39.867683 7f662a3ece00 4 rocksdb: Options.target_file_size_base: 67108864 2017-11-15 15:56:39.867684 7f662a3ece00 4 rocksdb: Options.target_file_size_multiplier: 1 2017-11-15 15:56:39.867684 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2017-11-15 15:56:39.867685 7f662a3ece00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0 2017-11-15 15:56:39.867686 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2017-11-15 15:56:39.867689 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2017-11-15 15:56:39.867689 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2017-11-15 15:56:39.867690 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2017-11-15 15:56:39.867691 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2017-11-15 15:56:39.867691 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2017-11-15 15:56:39.867692 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2017-11-15 15:56:39.867692 7f662a3ece00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2017-11-15 15:56:39.867693 7f662a3ece00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2017-11-15 15:56:39.867693 7f662a3ece00 4 rocksdb: Options.max_compaction_bytes: 1677721600 2017-11-15 15:56:39.867703 7f662a3ece00 4 rocksdb: Options.arena_block_size: 33554432 2017-11-15 15:56:39.867704 7f662a3ece00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2017-11-15 15:56:39.867704 7f662a3ece00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2017-11-15 15:56:39.867705 7f662a3ece00 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2017-11-15 15:56:39.867705 7f662a3ece00 4 rocksdb: Options.disable_auto_compactions: 0 2017-11-15 15:56:39.867707 7f662a3ece00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2017-11-15 15:56:39.867708 7f662a3ece00 4 rocksdb: Options.compaction_pri: kByCompensatedSize 2017-11-15 15:56:39.867708 7f662a3ece00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2017-11-15 15:56:39.867709 7f662a3ece00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2017-11-15 15:56:39.867710 7f662a3ece00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2017-11-15 15:56:39.867710 7f662a3ece00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2017-11-15 15:56:39.867711 7f662a3ece00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2017-11-15 15:56:39.867711 7f662a3ece00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2017-11-15 15:56:39.867712 7f662a3ece00 4 rocksdb: Options.table_properties_collectors: 2017-11-15 15:56:39.867713 7f662a3ece00 4 rocksdb: Options.inplace_update_support: 0 2017-11-15 15:56:39.867713 7f662a3ece00 4 rocksdb: Options.inplace_update_num_locks: 10000 2017-11-15 15:56:39.867714 7f662a3ece00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2017-11-15 15:56:39.867715 7f662a3ece00 4 rocksdb: Options.memtable_huge_page_size: 0 2017-11-15 15:56:39.867715 7f662a3ece00 4 rocksdb: Options.bloom_locality: 0 2017-11-15 15:56:39.867716 7f662a3ece00 4 rocksdb: Options.max_successive_merges: 0 2017-11-15 15:56:39.867716 7f662a3ece00 4 rocksdb: Options.optimize_filters_for_hits: 0 2017-11-15 15:56:39.867717 7f662a3ece00 4 rocksdb: Options.paranoid_file_checks: 0 2017-11-15 15:56:39.867717 7f662a3ece00 4 rocksdb: Options.force_consistency_checks: 0 2017-11-15 15:56:39.867718 7f662a3ece00 4 rocksdb: Options.report_bg_io_stats: 0 2017-11-15 15:56:39.959195 7f662a3ece00 4 rocksdb: [/build/ceph-12.2.1/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:db/MANIFEST-000033 succeeded,manifest_file_number is 33, next_file_number is 39, last_sequence is 3043, log_number is 0,prev_log_number is 0,max_column_family is 0 2017-11-15 15:56:39.959222 7f662a3ece00 4 rocksdb: [/build/ceph-12.2.1/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 32 2017-11-15 15:56:39.959287 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761399959277, "job": 1, "event": "recovery_started", "log_files": [34]} 2017-11-15 15:56:39.959296 7f662a3ece00 4 rocksdb: [/build/ceph-12.2.1/src/rocksdb/db/db_impl_open.cc:482] Recovering log #34 mode 0 2017-11-15 15:56:40.024791 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761400024772, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 39, "file_size": 5966, "table_properties": {"data_size": 4700, "index_size": 59, "filter_size": 238, "raw_key_size": 3278, "raw_average_key_size": 36, "raw_value_size": 1959, "raw_average_value_size": 22, "num_data_blocks": 2, "num_entries": 89, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "20", "kMergeOperands": "0"}} 2017-11-15 15:56:40.025519 7f662a3ece00 4 rocksdb: [/build/ceph-12.2.1/src/rocksdb/db/version_set.cc:2395] Creating manifest 40 2017-11-15 15:56:40.052846 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761400052835, "job": 1, "event": "recovery_finished"} 2017-11-15 15:56:40.053728 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761400053724, "job": 2, "event": "table_file_deletion", "file_number": 32} 2017-11-15 15:56:40.053808 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761400053805, "job": 2, "event": "table_file_deletion", "file_number": 29} 2017-11-15 15:56:40.053857 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761400053855, "job": 2, "event": "table_file_deletion", "file_number": 26} 2017-11-15 15:56:40.053906 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761400053905, "job": 2, "event": "table_file_deletion", "file_number": 23} 2017-11-15 15:56:40.053969 7f662a3ece00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1510761400053967, "job": 2, "event": "table_file_deletion", "file_number": 21} 2017-11-15 15:56:40.222574 7f662a3ece00 4 rocksdb: [/build/ceph-12.2.1/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x560c8b084d00 2017-11-15 15:56:40.222775 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152 2017-11-15 15:56:40.277613 7f662a3ece00 1 freelist init 2017-11-15 15:56:40.298392 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _open_alloc opening allocation metadata 2017-11-15 15:56:40.298586 7f662a3ece00 1 bluestore(/var/lib/ceph/osd/ceph-0) _open_alloc loaded 63830 M in 2 extents 2017-11-15 15:56:40.384980 7f662a3ece00 0 /build/ceph-12.2.1/src/cls/hello/cls_hello.cc:296: loading cls_hello 2017-11-15 15:56:40.386080 7f662a3ece00 0 _get_class not permitted to load sdk 2017-11-15 15:56:40.387424 7f662a3ece00 0 /build/ceph-12.2.1/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs 2017-11-15 15:56:40.388240 7f662a3ece00 0 _get_class not permitted to load kvs 2017-11-15 15:56:40.388288 7f662a3ece00 0 _get_class not permitted to load lua 2017-11-15 15:56:40.388334 7f662a3ece00 1 osd.0 0 warning: got an error loading one or more classes: (1) Operation not permitted 2017-11-15 15:56:40.474037 7f662a3ece00 0 osd.0 35 crush map has features 288514051259236352, adjusting msgr requires for clients 2017-11-15 15:56:40.474114 7f662a3ece00 0 osd.0 35 crush map has features 288514051259236352 was 8705, adjusting msgr requires for mons 2017-11-15 15:56:40.474131 7f662a3ece00 0 osd.0 35 crush map has features 1009089991638532096, adjusting msgr requires for osds 2017-11-15 15:56:40.492647 7f662a3ece00 0 osd.0 35 load_pgs 2017-11-15 15:56:41.835728 7f662a3ece00 0 osd.0 35 load_pgs opened 67 pgs 2017-11-15 15:56:41.836494 7f662a3ece00 0 osd.0 35 using weightedpriority op queue with priority op cut off at 64. 2017-11-15 15:56:41.838605 7f662a3ece00 -1 osd.0 35 log_to_monitors {default=true} 2017-11-15 15:56:43.375251 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.5a( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.375735 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.26( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,3,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.400096 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.47( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,0,2] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.400152 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.7f( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,1,3] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.400267 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.74( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,0,1] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.400293 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.58( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,0,2] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.400378 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.59( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,1] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.400426 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.65( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.400445 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.48( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,1,4] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.400548 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.4( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,0,2] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.400597 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.2c( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.400657 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.4e( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,3,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.401389 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.5d( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,3,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.401584 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.16( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,0,1] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.401724 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.79( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,1,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.401956 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.1b( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,0,3] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.402141 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.66( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.402283 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.39( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.402839 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.68( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,0,3] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.403139 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.1f( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,3,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.403360 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.70( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.403830 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.43( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,3,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.404306 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.27( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.404511 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.71( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,1,4] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.404955 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.e( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,3] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.405230 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.6c( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,0,4] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.405582 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.77( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,3,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.405596 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.4b( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,0,3] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.405761 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.45( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,0,1] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.405892 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.3e( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,0,4] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.405906 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.19( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406052 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.31( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,1,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.406056 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.75( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406177 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.3b( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,0,4] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406250 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.49( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.406253 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.63( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406345 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.44( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406427 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.0( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,0,2] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406433 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.3( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406489 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.51( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,1,3] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.406586 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.37( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406582 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.2b( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406639 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.23( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,3,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.406675 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.6e( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,2,1] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.406735 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.36( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,0,4] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.406790 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.24( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,3] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.406884 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.10( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407025 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.7d( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407036 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.29( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407120 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.1a( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407172 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.56( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407200 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.20( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407330 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.2a( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,0,2] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407353 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.6a( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407441 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.b( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,3,2] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.407469 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.22( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,0,3] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407627 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.2f( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,3] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.407716 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.a( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [1,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407802 7f660fd3e700 1 osd.0 pg_epoch: 35 pg[1.6d( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.407992 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.13( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,2,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.408177 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.72( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,3,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.408334 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.18( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [4,0,1] r=1 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.408481 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.3a( v 34'2 (0'0,34'2] local-lis/les=29/30 n=1 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,2,1] r=0 lpr=34 crt=34'2 lcod 0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.408708 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.4a( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [3,4,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.408880 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.7c( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,4,1] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.409100 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.1d( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [2,1,0] r=2 lpr=30 crt=0'0 unknown NOTIFY] state: transitioning to Stray 2017-11-15 15:56:43.409209 7f661053f700 1 osd.0 pg_epoch: 35 pg[1.60( empty local-lis/les=29/30 n=0 ec=29/29 lis/c 29/29 les/c/f 30/30/0 29/29/29) [0,2,1] r=0 lpr=34 crt=0'0 mlcod 0'0 unknown] state: transitioning to Primary 2017-11-15 15:56:43.409306 7f662a3ece00 0 osd.0 35 done with init, starting boot process 2017-11-15 15:56:43.409355 7f662a3ece00 1 osd.0 35 start_boot