2017-01-24 11:35:16.774040 7f051969a940 -1 WARNING: the following dangerous and experimental features are enabled: bluestore 2017-01-24 11:35:16.774408 7f051969a940 -1 WARNING: the following dangerous and experimental features are enabled: bluestore 2017-01-24 11:35:16.774425 7f051969a940 0 set uid:gid to 64045:64045 (ceph:) 2017-01-24 11:35:16.774443 7f051969a940 0 ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7), process ceph-osd, pid 4941 2017-01-24 11:35:16.774540 7f051969a940 -1 WARNING: experimental feature 'bluestore' is enabled Please be aware that this feature is experimental, untested, unsupported, and may result in data corruption, data loss, and/or irreparable damage to your cluster. Do not use feature with important data. starting osd.1 at - osd_data /var/lib/ceph/osd/osd.1 /var/lib/ceph/osd/ceph-1/journal 2017-01-24 11:35:16.777097 7f051969a940 0 pidfile_write: ignore empty --pid-file 2017-01-24 11:35:16.780186 7f051969a940 -1 WARNING: the following dangerous and experimental features are enabled: bluestore 2017-01-24 11:35:16.793700 7f051969a940 0 load: jerasure load: lrc load: isa 2017-01-24 11:35:16.794476 7f051969a940 1 bluestore(/var/lib/ceph/osd/osd.1) mount path /var/lib/ceph/osd/osd.1 2017-01-24 11:35:16.794547 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block type kernel 2017-01-24 11:35:16.795405 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open path /var/lib/ceph/osd/osd.1/block 2017-01-24 11:35:16.795774 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open size 12174995456 (0x2d5afb000, 11610 MB) block_size 4096 (4096 B) rotational 2017-01-24 11:35:16.796325 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block.db type kernel 2017-01-24 11:35:16.797250 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.db) open path /var/lib/ceph/osd/osd.1/block.db 2017-01-24 11:35:16.797613 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.db) open size 21474836480 (0x500000000, 20480 MB) block_size 4096 (4096 B) rotational 2017-01-24 11:35:16.797635 7f051969a940 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/osd.1/block.db size 20480 MB 2017-01-24 11:35:16.797885 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block type kernel 2017-01-24 11:35:16.798729 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open path /var/lib/ceph/osd/osd.1/block 2017-01-24 11:35:16.798983 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open size 12174995456 (0x2d5afb000, 11610 MB) block_size 4096 (4096 B) rotational 2017-01-24 11:35:16.799153 7f051969a940 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/osd.1/block size 11610 MB 2017-01-24 11:35:16.799204 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block.wal type kernel 2017-01-24 11:35:16.800085 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.wal) open path /var/lib/ceph/osd/osd.1/block.wal 2017-01-24 11:35:16.800630 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.wal) open size 603979776 (0x24000000, 576 MB) block_size 4096 (4096 B) rotational 2017-01-24 11:35:16.800646 7f051969a940 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/osd.1/block.wal size 576 MB 2017-01-24 11:35:16.800913 7f051969a940 1 bluefs mount 2017-01-24 11:35:16.818771 7f051969a940 0 set rocksdb option compression = kNoCompression 2017-01-24 11:35:16.818805 7f051969a940 0 set rocksdb option max_write_buffer_number = 4 2017-01-24 11:35:16.818815 7f051969a940 0 set rocksdb option min_write_buffer_number_to_merge = 1 2017-01-24 11:35:16.818830 7f051969a940 0 set rocksdb option recycle_log_file_num = 4 2017-01-24 11:35:16.818839 7f051969a940 0 set rocksdb option write_buffer_size = 268435456 2017-01-24 11:35:16.818933 7f051969a940 0 set rocksdb option compression = kNoCompression 2017-01-24 11:35:16.818946 7f051969a940 0 set rocksdb option max_write_buffer_number = 4 2017-01-24 11:35:16.818955 7f051969a940 0 set rocksdb option min_write_buffer_number_to_merge = 1 2017-01-24 11:35:16.818962 7f051969a940 0 set rocksdb option recycle_log_file_num = 4 2017-01-24 11:35:16.818970 7f051969a940 0 set rocksdb option write_buffer_size = 268435456 2017-01-24 11:35:16.819181 7f051969a940 4 rocksdb: RocksDB version: 5.0.0 2017-01-24 11:35:16.819204 7f051969a940 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2017-01-24 11:35:16.819207 7f051969a940 4 rocksdb: Compile date Jan 19 2017 2017-01-24 11:35:16.819209 7f051969a940 4 rocksdb: DB SUMMARY 2017-01-24 11:35:16.819223 7f051969a940 4 rocksdb: CURRENT file: CURRENT 2017-01-24 11:35:16.819226 7f051969a940 4 rocksdb: IDENTITY file: IDENTITY 2017-01-24 11:35:16.819235 7f051969a940 4 rocksdb: MANIFEST file: MANIFEST-000257 size: 445 Bytes 2017-01-24 11:35:16.819242 7f051969a940 4 rocksdb: SST files in db dir, Total Num: 6, files: 000245.sst 000247.sst 000250.sst 000253.sst 000256.sst 000261.sst 2017-01-24 11:35:16.819252 7f051969a940 4 rocksdb: SST files in db.slow dir, Total Num: 6, files: 000245.sst 000247.sst 000250.sst 000253.sst 000256.sst 000261.sst 2017-01-24 11:35:16.819265 7f051969a940 4 rocksdb: Write Ahead Log file in db.wal: 000258.log size: 3546 ; 2017-01-24 11:35:16.819270 7f051969a940 4 rocksdb: Options.error_if_exists: 0 2017-01-24 11:35:16.819272 7f051969a940 4 rocksdb: Options.create_if_missing: 0 2017-01-24 11:35:16.819274 7f051969a940 4 rocksdb: Options.paranoid_checks: 1 2017-01-24 11:35:16.819276 7f051969a940 4 rocksdb: Options.env: 0x564789497000 2017-01-24 11:35:16.819278 7f051969a940 4 rocksdb: Options.info_log: 0x564789497420 2017-01-24 11:35:16.819280 7f051969a940 4 rocksdb: Options.max_open_files: -1 2017-01-24 11:35:16.819282 7f051969a940 4 rocksdb: Options.max_file_opening_threads: 16 2017-01-24 11:35:16.819284 7f051969a940 4 rocksdb: Options.disableDataSync: 0 2017-01-24 11:35:16.819285 7f051969a940 4 rocksdb: Options.use_fsync: 0 2017-01-24 11:35:16.819287 7f051969a940 4 rocksdb: Options.max_log_file_size: 0 2017-01-24 11:35:16.819290 7f051969a940 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615 2017-01-24 11:35:16.819291 7f051969a940 4 rocksdb: Options.log_file_time_to_roll: 0 2017-01-24 11:35:16.819295 7f051969a940 4 rocksdb: Options.keep_log_file_num: 1000 2017-01-24 11:35:16.819296 7f051969a940 4 rocksdb: Options.recycle_log_file_num: 4 2017-01-24 11:35:16.819299 7f051969a940 4 rocksdb: Options.allow_os_buffer: 1 2017-01-24 11:35:16.819300 7f051969a940 4 rocksdb: Options.allow_mmap_reads: 0 2017-01-24 11:35:16.819302 7f051969a940 4 rocksdb: Options.allow_fallocate: 1 2017-01-24 11:35:16.819304 7f051969a940 4 rocksdb: Options.allow_mmap_writes: 0 2017-01-24 11:35:16.819305 7f051969a940 4 rocksdb: Options.use_direct_reads: 0 2017-01-24 11:35:16.819307 7f051969a940 4 rocksdb: Options.create_missing_column_families: 0 2017-01-24 11:35:16.819309 7f051969a940 4 rocksdb: Options.db_log_dir: 2017-01-24 11:35:16.819311 7f051969a940 4 rocksdb: Options.wal_dir: db.wal 2017-01-24 11:35:16.819313 7f051969a940 4 rocksdb: Options.table_cache_numshardbits: 6 2017-01-24 11:35:16.819315 7f051969a940 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2017-01-24 11:35:16.819317 7f051969a940 4 rocksdb: Options.max_subcompactions: 1 2017-01-24 11:35:16.819319 7f051969a940 4 rocksdb: Options.max_background_flushes: 1 2017-01-24 11:35:16.819321 7f051969a940 4 rocksdb: Options.WAL_ttl_seconds: 0 2017-01-24 11:35:16.819322 7f051969a940 4 rocksdb: Options.WAL_size_limit_MB: 0 2017-01-24 11:35:16.819325 7f051969a940 4 rocksdb: Options.manifest_preallocation_size: 4194304 2017-01-24 11:35:16.819327 7f051969a940 4 rocksdb: Options.allow_os_buffer: 1 2017-01-24 11:35:16.819328 7f051969a940 4 rocksdb: Options.allow_mmap_reads: 0 2017-01-24 11:35:16.819330 7f051969a940 4 rocksdb: Options.allow_mmap_writes: 0 2017-01-24 11:35:16.819333 7f051969a940 4 rocksdb: Options.is_fd_close_on_exec: 1 2017-01-24 11:35:16.819336 7f051969a940 4 rocksdb: Options.stats_dump_period_sec: 600 2017-01-24 11:35:16.819338 7f051969a940 4 rocksdb: Options.advise_random_on_open: 1 2017-01-24 11:35:16.819340 7f051969a940 4 rocksdb: Options.db_write_buffer_size: 0 2017-01-24 11:35:16.819342 7f051969a940 4 rocksdb: Options.access_hint_on_compaction_start: 1 2017-01-24 11:35:16.819344 7f051969a940 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2017-01-24 11:35:16.819345 7f051969a940 4 rocksdb: Options.compaction_readahead_size: 0 2017-01-24 11:35:16.819347 7f051969a940 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2017-01-24 11:35:16.819349 7f051969a940 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2017-01-24 11:35:16.819351 7f051969a940 4 rocksdb: Options.use_adaptive_mutex: 0 2017-01-24 11:35:16.819353 7f051969a940 4 rocksdb: Options.rate_limiter: (nil) 2017-01-24 11:35:16.819355 7f051969a940 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2017-01-24 11:35:16.819357 7f051969a940 4 rocksdb: Options.bytes_per_sync: 0 2017-01-24 11:35:16.819359 7f051969a940 4 rocksdb: Options.wal_bytes_per_sync: 0 2017-01-24 11:35:16.819361 7f051969a940 4 rocksdb: Options.wal_recovery_mode: 0 2017-01-24 11:35:16.819362 7f051969a940 4 rocksdb: Options.enable_thread_tracking: 0 2017-01-24 11:35:16.819369 7f051969a940 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2017-01-24 11:35:16.819371 7f051969a940 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2017-01-24 11:35:16.819373 7f051969a940 4 rocksdb: Options.write_thread_max_yield_usec: 100 2017-01-24 11:35:16.819375 7f051969a940 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2017-01-24 11:35:16.819376 7f051969a940 4 rocksdb: Options.row_cache: None 2017-01-24 11:35:16.819378 7f051969a940 4 rocksdb: Options.wal_filter: None 2017-01-24 11:35:16.819380 7f051969a940 4 rocksdb: Options.avoid_flush_during_recovery: 0 2017-01-24 11:35:16.819382 7f051969a940 4 rocksdb: Options.base_background_compactions: 1 2017-01-24 11:35:16.819384 7f051969a940 4 rocksdb: Options.max_background_compactions: 1 2017-01-24 11:35:16.819386 7f051969a940 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2017-01-24 11:35:16.819387 7f051969a940 4 rocksdb: Options.delayed_write_rate : 2097152 2017-01-24 11:35:16.819389 7f051969a940 4 rocksdb: Options.max_total_wal_size: 0 2017-01-24 11:35:16.819391 7f051969a940 4 rocksdb: Compression algorithms supported: 2017-01-24 11:35:16.819393 7f051969a940 4 rocksdb: Snappy supported: 0 2017-01-24 11:35:16.819395 7f051969a940 4 rocksdb: Zlib supported: 0 2017-01-24 11:35:16.819397 7f051969a940 4 rocksdb: Bzip supported: 0 2017-01-24 11:35:16.819398 7f051969a940 4 rocksdb: LZ4 supported: 0 2017-01-24 11:35:16.819400 7f051969a940 4 rocksdb: ZSTD supported: 0 2017-01-24 11:35:16.819402 7f051969a940 4 rocksdb: Fast CRC32 supported: 0 2017-01-24 11:35:16.819630 7f051969a940 4 rocksdb: Recovering from manifest file: MANIFEST-000257 2017-01-24 11:35:16.819713 7f051969a940 4 rocksdb: --------------- Options for column family [default]: 2017-01-24 11:35:16.819716 7f051969a940 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2017-01-24 11:35:16.819723 7f051969a940 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor 2017-01-24 11:35:16.819725 7f051969a940 4 rocksdb: Options.compaction_filter: None 2017-01-24 11:35:16.819727 7f051969a940 4 rocksdb: Options.compaction_filter_factory: None 2017-01-24 11:35:16.819730 7f051969a940 4 rocksdb: Options.memtable_factory: SkipListFactory 2017-01-24 11:35:16.819732 7f051969a940 4 rocksdb: Options.table_factory: BlockBasedTable 2017-01-24 11:35:16.819747 7f051969a940 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56478924c270) cache_index_and_filter_blocks: 0 pin_l0_filter_and_index_blocks_in_cache: 0 index_type: 0 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x564789287260 block_cache_size: 134217728 block_cache_compressed: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 filter_policy: nullptr whole_key_filtering: 1 skip_table_builder_flush: 0 format_version: 2 2017-01-24 11:35:16.819755 7f051969a940 4 rocksdb: Options.write_buffer_size: 268435456 2017-01-24 11:35:16.819757 7f051969a940 4 rocksdb: Options.max_write_buffer_number: 4 2017-01-24 11:35:16.819760 7f051969a940 4 rocksdb: Options.compression: NoCompression 2017-01-24 11:35:16.819762 7f051969a940 4 rocksdb: Options.bottommost_compression: Disabled 2017-01-24 11:35:16.819764 7f051969a940 4 rocksdb: Options.prefix_extractor: nullptr 2017-01-24 11:35:16.819766 7f051969a940 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2017-01-24 11:35:16.819767 7f051969a940 4 rocksdb: Options.num_levels: 7 2017-01-24 11:35:16.819769 7f051969a940 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2017-01-24 11:35:16.819771 7f051969a940 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2017-01-24 11:35:16.819773 7f051969a940 4 rocksdb: Options.compression_opts.window_bits: -14 2017-01-24 11:35:16.819774 7f051969a940 4 rocksdb: Options.compression_opts.level: -1 2017-01-24 11:35:16.819776 7f051969a940 4 rocksdb: Options.compression_opts.strategy: 0 2017-01-24 11:35:16.819778 7f051969a940 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2017-01-24 11:35:16.819780 7f051969a940 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2017-01-24 11:35:16.819781 7f051969a940 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2017-01-24 11:35:16.819783 7f051969a940 4 rocksdb: Options.level0_stop_writes_trigger: 24 2017-01-24 11:35:16.819785 7f051969a940 4 rocksdb: Options.target_file_size_base: 67108864 2017-01-24 11:35:16.819786 7f051969a940 4 rocksdb: Options.target_file_size_multiplier: 1 2017-01-24 11:35:16.819788 7f051969a940 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2017-01-24 11:35:16.819790 7f051969a940 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0 2017-01-24 11:35:16.819792 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2017-01-24 11:35:16.819799 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2017-01-24 11:35:16.819802 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2017-01-24 11:35:16.819804 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2017-01-24 11:35:16.819805 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2017-01-24 11:35:16.819807 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2017-01-24 11:35:16.819809 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2017-01-24 11:35:16.819811 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2017-01-24 11:35:16.819812 7f051969a940 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2017-01-24 11:35:16.819814 7f051969a940 4 rocksdb: Options.max_compaction_bytes: 1677721600 2017-01-24 11:35:16.819816 7f051969a940 4 rocksdb: Options.arena_block_size: 33554432 2017-01-24 11:35:16.819817 7f051969a940 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2017-01-24 11:35:16.819819 7f051969a940 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2017-01-24 11:35:16.819821 7f051969a940 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 1000 2017-01-24 11:35:16.819823 7f051969a940 4 rocksdb: Options.disable_auto_compactions: 0 2017-01-24 11:35:16.819825 7f051969a940 4 rocksdb: Options.verify_checksums_in_compaction: 1 2017-01-24 11:35:16.819826 7f051969a940 4 rocksdb: Options.compaction_style: 0 2017-01-24 11:35:16.819828 7f051969a940 4 rocksdb: Options.compaction_pri: 0 2017-01-24 11:35:16.819830 7f051969a940 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2017-01-24 11:35:16.819832 7f051969a940 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2017-01-24 11:35:16.819834 7f051969a940 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2017-01-24 11:35:16.819836 7f051969a940 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2017-01-24 11:35:16.819838 7f051969a940 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2017-01-24 11:35:16.819840 7f051969a940 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2017-01-24 11:35:16.819842 7f051969a940 4 rocksdb: Options.table_properties_collectors: 2017-01-24 11:35:16.819844 7f051969a940 4 rocksdb: Options.inplace_update_support: 0 2017-01-24 11:35:16.819846 7f051969a940 4 rocksdb: Options.inplace_update_num_locks: 10000 2017-01-24 11:35:16.819847 7f051969a940 4 rocksdb: Options.min_partial_merge_operands: 2 2017-01-24 11:35:16.819849 7f051969a940 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2017-01-24 11:35:16.819852 7f051969a940 4 rocksdb: Options.memtable_huge_page_size: 0 2017-01-24 11:35:16.819854 7f051969a940 4 rocksdb: Options.bloom_locality: 0 2017-01-24 11:35:16.819856 7f051969a940 4 rocksdb: Options.max_successive_merges: 0 2017-01-24 11:35:16.819857 7f051969a940 4 rocksdb: Options.optimize_filters_for_hits: 0 2017-01-24 11:35:16.819859 7f051969a940 4 rocksdb: Options.paranoid_file_checks: 0 2017-01-24 11:35:16.819861 7f051969a940 4 rocksdb: Options.force_consistency_checks: 0 2017-01-24 11:35:16.819867 7f051969a940 4 rocksdb: Options.report_bg_io_stats: 0 2017-01-24 11:35:16.822651 7f051969a940 4 rocksdb: Recovered from manifest file:db/MANIFEST-000257 succeeded,manifest_file_number is 257, next_file_number is 263, last_sequence is 130683, log_number is 0,prev_log_number is 0,max_column_family is 0 2017-01-24 11:35:16.822718 7f051969a940 4 rocksdb: Column family [default] (ID 0), log number is 256 2017-01-24 11:35:16.822829 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916822814, "job": 1, "event": "recovery_started", "log_files": [258]} 2017-01-24 11:35:16.822849 7f051969a940 4 rocksdb: Recovering log #258 mode 0 2017-01-24 11:35:16.848343 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916848320, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 263, "file_size": 2981, "table_properties": {"data_size": 2088, "index_size": 28, "filter_size": 0, "raw_key_size": 1370, "raw_average_key_size": 41, "raw_value_size": 915, "raw_average_value_size": 27, "num_data_blocks": 1, "num_entries": 33, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}} 2017-01-24 11:35:16.848442 7f051969a940 4 rocksdb: Creating manifest 264 2017-01-24 11:35:16.913371 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913361, "job": 1, "event": "recovery_finished"} 2017-01-24 11:35:16.913545 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913539, "job": 2, "event": "table_file_deletion", "file_number": 256} 2017-01-24 11:35:16.913565 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913560, "job": 2, "event": "table_file_deletion", "file_number": 253} 2017-01-24 11:35:16.913584 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913580, "job": 2, "event": "table_file_deletion", "file_number": 250} 2017-01-24 11:35:16.913619 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913615, "job": 2, "event": "table_file_deletion", "file_number": 247} 2017-01-24 11:35:16.913636 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913633, "job": 2, "event": "table_file_deletion", "file_number": 245} 2017-01-24 11:35:16.966903 7f051969a940 4 rocksdb: DB pointer 0x5647894f2000 2017-01-24 11:35:16.966974 7f051969a940 1 bluestore(/var/lib/ceph/osd/osd.1) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456 2017-01-24 11:35:16.967605 7f051969a940 1 freelist init 2017-01-24 11:35:17.053724 7f051969a940 0 /build/ceph-11.2.0/src/cls/cephfs/cls_cephfs.cc:198: loading cephfs 2017-01-24 11:35:17.053756 7f051969a940 0 _get_class not permitted to load lua 2017-01-24 11:35:17.059234 7f051969a940 0 /build/ceph-11.2.0/src/cls/hello/cls_hello.cc:296: loading cls_hello 2017-01-24 11:35:17.063534 7f051969a940 0 _get_class not permitted to load kvs 2017-01-24 11:35:17.064945 7f051969a940 0 osd.1 82 crush map has features 2200130813952, adjusting msgr requires for clients 2017-01-24 11:35:17.064968 7f051969a940 0 osd.1 82 crush map has features 2200130813952 was 8705, adjusting msgr requires for mons 2017-01-24 11:35:17.064975 7f051969a940 0 osd.1 82 crush map has features 2200130813952, adjusting msgr requires for osds 2017-01-24 11:35:17.556077 7f051969a940 0 osd.1 82 load_pgs /build/ceph-11.2.0/src/osd/PG.cc: In function 'static int PG::peek_map_epoch(ObjectStore*, spg_t, epoch_t*, ceph::bufferlist*)' thread 7f051969a940 time 2017-01-24 11:35:17.975784 /build/ceph-11.2.0/src/osd/PG.cc: 2995: FAILED assert(values.size() == 2) ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x82) [0x56477e26a152] 2: (PG::peek_map_epoch(ObjectStore*, spg_t, unsigned int*, ceph::buffer::list*)+0x41a) [0x56477dc1f19a] 3: (OSD::load_pgs()+0x7c7) [0x56477db92177] 4: (OSD::init()+0x2135) [0x56477db9e075] 5: (main()+0x2b74) [0x56477dace2c4] 6: (__libc_start_main()+0xf5) [0x7f051609db45] 7: (()+0x4059e6) [0x56477db4c9e6] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2017-01-24 11:35:17.978212 7f051969a940 -1 /build/ceph-11.2.0/src/osd/PG.cc: In function 'static int PG::peek_map_epoch(ObjectStore*, spg_t, epoch_t*, ceph::bufferlist*)' thread 7f051969a940 time 2017-01-24 11:35:17.975784 /build/ceph-11.2.0/src/osd/PG.cc: 2995: FAILED assert(values.size() == 2) ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x82) [0x56477e26a152] 2: (PG::peek_map_epoch(ObjectStore*, spg_t, unsigned int*, ceph::buffer::list*)+0x41a) [0x56477dc1f19a] 3: (OSD::load_pgs()+0x7c7) [0x56477db92177] 4: (OSD::init()+0x2135) [0x56477db9e075] 5: (main()+0x2b74) [0x56477dace2c4] 6: (__libc_start_main()+0xf5) [0x7f051609db45] 7: (()+0x4059e6) [0x56477db4c9e6] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -405> 2017-01-24 11:35:16.762297 7f051969a940 5 asok(0x564789370000) register_command perfcounters_dump hook 0x564789250030 -404> 2017-01-24 11:35:16.762319 7f051969a940 5 asok(0x564789370000) register_command 1 hook 0x564789250030 -403> 2017-01-24 11:35:16.762324 7f051969a940 5 asok(0x564789370000) register_command perf dump hook 0x564789250030 -402> 2017-01-24 11:35:16.762329 7f051969a940 5 asok(0x564789370000) register_command perfcounters_schema hook 0x564789250030 -401> 2017-01-24 11:35:16.762444 7f051969a940 5 asok(0x564789370000) register_command 2 hook 0x564789250030 -400> 2017-01-24 11:35:16.762448 7f051969a940 5 asok(0x564789370000) register_command perf schema hook 0x564789250030 -399> 2017-01-24 11:35:16.762454 7f051969a940 5 asok(0x564789370000) register_command perf reset hook 0x564789250030 -398> 2017-01-24 11:35:16.762470 7f051969a940 5 asok(0x564789370000) register_command config show hook 0x564789250030 -397> 2017-01-24 11:35:16.762474 7f051969a940 5 asok(0x564789370000) register_command config set hook 0x564789250030 -396> 2017-01-24 11:35:16.762478 7f051969a940 5 asok(0x564789370000) register_command config get hook 0x564789250030 -395> 2017-01-24 11:35:16.762496 7f051969a940 5 asok(0x564789370000) register_command config diff hook 0x564789250030 -394> 2017-01-24 11:35:16.762501 7f051969a940 5 asok(0x564789370000) register_command log flush hook 0x564789250030 -393> 2017-01-24 11:35:16.762506 7f051969a940 5 asok(0x564789370000) register_command log dump hook 0x564789250030 -392> 2017-01-24 11:35:16.762525 7f051969a940 5 asok(0x564789370000) register_command log reopen hook 0x564789250030 -391> 2017-01-24 11:35:16.762540 7f051969a940 5 asok(0x564789370000) register_command dump_mempools hook 0x564789364c48 -390> 2017-01-24 11:35:16.774040 7f051969a940 -1 WARNING: the following dangerous and experimental features are enabled: bluestore -389> 2017-01-24 11:35:16.774408 7f051969a940 -1 WARNING: the following dangerous and experimental features are enabled: bluestore -388> 2017-01-24 11:35:16.774425 7f051969a940 0 set uid:gid to 64045:64045 (ceph:) -387> 2017-01-24 11:35:16.774443 7f051969a940 0 ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7), process ceph-osd, pid 4941 -386> 2017-01-24 11:35:16.774496 7f051969a940 5 object store type is bluestore -385> 2017-01-24 11:35:16.774540 7f051969a940 -1 WARNING: experimental feature 'bluestore' is enabled Please be aware that this feature is experimental, untested, unsupported, and may result in data corruption, data loss, and/or irreparable damage to your cluster. Do not use feature with important data. -384> 2017-01-24 11:35:16.776002 7f05141d3700 2 Event(0x564789288a80 nevent=5000 time_id=1).set_owner idx=0 owner=139659789022976 -383> 2017-01-24 11:35:16.776054 7f05139d2700 2 Event(0x564789288e80 nevent=5000 time_id=1).set_owner idx=1 owner=139659780630272 -382> 2017-01-24 11:35:16.776178 7f05131d1700 2 Event(0x564789289280 nevent=5000 time_id=1).set_owner idx=2 owner=139659772237568 -381> 2017-01-24 11:35:16.776570 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -380> 2017-01-24 11:35:16.776702 7f051969a940 1 -- 10.0.10.111:0/0 learned_addr learned my addr 10.0.10.111:0/0 -379> 2017-01-24 11:35:16.776723 7f051969a940 1 -- 10.0.10.111:6800/4941 _finish_bind bind my_inst.addr is 10.0.10.111:6800/4941 -378> 2017-01-24 11:35:16.776728 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -377> 2017-01-24 11:35:16.776763 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -376> 2017-01-24 11:35:16.776805 7f051969a940 1 -- 10.0.10.111:0/0 learned_addr learned my addr 10.0.10.111:0/0 -375> 2017-01-24 11:35:16.776822 7f051969a940 1 -- 10.0.10.111:6801/4941 _finish_bind bind my_inst.addr is 10.0.10.111:6801/4941 -374> 2017-01-24 11:35:16.776827 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -373> 2017-01-24 11:35:16.776853 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -372> 2017-01-24 11:35:16.776891 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -371> 2017-01-24 11:35:16.776926 7f051969a940 1 -- 10.0.10.111:0/0 learned_addr learned my addr 10.0.10.111:0/0 -370> 2017-01-24 11:35:16.776942 7f051969a940 1 -- 10.0.10.111:6802/4941 _finish_bind bind my_inst.addr is 10.0.10.111:6802/4941 -369> 2017-01-24 11:35:16.776947 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -368> 2017-01-24 11:35:16.776972 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -367> 2017-01-24 11:35:16.777009 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -366> 2017-01-24 11:35:16.777044 7f051969a940 2 Event(0x564789288a80 nevent=5000 time_id=1).wakeup -365> 2017-01-24 11:35:16.777077 7f051969a940 1 -- 10.0.10.111:0/0 learned_addr learned my addr 10.0.10.111:0/0 -364> 2017-01-24 11:35:16.777092 7f051969a940 1 -- 10.0.10.111:6803/4941 _finish_bind bind my_inst.addr is 10.0.10.111:6803/4941 -363> 2017-01-24 11:35:16.777097 7f051969a940 0 pidfile_write: ignore empty --pid-file -362> 2017-01-24 11:35:16.780186 7f051969a940 -1 WARNING: the following dangerous and experimental features are enabled: bluestore -361> 2017-01-24 11:35:16.780213 7f051969a940 1 get compressor snappy = 0 -360> 2017-01-24 11:35:16.780218 7f051969a940 1 load compressor snappy -359> 2017-01-24 11:35:16.785367 7f051969a940 1 add compressor snappy 0x5647894de570 -358> 2017-01-24 11:35:16.785397 7f051969a940 1 get compressor snappy = 0x5647894de570 -357> 2017-01-24 11:35:16.785400 7f051969a940 1 load: compressor snappy loaded and registered -356> 2017-01-24 11:35:16.785405 7f051969a940 1 get compressor snappy = 0x5647894de570 -355> 2017-01-24 11:35:16.785419 7f051969a940 5 asok(0x564789370000) init /var/run/ceph/ceph-osd.1.asok -354> 2017-01-24 11:35:16.785439 7f051969a940 5 asok(0x564789370000) bind_and_listen /var/run/ceph/ceph-osd.1.asok -353> 2017-01-24 11:35:16.785623 7f051969a940 5 asok(0x564789370000) register_command 0 hook 0x56478924c120 -352> 2017-01-24 11:35:16.785651 7f051969a940 5 asok(0x564789370000) register_command version hook 0x56478924c120 -351> 2017-01-24 11:35:16.785656 7f051969a940 5 asok(0x564789370000) register_command git_version hook 0x56478924c120 -350> 2017-01-24 11:35:16.785663 7f051969a940 5 asok(0x564789370000) register_command help hook 0x564789250430 -349> 2017-01-24 11:35:16.785680 7f051969a940 5 asok(0x564789370000) register_command get_command_descriptions hook 0x564789250440 -348> 2017-01-24 11:35:16.785788 7f05093b5700 5 asok(0x564789370000) entry start -347> 2017-01-24 11:35:16.785809 7f051969a940 10 monclient(hunting): build_initial_monmap -346> 2017-01-24 11:35:16.793700 7f051969a940 0 load: jerasure load: lrc load: isa -345> 2017-01-24 11:35:16.793775 7f051969a940 5 adding auth protocol: cephx -344> 2017-01-24 11:35:16.793780 7f051969a940 5 adding auth protocol: cephx -343> 2017-01-24 11:35:16.794192 7f051969a940 5 asok(0x564789370000) register_command objecter_requests hook 0x5647892504d0 -342> 2017-01-24 11:35:16.794283 7f051969a940 1 -- 10.0.10.111:6800/4941 start start -341> 2017-01-24 11:35:16.794301 7f051969a940 1 -- - start start -340> 2017-01-24 11:35:16.794304 7f051969a940 1 -- 10.0.10.111:6803/4941 start start -339> 2017-01-24 11:35:16.794307 7f051969a940 1 -- 10.0.10.111:6802/4941 start start -338> 2017-01-24 11:35:16.794313 7f051969a940 1 -- 10.0.10.111:6801/4941 start start -337> 2017-01-24 11:35:16.794327 7f051969a940 1 -- - start start -336> 2017-01-24 11:35:16.794457 7f051969a940 2 osd.1 0 mounting /var/lib/ceph/osd/osd.1 /var/lib/ceph/osd/ceph-1/journal -335> 2017-01-24 11:35:16.794476 7f051969a940 1 bluestore(/var/lib/ceph/osd/osd.1) mount path /var/lib/ceph/osd/osd.1 -334> 2017-01-24 11:35:16.794547 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block type kernel -333> 2017-01-24 11:35:16.795405 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open path /var/lib/ceph/osd/osd.1/block -332> 2017-01-24 11:35:16.795774 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open size 12174995456 (0x2d5afb000, 11610 MB) block_size 4096 (4096 B) rotational -331> 2017-01-24 11:35:16.796325 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block.db type kernel -330> 2017-01-24 11:35:16.797250 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.db) open path /var/lib/ceph/osd/osd.1/block.db -329> 2017-01-24 11:35:16.797613 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.db) open size 21474836480 (0x500000000, 20480 MB) block_size 4096 (4096 B) rotational -328> 2017-01-24 11:35:16.797635 7f051969a940 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/osd.1/block.db size 20480 MB -327> 2017-01-24 11:35:16.797885 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block type kernel -326> 2017-01-24 11:35:16.798729 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open path /var/lib/ceph/osd/osd.1/block -325> 2017-01-24 11:35:16.798983 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block) open size 12174995456 (0x2d5afb000, 11610 MB) block_size 4096 (4096 B) rotational -324> 2017-01-24 11:35:16.799153 7f051969a940 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/osd.1/block size 11610 MB -323> 2017-01-24 11:35:16.799204 7f051969a940 1 bdev create path /var/lib/ceph/osd/osd.1/block.wal type kernel -322> 2017-01-24 11:35:16.800085 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.wal) open path /var/lib/ceph/osd/osd.1/block.wal -321> 2017-01-24 11:35:16.800630 7f051969a940 1 bdev(/var/lib/ceph/osd/osd.1/block.wal) open size 603979776 (0x24000000, 576 MB) block_size 4096 (4096 B) rotational -320> 2017-01-24 11:35:16.800646 7f051969a940 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/osd.1/block.wal size 576 MB -319> 2017-01-24 11:35:16.800913 7f051969a940 1 bluefs mount -318> 2017-01-24 11:35:16.818771 7f051969a940 0 set rocksdb option compression = kNoCompression -317> 2017-01-24 11:35:16.818805 7f051969a940 0 set rocksdb option max_write_buffer_number = 4 -316> 2017-01-24 11:35:16.818815 7f051969a940 0 set rocksdb option min_write_buffer_number_to_merge = 1 -315> 2017-01-24 11:35:16.818830 7f051969a940 0 set rocksdb option recycle_log_file_num = 4 -314> 2017-01-24 11:35:16.818839 7f051969a940 0 set rocksdb option write_buffer_size = 268435456 -313> 2017-01-24 11:35:16.818933 7f051969a940 0 set rocksdb option compression = kNoCompression -312> 2017-01-24 11:35:16.818946 7f051969a940 0 set rocksdb option max_write_buffer_number = 4 -311> 2017-01-24 11:35:16.818955 7f051969a940 0 set rocksdb option min_write_buffer_number_to_merge = 1 -310> 2017-01-24 11:35:16.818962 7f051969a940 0 set rocksdb option recycle_log_file_num = 4 -309> 2017-01-24 11:35:16.818970 7f051969a940 0 set rocksdb option write_buffer_size = 268435456 -308> 2017-01-24 11:35:16.819181 7f051969a940 4 rocksdb: RocksDB version: 5.0.0 -307> 2017-01-24 11:35:16.819204 7f051969a940 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ -306> 2017-01-24 11:35:16.819207 7f051969a940 4 rocksdb: Compile date Jan 19 2017 -305> 2017-01-24 11:35:16.819209 7f051969a940 4 rocksdb: DB SUMMARY -304> 2017-01-24 11:35:16.819223 7f051969a940 4 rocksdb: CURRENT file: CURRENT -303> 2017-01-24 11:35:16.819226 7f051969a940 4 rocksdb: IDENTITY file: IDENTITY -302> 2017-01-24 11:35:16.819235 7f051969a940 4 rocksdb: MANIFEST file: MANIFEST-000257 size: 445 Bytes -301> 2017-01-24 11:35:16.819242 7f051969a940 4 rocksdb: SST files in db dir, Total Num: 6, files: 000245.sst 000247.sst 000250.sst 000253.sst 000256.sst 000261.sst -300> 2017-01-24 11:35:16.819252 7f051969a940 4 rocksdb: SST files in db.slow dir, Total Num: 6, files: 000245.sst 000247.sst 000250.sst 000253.sst 000256.sst 000261.sst -299> 2017-01-24 11:35:16.819265 7f051969a940 4 rocksdb: Write Ahead Log file in db.wal: 000258.log size: 3546 ; -298> 2017-01-24 11:35:16.819270 7f051969a940 4 rocksdb: Options.error_if_exists: 0 -297> 2017-01-24 11:35:16.819272 7f051969a940 4 rocksdb: Options.create_if_missing: 0 -296> 2017-01-24 11:35:16.819274 7f051969a940 4 rocksdb: Options.paranoid_checks: 1 -295> 2017-01-24 11:35:16.819276 7f051969a940 4 rocksdb: Options.env: 0x564789497000 -294> 2017-01-24 11:35:16.819278 7f051969a940 4 rocksdb: Options.info_log: 0x564789497420 -293> 2017-01-24 11:35:16.819280 7f051969a940 4 rocksdb: Options.max_open_files: -1 -292> 2017-01-24 11:35:16.819282 7f051969a940 4 rocksdb: Options.max_file_opening_threads: 16 -291> 2017-01-24 11:35:16.819284 7f051969a940 4 rocksdb: Options.disableDataSync: 0 -290> 2017-01-24 11:35:16.819285 7f051969a940 4 rocksdb: Options.use_fsync: 0 -289> 2017-01-24 11:35:16.819287 7f051969a940 4 rocksdb: Options.max_log_file_size: 0 -288> 2017-01-24 11:35:16.819290 7f051969a940 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615 -287> 2017-01-24 11:35:16.819291 7f051969a940 4 rocksdb: Options.log_file_time_to_roll: 0 -286> 2017-01-24 11:35:16.819295 7f051969a940 4 rocksdb: Options.keep_log_file_num: 1000 -285> 2017-01-24 11:35:16.819296 7f051969a940 4 rocksdb: Options.recycle_log_file_num: 4 -284> 2017-01-24 11:35:16.819299 7f051969a940 4 rocksdb: Options.allow_os_buffer: 1 -283> 2017-01-24 11:35:16.819300 7f051969a940 4 rocksdb: Options.allow_mmap_reads: 0 -282> 2017-01-24 11:35:16.819302 7f051969a940 4 rocksdb: Options.allow_fallocate: 1 -281> 2017-01-24 11:35:16.819304 7f051969a940 4 rocksdb: Options.allow_mmap_writes: 0 -280> 2017-01-24 11:35:16.819305 7f051969a940 4 rocksdb: Options.use_direct_reads: 0 -279> 2017-01-24 11:35:16.819307 7f051969a940 4 rocksdb: Options.create_missing_column_families: 0 -278> 2017-01-24 11:35:16.819309 7f051969a940 4 rocksdb: Options.db_log_dir: -277> 2017-01-24 11:35:16.819311 7f051969a940 4 rocksdb: Options.wal_dir: db.wal -276> 2017-01-24 11:35:16.819313 7f051969a940 4 rocksdb: Options.table_cache_numshardbits: 6 -275> 2017-01-24 11:35:16.819315 7f051969a940 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 -274> 2017-01-24 11:35:16.819317 7f051969a940 4 rocksdb: Options.max_subcompactions: 1 -273> 2017-01-24 11:35:16.819319 7f051969a940 4 rocksdb: Options.max_background_flushes: 1 -272> 2017-01-24 11:35:16.819321 7f051969a940 4 rocksdb: Options.WAL_ttl_seconds: 0 -271> 2017-01-24 11:35:16.819322 7f051969a940 4 rocksdb: Options.WAL_size_limit_MB: 0 -270> 2017-01-24 11:35:16.819325 7f051969a940 4 rocksdb: Options.manifest_preallocation_size: 4194304 -269> 2017-01-24 11:35:16.819327 7f051969a940 4 rocksdb: Options.allow_os_buffer: 1 -268> 2017-01-24 11:35:16.819328 7f051969a940 4 rocksdb: Options.allow_mmap_reads: 0 -267> 2017-01-24 11:35:16.819330 7f051969a940 4 rocksdb: Options.allow_mmap_writes: 0 -266> 2017-01-24 11:35:16.819333 7f051969a940 4 rocksdb: Options.is_fd_close_on_exec: 1 -265> 2017-01-24 11:35:16.819336 7f051969a940 4 rocksdb: Options.stats_dump_period_sec: 600 -264> 2017-01-24 11:35:16.819338 7f051969a940 4 rocksdb: Options.advise_random_on_open: 1 -263> 2017-01-24 11:35:16.819340 7f051969a940 4 rocksdb: Options.db_write_buffer_size: 0 -262> 2017-01-24 11:35:16.819342 7f051969a940 4 rocksdb: Options.access_hint_on_compaction_start: 1 -261> 2017-01-24 11:35:16.819344 7f051969a940 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 -260> 2017-01-24 11:35:16.819345 7f051969a940 4 rocksdb: Options.compaction_readahead_size: 0 -259> 2017-01-24 11:35:16.819347 7f051969a940 4 rocksdb: Options.random_access_max_buffer_size: 1048576 -258> 2017-01-24 11:35:16.819349 7f051969a940 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 -257> 2017-01-24 11:35:16.819351 7f051969a940 4 rocksdb: Options.use_adaptive_mutex: 0 -256> 2017-01-24 11:35:16.819353 7f051969a940 4 rocksdb: Options.rate_limiter: (nil) -255> 2017-01-24 11:35:16.819355 7f051969a940 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 -254> 2017-01-24 11:35:16.819357 7f051969a940 4 rocksdb: Options.bytes_per_sync: 0 -253> 2017-01-24 11:35:16.819359 7f051969a940 4 rocksdb: Options.wal_bytes_per_sync: 0 -252> 2017-01-24 11:35:16.819361 7f051969a940 4 rocksdb: Options.wal_recovery_mode: 0 -251> 2017-01-24 11:35:16.819362 7f051969a940 4 rocksdb: Options.enable_thread_tracking: 0 -250> 2017-01-24 11:35:16.819369 7f051969a940 4 rocksdb: Options.allow_concurrent_memtable_write: 1 -249> 2017-01-24 11:35:16.819371 7f051969a940 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 -248> 2017-01-24 11:35:16.819373 7f051969a940 4 rocksdb: Options.write_thread_max_yield_usec: 100 -247> 2017-01-24 11:35:16.819375 7f051969a940 4 rocksdb: Options.write_thread_slow_yield_usec: 3 -246> 2017-01-24 11:35:16.819376 7f051969a940 4 rocksdb: Options.row_cache: None -245> 2017-01-24 11:35:16.819378 7f051969a940 4 rocksdb: Options.wal_filter: None -244> 2017-01-24 11:35:16.819380 7f051969a940 4 rocksdb: Options.avoid_flush_during_recovery: 0 -243> 2017-01-24 11:35:16.819382 7f051969a940 4 rocksdb: Options.base_background_compactions: 1 -242> 2017-01-24 11:35:16.819384 7f051969a940 4 rocksdb: Options.max_background_compactions: 1 -241> 2017-01-24 11:35:16.819386 7f051969a940 4 rocksdb: Options.avoid_flush_during_shutdown: 0 -240> 2017-01-24 11:35:16.819387 7f051969a940 4 rocksdb: Options.delayed_write_rate : 2097152 -239> 2017-01-24 11:35:16.819389 7f051969a940 4 rocksdb: Options.max_total_wal_size: 0 -238> 2017-01-24 11:35:16.819391 7f051969a940 4 rocksdb: Compression algorithms supported: -237> 2017-01-24 11:35:16.819393 7f051969a940 4 rocksdb: Snappy supported: 0 -236> 2017-01-24 11:35:16.819395 7f051969a940 4 rocksdb: Zlib supported: 0 -235> 2017-01-24 11:35:16.819397 7f051969a940 4 rocksdb: Bzip supported: 0 -234> 2017-01-24 11:35:16.819398 7f051969a940 4 rocksdb: LZ4 supported: 0 -233> 2017-01-24 11:35:16.819400 7f051969a940 4 rocksdb: ZSTD supported: 0 -232> 2017-01-24 11:35:16.819402 7f051969a940 4 rocksdb: Fast CRC32 supported: 0 -231> 2017-01-24 11:35:16.819630 7f051969a940 4 rocksdb: Recovering from manifest file: MANIFEST-000257 -230> 2017-01-24 11:35:16.819713 7f051969a940 4 rocksdb: --------------- Options for column family [default]: -229> 2017-01-24 11:35:16.819716 7f051969a940 4 rocksdb: Options.comparator: leveldb.BytewiseComparator -228> 2017-01-24 11:35:16.819723 7f051969a940 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor -227> 2017-01-24 11:35:16.819725 7f051969a940 4 rocksdb: Options.compaction_filter: None -226> 2017-01-24 11:35:16.819727 7f051969a940 4 rocksdb: Options.compaction_filter_factory: None -225> 2017-01-24 11:35:16.819730 7f051969a940 4 rocksdb: Options.memtable_factory: SkipListFactory -224> 2017-01-24 11:35:16.819732 7f051969a940 4 rocksdb: Options.table_factory: BlockBasedTable -223> 2017-01-24 11:35:16.819747 7f051969a940 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56478924c270) cache_index_and_filter_blocks: 0 pin_l0_filter_and_index_blocks_in_cache: 0 index_type: 0 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x564789287260 block_cache_size: 134217728 block_cache_compressed: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 filter_policy: nullptr whole_key_filtering: 1 skip_table_builder_flush: 0 format_version: 2 -222> 2017-01-24 11:35:16.819755 7f051969a940 4 rocksdb: Options.write_buffer_size: 268435456 -221> 2017-01-24 11:35:16.819757 7f051969a940 4 rocksdb: Options.max_write_buffer_number: 4 -220> 2017-01-24 11:35:16.819760 7f051969a940 4 rocksdb: Options.compression: NoCompression -219> 2017-01-24 11:35:16.819762 7f051969a940 4 rocksdb: Options.bottommost_compression: Disabled -218> 2017-01-24 11:35:16.819764 7f051969a940 4 rocksdb: Options.prefix_extractor: nullptr -217> 2017-01-24 11:35:16.819766 7f051969a940 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr -216> 2017-01-24 11:35:16.819767 7f051969a940 4 rocksdb: Options.num_levels: 7 -215> 2017-01-24 11:35:16.819769 7f051969a940 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 -214> 2017-01-24 11:35:16.819771 7f051969a940 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 -213> 2017-01-24 11:35:16.819773 7f051969a940 4 rocksdb: Options.compression_opts.window_bits: -14 -212> 2017-01-24 11:35:16.819774 7f051969a940 4 rocksdb: Options.compression_opts.level: -1 -211> 2017-01-24 11:35:16.819776 7f051969a940 4 rocksdb: Options.compression_opts.strategy: 0 -210> 2017-01-24 11:35:16.819778 7f051969a940 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 -209> 2017-01-24 11:35:16.819780 7f051969a940 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 -208> 2017-01-24 11:35:16.819781 7f051969a940 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 -207> 2017-01-24 11:35:16.819783 7f051969a940 4 rocksdb: Options.level0_stop_writes_trigger: 24 -206> 2017-01-24 11:35:16.819785 7f051969a940 4 rocksdb: Options.target_file_size_base: 67108864 -205> 2017-01-24 11:35:16.819786 7f051969a940 4 rocksdb: Options.target_file_size_multiplier: 1 -204> 2017-01-24 11:35:16.819788 7f051969a940 4 rocksdb: Options.max_bytes_for_level_base: 268435456 -203> 2017-01-24 11:35:16.819790 7f051969a940 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0 -202> 2017-01-24 11:35:16.819792 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 -201> 2017-01-24 11:35:16.819799 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 -200> 2017-01-24 11:35:16.819802 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 -199> 2017-01-24 11:35:16.819804 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 -198> 2017-01-24 11:35:16.819805 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 -197> 2017-01-24 11:35:16.819807 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 -196> 2017-01-24 11:35:16.819809 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 -195> 2017-01-24 11:35:16.819811 7f051969a940 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 -194> 2017-01-24 11:35:16.819812 7f051969a940 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 -193> 2017-01-24 11:35:16.819814 7f051969a940 4 rocksdb: Options.max_compaction_bytes: 1677721600 -192> 2017-01-24 11:35:16.819816 7f051969a940 4 rocksdb: Options.arena_block_size: 33554432 -191> 2017-01-24 11:35:16.819817 7f051969a940 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 -190> 2017-01-24 11:35:16.819819 7f051969a940 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 -189> 2017-01-24 11:35:16.819821 7f051969a940 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 1000 -188> 2017-01-24 11:35:16.819823 7f051969a940 4 rocksdb: Options.disable_auto_compactions: 0 -187> 2017-01-24 11:35:16.819825 7f051969a940 4 rocksdb: Options.verify_checksums_in_compaction: 1 -186> 2017-01-24 11:35:16.819826 7f051969a940 4 rocksdb: Options.compaction_style: 0 -185> 2017-01-24 11:35:16.819828 7f051969a940 4 rocksdb: Options.compaction_pri: 0 -184> 2017-01-24 11:35:16.819830 7f051969a940 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 -183> 2017-01-24 11:35:16.819832 7f051969a940 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 -182> 2017-01-24 11:35:16.819834 7f051969a940 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 -181> 2017-01-24 11:35:16.819836 7f051969a940 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 -180> 2017-01-24 11:35:16.819838 7f051969a940 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 -179> 2017-01-24 11:35:16.819840 7f051969a940 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 -178> 2017-01-24 11:35:16.819842 7f051969a940 4 rocksdb: Options.table_properties_collectors: -177> 2017-01-24 11:35:16.819844 7f051969a940 4 rocksdb: Options.inplace_update_support: 0 -176> 2017-01-24 11:35:16.819846 7f051969a940 4 rocksdb: Options.inplace_update_num_locks: 10000 -175> 2017-01-24 11:35:16.819847 7f051969a940 4 rocksdb: Options.min_partial_merge_operands: 2 -174> 2017-01-24 11:35:16.819849 7f051969a940 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 -173> 2017-01-24 11:35:16.819852 7f051969a940 4 rocksdb: Options.memtable_huge_page_size: 0 -172> 2017-01-24 11:35:16.819854 7f051969a940 4 rocksdb: Options.bloom_locality: 0 -171> 2017-01-24 11:35:16.819856 7f051969a940 4 rocksdb: Options.max_successive_merges: 0 -170> 2017-01-24 11:35:16.819857 7f051969a940 4 rocksdb: Options.optimize_filters_for_hits: 0 -169> 2017-01-24 11:35:16.819859 7f051969a940 4 rocksdb: Options.paranoid_file_checks: 0 -168> 2017-01-24 11:35:16.819861 7f051969a940 4 rocksdb: Options.force_consistency_checks: 0 -167> 2017-01-24 11:35:16.819867 7f051969a940 4 rocksdb: Options.report_bg_io_stats: 0 -166> 2017-01-24 11:35:16.822651 7f051969a940 4 rocksdb: Recovered from manifest file:db/MANIFEST-000257 succeeded,manifest_file_number is 257, next_file_number is 263, last_sequence is 130683, log_number is 0,prev_log_number is 0,max_column_family is 0 -165> 2017-01-24 11:35:16.822718 7f051969a940 4 rocksdb: Column family [default] (ID 0), log number is 256 -164> 2017-01-24 11:35:16.822829 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916822814, "job": 1, "event": "recovery_started", "log_files": [258]} -163> 2017-01-24 11:35:16.822849 7f051969a940 4 rocksdb: Recovering log #258 mode 0 -162> 2017-01-24 11:35:16.823375 7f051969a940 5 rocksdb: [default] [WriteLevel0TableForRecovery] Level-0 table #263: started -161> 2017-01-24 11:35:16.848343 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916848320, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 263, "file_size": 2981, "table_properties": {"data_size": 2088, "index_size": 28, "filter_size": 0, "raw_key_size": 1370, "raw_average_key_size": 41, "raw_value_size": 915, "raw_average_value_size": 27, "num_data_blocks": 1, "num_entries": 33, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}} -160> 2017-01-24 11:35:16.848392 7f051969a940 5 rocksdb: [default] [WriteLevel0TableForRecovery] Level-0 table #263: 2981 bytes OK -159> 2017-01-24 11:35:16.848442 7f051969a940 4 rocksdb: Creating manifest 264 -158> 2017-01-24 11:35:16.913371 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913361, "job": 1, "event": "recovery_finished"} -157> 2017-01-24 11:35:16.913508 7f051969a940 5 rocksdb: [JOB 2] Delete db.wal/000258.log type=0 #258 -- OK -156> 2017-01-24 11:35:16.913521 7f051969a940 5 rocksdb: [JOB 2] Delete db//MANIFEST-000257 type=3 #257 -- OK -155> 2017-01-24 11:35:16.913534 7f051969a940 5 rocksdb: [JOB 2] Delete db/000256.sst type=2 #256 -- OK -154> 2017-01-24 11:35:16.913545 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913539, "job": 2, "event": "table_file_deletion", "file_number": 256} -153> 2017-01-24 11:35:16.913556 7f051969a940 5 rocksdb: [JOB 2] Delete db/000253.sst type=2 #253 -- OK -152> 2017-01-24 11:35:16.913565 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913560, "job": 2, "event": "table_file_deletion", "file_number": 253} -151> 2017-01-24 11:35:16.913576 7f051969a940 5 rocksdb: [JOB 2] Delete db/000250.sst type=2 #250 -- OK -150> 2017-01-24 11:35:16.913584 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913580, "job": 2, "event": "table_file_deletion", "file_number": 250} -149> 2017-01-24 11:35:16.913611 7f051969a940 5 rocksdb: [JOB 2] Delete db/000247.sst type=2 #247 -- OK -148> 2017-01-24 11:35:16.913619 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913615, "job": 2, "event": "table_file_deletion", "file_number": 247} -147> 2017-01-24 11:35:16.913629 7f051969a940 5 rocksdb: [JOB 2] Delete db/000245.sst type=2 #245 -- OK -146> 2017-01-24 11:35:16.913636 7f051969a940 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1485282916913633, "job": 2, "event": "table_file_deletion", "file_number": 245} -145> 2017-01-24 11:35:16.966903 7f051969a940 4 rocksdb: DB pointer 0x5647894f2000 -144> 2017-01-24 11:35:16.966974 7f051969a940 1 bluestore(/var/lib/ceph/osd/osd.1) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456 -143> 2017-01-24 11:35:16.967605 7f051969a940 1 freelist init -142> 2017-01-24 11:35:17.052328 7f051969a940 1 get compressor snappy = 0x5647894de570 -141> 2017-01-24 11:35:17.052367 7f051969a940 2 osd.1 0 boot -140> 2017-01-24 11:35:17.053492 7f051969a940 1 /build/ceph-11.2.0/src/cls/user/cls_user.cc:368: Loaded user class! -139> 2017-01-24 11:35:17.053724 7f051969a940 0 /build/ceph-11.2.0/src/cls/cephfs/cls_cephfs.cc:198: loading cephfs -138> 2017-01-24 11:35:17.053756 7f051969a940 0 _get_class not permitted to load lua -137> 2017-01-24 11:35:17.053944 7f051969a940 1 /build/ceph-11.2.0/src/cls/version/cls_version.cc:221: Loaded version class! -136> 2017-01-24 11:35:17.058246 7f051969a940 1 /build/ceph-11.2.0/src/cls/rgw/cls_rgw.cc:3476: Loaded rgw class! -135> 2017-01-24 11:35:17.059234 7f051969a940 0 /build/ceph-11.2.0/src/cls/hello/cls_hello.cc:296: loading cls_hello -134> 2017-01-24 11:35:17.062317 7f051969a940 1 /build/ceph-11.2.0/src/cls/refcount/cls_refcount.cc:226: Loaded refcount class! -133> 2017-01-24 11:35:17.062599 7f051969a940 1 /build/ceph-11.2.0/src/cls/log/cls_log.cc:311: Loaded log class! -132> 2017-01-24 11:35:17.063144 7f051969a940 1 /build/ceph-11.2.0/src/cls/statelog/cls_statelog.cc:300: Loaded log class! -131> 2017-01-24 11:35:17.063534 7f051969a940 0 _get_class not permitted to load kvs -130> 2017-01-24 11:35:17.063798 7f051969a940 1 /build/ceph-11.2.0/src/cls/replica_log/cls_replica_log.cc:136: Loaded replica log class! -129> 2017-01-24 11:35:17.064326 7f051969a940 1 /build/ceph-11.2.0/src/cls/timeindex/cls_timeindex.cc:254: Loaded timeindex class! -128> 2017-01-24 11:35:17.064945 7f051969a940 0 osd.1 82 crush map has features 2200130813952, adjusting msgr requires for clients -127> 2017-01-24 11:35:17.064968 7f051969a940 0 osd.1 82 crush map has features 2200130813952 was 8705, adjusting msgr requires for mons -126> 2017-01-24 11:35:17.064975 7f051969a940 0 osd.1 82 crush map has features 2200130813952, adjusting msgr requires for osds -125> 2017-01-24 11:35:17.556077 7f051969a940 0 osd.1 82 load_pgs -124> 2017-01-24 11:35:17.557436 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.d(unlocked)] enter Initial -123> 2017-01-24 11:35:17.561980 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.d( v 31'124 (0'0,31'124] local-les=34 n=70 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'124 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.004544 0 0.000000 -122> 2017-01-24 11:35:17.562037 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.d( v 31'124 (0'0,31'124] local-les=34 n=70 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'124 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -121> 2017-01-24 11:35:17.562054 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -120> 2017-01-24 11:35:17.568831 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.c(unlocked)] enter Initial -119> 2017-01-24 11:35:17.571306 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.c( v 31'85 (0'0,31'85] local-les=34 n=63 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'85 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.002475 0 0.000000 -118> 2017-01-24 11:35:17.571343 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.c( v 31'85 (0'0,31'85] local-les=34 n=63 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'85 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -117> 2017-01-24 11:35:17.571357 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -116> 2017-01-24 11:35:17.579917 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.a(unlocked)] enter Initial -115> 2017-01-24 11:35:17.582370 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.a( v 31'94 (0'0,31'94] local-les=34 n=57 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'94 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.002452 0 0.000000 -114> 2017-01-24 11:35:17.582433 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.a( v 31'94 (0'0,31'94] local-les=34 n=57 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'94 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -113> 2017-01-24 11:35:17.582453 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -112> 2017-01-24 11:35:17.594283 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.9(unlocked)] enter Initial -111> 2017-01-24 11:35:17.596639 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.9( v 31'65 (0'0,31'65] local-les=34 n=49 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'65 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.002356 0 0.000000 -110> 2017-01-24 11:35:17.596685 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.9( v 31'65 (0'0,31'65] local-les=34 n=49 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'65 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -109> 2017-01-24 11:35:17.596700 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -108> 2017-01-24 11:35:17.640637 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.8(unlocked)] enter Initial -107> 2017-01-24 11:35:17.643269 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.8( v 34'84 lc 32'81 (0'0,34'84] local-les=82 n=54 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=34'84 lcod 0'0 inactive NOTIFY NIBBLEWISE m=3] exit Initial 0.002632 0 0.000000 -106> 2017-01-24 11:35:17.643323 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.8( v 34'84 lc 32'81 (0'0,34'84] local-les=82 n=54 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=34'84 lcod 0'0 inactive NOTIFY NIBBLEWISE m=3] enter Reset -105> 2017-01-24 11:35:17.643340 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -104> 2017-01-24 11:35:17.649225 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.6(unlocked)] enter Initial -103> 2017-01-24 11:35:17.652082 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.6( v 31'93 (0'0,31'93] local-les=34 n=60 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'93 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.002854 0 0.000000 -102> 2017-01-24 11:35:17.652120 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.6( v 31'93 (0'0,31'93] local-les=34 n=60 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'93 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -101> 2017-01-24 11:35:17.652135 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -100> 2017-01-24 11:35:17.664033 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3e(unlocked)] enter Initial -99> 2017-01-24 11:35:17.668325 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3e( v 31'108 (0'0,31'108] local-les=34 n=68 ec=22 les/c/f 34/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'108 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.004292 0 0.000000 -98> 2017-01-24 11:35:17.668395 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3e( v 31'108 (0'0,31'108] local-les=34 n=68 ec=22 les/c/f 34/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'108 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -97> 2017-01-24 11:35:17.668414 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -96> 2017-01-24 11:35:17.681826 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3c(unlocked)] enter Initial -95> 2017-01-24 11:35:17.687049 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3c( v 31'121 (0'0,31'121] local-les=34 n=63 ec=22 les/c/f 34/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'121 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.005223 0 0.000000 -94> 2017-01-24 11:35:17.687122 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3c( v 31'121 (0'0,31'121] local-les=34 n=63 ec=22 les/c/f 34/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'121 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -93> 2017-01-24 11:35:17.687140 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -92> 2017-01-24 11:35:17.699169 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3b(unlocked)] enter Initial -91> 2017-01-24 11:35:17.702948 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3b( v 31'125 (0'0,31'125] local-les=34 n=64 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'125 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.003779 0 0.000000 -90> 2017-01-24 11:35:17.703033 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.3b( v 31'125 (0'0,31'125] local-les=34 n=64 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'125 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -89> 2017-01-24 11:35:17.703052 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -88> 2017-01-24 11:35:17.723530 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.36(unlocked)] enter Initial -87> 2017-01-24 11:35:17.727327 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.36( v 46'113 lc 44'111 (0'0,46'113] local-les=82 n=54 ec=22 les/c/f 76/76/0 80/81/81) [1,0] r=0 lpr=0 pi=43-80/12 crt=46'113 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE m=2] exit Initial 0.003797 0 0.000000 -86> 2017-01-24 11:35:17.727405 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.36( v 46'113 lc 44'111 (0'0,46'113] local-les=82 n=54 ec=22 les/c/f 76/76/0 80/81/81) [1,0] r=0 lpr=0 pi=43-80/12 crt=46'113 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE m=2] enter Reset -85> 2017-01-24 11:35:17.727449 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -84> 2017-01-24 11:35:17.748424 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.35(unlocked)] enter Initial -83> 2017-01-24 11:35:17.752764 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.35( v 31'85 (0'0,31'85] local-les=34 n=55 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'85 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.004341 0 0.000000 -82> 2017-01-24 11:35:17.752833 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.35( v 31'85 (0'0,31'85] local-les=34 n=55 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'85 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -81> 2017-01-24 11:35:17.752851 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -80> 2017-01-24 11:35:17.764572 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.33(unlocked)] enter Initial -79> 2017-01-24 11:35:17.768646 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.33( v 54'97 lc 34'96 (0'0,54'97] local-les=82 n=59 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=54'97 lcod 0'0 inactive NOTIFY NIBBLEWISE m=1] exit Initial 0.004075 0 0.000000 -78> 2017-01-24 11:35:17.768697 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.33( v 54'97 lc 34'96 (0'0,54'97] local-les=82 n=59 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=54'97 lcod 0'0 inactive NOTIFY NIBBLEWISE m=1] enter Reset -77> 2017-01-24 11:35:17.768713 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -76> 2017-01-24 11:35:17.784045 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.30(unlocked)] enter Initial -75> 2017-01-24 11:35:17.788078 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.30( v 31'120 (0'0,31'120] local-les=34 n=71 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'120 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.004032 0 0.000000 -74> 2017-01-24 11:35:17.788130 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.30( v 31'120 (0'0,31'120] local-les=34 n=71 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=28-79/21 crt=31'120 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -73> 2017-01-24 11:35:17.788145 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -72> 2017-01-24 11:35:17.799639 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.2e(unlocked)] enter Initial -71> 2017-01-24 11:35:17.802366 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.2e( v 44'99 lc 32'97 (0'0,44'99] local-les=82 n=64 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=44'99 lcod 0'0 inactive NOTIFY NIBBLEWISE m=1] exit Initial 0.002727 0 0.000000 -70> 2017-01-24 11:35:17.802423 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.2e( v 44'99 lc 32'97 (0'0,44'99] local-les=82 n=64 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=44'99 lcod 0'0 inactive NOTIFY NIBBLEWISE m=1] enter Reset -69> 2017-01-24 11:35:17.802438 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -68> 2017-01-24 11:35:17.814492 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.2c(unlocked)] enter Initial -67> 2017-01-24 11:35:17.817746 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.2c( v 31'85 (0'0,31'85] local-les=34 n=52 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'85 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.003254 0 0.000000 -66> 2017-01-24 11:35:17.817804 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.2c( v 31'85 (0'0,31'85] local-les=34 n=52 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'85 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -65> 2017-01-24 11:35:17.817821 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -64> 2017-01-24 11:35:17.823367 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.2b(unlocked)] enter Initial -63> 2017-01-24 11:35:17.826019 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.2b( v 36'78 (0'0,36'78] local-les=82 n=58 ec=22 les/c/f 76/76/0 80/81/81) [1,0] r=0 lpr=0 pi=73-80/3 crt=36'78 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.002652 0 0.000000 -62> 2017-01-24 11:35:17.826075 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.2b( v 36'78 (0'0,36'78] local-les=82 n=58 ec=22 les/c/f 76/76/0 80/81/81) [1,0] r=0 lpr=0 pi=73-80/3 crt=36'78 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -61> 2017-01-24 11:35:17.826101 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -60> 2017-01-24 11:35:17.832619 7f051969a940 5 osd.1 pg_epoch: 80 pg[1.1d(unlocked)] enter Initial -59> 2017-01-24 11:35:17.833012 7f051969a940 5 osd.1 pg_epoch: 80 pg[1.1d( v 24'2 (0'0,24'2] local-les=34 n=1 ec=20 les/c/f 34/31/0 80/80/80) [1] r=0 lpr=0 pi=20-79/22 crt=24'2 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.000393 0 0.000000 -58> 2017-01-24 11:35:17.833044 7f051969a940 5 osd.1 pg_epoch: 80 pg[1.1d( v 24'2 (0'0,24'2] local-les=34 n=1 ec=20 les/c/f 34/31/0 80/80/80) [1] r=0 lpr=0 pi=20-79/22 crt=24'2 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -57> 2017-01-24 11:35:17.833066 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -56> 2017-01-24 11:35:17.839043 7f051969a940 5 osd.1 pg_epoch: 82 pg[1.b(unlocked)] enter Initial -55> 2017-01-24 11:35:17.839275 7f051969a940 5 osd.1 pg_epoch: 82 pg[1.b( v 24'1 (0'0,24'1] local-les=82 n=1 ec=20 les/c/f 76/76/0 80/81/20) [0,1] r=1 lpr=0 pi=20-80/16 crt=24'1 lcod 0'0 inactive NOTIFY NIBBLEWISE] exit Initial 0.000233 0 0.000000 -54> 2017-01-24 11:35:17.839309 7f051969a940 5 osd.1 pg_epoch: 82 pg[1.b( v 24'1 (0'0,24'1] local-les=82 n=1 ec=20 les/c/f 76/76/0 80/81/20) [0,1] r=1 lpr=0 pi=20-80/16 crt=24'1 lcod 0'0 inactive NOTIFY NIBBLEWISE] enter Reset -53> 2017-01-24 11:35:17.839327 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -52> 2017-01-24 11:35:17.844737 7f051969a940 5 osd.1 pg_epoch: 82 pg[1.1a(unlocked)] enter Initial -51> 2017-01-24 11:35:17.844935 7f051969a940 5 osd.1 pg_epoch: 82 pg[1.1a( empty local-les=82 n=0 ec=20 les/c/f 76/76/0 80/81/81) [1,0] r=0 lpr=0 pi=73-80/3 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.000198 0 0.000000 -50> 2017-01-24 11:35:17.844968 7f051969a940 5 osd.1 pg_epoch: 82 pg[1.1a( empty local-les=82 n=0 ec=20 les/c/f 76/76/0 80/81/81) [1,0] r=0 lpr=0 pi=73-80/3 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -49> 2017-01-24 11:35:17.844996 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -48> 2017-01-24 11:35:17.861679 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.9(unlocked)] enter Initial -47> 2017-01-24 11:35:17.861935 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.9( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] exit Initial 0.000255 0 0.000000 -46> 2017-01-24 11:35:17.861966 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.9( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] enter Reset -45> 2017-01-24 11:35:17.861978 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -44> 2017-01-24 11:35:17.868693 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.19(unlocked)] enter Initial -43> 2017-01-24 11:35:17.871897 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.19( v 31'100 (0'0,31'100] local-les=34 n=74 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'100 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.003204 0 0.000000 -42> 2017-01-24 11:35:17.871932 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.19( v 31'100 (0'0,31'100] local-les=34 n=74 ec=22 les/c/f 29/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'100 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -41> 2017-01-24 11:35:17.871946 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -40> 2017-01-24 11:35:17.877394 7f051969a940 5 osd.1 pg_epoch: 80 pg[1.1(unlocked)] enter Initial -39> 2017-01-24 11:35:17.877641 7f051969a940 5 osd.1 pg_epoch: 80 pg[1.1( empty local-les=34 n=0 ec=20 les/c/f 31/31/0 80/80/80) [1] r=0 lpr=0 pi=20-79/22 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.000247 0 0.000000 -38> 2017-01-24 11:35:17.877671 7f051969a940 5 osd.1 pg_epoch: 80 pg[1.1( empty local-les=34 n=0 ec=20 les/c/f 31/31/0 80/80/80) [1] r=0 lpr=0 pi=20-79/22 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -37> 2017-01-24 11:35:17.877683 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -36> 2017-01-24 11:35:17.886728 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.c(unlocked)] enter Initial -35> 2017-01-24 11:35:17.886950 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.c( empty local-les=34 n=0 ec=1 les/c/f 27/27/0 80/80/80) [1] r=0 lpr=0 pi=26-79/21 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.000222 0 0.000000 -34> 2017-01-24 11:35:17.886980 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.c( empty local-les=34 n=0 ec=1 les/c/f 27/27/0 80/80/80) [1] r=0 lpr=0 pi=26-79/21 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -33> 2017-01-24 11:35:17.886992 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -32> 2017-01-24 11:35:17.893211 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.27(unlocked)] enter Initial -31> 2017-01-24 11:35:17.895893 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.27( v 31'97 (0'0,31'97] local-les=82 n=59 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=31'97 lcod 0'0 inactive NOTIFY NIBBLEWISE] exit Initial 0.002682 0 0.000000 -30> 2017-01-24 11:35:17.895925 7f051969a940 5 osd.1 pg_epoch: 82 pg[2.27( v 31'97 (0'0,31'97] local-les=82 n=59 ec=22 les/c/f 76/76/0 80/81/22) [0,1] r=1 lpr=0 pi=22-80/16 crt=31'97 lcod 0'0 inactive NOTIFY NIBBLEWISE] enter Reset -29> 2017-01-24 11:35:17.895941 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -28> 2017-01-24 11:35:17.906547 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.b(unlocked)] enter Initial -27> 2017-01-24 11:35:17.906742 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.b( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] exit Initial 0.000195 0 0.000000 -26> 2017-01-24 11:35:17.906772 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.b( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] enter Reset -25> 2017-01-24 11:35:17.906783 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -24> 2017-01-24 11:35:17.922046 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.d(unlocked)] enter Initial -23> 2017-01-24 11:35:17.922269 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.d( empty local-les=34 n=0 ec=1 les/c/f 34/27/0 80/80/80) [1] r=0 lpr=0 pi=8-79/26 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.000222 0 0.000000 -22> 2017-01-24 11:35:17.922299 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.d( empty local-les=34 n=0 ec=1 les/c/f 34/27/0 80/80/80) [1] r=0 lpr=0 pi=8-79/26 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -21> 2017-01-24 11:35:17.922311 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -20> 2017-01-24 11:35:17.928894 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.a(unlocked)] enter Initial -19> 2017-01-24 11:35:17.929135 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.a( empty local-les=34 n=0 ec=1 les/c/f 27/27/0 80/80/80) [1] r=0 lpr=0 pi=8-79/26 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.000240 0 0.000000 -18> 2017-01-24 11:35:17.929171 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.a( empty local-les=34 n=0 ec=1 les/c/f 27/27/0 80/80/80) [1] r=0 lpr=0 pi=8-79/26 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -17> 2017-01-24 11:35:17.929185 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -16> 2017-01-24 11:35:17.934983 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.5(unlocked)] enter Initial -15> 2017-01-24 11:35:17.939393 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.5( v 31'150 (0'0,31'150] local-les=34 n=75 ec=22 les/c/f 34/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'150 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.004409 0 0.000000 -14> 2017-01-24 11:35:17.939427 7f051969a940 5 osd.1 pg_epoch: 80 pg[2.5( v 31'150 (0'0,31'150] local-les=34 n=75 ec=22 les/c/f 34/29/0 80/80/80) [1] r=0 lpr=0 pi=22-79/22 crt=31'150 lcod 0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -13> 2017-01-24 11:35:17.939440 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -12> 2017-01-24 11:35:17.945360 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.e(unlocked)] enter Initial -11> 2017-01-24 11:35:17.945590 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.e( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] exit Initial 0.000230 0 0.000000 -10> 2017-01-24 11:35:17.945620 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.e( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] enter Reset -9> 2017-01-24 11:35:17.945633 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -8> 2017-01-24 11:35:17.952935 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.27(unlocked)] enter Initial -7> 2017-01-24 11:35:17.953128 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.27( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] exit Initial 0.000192 0 0.000000 -6> 2017-01-24 11:35:17.953156 7f051969a940 5 osd.1 pg_epoch: 82 pg[0.27( empty local-les=82 n=0 ec=1 les/c/f 76/76/0 80/81/8) [0,1] r=1 lpr=0 pi=8-80/20 crt=0'0 inactive NOTIFY NIBBLEWISE] enter Reset -5> 2017-01-24 11:35:17.953168 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 -4> 2017-01-24 11:35:17.958934 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.4(unlocked)] enter Initial -3> 2017-01-24 11:35:17.959144 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.4( empty local-les=34 n=0 ec=1 les/c/f 27/27/0 80/80/80) [1] r=0 lpr=0 pi=26-79/21 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] exit Initial 0.000209 0 0.000000 -2> 2017-01-24 11:35:17.959173 7f051969a940 5 osd.1 pg_epoch: 80 pg[0.4( empty local-les=34 n=0 ec=1 les/c/f 27/27/0 80/80/80) [1] r=0 lpr=0 pi=26-79/21 crt=0'0 mlcod 0'0 inactive NIBBLEWISE] enter Reset -1> 2017-01-24 11:35:17.959190 7f051969a940 5 write_log_and_missing with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, writeout_from: 4294967295'18446744073709551615, trimmed: , clear_divergent_priors: 0 0> 2017-01-24 11:35:17.978212 7f051969a940 -1 /build/ceph-11.2.0/src/osd/PG.cc: In function 'static int PG::peek_map_epoch(ObjectStore*, spg_t, epoch_t*, ceph::bufferlist*)' thread 7f051969a940 time 2017-01-24 11:35:17.975784 /build/ceph-11.2.0/src/osd/PG.cc: 2995: FAILED assert(values.size() == 2) ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x82) [0x56477e26a152] 2: (PG::peek_map_epoch(ObjectStore*, spg_t, unsigned int*, ceph::buffer::list*)+0x41a) [0x56477dc1f19a] 3: (OSD::load_pgs()+0x7c7) [0x56477db92177] 4: (OSD::init()+0x2135) [0x56477db9e075] 5: (main()+0x2b74) [0x56477dace2c4] 6: (__libc_start_main()+0xf5) [0x7f051609db45] 7: (()+0x4059e6) [0x56477db4c9e6] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 0/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore 1/ 5 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk -2/-2 (syslog threshold) 99/99 (stderr threshold) max_recent 10000 max_new 1000 log_file --- end dump of recent events --- *** Caught signal (Aborted) ** in thread 7f051969a940 thread_name:ceph-osd ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7) 1: (()+0x9419f7) [0x56477e0889f7] 2: (()+0xf890) [0x7f05182c3890] 3: (gsignal()+0x37) [0x7f05160b1067] 4: (abort()+0x148) [0x7f05160b2448] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x256) [0x56477e26a326] 6: (PG::peek_map_epoch(ObjectStore*, spg_t, unsigned int*, ceph::buffer::list*)+0x41a) [0x56477dc1f19a] 7: (OSD::load_pgs()+0x7c7) [0x56477db92177] 8: (OSD::init()+0x2135) [0x56477db9e075] 9: (main()+0x2b74) [0x56477dace2c4] 10: (__libc_start_main()+0xf5) [0x7f051609db45] 11: (()+0x4059e6) [0x56477db4c9e6] 2017-01-24 11:35:17.985265 7f051969a940 -1 *** Caught signal (Aborted) ** in thread 7f051969a940 thread_name:ceph-osd ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7) 1: (()+0x9419f7) [0x56477e0889f7] 2: (()+0xf890) [0x7f05182c3890] 3: (gsignal()+0x37) [0x7f05160b1067] 4: (abort()+0x148) [0x7f05160b2448] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x256) [0x56477e26a326] 6: (PG::peek_map_epoch(ObjectStore*, spg_t, unsigned int*, ceph::buffer::list*)+0x41a) [0x56477dc1f19a] 7: (OSD::load_pgs()+0x7c7) [0x56477db92177] 8: (OSD::init()+0x2135) [0x56477db9e075] 9: (main()+0x2b74) [0x56477dace2c4] 10: (__libc_start_main()+0xf5) [0x7f051609db45] 11: (()+0x4059e6) [0x56477db4c9e6] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- 0> 2017-01-24 11:35:17.985265 7f051969a940 -1 *** Caught signal (Aborted) ** in thread 7f051969a940 thread_name:ceph-osd ceph version 11.2.0 (f223e27eeb35991352ebc1f67423d4ebc252adb7) 1: (()+0x9419f7) [0x56477e0889f7] 2: (()+0xf890) [0x7f05182c3890] 3: (gsignal()+0x37) [0x7f05160b1067] 4: (abort()+0x148) [0x7f05160b2448] 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x256) [0x56477e26a326] 6: (PG::peek_map_epoch(ObjectStore*, spg_t, unsigned int*, ceph::buffer::list*)+0x41a) [0x56477dc1f19a] 7: (OSD::load_pgs()+0x7c7) [0x56477db92177] 8: (OSD::init()+0x2135) [0x56477db9e075] 9: (main()+0x2b74) [0x56477dace2c4] 10: (__libc_start_main()+0xf5) [0x7f051609db45] 11: (()+0x4059e6) [0x56477db4c9e6] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 0/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore 1/ 5 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 4/ 5 memdb 1/ 5 kinetic 1/ 5 fuse 1/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk -2/-2 (syslog threshold) 99/99 (stderr threshold) max_recent 10000 max_new 1000 log_file --- end dump of recent events ---