Project

General

Profile

Bug #20529 » ceph-mon.0-pve53.log

Benjamin Candler, 07/21/2017 12:45 PM

 
2017-07-21 14:24:06.399911 7ff1f6869c80 0 set rocksdb option compression = kNoCompression
2017-07-21 14:24:06.399931 7ff1f6869c80 0 set rocksdb option write_buffer_size = 33554432
2017-07-21 14:24:06.400033 7ff1f6869c80 0 set rocksdb option compression = kNoCompression
2017-07-21 14:24:06.400038 7ff1f6869c80 0 set rocksdb option write_buffer_size = 33554432
2017-07-21 14:24:06.400163 7ff1f6869c80 4 rocksdb: RocksDB version: 5.4.0

2017-07-21 14:24:06.400174 7ff1f6869c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
2017-07-21 14:24:06.400176 7ff1f6869c80 4 rocksdb: Compile date Jul 3 2017
2017-07-21 14:24:06.400178 7ff1f6869c80 4 rocksdb: DB SUMMARY

2017-07-21 14:24:06.400200 7ff1f6869c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-0/store.db dir, Total Num: 0, files:

2017-07-21 14:24:06.400206 7ff1f6869c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-0/store.db:

2017-07-21 14:24:06.400208 7ff1f6869c80 4 rocksdb: Options.error_if_exists: 0
2017-07-21 14:24:06.400209 7ff1f6869c80 4 rocksdb: Options.create_if_missing: 1
2017-07-21 14:24:06.400210 7ff1f6869c80 4 rocksdb: Options.paranoid_checks: 1
2017-07-21 14:24:06.400211 7ff1f6869c80 4 rocksdb: Options.env: 0x55972f949e20
2017-07-21 14:24:06.400213 7ff1f6869c80 4 rocksdb: Options.info_log: 0x55973070a820
2017-07-21 14:24:06.400214 7ff1f6869c80 4 rocksdb: Options.max_open_files: -1
2017-07-21 14:24:06.400215 7ff1f6869c80 4 rocksdb: Options.max_file_opening_threads: 16
2017-07-21 14:24:06.400216 7ff1f6869c80 4 rocksdb: Options.use_fsync: 0
2017-07-21 14:24:06.400217 7ff1f6869c80 4 rocksdb: Options.max_log_file_size: 0
2017-07-21 14:24:06.400218 7ff1f6869c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
2017-07-21 14:24:06.400220 7ff1f6869c80 4 rocksdb: Options.log_file_time_to_roll: 0
2017-07-21 14:24:06.400221 7ff1f6869c80 4 rocksdb: Options.keep_log_file_num: 1000
2017-07-21 14:24:06.400222 7ff1f6869c80 4 rocksdb: Options.recycle_log_file_num: 0
2017-07-21 14:24:06.400223 7ff1f6869c80 4 rocksdb: Options.allow_fallocate: 1
2017-07-21 14:24:06.400224 7ff1f6869c80 4 rocksdb: Options.allow_mmap_reads: 0
2017-07-21 14:24:06.400225 7ff1f6869c80 4 rocksdb: Options.allow_mmap_writes: 0
2017-07-21 14:24:06.400226 7ff1f6869c80 4 rocksdb: Options.use_direct_reads: 0
2017-07-21 14:24:06.400227 7ff1f6869c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
2017-07-21 14:24:06.400228 7ff1f6869c80 4 rocksdb: Options.create_missing_column_families: 0
2017-07-21 14:24:06.400229 7ff1f6869c80 4 rocksdb: Options.db_log_dir:
2017-07-21 14:24:06.400230 7ff1f6869c80 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-0/store.db
2017-07-21 14:24:06.400231 7ff1f6869c80 4 rocksdb: Options.table_cache_numshardbits: 6
2017-07-21 14:24:06.400232 7ff1f6869c80 4 rocksdb: Options.max_subcompactions: 1
2017-07-21 14:24:06.400234 7ff1f6869c80 4 rocksdb: Options.max_background_flushes: 1
2017-07-21 14:24:06.400235 7ff1f6869c80 4 rocksdb: Options.WAL_ttl_seconds: 0
2017-07-21 14:24:06.400236 7ff1f6869c80 4 rocksdb: Options.WAL_size_limit_MB: 0
2017-07-21 14:24:06.400237 7ff1f6869c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
2017-07-21 14:24:06.400238 7ff1f6869c80 4 rocksdb: Options.is_fd_close_on_exec: 1
2017-07-21 14:24:06.400239 7ff1f6869c80 4 rocksdb: Options.advise_random_on_open: 1
2017-07-21 14:24:06.400240 7ff1f6869c80 4 rocksdb: Options.db_write_buffer_size: 0
2017-07-21 14:24:06.400241 7ff1f6869c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
2017-07-21 14:24:06.400242 7ff1f6869c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
2017-07-21 14:24:06.400243 7ff1f6869c80 4 rocksdb: Options.compaction_readahead_size: 0
2017-07-21 14:24:06.400244 7ff1f6869c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
2017-07-21 14:24:06.400245 7ff1f6869c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
2017-07-21 14:24:06.400246 7ff1f6869c80 4 rocksdb: Options.use_adaptive_mutex: 0
2017-07-21 14:24:06.400247 7ff1f6869c80 4 rocksdb: Options.rate_limiter: (nil)
2017-07-21 14:24:06.400249 7ff1f6869c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
2017-07-21 14:24:06.400250 7ff1f6869c80 4 rocksdb: Options.bytes_per_sync: 0
2017-07-21 14:24:06.400251 7ff1f6869c80 4 rocksdb: Options.wal_bytes_per_sync: 0
2017-07-21 14:24:06.400252 7ff1f6869c80 4 rocksdb: Options.wal_recovery_mode: 2
2017-07-21 14:24:06.400253 7ff1f6869c80 4 rocksdb: Options.enable_thread_tracking: 0
2017-07-21 14:24:06.400254 7ff1f6869c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
2017-07-21 14:24:06.400255 7ff1f6869c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
2017-07-21 14:24:06.400255 7ff1f6869c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
2017-07-21 14:24:06.400257 7ff1f6869c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
2017-07-21 14:24:06.400258 7ff1f6869c80 4 rocksdb: Options.row_cache: 26843546
2017-07-21 14:24:06.400259 7ff1f6869c80 4 rocksdb: Options.wal_filter: None
2017-07-21 14:24:06.400261 7ff1f6869c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
2017-07-21 14:24:06.400262 7ff1f6869c80 4 rocksdb: Options.base_background_compactions: 1
2017-07-21 14:24:06.400263 7ff1f6869c80 4 rocksdb: Options.max_background_compactions: 1
2017-07-21 14:24:06.400264 7ff1f6869c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
2017-07-21 14:24:06.400265 7ff1f6869c80 4 rocksdb: Options.delayed_write_rate : 16777216
2017-07-21 14:24:06.400266 7ff1f6869c80 4 rocksdb: Options.max_total_wal_size: 0
2017-07-21 14:24:06.400267 7ff1f6869c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
2017-07-21 14:24:06.400268 7ff1f6869c80 4 rocksdb: Options.stats_dump_period_sec: 600
2017-07-21 14:24:06.400269 7ff1f6869c80 4 rocksdb: Compression algorithms supported:
2017-07-21 14:24:06.400270 7ff1f6869c80 4 rocksdb: Snappy supported: 0
2017-07-21 14:24:06.400271 7ff1f6869c80 4 rocksdb: Zlib supported: 0
2017-07-21 14:24:06.400273 7ff1f6869c80 4 rocksdb: Bzip supported: 0
2017-07-21 14:24:06.400274 7ff1f6869c80 4 rocksdb: LZ4 supported: 0
2017-07-21 14:24:06.400275 7ff1f6869c80 4 rocksdb: ZSTD supported: 0
2017-07-21 14:24:06.400276 7ff1f6869c80 4 rocksdb: Fast CRC32 supported: 0
2017-07-21 14:24:06.400335 7ff1f6869c80 4 rocksdb: [/home/dietmar/pve5-devel/ceph/ceph-12.1.0/src/rocksdb/db/db_impl_open.cc:192] Creating manifest 1

2017-07-21 14:24:06.584744 7ff1f6869c80 4 rocksdb: [/home/dietmar/pve5-devel/ceph/ceph-12.1.0/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001

2017-07-21 14:24:06.584849 7ff1f6869c80 4 rocksdb: [/home/dietmar/pve5-devel/ceph/ceph-12.1.0/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:

2017-07-21 14:24:06.584858 7ff1f6869c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
2017-07-21 14:24:06.584860 7ff1f6869c80 4 rocksdb: Options.merge_operator:
2017-07-21 14:24:06.584862 7ff1f6869c80 4 rocksdb: Options.compaction_filter: None
2017-07-21 14:24:06.584863 7ff1f6869c80 4 rocksdb: Options.compaction_filter_factory: None
2017-07-21 14:24:06.584865 7ff1f6869c80 4 rocksdb: Options.memtable_factory: SkipListFactory
2017-07-21 14:24:06.584866 7ff1f6869c80 4 rocksdb: Options.table_factory: BlockBasedTable
2017-07-21 14:24:06.584890 7ff1f6869c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559730514150)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 0
pin_l0_filter_and_index_blocks_in_cache: 0
index_type: 0
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x559730558770
block_cache_name: LRUCache
block_cache_options:
capacity : 107374182
num_shard_bits : 4
strict_capacity_limit : 0
high_pri_pool_ratio: 0.000
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
filter_policy: nullptr
whole_key_filtering: 1
format_version: 2

2017-07-21 14:24:06.584928 7ff1f6869c80 4 rocksdb: Options.write_buffer_size: 33554432
2017-07-21 14:24:06.584932 7ff1f6869c80 4 rocksdb: Options.max_write_buffer_number: 2
2017-07-21 14:24:06.584934 7ff1f6869c80 4 rocksdb: Options.compression: NoCompression
2017-07-21 14:24:06.584936 7ff1f6869c80 4 rocksdb: Options.bottommost_compression: Disabled
2017-07-21 14:24:06.584937 7ff1f6869c80 4 rocksdb: Options.prefix_extractor: nullptr
2017-07-21 14:24:06.584938 7ff1f6869c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
2017-07-21 14:24:06.584939 7ff1f6869c80 4 rocksdb: Options.num_levels: 7
2017-07-21 14:24:06.584940 7ff1f6869c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
2017-07-21 14:24:06.584941 7ff1f6869c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
2017-07-21 14:24:06.584942 7ff1f6869c80 4 rocksdb: Options.compression_opts.window_bits: -14
2017-07-21 14:24:06.584943 7ff1f6869c80 4 rocksdb: Options.compression_opts.level: -1
2017-07-21 14:24:06.584944 7ff1f6869c80 4 rocksdb: Options.compression_opts.strategy: 0
2017-07-21 14:24:06.584946 7ff1f6869c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
2017-07-21 14:24:06.584947 7ff1f6869c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
2017-07-21 14:24:06.584948 7ff1f6869c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
2017-07-21 14:24:06.584949 7ff1f6869c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
2017-07-21 14:24:06.584951 7ff1f6869c80 4 rocksdb: Options.target_file_size_base: 67108864
2017-07-21 14:24:06.584952 7ff1f6869c80 4 rocksdb: Options.target_file_size_multiplier: 1
2017-07-21 14:24:06.584954 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
2017-07-21 14:24:06.584955 7ff1f6869c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
2017-07-21 14:24:06.584955 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
2017-07-21 14:24:06.584959 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2017-07-21 14:24:06.584960 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2017-07-21 14:24:06.584962 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2017-07-21 14:24:06.584963 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2017-07-21 14:24:06.584964 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2017-07-21 14:24:06.584965 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2017-07-21 14:24:06.584966 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2017-07-21 14:24:06.584967 7ff1f6869c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
2017-07-21 14:24:06.584968 7ff1f6869c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
2017-07-21 14:24:06.584969 7ff1f6869c80 4 rocksdb: Options.arena_block_size: 4194304
2017-07-21 14:24:06.584970 7ff1f6869c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
2017-07-21 14:24:06.584971 7ff1f6869c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
2017-07-21 14:24:06.584979 7ff1f6869c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
2017-07-21 14:24:06.584980 7ff1f6869c80 4 rocksdb: Options.disable_auto_compactions: 0
2017-07-21 14:24:06.584982 7ff1f6869c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
2017-07-21 14:24:06.584983 7ff1f6869c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
2017-07-21 14:24:06.584984 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2017-07-21 14:24:06.584985 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2017-07-21 14:24:06.584986 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2017-07-21 14:24:06.584987 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2017-07-21 14:24:06.584988 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2017-07-21 14:24:06.584989 7ff1f6869c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2017-07-21 14:24:06.584990 7ff1f6869c80 4 rocksdb: Options.table_properties_collectors:
2017-07-21 14:24:06.584991 7ff1f6869c80 4 rocksdb: Options.inplace_update_support: 0
2017-07-21 14:24:06.584992 7ff1f6869c80 4 rocksdb: Options.inplace_update_num_locks: 10000
2017-07-21 14:24:06.584993 7ff1f6869c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
2017-07-21 14:24:06.584994 7ff1f6869c80 4 rocksdb: Options.memtable_huge_page_size: 0
2017-07-21 14:24:06.584995 7ff1f6869c80 4 rocksdb: Options.bloom_locality: 0
2017-07-21 14:24:06.584996 7ff1f6869c80 4 rocksdb: Options.max_successive_merges: 0
2017-07-21 14:24:06.585004 7ff1f6869c80 4 rocksdb: Options.optimize_filters_for_hits: 0
2017-07-21 14:24:06.585006 7ff1f6869c80 4 rocksdb: Options.paranoid_file_checks: 0
2017-07-21 14:24:06.585007 7ff1f6869c80 4 rocksdb: Options.force_consistency_checks: 0
2017-07-21 14:24:06.585008 7ff1f6869c80 4 rocksdb: Options.report_bg_io_stats: 0
2017-07-21 14:24:06.588433 7ff1f6869c80 -1 *** Caught signal (Illegal instruction) **
in thread 7ff1f6869c80 thread_name:ceph-mon

ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
1: (()+0x82bcc2) [0x559727100cc2]
2: (()+0x110c0) [0x7ff1f5c220c0]
3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x5597272c1cc1]
4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x5597271a914c]
5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x55972717031f]
6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x559727171d90]
7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x5597271735f8]
8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x559726d0a00e]
9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x559726d0b5c7]
10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x559726bebc83]
11: (main()+0x7ef) [0x559726b5a4af]
12: (__libc_start_main()+0xf1) [0x7ff1f30362b1]
13: (_start()+0x2a) [0x559726be8dba]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-155> 2017-07-21 14:24:06.276203 7ff1f6869c80 5 asok(0x55973059ad20) register_command perfcounters_dump hook 0x5597305161b0
-154> 2017-07-21 14:24:06.276220 7ff1f6869c80 5 asok(0x55973059ad20) register_command 1 hook 0x5597305161b0
-153> 2017-07-21 14:24:06.276225 7ff1f6869c80 5 asok(0x55973059ad20) register_command perf dump hook 0x5597305161b0
-152> 2017-07-21 14:24:06.276229 7ff1f6869c80 5 asok(0x55973059ad20) register_command perfcounters_schema hook 0x5597305161b0
-151> 2017-07-21 14:24:06.276234 7ff1f6869c80 5 asok(0x55973059ad20) register_command perf histogram dump hook 0x5597305161b0
-150> 2017-07-21 14:24:06.276238 7ff1f6869c80 5 asok(0x55973059ad20) register_command 2 hook 0x5597305161b0
-149> 2017-07-21 14:24:06.276242 7ff1f6869c80 5 asok(0x55973059ad20) register_command perf schema hook 0x5597305161b0
-148> 2017-07-21 14:24:06.276246 7ff1f6869c80 5 asok(0x55973059ad20) register_command perf histogram schema hook 0x5597305161b0
-147> 2017-07-21 14:24:06.276255 7ff1f6869c80 5 asok(0x55973059ad20) register_command perf reset hook 0x5597305161b0
-146> 2017-07-21 14:24:06.276260 7ff1f6869c80 5 asok(0x55973059ad20) register_command config show hook 0x5597305161b0
-145> 2017-07-21 14:24:06.276264 7ff1f6869c80 5 asok(0x55973059ad20) register_command config set hook 0x5597305161b0
-144> 2017-07-21 14:24:06.276268 7ff1f6869c80 5 asok(0x55973059ad20) register_command config get hook 0x5597305161b0
-143> 2017-07-21 14:24:06.276272 7ff1f6869c80 5 asok(0x55973059ad20) register_command config diff hook 0x5597305161b0
-142> 2017-07-21 14:24:06.276276 7ff1f6869c80 5 asok(0x55973059ad20) register_command config diff get hook 0x5597305161b0
-141> 2017-07-21 14:24:06.276281 7ff1f6869c80 5 asok(0x55973059ad20) register_command log flush hook 0x5597305161b0
-140> 2017-07-21 14:24:06.276285 7ff1f6869c80 5 asok(0x55973059ad20) register_command log dump hook 0x5597305161b0
-139> 2017-07-21 14:24:06.276289 7ff1f6869c80 5 asok(0x55973059ad20) register_command log reopen hook 0x5597305161b0
-138> 2017-07-21 14:24:06.276299 7ff1f6869c80 5 asok(0x55973059ad20) register_command dump_mempools hook 0x5597306953a8
-137> 2017-07-21 14:24:06.399911 7ff1f6869c80 0 set rocksdb option compression = kNoCompression
-136> 2017-07-21 14:24:06.399931 7ff1f6869c80 0 set rocksdb option write_buffer_size = 33554432
-135> 2017-07-21 14:24:06.400033 7ff1f6869c80 0 set rocksdb option compression = kNoCompression
-134> 2017-07-21 14:24:06.400038 7ff1f6869c80 0 set rocksdb option write_buffer_size = 33554432
-133> 2017-07-21 14:24:06.400163 7ff1f6869c80 4 rocksdb: RocksDB version: 5.4.0

-132> 2017-07-21 14:24:06.400174 7ff1f6869c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
-131> 2017-07-21 14:24:06.400176 7ff1f6869c80 4 rocksdb: Compile date Jul 3 2017
-130> 2017-07-21 14:24:06.400178 7ff1f6869c80 4 rocksdb: DB SUMMARY

-129> 2017-07-21 14:24:06.400200 7ff1f6869c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-0/store.db dir, Total Num: 0, files:

-128> 2017-07-21 14:24:06.400206 7ff1f6869c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-0/store.db:

-127> 2017-07-21 14:24:06.400208 7ff1f6869c80 4 rocksdb: Options.error_if_exists: 0
-126> 2017-07-21 14:24:06.400209 7ff1f6869c80 4 rocksdb: Options.create_if_missing: 1
-125> 2017-07-21 14:24:06.400210 7ff1f6869c80 4 rocksdb: Options.paranoid_checks: 1
-124> 2017-07-21 14:24:06.400211 7ff1f6869c80 4 rocksdb: Options.env: 0x55972f949e20
-123> 2017-07-21 14:24:06.400213 7ff1f6869c80 4 rocksdb: Options.info_log: 0x55973070a820
-122> 2017-07-21 14:24:06.400214 7ff1f6869c80 4 rocksdb: Options.max_open_files: -1
-121> 2017-07-21 14:24:06.400215 7ff1f6869c80 4 rocksdb: Options.max_file_opening_threads: 16
-120> 2017-07-21 14:24:06.400216 7ff1f6869c80 4 rocksdb: Options.use_fsync: 0
-119> 2017-07-21 14:24:06.400217 7ff1f6869c80 4 rocksdb: Options.max_log_file_size: 0
-118> 2017-07-21 14:24:06.400218 7ff1f6869c80 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
-117> 2017-07-21 14:24:06.400220 7ff1f6869c80 4 rocksdb: Options.log_file_time_to_roll: 0
-116> 2017-07-21 14:24:06.400221 7ff1f6869c80 4 rocksdb: Options.keep_log_file_num: 1000
-115> 2017-07-21 14:24:06.400222 7ff1f6869c80 4 rocksdb: Options.recycle_log_file_num: 0
-114> 2017-07-21 14:24:06.400223 7ff1f6869c80 4 rocksdb: Options.allow_fallocate: 1
-113> 2017-07-21 14:24:06.400224 7ff1f6869c80 4 rocksdb: Options.allow_mmap_reads: 0
-112> 2017-07-21 14:24:06.400225 7ff1f6869c80 4 rocksdb: Options.allow_mmap_writes: 0
-111> 2017-07-21 14:24:06.400226 7ff1f6869c80 4 rocksdb: Options.use_direct_reads: 0
-110> 2017-07-21 14:24:06.400227 7ff1f6869c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
-109> 2017-07-21 14:24:06.400228 7ff1f6869c80 4 rocksdb: Options.create_missing_column_families: 0
-108> 2017-07-21 14:24:06.400229 7ff1f6869c80 4 rocksdb: Options.db_log_dir:
-107> 2017-07-21 14:24:06.400230 7ff1f6869c80 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-0/store.db
-106> 2017-07-21 14:24:06.400231 7ff1f6869c80 4 rocksdb: Options.table_cache_numshardbits: 6
-105> 2017-07-21 14:24:06.400232 7ff1f6869c80 4 rocksdb: Options.max_subcompactions: 1
-104> 2017-07-21 14:24:06.400234 7ff1f6869c80 4 rocksdb: Options.max_background_flushes: 1
-103> 2017-07-21 14:24:06.400235 7ff1f6869c80 4 rocksdb: Options.WAL_ttl_seconds: 0
-102> 2017-07-21 14:24:06.400236 7ff1f6869c80 4 rocksdb: Options.WAL_size_limit_MB: 0
-101> 2017-07-21 14:24:06.400237 7ff1f6869c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
-100> 2017-07-21 14:24:06.400238 7ff1f6869c80 4 rocksdb: Options.is_fd_close_on_exec: 1
-99> 2017-07-21 14:24:06.400239 7ff1f6869c80 4 rocksdb: Options.advise_random_on_open: 1
-98> 2017-07-21 14:24:06.400240 7ff1f6869c80 4 rocksdb: Options.db_write_buffer_size: 0
-97> 2017-07-21 14:24:06.400241 7ff1f6869c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
-96> 2017-07-21 14:24:06.400242 7ff1f6869c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
-95> 2017-07-21 14:24:06.400243 7ff1f6869c80 4 rocksdb: Options.compaction_readahead_size: 0
-94> 2017-07-21 14:24:06.400244 7ff1f6869c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
-93> 2017-07-21 14:24:06.400245 7ff1f6869c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
-92> 2017-07-21 14:24:06.400246 7ff1f6869c80 4 rocksdb: Options.use_adaptive_mutex: 0
-91> 2017-07-21 14:24:06.400247 7ff1f6869c80 4 rocksdb: Options.rate_limiter: (nil)
-90> 2017-07-21 14:24:06.400249 7ff1f6869c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
-89> 2017-07-21 14:24:06.400250 7ff1f6869c80 4 rocksdb: Options.bytes_per_sync: 0
-88> 2017-07-21 14:24:06.400251 7ff1f6869c80 4 rocksdb: Options.wal_bytes_per_sync: 0
-87> 2017-07-21 14:24:06.400252 7ff1f6869c80 4 rocksdb: Options.wal_recovery_mode: 2
-86> 2017-07-21 14:24:06.400253 7ff1f6869c80 4 rocksdb: Options.enable_thread_tracking: 0
-85> 2017-07-21 14:24:06.400254 7ff1f6869c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
-84> 2017-07-21 14:24:06.400255 7ff1f6869c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
-83> 2017-07-21 14:24:06.400255 7ff1f6869c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
-82> 2017-07-21 14:24:06.400257 7ff1f6869c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
-81> 2017-07-21 14:24:06.400258 7ff1f6869c80 4 rocksdb: Options.row_cache: 26843546
-80> 2017-07-21 14:24:06.400259 7ff1f6869c80 4 rocksdb: Options.wal_filter: None
-79> 2017-07-21 14:24:06.400261 7ff1f6869c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
-78> 2017-07-21 14:24:06.400262 7ff1f6869c80 4 rocksdb: Options.base_background_compactions: 1
-77> 2017-07-21 14:24:06.400263 7ff1f6869c80 4 rocksdb: Options.max_background_compactions: 1
-76> 2017-07-21 14:24:06.400264 7ff1f6869c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
-75> 2017-07-21 14:24:06.400265 7ff1f6869c80 4 rocksdb: Options.delayed_write_rate : 16777216
-74> 2017-07-21 14:24:06.400266 7ff1f6869c80 4 rocksdb: Options.max_total_wal_size: 0
-73> 2017-07-21 14:24:06.400267 7ff1f6869c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
-72> 2017-07-21 14:24:06.400268 7ff1f6869c80 4 rocksdb: Options.stats_dump_period_sec: 600
-71> 2017-07-21 14:24:06.400269 7ff1f6869c80 4 rocksdb: Compression algorithms supported:
-70> 2017-07-21 14:24:06.400270 7ff1f6869c80 4 rocksdb: Snappy supported: 0
-69> 2017-07-21 14:24:06.400271 7ff1f6869c80 4 rocksdb: Zlib supported: 0
-68> 2017-07-21 14:24:06.400273 7ff1f6869c80 4 rocksdb: Bzip supported: 0
-67> 2017-07-21 14:24:06.400274 7ff1f6869c80 4 rocksdb: LZ4 supported: 0
-66> 2017-07-21 14:24:06.400275 7ff1f6869c80 4 rocksdb: ZSTD supported: 0
-65> 2017-07-21 14:24:06.400276 7ff1f6869c80 4 rocksdb: Fast CRC32 supported: 0
-64> 2017-07-21 14:24:06.400335 7ff1f6869c80 4 rocksdb: [/home/dietmar/pve5-devel/ceph/ceph-12.1.0/src/rocksdb/db/db_impl_open.cc:192] Creating manifest 1

-63> 2017-07-21 14:24:06.584744 7ff1f6869c80 4 rocksdb: [/home/dietmar/pve5-devel/ceph/ceph-12.1.0/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001

-62> 2017-07-21 14:24:06.584849 7ff1f6869c80 4 rocksdb: [/home/dietmar/pve5-devel/ceph/ceph-12.1.0/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:

-61> 2017-07-21 14:24:06.584858 7ff1f6869c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
-60> 2017-07-21 14:24:06.584860 7ff1f6869c80 4 rocksdb: Options.merge_operator:
-59> 2017-07-21 14:24:06.584862 7ff1f6869c80 4 rocksdb: Options.compaction_filter: None
-58> 2017-07-21 14:24:06.584863 7ff1f6869c80 4 rocksdb: Options.compaction_filter_factory: None
-57> 2017-07-21 14:24:06.584865 7ff1f6869c80 4 rocksdb: Options.memtable_factory: SkipListFactory
-56> 2017-07-21 14:24:06.584866 7ff1f6869c80 4 rocksdb: Options.table_factory: BlockBasedTable
-55> 2017-07-21 14:24:06.584890 7ff1f6869c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559730514150)
cache_index_and_filter_blocks: 0
cache_index_and_filter_blocks_with_high_priority: 0
pin_l0_filter_and_index_blocks_in_cache: 0
index_type: 0
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x559730558770
block_cache_name: LRUCache
block_cache_options:
capacity : 107374182
num_shard_bits : 4
strict_capacity_limit : 0
high_pri_pool_ratio: 0.000
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
filter_policy: nullptr
whole_key_filtering: 1
format_version: 2

-54> 2017-07-21 14:24:06.584928 7ff1f6869c80 4 rocksdb: Options.write_buffer_size: 33554432
-53> 2017-07-21 14:24:06.584932 7ff1f6869c80 4 rocksdb: Options.max_write_buffer_number: 2
-52> 2017-07-21 14:24:06.584934 7ff1f6869c80 4 rocksdb: Options.compression: NoCompression
-51> 2017-07-21 14:24:06.584936 7ff1f6869c80 4 rocksdb: Options.bottommost_compression: Disabled
-50> 2017-07-21 14:24:06.584937 7ff1f6869c80 4 rocksdb: Options.prefix_extractor: nullptr
-49> 2017-07-21 14:24:06.584938 7ff1f6869c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
-48> 2017-07-21 14:24:06.584939 7ff1f6869c80 4 rocksdb: Options.num_levels: 7
-47> 2017-07-21 14:24:06.584940 7ff1f6869c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
-46> 2017-07-21 14:24:06.584941 7ff1f6869c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
-45> 2017-07-21 14:24:06.584942 7ff1f6869c80 4 rocksdb: Options.compression_opts.window_bits: -14
-44> 2017-07-21 14:24:06.584943 7ff1f6869c80 4 rocksdb: Options.compression_opts.level: -1
-43> 2017-07-21 14:24:06.584944 7ff1f6869c80 4 rocksdb: Options.compression_opts.strategy: 0
-42> 2017-07-21 14:24:06.584946 7ff1f6869c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
-41> 2017-07-21 14:24:06.584947 7ff1f6869c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
-40> 2017-07-21 14:24:06.584948 7ff1f6869c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
-39> 2017-07-21 14:24:06.584949 7ff1f6869c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
-38> 2017-07-21 14:24:06.584951 7ff1f6869c80 4 rocksdb: Options.target_file_size_base: 67108864
-37> 2017-07-21 14:24:06.584952 7ff1f6869c80 4 rocksdb: Options.target_file_size_multiplier: 1
-36> 2017-07-21 14:24:06.584954 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
-35> 2017-07-21 14:24:06.584955 7ff1f6869c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
-34> 2017-07-21 14:24:06.584955 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
-33> 2017-07-21 14:24:06.584959 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
-32> 2017-07-21 14:24:06.584960 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
-31> 2017-07-21 14:24:06.584962 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
-30> 2017-07-21 14:24:06.584963 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
-29> 2017-07-21 14:24:06.584964 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
-28> 2017-07-21 14:24:06.584965 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
-27> 2017-07-21 14:24:06.584966 7ff1f6869c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
-26> 2017-07-21 14:24:06.584967 7ff1f6869c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
-25> 2017-07-21 14:24:06.584968 7ff1f6869c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
-24> 2017-07-21 14:24:06.584969 7ff1f6869c80 4 rocksdb: Options.arena_block_size: 4194304
-23> 2017-07-21 14:24:06.584970 7ff1f6869c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
-22> 2017-07-21 14:24:06.584971 7ff1f6869c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
-21> 2017-07-21 14:24:06.584979 7ff1f6869c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
-20> 2017-07-21 14:24:06.584980 7ff1f6869c80 4 rocksdb: Options.disable_auto_compactions: 0
-19> 2017-07-21 14:24:06.584982 7ff1f6869c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
-18> 2017-07-21 14:24:06.584983 7ff1f6869c80 4 rocksdb: Options.compaction_pri: kByCompensatedSize
-17> 2017-07-21 14:24:06.584984 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
-16> 2017-07-21 14:24:06.584985 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
-15> 2017-07-21 14:24:06.584986 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
-14> 2017-07-21 14:24:06.584987 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
-13> 2017-07-21 14:24:06.584988 7ff1f6869c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
-12> 2017-07-21 14:24:06.584989 7ff1f6869c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
-11> 2017-07-21 14:24:06.584990 7ff1f6869c80 4 rocksdb: Options.table_properties_collectors:
-10> 2017-07-21 14:24:06.584991 7ff1f6869c80 4 rocksdb: Options.inplace_update_support: 0
-9> 2017-07-21 14:24:06.584992 7ff1f6869c80 4 rocksdb: Options.inplace_update_num_locks: 10000
-8> 2017-07-21 14:24:06.584993 7ff1f6869c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
-7> 2017-07-21 14:24:06.584994 7ff1f6869c80 4 rocksdb: Options.memtable_huge_page_size: 0
-6> 2017-07-21 14:24:06.584995 7ff1f6869c80 4 rocksdb: Options.bloom_locality: 0
-5> 2017-07-21 14:24:06.584996 7ff1f6869c80 4 rocksdb: Options.max_successive_merges: 0
-4> 2017-07-21 14:24:06.585004 7ff1f6869c80 4 rocksdb: Options.optimize_filters_for_hits: 0
-3> 2017-07-21 14:24:06.585006 7ff1f6869c80 4 rocksdb: Options.paranoid_file_checks: 0
-2> 2017-07-21 14:24:06.585007 7ff1f6869c80 4 rocksdb: Options.force_consistency_checks: 0
-1> 2017-07-21 14:24:06.585008 7ff1f6869c80 4 rocksdb: Options.report_bg_io_stats: 0
0> 2017-07-21 14:24:06.588433 7ff1f6869c80 -1 *** Caught signal (Illegal instruction) **
in thread 7ff1f6869c80 thread_name:ceph-mon

ceph version 12.1.0 (330b5d17d66c6c05b08ebc129d3e6e8f92f73c60) luminous (dev)
1: (()+0x82bcc2) [0x559727100cc2]
2: (()+0x110c0) [0x7ff1f5c220c0]
3: (rocksdb::VersionBuilder::SaveTo(rocksdb::VersionStorageInfo*)+0x871) [0x5597272c1cc1]
4: (rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool)+0x26bc) [0x5597271a914c]
5: (rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, bool, bool, bool)+0x11f) [0x55972717031f]
6: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator<rocksdb::ColumnFamilyDescriptor> > const&, std::vector<rocksdb::ColumnFamilyHandle*, std::allocator<rocksdb::ColumnFamilyHandle*> >*, rocksdb::DB**)+0xe40) [0x559727171d90]
7: (rocksdb::DB::Open(rocksdb::Options const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::DB**)+0x698) [0x5597271735f8]
8: (RocksDBStore::do_open(std::ostream&, bool)+0x68e) [0x559726d0a00e]
9: (RocksDBStore::create_and_open(std::ostream&)+0xd7) [0x559726d0b5c7]
10: (MonitorDBStore::create_and_open(std::ostream&)+0xe3) [0x559726bebc83]
11: (main()+0x7ef) [0x559726b5a4af]
12: (__libc_start_main()+0xf1) [0x7ff1f30362b1]
13: (_start()+0x2a) [0x559726be8dba]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
max_recent 10000
max_new 1000
log_file /var/log/ceph/ceph-mon.0.log
--- end dump of recent events ---
(4-4/8)