debug 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 setuser_match_path /var/lib/ceph/mon/ceph-a/store.db owned by 167:167. set uid:gid to 167:167 (ceph:ceph) debug 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable), process ceph-mon, pid 98 debug 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 pidfile_write: ignore empty --pid-file debug 2024-02-16T21:27:13.239+0000 7fca997d4c80 0 load: jerasure load: lrc debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: RocksDB version: 7.9.2 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Git sha 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compile date 2024-02-15 23:05:54 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB SUMMARY debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB Session ID: 4VWHRHUR4SCTKUZAVCUX debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: CURRENT file: CURRENT debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: IDENTITY file: IDENTITY debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: MANIFEST file: MANIFEST-000021 size: 268 Bytes debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000008.sst 000015.sst debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000016.log size: 0 ; 000020.log size: 0 ; debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.error_if_exists: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_if_missing: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.paranoid_checks: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.flush_verify_memtable_count: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.env: 0x555c9cde2720 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.fs: PosixFileSystem debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.info_log: 0x555c9e629580 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_file_opening_threads: 16 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.statistics: (nil) debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_fsync: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_log_file_size: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_file_time_to_roll: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.keep_log_file_num: 1000 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.recycle_log_file_num: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_fallocate: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_reads: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_writes: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_reads: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_missing_column_families: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_log_dir: debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_dir: debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.table_cache_numshardbits: 6 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_ttl_seconds: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_size_limit_MB: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.is_fd_close_on_exec: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.advise_random_on_open: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_write_buffer_size: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_manager: 0x555c9d8c0320 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_adaptive_mutex: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.rate_limiter: (nil) debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_recovery_mode: 2 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_thread_tracking: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_pipelined_write: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.unordered_write: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.row_cache: None debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_filter: None debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_ingest_behind: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.two_write_queues: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manual_wal_flush: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_compression: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.atomic_flush: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.persist_stats_to_disk: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_dbid_to_manifest: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_readahead_size: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.best_efforts_recovery: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_data_in_errors: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_host_id: __hostname__ debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enforce_single_del_contracts: true debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_jobs: 2 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_compactions: -1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_subcompactions: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delayed_write_rate : 16777216 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_total_wal_size: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_dump_period_sec: 600 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_persist_period_sec: 600 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_open_files: -1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bytes_per_sync: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_bytes_per_sync: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.strict_bytes_per_sync: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.compaction_readahead_size: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_flushes: -1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compression algorithms supported: debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTD supported: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kXpressCompression supported: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4HCCompression supported: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZlibCompression supported: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kSnappyCompression supported: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4Compression supported: 1 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kBZip2Compression supported: 0 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Fast CRC32 supported: Supported on x86 debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DMutex implementation: pthread_mutex_t debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.merge_operator: debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter: None debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter_factory: None debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.sst_partitioner_factory: None debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_factory: SkipListFactory debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_factory: BlockBasedTable debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c9e629680) cache_index_and_filter_blocks: 1 cache_index_and_filter_blocks_with_high_priority: 0 pin_l0_filter_and_index_blocks_in_cache: 0 pin_top_level_index_and_filter: 1 index_type: 0 data_block_index_type: 0 index_shortening: 1 data_block_hash_table_util_ratio: 0.750000 checksum: 4 no_block_cache: 0 block_cache: 0x555c9d943350 block_cache_name: BinnedLRUCache block_cache_options: capacity : 536870912 num_shard_bits : 4 strict_capacity_limit : 0 high_pri_pool_ratio: 0.000 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: bloomfilter whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 5 enable_index_compression: 1 block_align: 0 max_auto_readahead_size: 262144 prepopulate_block_cache: 0 initial_auto_readahead_size: 8192 num_file_reads_for_auto_readahead: 2 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_size: 33554432 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number: 2 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression: NoCompression debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression: Disabled debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.prefix_extractor: nullptr debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.num_levels: 7 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.window_bits: -14 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.level: 32767 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.strategy: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.enabled: false debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_base: 67108864 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_multiplier: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.arena_block_size: 1048576 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.disable_auto_compactions: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_properties_collectors: debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_support: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_num_locks: 10000 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_huge_page_size: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bloom_locality: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_successive_merges: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.optimize_filters_for_hits: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.paranoid_file_checks: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.force_consistency_checks: 1 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.report_bg_io_stats: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ttl: 2592000 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.periodic_compaction_seconds: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_files: false debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_blob_size: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_size: 268435456 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compression_type: NoCompression debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_garbage_collection: false debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_starting_level: 0 debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 succeeded,manifest_file_number is 21, next_file_number is 23, last_sequence is 4154, log_number is 17,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 10 debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 17 debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca0be335-dc15-4959-a5fc-0416b60f370b debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313149, "job": 1, "event": "recovery_started", "wal_files": [16, 20]} debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1029] Skipping log #16 since it is older than min log to keep #17 debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #20 mode 2 debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313298, "job": 1, "event": "recovery_finished"} debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 25 debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. debug 2024-02-16T21:27:13.315+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c9d9ee000 debug 2024-02-16T21:27:13.319+0000 7fca997d4c80 4 rocksdb: DB pointer 0x555c9d9cc000 debug 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- debug 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1111] ** DB Stats ** Uptime(secs): 0.1 total, 0.1 interval Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 1/0 5.42 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L6 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 2/0 5.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 0.1 total, 0.1 interval Flush(GB): cumulative 0.000, interval 0.000 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count Block cache BinnedLRUCache@0x555c9d943350#98 capacity: 512.00 MB usage: 18.09 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 Block cache entry stats(count,size,portion): DataBlock(1,0.77 KB,0.000146031%) FilterBlock(2,5.14 KB,0.000980496%) IndexBlock(2,12.19 KB,0.00232458%) Misc(1,0.00 KB,0%) ** File Read Latency Histogram By Level [default] ** debug 2024-02-16T21:27:13.319+0000 7fca997d4c80 0 starting mon.a rank 0 at public addrs [v2:10.109.102.152:3300/0,v1:10.109.102.152:6789/0] at bind addrs [v2:10.244.65.102:3300/0,v1:10.244.65.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb debug 2024-02-16T21:27:13.319+0000 7fca997d4c80 1 mon.a@-1(???) e1 preinit fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' what(): End of buffer [buffer:2] *** Caught signal (Aborted) ** in thread 7fca997d4c80 thread_name:ceph-mon ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable) 1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20] 2: gsignal() 3: abort() 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b] 5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c] 6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7] 7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808] 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385] 9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0xa64) [0x7fca991ede94] 10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x162) [0x7fca991fbb42] 11: (void ceph::decode > >(std::vector, std::allocator > >&, ceph::buffer::v15_2_0::list::iterator_impl&)+0x145) [0x7fca99208195] 12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x161) [0x7fca991fda01] 13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb] 14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764] 15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b] 16: main() 17: __libc_start_main() 18: _start() debug 2024-02-16T21:27:13.343+0000 7fca997d4c80 -1 *** Caught signal (Aborted) ** in thread 7fca997d4c80 thread_name:ceph-mon ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable) 1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20] 2: gsignal() 3: abort() 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b] 5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c] 6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7] 7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808] 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385] 9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0xa64) [0x7fca991ede94] 10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x162) [0x7fca991fbb42] 11: (void ceph::decode > >(std::vector, std::allocator > >&, ceph::buffer::v15_2_0::list::iterator_impl&)+0x145) [0x7fca99208195] 12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x161) [0x7fca991fda01] 13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb] 14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764] 15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b] 16: main() 17: __libc_start_main() 18: _start() NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- debug -299> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command assert hook 0x555c9d882b30 debug -298> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command abort hook 0x555c9d882b30 debug -297> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command leak_some_memory hook 0x555c9d882b30 debug -296> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_dump hook 0x555c9d882b30 debug -295> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 1 hook 0x555c9d882b30 debug -294> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf dump hook 0x555c9d882b30 debug -293> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_schema hook 0x555c9d882b30 debug -292> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram dump hook 0x555c9d882b30 debug -291> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 2 hook 0x555c9d882b30 debug -290> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf schema hook 0x555c9d882b30 debug -289> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter dump hook 0x555c9d882b30 debug -288> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter schema hook 0x555c9d882b30 debug -287> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram schema hook 0x555c9d882b30 debug -286> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf reset hook 0x555c9d882b30 debug -285> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config show hook 0x555c9d882b30 debug -284> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config help hook 0x555c9d882b30 debug -283> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config set hook 0x555c9d882b30 debug -282> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config unset hook 0x555c9d882b30 debug -281> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config get hook 0x555c9d882b30 debug -280> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff hook 0x555c9d882b30 debug -279> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff get hook 0x555c9d882b30 debug -278> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command injectargs hook 0x555c9d882b30 debug -277> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log flush hook 0x555c9d882b30 debug -276> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log dump hook 0x555c9d882b30 debug -275> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log reopen hook 0x555c9d882b30 debug -274> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command dump_mempools hook 0x555c9d89e328 debug -273> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 setuser_match_path /var/lib/ceph/mon/ceph-a/store.db owned by 167:167. set uid:gid to 167:167 (ceph:ceph) debug -272> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable), process ceph-mon, pid 98 debug -271> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 pidfile_write: ignore empty --pid-file debug -270> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) init /var/run/ceph/ceph-mon.a.asok debug -269> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) bind_and_listen /var/run/ceph/ceph-mon.a.asok debug -268> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 0 hook 0x555c9d8866d8 debug -267> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command version hook 0x555c9d8866d8 debug -266> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command git_version hook 0x555c9d8866d8 debug -265> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command help hook 0x555c9d882ad0 debug -264> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command get_command_descriptions hook 0x555c9d882ac0 debug -263> 2024-02-16T21:27:13.239+0000 7fca997d4c80 0 load: jerasure load: lrc debug -262> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true debug -261> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432 debug -260> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression debug -259> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true debug -258> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432 debug -257> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression debug -256> 2024-02-16T21:27:13.247+0000 7fca901e3700 5 asok(0x555c9db7c000) entry start debug -255> 2024-02-16T21:27:13.247+0000 7fca997d4c80 5 rocksdb: verify_sharding column families from rocksdb: [default] debug -254> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: RocksDB version: 7.9.2 debug -253> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Git sha 0 debug -252> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compile date 2024-02-15 23:05:54 debug -251> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB SUMMARY debug -250> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB Session ID: 4VWHRHUR4SCTKUZAVCUX debug -249> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: CURRENT file: CURRENT debug -248> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: IDENTITY file: IDENTITY debug -247> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: MANIFEST file: MANIFEST-000021 size: 268 Bytes debug -246> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000008.sst 000015.sst debug -245> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000016.log size: 0 ; 000020.log size: 0 ; debug -244> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.error_if_exists: 0 debug -243> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_if_missing: 0 debug -242> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.paranoid_checks: 1 debug -241> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.flush_verify_memtable_count: 1 debug -240> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 debug -239> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 debug -238> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.env: 0x555c9cde2720 debug -237> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.fs: PosixFileSystem debug -236> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.info_log: 0x555c9e629580 debug -235> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_file_opening_threads: 16 debug -234> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.statistics: (nil) debug -233> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_fsync: 0 debug -232> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_log_file_size: 0 debug -231> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 debug -230> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_file_time_to_roll: 0 debug -229> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.keep_log_file_num: 1000 debug -228> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.recycle_log_file_num: 0 debug -227> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_fallocate: 1 debug -226> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_reads: 0 debug -225> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_writes: 0 debug -224> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_reads: 0 debug -223> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 debug -222> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_missing_column_families: 0 debug -221> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_log_dir: debug -220> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_dir: debug -219> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.table_cache_numshardbits: 6 debug -218> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_ttl_seconds: 0 debug -217> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_size_limit_MB: 0 debug -216> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 debug -215> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 debug -214> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.is_fd_close_on_exec: 1 debug -213> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.advise_random_on_open: 1 debug -212> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_write_buffer_size: 0 debug -211> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_manager: 0x555c9d8c0320 debug -210> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 debug -209> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 debug -208> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_adaptive_mutex: 0 debug -207> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.rate_limiter: (nil) debug -206> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 debug -205> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_recovery_mode: 2 debug -204> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_thread_tracking: 0 debug -203> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_pipelined_write: 0 debug -202> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.unordered_write: 0 debug -201> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 debug -200> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 debug -199> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 debug -198> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 debug -197> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.row_cache: None debug -196> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_filter: None debug -195> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 debug -194> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_ingest_behind: 0 debug -193> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.two_write_queues: 0 debug -192> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manual_wal_flush: 0 debug -191> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_compression: 0 debug -190> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.atomic_flush: 0 debug -189> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 debug -188> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.persist_stats_to_disk: 0 debug -187> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_dbid_to_manifest: 0 debug -186> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_readahead_size: 0 debug -185> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown debug -184> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.best_efforts_recovery: 0 debug -183> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 debug -182> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 debug -181> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_data_in_errors: 0 debug -180> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_host_id: __hostname__ debug -179> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enforce_single_del_contracts: true debug -178> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_jobs: 2 debug -177> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_compactions: -1 debug -176> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_subcompactions: 1 debug -175> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 debug -174> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 debug -173> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delayed_write_rate : 16777216 debug -172> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_total_wal_size: 0 debug -171> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 debug -170> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_dump_period_sec: 600 debug -169> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_persist_period_sec: 600 debug -168> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 debug -167> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_open_files: -1 debug -166> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bytes_per_sync: 0 debug -165> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_bytes_per_sync: 0 debug -164> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.strict_bytes_per_sync: 0 debug -163> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.compaction_readahead_size: 0 debug -162> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_flushes: -1 debug -161> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compression algorithms supported: debug -160> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 debug -159> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTD supported: 0 debug -158> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kXpressCompression supported: 0 debug -157> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4HCCompression supported: 1 debug -156> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZlibCompression supported: 1 debug -155> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kSnappyCompression supported: 1 debug -154> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4Compression supported: 1 debug -153> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kBZip2Compression supported: 0 debug -152> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Fast CRC32 supported: Supported on x86 debug -151> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DMutex implementation: pthread_mutex_t debug -150> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 debug -149> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: debug -148> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator debug -147> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.merge_operator: debug -146> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter: None debug -145> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter_factory: None debug -144> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.sst_partitioner_factory: None debug -143> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_factory: SkipListFactory debug -142> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_factory: BlockBasedTable debug -141> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c9e629680) cache_index_and_filter_blocks: 1 cache_index_and_filter_blocks_with_high_priority: 0 pin_l0_filter_and_index_blocks_in_cache: 0 pin_top_level_index_and_filter: 1 index_type: 0 data_block_index_type: 0 index_shortening: 1 data_block_hash_table_util_ratio: 0.750000 checksum: 4 no_block_cache: 0 block_cache: 0x555c9d943350 block_cache_name: BinnedLRUCache block_cache_options: capacity : 536870912 num_shard_bits : 4 strict_capacity_limit : 0 high_pri_pool_ratio: 0.000 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: bloomfilter whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 5 enable_index_compression: 1 block_align: 0 max_auto_readahead_size: 262144 prepopulate_block_cache: 0 initial_auto_readahead_size: 8192 num_file_reads_for_auto_readahead: 2 debug -140> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_size: 33554432 debug -139> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number: 2 debug -138> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression: NoCompression debug -137> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression: Disabled debug -136> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.prefix_extractor: nullptr debug -135> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr debug -134> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.num_levels: 7 debug -133> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 debug -132> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 debug -131> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 debug -130> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 debug -129> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 debug -128> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 debug -127> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 debug -126> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 debug -125> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 debug -124> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false debug -123> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 debug -122> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true debug -121> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.window_bits: -14 debug -120> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.level: 32767 debug -119> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.strategy: 0 debug -118> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 debug -117> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 debug -116> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true debug -115> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 debug -114> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.enabled: false debug -113> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 debug -112> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 debug -111> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 debug -110> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 debug -109> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_base: 67108864 debug -108> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_multiplier: 1 debug -107> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 debug -106> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 debug -105> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 debug -104> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 debug -103> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 debug -102> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 debug -101> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 debug -100> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 debug -99> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 debug -98> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 debug -97> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 debug -96> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 debug -95> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true debug -94> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.arena_block_size: 1048576 debug -93> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 debug -92> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 debug -91> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.disable_auto_compactions: 0 debug -90> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel debug -89> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio debug -88> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 debug -87> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 debug -86> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 debug -85> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 debug -84> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 debug -83> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize debug -82> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 debug -81> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 debug -80> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_properties_collectors: debug -79> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_support: 0 debug -78> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_num_locks: 10000 debug -77> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 debug -76> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 debug -75> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_huge_page_size: 0 debug -74> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bloom_locality: 0 debug -73> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_successive_merges: 0 debug -72> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.optimize_filters_for_hits: 0 debug -71> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.paranoid_file_checks: 0 debug -70> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.force_consistency_checks: 1 debug -69> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.report_bg_io_stats: 0 debug -68> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ttl: 2592000 debug -67> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.periodic_compaction_seconds: 0 debug -66> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 debug -65> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 debug -64> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_files: false debug -63> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_blob_size: 0 debug -62> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_size: 268435456 debug -61> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compression_type: NoCompression debug -60> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_garbage_collection: false debug -59> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 debug -58> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 debug -57> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 debug -56> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_starting_level: 0 debug -55> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 debug -54> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. debug -53> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 succeeded,manifest_file_number is 21, next_file_number is 23, last_sequence is 4154, log_number is 17,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 10 debug -52> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 17 debug -51> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca0be335-dc15-4959-a5fc-0416b60f370b debug -50> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313149, "job": 1, "event": "recovery_started", "wal_files": [16, 20]} debug -49> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1029] Skipping log #16 since it is older than min log to keep #17 debug -48> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #20 mode 2 debug -47> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313298, "job": 1, "event": "recovery_finished"} debug -46> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 25 debug -45> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. debug -44> 2024-02-16T21:27:13.315+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c9d9ee000 debug -43> 2024-02-16T21:27:13.319+0000 7fca997d4c80 4 rocksdb: DB pointer 0x555c9d9cc000 debug -42> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- debug -41> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx debug -40> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx debug -39> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx debug -38> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: none debug -37> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -36> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -35> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -34> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -33> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -32> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -31> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -30> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -29> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -28> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -27> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -26> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -25> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring debug -24> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1111] ** DB Stats ** Uptime(secs): 0.1 total, 0.1 interval Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 1/0 5.42 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L6 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 2/0 5.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 0.1 total, 0.1 interval Flush(GB): cumulative 0.000, interval 0.000 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count Block cache BinnedLRUCache@0x555c9d943350#98 capacity: 512.00 MB usage: 18.09 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 Block cache entry stats(count,size,portion): DataBlock(1,0.77 KB,0.000146031%) FilterBlock(2,5.14 KB,0.000980496%) IndexBlock(2,12.19 KB,0.00232458%) Misc(1,0.00 KB,0%) ** File Read Latency Histogram By Level [default] ** debug -23> 2024-02-16T21:27:13.319+0000 7fca997d4c80 0 starting mon.a rank 0 at public addrs [v2:10.109.102.152:3300/0,v1:10.109.102.152:6789/0] at bind addrs [v2:10.244.65.102:3300/0,v1:10.244.65.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb debug -22> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx debug -21> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx debug -20> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx debug -19> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: none debug -18> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -17> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -16> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -15> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -14> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -13> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -12> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -11> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -10> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -9> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -8> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -7> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -6> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring debug -5> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx debug -4> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx debug -3> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) debug -2> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) debug -1> 2024-02-16T21:27:13.319+0000 7fca997d4c80 1 mon.a@-1(???) e1 preinit fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb debug 0> 2024-02-16T21:27:13.343+0000 7fca997d4c80 -1 *** Caught signal (Aborted) ** in thread 7fca997d4c80 thread_name:ceph-mon ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable) 1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20] 2: gsignal() 3: abort() 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b] 5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c] 6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7] 7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808] 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385] 9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0xa64) [0x7fca991ede94] 10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x162) [0x7fca991fbb42] 11: (void ceph::decode > >(std::vector, std::allocator > >&, ceph::buffer::v15_2_0::list::iterator_impl&)+0x145) [0x7fca99208195] 12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x161) [0x7fca991fda01] 13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb] 14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764] 15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b] 16: main() 17: __libc_start_main() 18: _start() NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 rbd_pwl 0/ 5 journaler 0/ 5 objectcacher 0/ 5 immutable_obj_cache 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 0 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 1 reserver 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 rgw_sync 1/ 5 rgw_datacache 1/ 5 rgw_access 1/ 5 rgw_dbstore 1/ 5 rgw_flight 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 compressor 1/ 5 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 1/ 5 fuse 2/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace 1/ 5 prioritycache 0/ 5 test 0/ 5 cephfs_mirror 0/ 5 cephsqlite 0/ 5 seastore 0/ 5 seastore_onode 0/ 5 seastore_odata 0/ 5 seastore_omap 0/ 5 seastore_tm 0/ 5 seastore_t 0/ 5 seastore_cleaner 0/ 5 seastore_epm 0/ 5 seastore_lba 0/ 5 seastore_fixedkv_tree 0/ 5 seastore_cache 0/ 5 seastore_journal 0/ 5 seastore_device 0/ 5 seastore_backref 0/ 5 alienstore 1/ 5 mclock 0/ 5 cyanstore 1/ 5 ceph_exporter 1/ 5 memstore -2/-2 (syslog threshold) 99/99 (stderr threshold) --- pthread ID / name mapping for recent threads --- 7fca7dfce700 / ceph-mon 7fca901e3700 / admin_socket 7fca997d4c80 / ceph-mon max_recent 10000 max_new 1000 log_file --- end dump of recent events --- --- begin dump of recent events --- debug -299> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command assert hook 0x555c9d882b30 debug -298> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command abort hook 0x555c9d882b30 debug -297> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command leak_some_memory hook 0x555c9d882b30 debug -296> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_dump hook 0x555c9d882b30 debug -295> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 1 hook 0x555c9d882b30 debug -294> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf dump hook 0x555c9d882b30 debug -293> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_schema hook 0x555c9d882b30 debug -292> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram dump hook 0x555c9d882b30 debug -291> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 2 hook 0x555c9d882b30 debug -290> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf schema hook 0x555c9d882b30 debug -289> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter dump hook 0x555c9d882b30 debug -288> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter schema hook 0x555c9d882b30 debug -287> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram schema hook 0x555c9d882b30 debug -286> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf reset hook 0x555c9d882b30 debug -285> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config show hook 0x555c9d882b30 debug -284> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config help hook 0x555c9d882b30 debug -283> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config set hook 0x555c9d882b30 debug -282> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config unset hook 0x555c9d882b30 debug -281> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config get hook 0x555c9d882b30 debug -280> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff hook 0x555c9d882b30 debug -279> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff get hook 0x555c9d882b30 debug -278> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command injectargs hook 0x555c9d882b30 debug -277> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log flush hook 0x555c9d882b30 debug -276> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log dump hook 0x555c9d882b30 debug -275> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log reopen hook 0x555c9d882b30 debug -274> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command dump_mempools hook 0x555c9d89e328 debug -273> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 setuser_match_path /var/lib/ceph/mon/ceph-a/store.db owned by 167:167. set uid:gid to 167:167 (ceph:ceph) debug -272> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable), process ceph-mon, pid 98 debug -271> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 pidfile_write: ignore empty --pid-file debug -270> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) init /var/run/ceph/ceph-mon.a.asok debug -269> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) bind_and_listen /var/run/ceph/ceph-mon.a.asok debug -268> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 0 hook 0x555c9d8866d8 debug -267> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command version hook 0x555c9d8866d8 debug -266> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command git_version hook 0x555c9d8866d8 debug -265> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command help hook 0x555c9d882ad0 debug -264> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command get_command_descriptions hook 0x555c9d882ac0 debug -263> 2024-02-16T21:27:13.239+0000 7fca997d4c80 0 load: jerasure load: lrc debug -262> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true debug -261> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432 debug -260> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression debug -259> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true debug -258> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432 debug -257> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression debug -256> 2024-02-16T21:27:13.247+0000 7fca901e3700 5 asok(0x555c9db7c000) entry start debug -255> 2024-02-16T21:27:13.247+0000 7fca997d4c80 5 rocksdb: verify_sharding column families from rocksdb: [default] debug -254> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: RocksDB version: 7.9.2 debug -253> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Git sha 0 debug -252> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compile date 2024-02-15 23:05:54 debug -251> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB SUMMARY debug -250> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB Session ID: 4VWHRHUR4SCTKUZAVCUX debug -249> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: CURRENT file: CURRENT debug -248> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: IDENTITY file: IDENTITY debug -247> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: MANIFEST file: MANIFEST-000021 size: 268 Bytes debug -246> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000008.sst 000015.sst debug -245> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000016.log size: 0 ; 000020.log size: 0 ; debug -244> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.error_if_exists: 0 debug -243> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_if_missing: 0 debug -242> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.paranoid_checks: 1 debug -241> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.flush_verify_memtable_count: 1 debug -240> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 debug -239> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 debug -238> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.env: 0x555c9cde2720 debug -237> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.fs: PosixFileSystem debug -236> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.info_log: 0x555c9e629580 debug -235> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_file_opening_threads: 16 debug -234> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.statistics: (nil) debug -233> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_fsync: 0 debug -232> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_log_file_size: 0 debug -231> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 debug -230> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_file_time_to_roll: 0 debug -229> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.keep_log_file_num: 1000 debug -228> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.recycle_log_file_num: 0 debug -227> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_fallocate: 1 debug -226> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_reads: 0 debug -225> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_writes: 0 debug -224> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_reads: 0 debug -223> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 debug -222> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_missing_column_families: 0 debug -221> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_log_dir: debug -220> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_dir: debug -219> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.table_cache_numshardbits: 6 debug -218> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_ttl_seconds: 0 debug -217> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_size_limit_MB: 0 debug -216> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 debug -215> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 debug -214> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.is_fd_close_on_exec: 1 debug -213> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.advise_random_on_open: 1 debug -212> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_write_buffer_size: 0 debug -211> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_manager: 0x555c9d8c0320 debug -210> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 debug -209> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 debug -208> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_adaptive_mutex: 0 debug -207> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.rate_limiter: (nil) debug -206> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 debug -205> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_recovery_mode: 2 debug -204> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_thread_tracking: 0 debug -203> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_pipelined_write: 0 debug -202> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.unordered_write: 0 debug -201> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 debug -200> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 debug -199> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 debug -198> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 debug -197> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.row_cache: None debug -196> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_filter: None debug -195> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 debug -194> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_ingest_behind: 0 debug -193> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.two_write_queues: 0 debug -192> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manual_wal_flush: 0 debug -191> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_compression: 0 debug -190> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.atomic_flush: 0 debug -189> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 debug -188> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.persist_stats_to_disk: 0 debug -187> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_dbid_to_manifest: 0 debug -186> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_readahead_size: 0 debug -185> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown debug -184> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.best_efforts_recovery: 0 debug -183> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 debug -182> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 debug -181> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_data_in_errors: 0 debug -180> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_host_id: __hostname__ debug -179> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enforce_single_del_contracts: true debug -178> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_jobs: 2 debug -177> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_compactions: -1 debug -176> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_subcompactions: 1 debug -175> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 debug -174> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 debug -173> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delayed_write_rate : 16777216 debug -172> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_total_wal_size: 0 debug -171> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 debug -170> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_dump_period_sec: 600 debug -169> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_persist_period_sec: 600 debug -168> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 debug -167> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_open_files: -1 debug -166> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bytes_per_sync: 0 debug -165> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_bytes_per_sync: 0 debug -164> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.strict_bytes_per_sync: 0 debug -163> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.compaction_readahead_size: 0 debug -162> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_flushes: -1 debug -161> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compression algorithms supported: debug -160> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 debug -159> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTD supported: 0 debug -158> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kXpressCompression supported: 0 debug -157> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4HCCompression supported: 1 debug -156> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZlibCompression supported: 1 debug -155> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kSnappyCompression supported: 1 debug -154> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4Compression supported: 1 debug -153> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kBZip2Compression supported: 0 debug -152> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Fast CRC32 supported: Supported on x86 debug -151> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DMutex implementation: pthread_mutex_t debug -150> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 debug -149> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: debug -148> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator debug -147> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.merge_operator: debug -146> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter: None debug -145> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter_factory: None debug -144> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.sst_partitioner_factory: None debug -143> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_factory: SkipListFactory debug -142> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_factory: BlockBasedTable debug -141> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c9e629680) cache_index_and_filter_blocks: 1 cache_index_and_filter_blocks_with_high_priority: 0 pin_l0_filter_and_index_blocks_in_cache: 0 pin_top_level_index_and_filter: 1 index_type: 0 data_block_index_type: 0 index_shortening: 1 data_block_hash_table_util_ratio: 0.750000 checksum: 4 no_block_cache: 0 block_cache: 0x555c9d943350 block_cache_name: BinnedLRUCache block_cache_options: capacity : 536870912 num_shard_bits : 4 strict_capacity_limit : 0 high_pri_pool_ratio: 0.000 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: bloomfilter whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 5 enable_index_compression: 1 block_align: 0 max_auto_readahead_size: 262144 prepopulate_block_cache: 0 initial_auto_readahead_size: 8192 num_file_reads_for_auto_readahead: 2 debug -140> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_size: 33554432 debug -139> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number: 2 debug -138> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression: NoCompression debug -137> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression: Disabled debug -136> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.prefix_extractor: nullptr debug -135> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr debug -134> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.num_levels: 7 debug -133> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 debug -132> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 debug -131> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 debug -130> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 debug -129> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 debug -128> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 debug -127> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 debug -126> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 debug -125> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 debug -124> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false debug -123> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 debug -122> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true debug -121> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.window_bits: -14 debug -120> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.level: 32767 debug -119> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.strategy: 0 debug -118> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 debug -117> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 debug -116> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true debug -115> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 debug -114> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.enabled: false debug -113> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 debug -112> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 debug -111> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 debug -110> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 debug -109> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_base: 67108864 debug -108> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_multiplier: 1 debug -107> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 debug -106> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 debug -105> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 debug -104> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 debug -103> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 debug -102> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 debug -101> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 debug -100> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 debug -99> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 debug -98> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 debug -97> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 debug -96> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 debug -95> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true debug -94> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.arena_block_size: 1048576 debug -93> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 debug -92> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 debug -91> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.disable_auto_compactions: 0 debug -90> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel debug -89> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio debug -88> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 debug -87> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 debug -86> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 debug -85> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 debug -84> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 debug -83> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize debug -82> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 debug -81> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 debug -80> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_properties_collectors: debug -79> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_support: 0 debug -78> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_num_locks: 10000 debug -77> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 debug -76> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 debug -75> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_huge_page_size: 0 debug -74> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bloom_locality: 0 debug -73> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_successive_merges: 0 debug -72> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.optimize_filters_for_hits: 0 debug -71> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.paranoid_file_checks: 0 debug -70> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.force_consistency_checks: 1 debug -69> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.report_bg_io_stats: 0 debug -68> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ttl: 2592000 debug -67> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.periodic_compaction_seconds: 0 debug -66> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 debug -65> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 debug -64> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_files: false debug -63> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_blob_size: 0 debug -62> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_size: 268435456 debug -61> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compression_type: NoCompression debug -60> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_garbage_collection: false debug -59> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 debug -58> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 debug -57> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 debug -56> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_starting_level: 0 debug -55> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 debug -54> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. debug -53> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 succeeded,manifest_file_number is 21, next_file_number is 23, last_sequence is 4154, log_number is 17,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 10 debug -52> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 17 debug -51> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca0be335-dc15-4959-a5fc-0416b60f370b debug -50> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313149, "job": 1, "event": "recovery_started", "wal_files": [16, 20]} debug -49> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1029] Skipping log #16 since it is older than min log to keep #17 debug -48> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #20 mode 2 debug -47> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313298, "job": 1, "event": "recovery_finished"} debug -46> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 25 debug -45> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. debug -44> 2024-02-16T21:27:13.315+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c9d9ee000 debug -43> 2024-02-16T21:27:13.319+0000 7fca997d4c80 4 rocksdb: DB pointer 0x555c9d9cc000 debug -42> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- debug -41> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx debug -40> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx debug -39> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx debug -38> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: none debug -37> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -36> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -35> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -34> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -33> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -32> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -31> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -30> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -29> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -28> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -27> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc debug -26> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure debug -25> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring debug -24> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1111] ** DB Stats ** Uptime(secs): 0.1 total, 0.1 interval Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 1/0 5.42 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L6 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 2/0 5.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 0.1 total, 0.1 interval Flush(GB): cumulative 0.000, interval 0.000 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count Block cache BinnedLRUCache@0x555c9d943350#98 capacity: 512.00 MB usage: 18.09 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 Block cache entry stats(count,size,portion): DataBlock(1,0.77 KB,0.000146031%) FilterBlock(2,5.14 KB,0.000980496%) IndexBlock(2,12.19 KB,0.00232458%) Misc(1,0.00 KB,0%) ** File Read Latency Histogram By Level [default] ** debug -23> 2024-02-16T21:27:13.319+0000 7fca997d4c80 0 starting mon.a rank 0 at public addrs [v2:10.109.102.152:3300/0,v1:10.109.102.152:6789/0] at bind addrs [v2:10.244.65.102:3300/0,v1:10.244.65.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb debug -22> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx debug -21> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx debug -20> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx debug -19> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: none debug -18> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -17> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -16> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -15> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -14> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -13> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -12> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -11> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -10> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -9> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -8> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc debug -7> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure debug -6> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring debug -5> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx debug -4> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx debug -3> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) debug -2> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201) debug -1> 2024-02-16T21:27:13.319+0000 7fca997d4c80 1 mon.a@-1(???) e1 preinit fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb debug 0> 2024-02-16T21:27:13.343+0000 7fca997d4c80 -1 *** Caught signal (Aborted) ** in thread 7fca997d4c80 thread_name:ceph-mon ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable) 1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20] 2: gsignal() 3: abort() 4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b] 5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c] 6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7] 7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808] 8: (ceph::buffer::v15_2_0::list::iterator_impl::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385] 9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0xa64) [0x7fca991ede94] 10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x162) [0x7fca991fbb42] 11: (void ceph::decode > >(std::vector, std::allocator > >&, ceph::buffer::v15_2_0::list::iterator_impl&)+0x145) [0x7fca99208195] 12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl&)+0x161) [0x7fca991fda01] 13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb] 14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764] 15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b] 16: main() 17: __libc_start_main() 18: _start() NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_mirror 0/ 5 rbd_replay 0/ 5 rbd_pwl 0/ 5 journaler 0/ 5 objectcacher 0/ 5 immutable_obj_cache 0/ 5 client 1/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 0 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 1 reserver 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 rgw_sync 1/ 5 rgw_datacache 1/ 5 rgw_access 1/ 5 rgw_dbstore 1/ 5 rgw_flight 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 compressor 1/ 5 bluestore 1/ 5 bluefs 1/ 3 bdev 1/ 5 kstore 4/ 5 rocksdb 4/ 5 leveldb 1/ 5 fuse 2/ 5 mgr 1/ 5 mgrc 1/ 5 dpdk 1/ 5 eventtrace 1/ 5 prioritycache 0/ 5 test 0/ 5 cephfs_mirror 0/ 5 cephsqlite 0/ 5 seastore 0/ 5 seastore_onode 0/ 5 seastore_odata 0/ 5 seastore_omap 0/ 5 seastore_tm 0/ 5 seastore_t 0/ 5 seastore_cleaner 0/ 5 seastore_epm 0/ 5 seastore_lba 0/ 5 seastore_fixedkv_tree 0/ 5 seastore_cache 0/ 5 seastore_journal 0/ 5 seastore_device 0/ 5 seastore_backref 0/ 5 alienstore 1/ 5 mclock 0/ 5 cyanstore 1/ 5 ceph_exporter 1/ 5 memstore -2/-2 (syslog threshold) 99/99 (stderr threshold) --- pthread ID / name mapping for recent threads --- 7fca7dfce700 / ceph-mon 7fca901e3700 / admin_socket 7fca997d4c80 / ceph-mon max_recent 10000 max_new 1000 log_file /var/lib/ceph/crash/2024-02-16T21:27:13.345559Z_e6a9acaa-b1b2-404c-9d42-48efcb9449a7/log --- end dump of recent events ---