Project

General

Profile

Bug #64478 ยป mon-a-crash.log

Travis Nielsen, 02/16/2024 10:10 PM

 
debug 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 setuser_match_path /var/lib/ceph/mon/ceph-a/store.db owned by 167:167. set uid:gid to 167:167 (ceph:ceph)
debug 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable), process ceph-mon, pid 98
debug 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 pidfile_write: ignore empty --pid-file
debug 2024-02-16T21:27:13.239+0000 7fca997d4c80 0 load: jerasure load: lrc
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: RocksDB version: 7.9.2

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Git sha 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compile date 2024-02-15 23:05:54
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB SUMMARY

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB Session ID: 4VWHRHUR4SCTKUZAVCUX

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: CURRENT file: CURRENT

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: IDENTITY file: IDENTITY

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: MANIFEST file: MANIFEST-000021 size: 268 Bytes

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000008.sst 000015.sst

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000016.log size: 0 ; 000020.log size: 0 ;

debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.error_if_exists: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_if_missing: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.paranoid_checks: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.flush_verify_memtable_count: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.env: 0x555c9cde2720
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.fs: PosixFileSystem
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.info_log: 0x555c9e629580
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_file_opening_threads: 16
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.statistics: (nil)
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_fsync: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_log_file_size: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_file_time_to_roll: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.keep_log_file_num: 1000
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.recycle_log_file_num: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_fallocate: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_reads: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_writes: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_reads: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_missing_column_families: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_log_dir:
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_dir:
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.table_cache_numshardbits: 6
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_ttl_seconds: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_size_limit_MB: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.is_fd_close_on_exec: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.advise_random_on_open: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_write_buffer_size: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_manager: 0x555c9d8c0320
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_adaptive_mutex: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.rate_limiter: (nil)
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_recovery_mode: 2
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_thread_tracking: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_pipelined_write: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.unordered_write: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.row_cache: None
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_filter: None
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_ingest_behind: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.two_write_queues: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manual_wal_flush: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_compression: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.atomic_flush: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.persist_stats_to_disk: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_dbid_to_manifest: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_readahead_size: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.best_efforts_recovery: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_data_in_errors: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_host_id: __hostname__
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enforce_single_del_contracts: true
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_jobs: 2
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_compactions: -1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_subcompactions: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delayed_write_rate : 16777216
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_total_wal_size: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_dump_period_sec: 600
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_persist_period_sec: 600
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_open_files: -1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bytes_per_sync: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_bytes_per_sync: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.strict_bytes_per_sync: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.compaction_readahead_size: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_flushes: -1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compression algorithms supported:
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTD supported: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kXpressCompression supported: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4HCCompression supported: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZlibCompression supported: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kSnappyCompression supported: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4Compression supported: 1
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kBZip2Compression supported: 0
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Fast CRC32 supported: Supported on x86
debug 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DMutex implementation: pthread_mutex_t
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021

debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]:

debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.merge_operator:
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter: None
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter_factory: None
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.sst_partitioner_factory: None
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_factory: SkipListFactory
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_factory: BlockBasedTable
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c9e629680)
cache_index_and_filter_blocks: 1
cache_index_and_filter_blocks_with_high_priority: 0
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
checksum: 4
no_block_cache: 0
block_cache: 0x555c9d943350
block_cache_name: BinnedLRUCache
block_cache_options:
capacity : 536870912
num_shard_bits : 4
strict_capacity_limit : 0
high_pri_pool_ratio: 0.000
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: bloomfilter
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
initial_auto_readahead_size: 8192
num_file_reads_for_auto_readahead: 2

debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_size: 33554432
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number: 2
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression: NoCompression
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression: Disabled
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.prefix_extractor: nullptr
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.num_levels: 7
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.window_bits: -14
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.level: 32767
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.strategy: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.parallel_threads: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.enabled: false
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_base: 67108864
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_multiplier: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.arena_block_size: 1048576
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.disable_auto_compactions: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_properties_collectors:
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_support: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_num_locks: 10000
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_huge_page_size: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bloom_locality: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_successive_merges: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.optimize_filters_for_hits: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.paranoid_file_checks: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.force_consistency_checks: 1
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.report_bg_io_stats: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ttl: 2592000
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.periodic_compaction_seconds: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preserve_internal_time_seconds: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_files: false
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_blob_size: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_size: 268435456
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compression_type: NoCompression
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_garbage_collection: false
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compaction_readahead_size: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_starting_level: 0
debug 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000
debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed.
debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 succeeded,manifest_file_number is 21, next_file_number is 23, last_sequence is 4154, log_number is 17,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 10

debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 17

debug 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca0be335-dc15-4959-a5fc-0416b60f370b

debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313149, "job": 1, "event": "recovery_started", "wal_files": [16, 20]}
debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1029] Skipping log #16 since it is older than min log to keep #17
debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #20 mode 2
debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313298, "job": 1, "event": "recovery_finished"}
debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 25

debug 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed.
debug 2024-02-16T21:27:13.315+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c9d9ee000
debug 2024-02-16T21:27:13.319+0000 7fca997d4c80 4 rocksdb: DB pointer 0x555c9d9cc000
debug 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS -------
debug 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1111]
** DB Stats **
Uptime(secs): 0.1 total, 0.1 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 5.42 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
L6 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
Sum 2/0 5.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0

** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0

Uptime(secs): 0.1 total, 0.1 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache BinnedLRUCache@0x555c9d943350#98 capacity: 512.00 MB usage: 18.09 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(1,0.77 KB,0.000146031%) FilterBlock(2,5.14 KB,0.000980496%) IndexBlock(2,12.19 KB,0.00232458%) Misc(1,0.00 KB,0%)

** File Read Latency Histogram By Level [default] **

debug 2024-02-16T21:27:13.319+0000 7fca997d4c80 0 starting mon.a rank 0 at public addrs [v2:10.109.102.152:3300/0,v1:10.109.102.152:6789/0] at bind addrs [v2:10.244.65.102:3300/0,v1:10.244.65.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb
debug 2024-02-16T21:27:13.319+0000 7fca997d4c80 1 mon.a@-1(???) e1 preinit fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb
terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer'
what(): End of buffer [buffer:2]
*** Caught signal (Aborted) **
in thread 7fca997d4c80 thread_name:ceph-mon
ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable)
1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20]
2: gsignal()
3: abort()
4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b]
5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c]
6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7]
7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808]
8: (ceph::buffer::v15_2_0::list::iterator_impl<true>::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385]
9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0xa64) [0x7fca991ede94]
10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x162) [0x7fca991fbb42]
11: (void ceph::decode<Filesystem, std::allocator<std::shared_ptr<Filesystem> > >(std::vector<std::shared_ptr<Filesystem>, std::allocator<std::shared_ptr<Filesystem> > >&, ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x145) [0x7fca99208195]
12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x161) [0x7fca991fda01]
13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb]
14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764]
15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b]
16: main()
17: __libc_start_main()
18: _start()
debug 2024-02-16T21:27:13.343+0000 7fca997d4c80 -1 *** Caught signal (Aborted) **
in thread 7fca997d4c80 thread_name:ceph-mon

ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable)
1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20]
2: gsignal()
3: abort()
4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b]
5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c]
6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7]
7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808]
8: (ceph::buffer::v15_2_0::list::iterator_impl<true>::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385]
9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0xa64) [0x7fca991ede94]
10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x162) [0x7fca991fbb42]
11: (void ceph::decode<Filesystem, std::allocator<std::shared_ptr<Filesystem> > >(std::vector<std::shared_ptr<Filesystem>, std::allocator<std::shared_ptr<Filesystem> > >&, ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x145) [0x7fca99208195]
12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x161) [0x7fca991fda01]
13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb]
14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764]
15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b]
16: main()
17: __libc_start_main()
18: _start()
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
debug -299> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command assert hook 0x555c9d882b30
debug -298> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command abort hook 0x555c9d882b30
debug -297> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command leak_some_memory hook 0x555c9d882b30
debug -296> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_dump hook 0x555c9d882b30
debug -295> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 1 hook 0x555c9d882b30
debug -294> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf dump hook 0x555c9d882b30
debug -293> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_schema hook 0x555c9d882b30
debug -292> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram dump hook 0x555c9d882b30
debug -291> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 2 hook 0x555c9d882b30
debug -290> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf schema hook 0x555c9d882b30
debug -289> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter dump hook 0x555c9d882b30
debug -288> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter schema hook 0x555c9d882b30
debug -287> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram schema hook 0x555c9d882b30
debug -286> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf reset hook 0x555c9d882b30
debug -285> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config show hook 0x555c9d882b30
debug -284> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config help hook 0x555c9d882b30
debug -283> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config set hook 0x555c9d882b30
debug -282> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config unset hook 0x555c9d882b30
debug -281> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config get hook 0x555c9d882b30
debug -280> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff hook 0x555c9d882b30
debug -279> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff get hook 0x555c9d882b30
debug -278> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command injectargs hook 0x555c9d882b30
debug -277> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log flush hook 0x555c9d882b30
debug -276> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log dump hook 0x555c9d882b30
debug -275> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log reopen hook 0x555c9d882b30
debug -274> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command dump_mempools hook 0x555c9d89e328
debug -273> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 setuser_match_path /var/lib/ceph/mon/ceph-a/store.db owned by 167:167. set uid:gid to 167:167 (ceph:ceph)
debug -272> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable), process ceph-mon, pid 98
debug -271> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 pidfile_write: ignore empty --pid-file
debug -270> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) init /var/run/ceph/ceph-mon.a.asok
debug -269> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) bind_and_listen /var/run/ceph/ceph-mon.a.asok
debug -268> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 0 hook 0x555c9d8866d8
debug -267> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command version hook 0x555c9d8866d8
debug -266> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command git_version hook 0x555c9d8866d8
debug -265> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command help hook 0x555c9d882ad0
debug -264> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command get_command_descriptions hook 0x555c9d882ac0
debug -263> 2024-02-16T21:27:13.239+0000 7fca997d4c80 0 load: jerasure load: lrc
debug -262> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true
debug -261> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432
debug -260> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression
debug -259> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true
debug -258> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432
debug -257> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression
debug -256> 2024-02-16T21:27:13.247+0000 7fca901e3700 5 asok(0x555c9db7c000) entry start
debug -255> 2024-02-16T21:27:13.247+0000 7fca997d4c80 5 rocksdb: verify_sharding column families from rocksdb: [default]
debug -254> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: RocksDB version: 7.9.2

debug -253> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Git sha 0
debug -252> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compile date 2024-02-15 23:05:54
debug -251> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB SUMMARY

debug -250> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB Session ID: 4VWHRHUR4SCTKUZAVCUX

debug -249> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: CURRENT file: CURRENT

debug -248> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: IDENTITY file: IDENTITY

debug -247> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: MANIFEST file: MANIFEST-000021 size: 268 Bytes

debug -246> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000008.sst 000015.sst

debug -245> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000016.log size: 0 ; 000020.log size: 0 ;

debug -244> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.error_if_exists: 0
debug -243> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_if_missing: 0
debug -242> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.paranoid_checks: 1
debug -241> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.flush_verify_memtable_count: 1
debug -240> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0
debug -239> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1
debug -238> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.env: 0x555c9cde2720
debug -237> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.fs: PosixFileSystem
debug -236> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.info_log: 0x555c9e629580
debug -235> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_file_opening_threads: 16
debug -234> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.statistics: (nil)
debug -233> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_fsync: 0
debug -232> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_log_file_size: 0
debug -231> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
debug -230> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_file_time_to_roll: 0
debug -229> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.keep_log_file_num: 1000
debug -228> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.recycle_log_file_num: 0
debug -227> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_fallocate: 1
debug -226> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_reads: 0
debug -225> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_writes: 0
debug -224> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_reads: 0
debug -223> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
debug -222> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_missing_column_families: 0
debug -221> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_log_dir:
debug -220> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_dir:
debug -219> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.table_cache_numshardbits: 6
debug -218> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_ttl_seconds: 0
debug -217> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_size_limit_MB: 0
debug -216> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576
debug -215> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
debug -214> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.is_fd_close_on_exec: 1
debug -213> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.advise_random_on_open: 1
debug -212> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_write_buffer_size: 0
debug -211> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_manager: 0x555c9d8c0320
debug -210> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
debug -209> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
debug -208> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_adaptive_mutex: 0
debug -207> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.rate_limiter: (nil)
debug -206> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
debug -205> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_recovery_mode: 2
debug -204> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_thread_tracking: 0
debug -203> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_pipelined_write: 0
debug -202> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.unordered_write: 0
debug -201> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
debug -200> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
debug -199> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
debug -198> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
debug -197> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.row_cache: None
debug -196> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_filter: None
debug -195> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
debug -194> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_ingest_behind: 0
debug -193> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.two_write_queues: 0
debug -192> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manual_wal_flush: 0
debug -191> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_compression: 0
debug -190> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.atomic_flush: 0
debug -189> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
debug -188> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.persist_stats_to_disk: 0
debug -187> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_dbid_to_manifest: 0
debug -186> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_readahead_size: 0
debug -185> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown
debug -184> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.best_efforts_recovery: 0
debug -183> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647
debug -182> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000
debug -181> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_data_in_errors: 0
debug -180> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_host_id: __hostname__
debug -179> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enforce_single_del_contracts: true
debug -178> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_jobs: 2
debug -177> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_compactions: -1
debug -176> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_subcompactions: 1
debug -175> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
debug -174> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
debug -173> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delayed_write_rate : 16777216
debug -172> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_total_wal_size: 0
debug -171> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
debug -170> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_dump_period_sec: 600
debug -169> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_persist_period_sec: 600
debug -168> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
debug -167> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_open_files: -1
debug -166> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bytes_per_sync: 0
debug -165> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_bytes_per_sync: 0
debug -164> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.strict_bytes_per_sync: 0
debug -163> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.compaction_readahead_size: 0
debug -162> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_flushes: -1
debug -161> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compression algorithms supported:
debug -160> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
debug -159> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTD supported: 0
debug -158> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kXpressCompression supported: 0
debug -157> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4HCCompression supported: 1
debug -156> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZlibCompression supported: 1
debug -155> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kSnappyCompression supported: 1
debug -154> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4Compression supported: 1
debug -153> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kBZip2Compression supported: 0
debug -152> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Fast CRC32 supported: Supported on x86
debug -151> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DMutex implementation: pthread_mutex_t
debug -150> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021

debug -149> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]:

debug -148> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
debug -147> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.merge_operator:
debug -146> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter: None
debug -145> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter_factory: None
debug -144> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.sst_partitioner_factory: None
debug -143> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_factory: SkipListFactory
debug -142> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_factory: BlockBasedTable
debug -141> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c9e629680)
cache_index_and_filter_blocks: 1
cache_index_and_filter_blocks_with_high_priority: 0
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
checksum: 4
no_block_cache: 0
block_cache: 0x555c9d943350
block_cache_name: BinnedLRUCache
block_cache_options:
capacity : 536870912
num_shard_bits : 4
strict_capacity_limit : 0
high_pri_pool_ratio: 0.000
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: bloomfilter
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
initial_auto_readahead_size: 8192
num_file_reads_for_auto_readahead: 2

debug -140> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_size: 33554432
debug -139> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number: 2
debug -138> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression: NoCompression
debug -137> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression: Disabled
debug -136> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.prefix_extractor: nullptr
debug -135> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
debug -134> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.num_levels: 7
debug -133> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
debug -132> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
debug -131> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0
debug -130> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
debug -129> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
debug -128> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
debug -127> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
debug -126> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
debug -125> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1
debug -124> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
debug -123> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
debug -122> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true
debug -121> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.window_bits: -14
debug -120> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.level: 32767
debug -119> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.strategy: 0
debug -118> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
debug -117> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
debug -116> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true
debug -115> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.parallel_threads: 1
debug -114> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.enabled: false
debug -113> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0
debug -112> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
debug -111> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
debug -110> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
debug -109> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_base: 67108864
debug -108> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_multiplier: 1
debug -107> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
debug -106> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1
debug -105> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
debug -104> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
debug -103> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
debug -102> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
debug -101> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
debug -100> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
debug -99> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
debug -98> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
debug -97> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
debug -96> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
debug -95> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true
debug -94> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.arena_block_size: 1048576
debug -93> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
debug -92> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
debug -91> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.disable_auto_compactions: 0
debug -90> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
debug -89> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
debug -88> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
debug -87> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
debug -86> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
debug -85> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
debug -84> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
debug -83> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
debug -82> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
debug -81> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
debug -80> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_properties_collectors:
debug -79> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_support: 0
debug -78> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_num_locks: 10000
debug -77> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
debug -76> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
debug -75> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_huge_page_size: 0
debug -74> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bloom_locality: 0
debug -73> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_successive_merges: 0
debug -72> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.optimize_filters_for_hits: 0
debug -71> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.paranoid_file_checks: 0
debug -70> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.force_consistency_checks: 1
debug -69> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.report_bg_io_stats: 0
debug -68> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ttl: 2592000
debug -67> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.periodic_compaction_seconds: 0
debug -66> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0
debug -65> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preserve_internal_time_seconds: 0
debug -64> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_files: false
debug -63> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_blob_size: 0
debug -62> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_size: 268435456
debug -61> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compression_type: NoCompression
debug -60> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_garbage_collection: false
debug -59> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000
debug -58> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000
debug -57> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compaction_readahead_size: 0
debug -56> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_starting_level: 0
debug -55> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000
debug -54> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed.
debug -53> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 succeeded,manifest_file_number is 21, next_file_number is 23, last_sequence is 4154, log_number is 17,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 10

debug -52> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 17

debug -51> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca0be335-dc15-4959-a5fc-0416b60f370b

debug -50> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313149, "job": 1, "event": "recovery_started", "wal_files": [16, 20]}
debug -49> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1029] Skipping log #16 since it is older than min log to keep #17
debug -48> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #20 mode 2
debug -47> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313298, "job": 1, "event": "recovery_finished"}
debug -46> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 25

debug -45> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed.
debug -44> 2024-02-16T21:27:13.315+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c9d9ee000
debug -43> 2024-02-16T21:27:13.319+0000 7fca997d4c80 4 rocksdb: DB pointer 0x555c9d9cc000
debug -42> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS -------
debug -41> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx
debug -40> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx
debug -39> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx
debug -38> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: none
debug -37> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -36> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -35> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -34> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -33> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -32> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -31> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -30> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -29> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -28> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -27> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -26> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -25> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring
debug -24> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1111]
** DB Stats **
Uptime(secs): 0.1 total, 0.1 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 5.42 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
L6 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
Sum 2/0 5.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0

** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0

Uptime(secs): 0.1 total, 0.1 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache BinnedLRUCache@0x555c9d943350#98 capacity: 512.00 MB usage: 18.09 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(1,0.77 KB,0.000146031%) FilterBlock(2,5.14 KB,0.000980496%) IndexBlock(2,12.19 KB,0.00232458%) Misc(1,0.00 KB,0%)

** File Read Latency Histogram By Level [default] **

debug -23> 2024-02-16T21:27:13.319+0000 7fca997d4c80 0 starting mon.a rank 0 at public addrs [v2:10.109.102.152:3300/0,v1:10.109.102.152:6789/0] at bind addrs [v2:10.244.65.102:3300/0,v1:10.244.65.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb
debug -22> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx
debug -21> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx
debug -20> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx
debug -19> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: none
debug -18> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -17> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -16> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -15> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -14> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -13> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -12> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -11> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -10> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -9> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -8> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -7> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -6> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring
debug -5> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx
debug -4> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx
debug -3> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
debug -2> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
debug -1> 2024-02-16T21:27:13.319+0000 7fca997d4c80 1 mon.a@-1(???) e1 preinit fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb
debug 0> 2024-02-16T21:27:13.343+0000 7fca997d4c80 -1 *** Caught signal (Aborted) **
in thread 7fca997d4c80 thread_name:ceph-mon

ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable)
1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20]
2: gsignal()
3: abort()
4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b]
5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c]
6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7]
7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808]
8: (ceph::buffer::v15_2_0::list::iterator_impl<true>::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385]
9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0xa64) [0x7fca991ede94]
10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x162) [0x7fca991fbb42]
11: (void ceph::decode<Filesystem, std::allocator<std::shared_ptr<Filesystem> > >(std::vector<std::shared_ptr<Filesystem>, std::allocator<std::shared_ptr<Filesystem> > >&, ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x145) [0x7fca99208195]
12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x161) [0x7fca991fda01]
13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb]
14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764]
15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b]
16: main()
17: __libc_start_main()
18: _start()
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 rbd_pwl
0/ 5 journaler
0/ 5 objectcacher
0/ 5 immutable_obj_cache
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 rgw_sync
1/ 5 rgw_datacache
1/ 5 rgw_access
1/ 5 rgw_dbstore
1/ 5 rgw_flight
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
1/ 5 fuse
2/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
1/ 5 prioritycache
0/ 5 test
0/ 5 cephfs_mirror
0/ 5 cephsqlite
0/ 5 seastore
0/ 5 seastore_onode
0/ 5 seastore_odata
0/ 5 seastore_omap
0/ 5 seastore_tm
0/ 5 seastore_t
0/ 5 seastore_cleaner
0/ 5 seastore_epm
0/ 5 seastore_lba
0/ 5 seastore_fixedkv_tree
0/ 5 seastore_cache
0/ 5 seastore_journal
0/ 5 seastore_device
0/ 5 seastore_backref
0/ 5 alienstore
1/ 5 mclock
0/ 5 cyanstore
1/ 5 ceph_exporter
1/ 5 memstore
-2/-2 (syslog threshold)
99/99 (stderr threshold)
--- pthread ID / name mapping for recent threads ---
7fca7dfce700 / ceph-mon
7fca901e3700 / admin_socket
7fca997d4c80 / ceph-mon
max_recent 10000
max_new 1000
log_file
--- end dump of recent events ---
--- begin dump of recent events ---
debug -299> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command assert hook 0x555c9d882b30
debug -298> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command abort hook 0x555c9d882b30
debug -297> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command leak_some_memory hook 0x555c9d882b30
debug -296> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_dump hook 0x555c9d882b30
debug -295> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 1 hook 0x555c9d882b30
debug -294> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf dump hook 0x555c9d882b30
debug -293> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perfcounters_schema hook 0x555c9d882b30
debug -292> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram dump hook 0x555c9d882b30
debug -291> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 2 hook 0x555c9d882b30
debug -290> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf schema hook 0x555c9d882b30
debug -289> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter dump hook 0x555c9d882b30
debug -288> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command counter schema hook 0x555c9d882b30
debug -287> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf histogram schema hook 0x555c9d882b30
debug -286> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command perf reset hook 0x555c9d882b30
debug -285> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config show hook 0x555c9d882b30
debug -284> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config help hook 0x555c9d882b30
debug -283> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config set hook 0x555c9d882b30
debug -282> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config unset hook 0x555c9d882b30
debug -281> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config get hook 0x555c9d882b30
debug -280> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff hook 0x555c9d882b30
debug -279> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command config diff get hook 0x555c9d882b30
debug -278> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command injectargs hook 0x555c9d882b30
debug -277> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log flush hook 0x555c9d882b30
debug -276> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log dump hook 0x555c9d882b30
debug -275> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command log reopen hook 0x555c9d882b30
debug -274> 2024-02-16T21:27:13.155+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command dump_mempools hook 0x555c9d89e328
debug -273> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 setuser_match_path /var/lib/ceph/mon/ceph-a/store.db owned by 167:167. set uid:gid to 167:167 (ceph:ceph)
debug -272> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable), process ceph-mon, pid 98
debug -271> 2024-02-16T21:27:13.195+0000 7fca997d4c80 0 pidfile_write: ignore empty --pid-file
debug -270> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) init /var/run/ceph/ceph-mon.a.asok
debug -269> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) bind_and_listen /var/run/ceph/ceph-mon.a.asok
debug -268> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command 0 hook 0x555c9d8866d8
debug -267> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command version hook 0x555c9d8866d8
debug -266> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command git_version hook 0x555c9d8866d8
debug -265> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command help hook 0x555c9d882ad0
debug -264> 2024-02-16T21:27:13.195+0000 7fca997d4c80 5 asok(0x555c9db7c000) register_command get_command_descriptions hook 0x555c9d882ac0
debug -263> 2024-02-16T21:27:13.239+0000 7fca997d4c80 0 load: jerasure load: lrc
debug -262> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true
debug -261> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432
debug -260> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression
debug -259> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option level_compaction_dynamic_level_bytes = true
debug -258> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option write_buffer_size = 33554432
debug -257> 2024-02-16T21:27:13.243+0000 7fca997d4c80 1 set rocksdb option compression = kNoCompression
debug -256> 2024-02-16T21:27:13.247+0000 7fca901e3700 5 asok(0x555c9db7c000) entry start
debug -255> 2024-02-16T21:27:13.247+0000 7fca997d4c80 5 rocksdb: verify_sharding column families from rocksdb: [default]
debug -254> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: RocksDB version: 7.9.2

debug -253> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Git sha 0
debug -252> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compile date 2024-02-15 23:05:54
debug -251> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB SUMMARY

debug -250> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DB Session ID: 4VWHRHUR4SCTKUZAVCUX

debug -249> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: CURRENT file: CURRENT

debug -248> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: IDENTITY file: IDENTITY

debug -247> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: MANIFEST file: MANIFEST-000021 size: 268 Bytes

debug -246> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000008.sst 000015.sst

debug -245> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000016.log size: 0 ; 000020.log size: 0 ;

debug -244> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.error_if_exists: 0
debug -243> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_if_missing: 0
debug -242> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.paranoid_checks: 1
debug -241> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.flush_verify_memtable_count: 1
debug -240> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0
debug -239> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1
debug -238> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.env: 0x555c9cde2720
debug -237> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.fs: PosixFileSystem
debug -236> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.info_log: 0x555c9e629580
debug -235> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_file_opening_threads: 16
debug -234> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.statistics: (nil)
debug -233> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_fsync: 0
debug -232> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_log_file_size: 0
debug -231> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
debug -230> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_file_time_to_roll: 0
debug -229> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.keep_log_file_num: 1000
debug -228> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.recycle_log_file_num: 0
debug -227> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_fallocate: 1
debug -226> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_reads: 0
debug -225> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_mmap_writes: 0
debug -224> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_reads: 0
debug -223> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
debug -222> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.create_missing_column_families: 0
debug -221> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_log_dir:
debug -220> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_dir:
debug -219> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.table_cache_numshardbits: 6
debug -218> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_ttl_seconds: 0
debug -217> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.WAL_size_limit_MB: 0
debug -216> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576
debug -215> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
debug -214> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.is_fd_close_on_exec: 1
debug -213> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.advise_random_on_open: 1
debug -212> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_write_buffer_size: 0
debug -211> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_manager: 0x555c9d8c0320
debug -210> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
debug -209> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
debug -208> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.use_adaptive_mutex: 0
debug -207> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.rate_limiter: (nil)
debug -206> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
debug -205> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_recovery_mode: 2
debug -204> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_thread_tracking: 0
debug -203> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_pipelined_write: 0
debug -202> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.unordered_write: 0
debug -201> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
debug -200> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
debug -199> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
debug -198> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
debug -197> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.row_cache: None
debug -196> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_filter: None
debug -195> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
debug -194> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_ingest_behind: 0
debug -193> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.two_write_queues: 0
debug -192> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.manual_wal_flush: 0
debug -191> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_compression: 0
debug -190> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.atomic_flush: 0
debug -189> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
debug -188> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.persist_stats_to_disk: 0
debug -187> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.write_dbid_to_manifest: 0
debug -186> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.log_readahead_size: 0
debug -185> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown
debug -184> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.best_efforts_recovery: 0
debug -183> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647
debug -182> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000
debug -181> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.allow_data_in_errors: 0
debug -180> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.db_host_id: __hostname__
debug -179> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.enforce_single_del_contracts: true
debug -178> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_jobs: 2
debug -177> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_compactions: -1
debug -176> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_subcompactions: 1
debug -175> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
debug -174> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
debug -173> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delayed_write_rate : 16777216
debug -172> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_total_wal_size: 0
debug -171> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
debug -170> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_dump_period_sec: 600
debug -169> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_persist_period_sec: 600
debug -168> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
debug -167> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_open_files: -1
debug -166> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.bytes_per_sync: 0
debug -165> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.wal_bytes_per_sync: 0
debug -164> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.strict_bytes_per_sync: 0
debug -163> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.compaction_readahead_size: 0
debug -162> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Options.max_background_flushes: -1
debug -161> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Compression algorithms supported:
debug -160> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
debug -159> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZSTD supported: 0
debug -158> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kXpressCompression supported: 0
debug -157> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4HCCompression supported: 1
debug -156> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kZlibCompression supported: 1
debug -155> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kSnappyCompression supported: 1
debug -154> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kLZ4Compression supported: 1
debug -153> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: kBZip2Compression supported: 0
debug -152> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: Fast CRC32 supported: Supported on x86
debug -151> 2024-02-16T21:27:13.247+0000 7fca997d4c80 4 rocksdb: DMutex implementation: pthread_mutex_t
debug -150> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021

debug -149> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]:

debug -148> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
debug -147> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.merge_operator:
debug -146> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter: None
debug -145> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_filter_factory: None
debug -144> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.sst_partitioner_factory: None
debug -143> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_factory: SkipListFactory
debug -142> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_factory: BlockBasedTable
debug -141> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555c9e629680)
cache_index_and_filter_blocks: 1
cache_index_and_filter_blocks_with_high_priority: 0
pin_l0_filter_and_index_blocks_in_cache: 0
pin_top_level_index_and_filter: 1
index_type: 0
data_block_index_type: 0
index_shortening: 1
data_block_hash_table_util_ratio: 0.750000
checksum: 4
no_block_cache: 0
block_cache: 0x555c9d943350
block_cache_name: BinnedLRUCache
block_cache_options:
capacity : 536870912
num_shard_bits : 4
strict_capacity_limit : 0
high_pri_pool_ratio: 0.000
block_cache_compressed: (nil)
persistent_cache: (nil)
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
metadata_block_size: 4096
partition_filters: 0
use_delta_encoding: 1
filter_policy: bloomfilter
whole_key_filtering: 1
verify_compression: 0
read_amp_bytes_per_bit: 0
format_version: 5
enable_index_compression: 1
block_align: 0
max_auto_readahead_size: 262144
prepopulate_block_cache: 0
initial_auto_readahead_size: 8192
num_file_reads_for_auto_readahead: 2

debug -140> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.write_buffer_size: 33554432
debug -139> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number: 2
debug -138> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression: NoCompression
debug -137> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression: Disabled
debug -136> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.prefix_extractor: nullptr
debug -135> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
debug -134> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.num_levels: 7
debug -133> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
debug -132> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
debug -131> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0
debug -130> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
debug -129> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
debug -128> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
debug -127> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
debug -126> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
debug -125> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1
debug -124> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
debug -123> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0
debug -122> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true
debug -121> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.window_bits: -14
debug -120> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.level: 32767
debug -119> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.strategy: 0
debug -118> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
debug -117> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
debug -116> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true
debug -115> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.parallel_threads: 1
debug -114> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.enabled: false
debug -113> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0
debug -112> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
debug -111> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
debug -110> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
debug -109> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_base: 67108864
debug -108> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.target_file_size_multiplier: 1
debug -107> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
debug -106> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1
debug -105> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
debug -104> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
debug -103> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
debug -102> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
debug -101> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
debug -100> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
debug -99> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
debug -98> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
debug -97> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
debug -96> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
debug -95> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true
debug -94> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.arena_block_size: 1048576
debug -93> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
debug -92> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
debug -91> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.disable_auto_compactions: 0
debug -90> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
debug -89> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
debug -88> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
debug -87> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
debug -86> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
debug -85> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
debug -84> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
debug -83> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
debug -82> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
debug -81> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
debug -80> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.table_properties_collectors:
debug -79> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_support: 0
debug -78> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.inplace_update_num_locks: 10000
debug -77> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
debug -76> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
debug -75> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.memtable_huge_page_size: 0
debug -74> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.bloom_locality: 0
debug -73> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.max_successive_merges: 0
debug -72> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.optimize_filters_for_hits: 0
debug -71> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.paranoid_file_checks: 0
debug -70> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.force_consistency_checks: 1
debug -69> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.report_bg_io_stats: 0
debug -68> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.ttl: 2592000
debug -67> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.periodic_compaction_seconds: 0
debug -66> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0
debug -65> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.preserve_internal_time_seconds: 0
debug -64> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_files: false
debug -63> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.min_blob_size: 0
debug -62> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_size: 268435456
debug -61> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compression_type: NoCompression
debug -60> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.enable_blob_garbage_collection: false
debug -59> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000
debug -58> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000
debug -57> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_compaction_readahead_size: 0
debug -56> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.blob_file_starting_level: 0
debug -55> 2024-02-16T21:27:13.251+0000 7fca997d4c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000
debug -54> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed.
debug -53> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000021 succeeded,manifest_file_number is 21, next_file_number is 23, last_sequence is 4154, log_number is 17,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 10

debug -52> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 17

debug -51> 2024-02-16T21:27:13.303+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca0be335-dc15-4959-a5fc-0416b60f370b

debug -50> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313149, "job": 1, "event": "recovery_started", "wal_files": [16, 20]}
debug -49> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1029] Skipping log #16 since it is older than min log to keep #17
debug -48> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #20 mode 2
debug -47> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708118833313298, "job": 1, "event": "recovery_finished"}
debug -46> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 25

debug -45> 2024-02-16T21:27:13.311+0000 7fca997d4c80 4 rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed.
debug -44> 2024-02-16T21:27:13.315+0000 7fca997d4c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555c9d9ee000
debug -43> 2024-02-16T21:27:13.319+0000 7fca997d4c80 4 rocksdb: DB pointer 0x555c9d9cc000
debug -42> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS -------
debug -41> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx
debug -40> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx
debug -39> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: cephx
debug -38> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding auth protocol: none
debug -37> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -36> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -35> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -34> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -33> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -32> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -31> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -30> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -29> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -28> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -27> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: crc
debug -26> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964140) adding con mode: secure
debug -25> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring
debug -24> 2024-02-16T21:27:13.319+0000 7fca7dfce700 4 rocksdb: [db/db_impl/db_impl.cc:1111]
** DB Stats **
Uptime(secs): 0.1 total, 0.1 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 5.42 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
L6 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
Sum 2/0 5.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0

** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0

Uptime(secs): 0.1 total, 0.1 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
Block cache BinnedLRUCache@0x555c9d943350#98 capacity: 512.00 MB usage: 18.09 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0
Block cache entry stats(count,size,portion): DataBlock(1,0.77 KB,0.000146031%) FilterBlock(2,5.14 KB,0.000980496%) IndexBlock(2,12.19 KB,0.00232458%) Misc(1,0.00 KB,0%)

** File Read Latency Histogram By Level [default] **

debug -23> 2024-02-16T21:27:13.319+0000 7fca997d4c80 0 starting mon.a rank 0 at public addrs [v2:10.109.102.152:3300/0,v1:10.109.102.152:6789/0] at bind addrs [v2:10.244.65.102:3300/0,v1:10.244.65.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb
debug -22> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx
debug -21> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx
debug -20> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: cephx
debug -19> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding auth protocol: none
debug -18> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -17> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -16> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -15> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -14> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -13> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -12> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -11> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -10> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -9> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -8> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: crc
debug -7> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 AuthRegistry(0x555c9d964a40) adding con mode: secure
debug -6> 2024-02-16T21:27:13.319+0000 7fca997d4c80 2 auth: KeyRing::load: loaded key file /etc/ceph/keyring-store/keyring
debug -5> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx
debug -4> 2024-02-16T21:27:13.319+0000 7fca997d4c80 5 adding auth protocol: cephx
debug -3> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
debug -2> 2024-02-16T21:27:13.319+0000 7fca997d4c80 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
debug -1> 2024-02-16T21:27:13.319+0000 7fca997d4c80 1 mon.a@-1(???) e1 preinit fsid 8a85cb29-13cb-4904-b9e3-6b692e7bfffb
debug 0> 2024-02-16T21:27:13.343+0000 7fca997d4c80 -1 *** Caught signal (Aborted) **
in thread 7fca997d4c80 thread_name:ceph-mon

ceph version 18.2.1-593-g744c573d (744c573dfc29e50959567861c524f9e6c038171f) reef (stable)
1: /lib64/libpthread.so.0(+0x12d20) [0x7fca9642dd20]
2: gsignal()
3: abort()
4: /lib64/libstdc++.so.6(+0x9009b) [0x7fca95a3f09b]
5: /lib64/libstdc++.so.6(+0x9654c) [0x7fca95a4554c]
6: /lib64/libstdc++.so.6(+0x965a7) [0x7fca95a455a7]
7: /lib64/libstdc++.so.6(+0x96808) [0x7fca95a45808]
8: (ceph::buffer::v15_2_0::list::iterator_impl<true>::copy(unsigned int, char*)+0xa5) [0x7fca98fd2385]
9: (MDSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0xa64) [0x7fca991ede94]
10: (Filesystem::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x162) [0x7fca991fbb42]
11: (void ceph::decode<Filesystem, std::allocator<std::shared_ptr<Filesystem> > >(std::vector<std::shared_ptr<Filesystem>, std::allocator<std::shared_ptr<Filesystem> > >&, ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x145) [0x7fca99208195]
12: (FSMap::decode(ceph::buffer::v15_2_0::list::iterator_impl<true>&)+0x161) [0x7fca991fda01]
13: (MDSMonitor::update_from_paxos(bool*)+0x26b) [0x555c9c6e55eb]
14: (Monitor::refresh_from_paxos(bool*)+0x104) [0x555c9c473764]
15: (Monitor::preinit()+0xa2b) [0x555c9c4a1b6b]
16: main()
17: __libc_start_main()
18: _start()
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 rbd_pwl
0/ 5 journaler
0/ 5 objectcacher
0/ 5 immutable_obj_cache
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 0 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 rgw_sync
1/ 5 rgw_datacache
1/ 5 rgw_access
1/ 5 rgw_dbstore
1/ 5 rgw_flight
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
1/ 5 fuse
2/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
1/ 5 prioritycache
0/ 5 test
0/ 5 cephfs_mirror
0/ 5 cephsqlite
0/ 5 seastore
0/ 5 seastore_onode
0/ 5 seastore_odata
0/ 5 seastore_omap
0/ 5 seastore_tm
0/ 5 seastore_t
0/ 5 seastore_cleaner
0/ 5 seastore_epm
0/ 5 seastore_lba
0/ 5 seastore_fixedkv_tree
0/ 5 seastore_cache
0/ 5 seastore_journal
0/ 5 seastore_device
0/ 5 seastore_backref
0/ 5 alienstore
1/ 5 mclock
0/ 5 cyanstore
1/ 5 ceph_exporter
1/ 5 memstore
-2/-2 (syslog threshold)
99/99 (stderr threshold)
--- pthread ID / name mapping for recent threads ---
7fca7dfce700 / ceph-mon
7fca901e3700 / admin_socket
7fca997d4c80 / ceph-mon
max_recent 10000
max_new 1000
log_file /var/lib/ceph/crash/2024-02-16T21:27:13.345559Z_e6a9acaa-b1b2-404c-9d42-48efcb9449a7/log
--- end dump of recent events ---
    (1-1/1)