|
2020-03-24 10:19:53.030 7f0410ca0700 1 osd.5 1071 triggering manual compaction
|
|
2020-03-24 10:19:53.030 7f0410ca0700 4 rocksdb: [db/db_impl_write.cc:1470] [default] New memtable created with log file: #7627. Immutable memtables: 0.
|
|
|
|
2020-03-24 10:19:53.034 7f0407bfe700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.035269) [db/db_impl_compaction_flush.cc:2073] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0
|
|
2020-03-24 10:19:53.034 7f0407bfe700 4 rocksdb: [db/flush_job.cc:322] [default] [JOB 3] Flushing memtable with next log file: 7627
|
|
|
|
2020-03-24 10:19:53.034 7f0407bfe700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593035296, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 2435, "num_deletes": 348, "total_data_size": 1308361, "memory_usage": 1352000, "flush_reason": "Manual Compaction"}
|
|
2020-03-24 10:19:53.034 7f0407bfe700 4 rocksdb: [db/flush_job.cc:351] [default] [JOB 3] Level-0 flush table #7628: started
|
|
2020-03-24 10:19:53.046 7f0407bfe700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593048295, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 7628, "file_size": 600233, "table_properties": {"data_size": 593017, "index_size": 3477, "filter_size": 2885, "raw_key_size": 42693, "raw_average_key_size": 37, "raw_value_size": 567351, "raw_average_value_size": 498, "num_data_blocks": 105, "num_entries": 1139, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:53.046 7f0407bfe700 4 rocksdb: [db/flush_job.cc:392] [default] [JOB 3] Level-0 flush table #7628: 600233 bytes OK
|
|
2020-03-24 10:19:53.054 7f0407bfe700 4 rocksdb: [db/db_impl_files.cc:194] adding log 7624 to recycle list
|
|
|
|
2020-03-24 10:19:53.054 7f0407bfe700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.048314) [db/memtable_list.cc:380] [default] Level-0 commit table #7628 started
|
|
2020-03-24 10:19:53.054 7f0407bfe700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.056572) [db/memtable_list.cc:428] [default] Level-0 commit table #7628: memtable #1 done
|
|
2020-03-24 10:19:53.054 7f0407bfe700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.056580) EVENT_LOG_v1 {"time_micros": 1585041593056577, "job": 3, "event": "flush_finished", "output_compression": "NoCompression", "lsm_state": [4, 0, 9, 0, 0, 0, 0], "immutable_memtables": 0}
|
|
2020-03-24 10:19:53.054 7f0407bfe700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.056595) [db/db_impl_compaction_flush.cc:201] [default] Level summary: files[4 0 9 0 0 0 0] max score 1.00
|
|
|
|
2020-03-24 10:19:53.054 7f0408c00700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 4] Compacting 4@0 files to L1, score 1.00
|
|
2020-03-24 10:19:53.054 7f0408c00700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 3 Base level 0, inputs: [7628(586KB) 7622(1528B) 7619(7093KB) 7617(7543KB)]
|
|
|
|
2020-03-24 10:19:53.054 7f0408c00700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593056726, "job": 4, "event": "compaction_started", "compaction_reason": "LevelL0FilesNum", "files_L0": [7628, 7622, 7619, 7617], "score": 1, "input_data_size": 15589628}
|
|
2020-03-24 10:19:53.054 7f0410ca0700 4 rocksdb: [db/db_impl_compaction_flush.cc:1397] [default] Manual compaction waiting for all other scheduled background compactions to finish
|
|
2020-03-24 10:19:53.146 7f0408c00700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 4] Generated table #7629: 116627 keys, 12942280 bytes
|
|
2020-03-24 10:19:53.146 7f0408c00700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593148368, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 7629, "file_size": 12942280, "table_properties": {"data_size": 12463018, "index_size": 186747, "filter_size": 291653, "raw_key_size": 5936773, "raw_average_key_size": 50, "raw_value_size": 10495970, "raw_average_value_size": 89, "num_data_blocks": 3046, "num_entries": 116627, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:53.146 7f0408c00700 4 rocksdb: [db/compaction_job.cc:1395] [default] [JOB 4] Compacted 4@0 files to L1 => 12942280 bytes
|
|
2020-03-24 10:19:53.154 7f0408c00700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.156806) [db/compaction_job.cc:768] [default] compacted to: files[0 1 9 0 0 0 0] max score 0.21, MB/sec: 170.0 rd, 141.1 wr, level 1, files in(4, 0) out(1) MB in(14.9, 0.0) out(12.3), read-write-amplify(1.8) write-amplify(0.8) OK, records in: 127371, records dropped: 10629 output_compression: NoCompression
|
|
|
|
2020-03-24 10:19:53.154 7f0408c00700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.156825) EVENT_LOG_v1 {"time_micros": 1585041593156819, "job": 4, "event": "compaction_finished", "compaction_time_micros": 91724, "compaction_time_cpu_micros": 56741, "output_level": 1, "num_output_files": 1, "total_output_size": 12942280, "num_input_records": 127256, "num_output_records": 116627, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 1, 9, 0, 0, 0, 0]}
|
|
2020-03-24 10:19:53.154 7f0408c00700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593156951, "job": 4, "event": "table_file_deletion", "file_number": 7628}
|
|
2020-03-24 10:19:53.154 7f0408c00700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593156981, "job": 4, "event": "table_file_deletion", "file_number": 7622}
|
|
2020-03-24 10:19:53.154 7f0408c00700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593157005, "job": 4, "event": "table_file_deletion", "file_number": 7619}
|
|
2020-03-24 10:19:53.154 7f0408c00700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593157021, "job": 4, "event": "table_file_deletion", "file_number": 7617}
|
|
2020-03-24 10:19:53.154 7f0410ca0700 4 rocksdb: [db/db_impl_compaction_flush.cc:1403] [default] Manual compaction starting
|
|
2020-03-24 10:19:53.154 7f0410ca0700 4 rocksdb: [db/db_impl_compaction_flush.cc:1403] [default] Manual compaction starting
|
|
2020-03-24 10:19:53.154 7f04083ff700 4 rocksdb: (Original Log Time 2020/03/24-10:19:53.157221) [db/db_impl_compaction_flush.cc:2374] [default] Manual compaction from level-1 to level-2 from (begin) .. (end); will stop at (end)
|
|
|
|
2020-03-24 10:19:53.154 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 5] Compacting 1@1 + 9@2 files to L2, score -1.00
|
|
2020-03-24 10:19:53.154 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 4 Base level 1, inputs: [7629(12MB)], [7607(66MB) 7608(65MB) 7609(65MB) 7610(65MB) 7611(65MB) 7612(65MB) 7613(65MB) 7614(65MB) 7615(8256KB)]
|
|
|
|
2020-03-24 10:19:53.154 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593157247, "job": 5, "event": "compaction_started", "compaction_reason": "ManualCompaction", "files_L1": [7629], "files_L2": [7607, 7608, 7609, 7610, 7611, 7612, 7613, 7614, 7615], "score": -1, "input_data_size": 573222543}
|
|
2020-03-24 10:19:53.710 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7630: 417286 keys, 69248835 bytes
|
|
2020-03-24 10:19:53.710 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041593714949, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7630, "file_size": 69248835, "table_properties": {"data_size": 67112291, "index_size": 1092415, "filter_size": 1043269, "raw_key_size": 21906600, "raw_average_key_size": 52, "raw_value_size": 59698517, "raw_average_value_size": 143, "num_data_blocks": 16657, "num_entries": 417286, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:54.370 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7631: 119792 keys, 68934970 bytes
|
|
2020-03-24 10:19:54.370 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041594373462, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7631, "file_size": 68934970, "table_properties": {"data_size": 67110956, "index_size": 1523565, "filter_size": 299589, "raw_key_size": 10474376, "raw_average_key_size": 87, "raw_value_size": 63034959, "raw_average_value_size": 526, "num_data_blocks": 17005, "num_entries": 119792, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:55.030 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7632: 119584 keys, 68933408 bytes
|
|
2020-03-24 10:19:55.030 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041595031663, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7632, "file_size": 68933408, "table_properties": {"data_size": 67109750, "index_size": 1523721, "filter_size": 299077, "raw_key_size": 10455900, "raw_average_key_size": 87, "raw_value_size": 63035699, "raw_average_value_size": 527, "num_data_blocks": 16999, "num_entries": 119584, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:55.710 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7633: 119638 keys, 68931092 bytes
|
|
2020-03-24 10:19:55.710 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041595714849, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7633, "file_size": 68931092, "table_properties": {"data_size": 67110937, "index_size": 1520090, "filter_size": 299205, "raw_key_size": 10460846, "raw_average_key_size": 87, "raw_value_size": 63041230, "raw_average_value_size": 526, "num_data_blocks": 16995, "num_entries": 119638, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:56.378 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7634: 119755 keys, 68935161 bytes
|
|
2020-03-24 10:19:56.378 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041596381676, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7634, "file_size": 68935161, "table_properties": {"data_size": 67113116, "index_size": 1521724, "filter_size": 299461, "raw_key_size": 10471058, "raw_average_key_size": 87, "raw_value_size": 63039057, "raw_average_value_size": 526, "num_data_blocks": 16981, "num_entries": 119755, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:57.010 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7635: 119764 keys, 68932531 bytes
|
|
2020-03-24 10:19:57.010 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041597014814, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7635, "file_size": 68932531, "table_properties": {"data_size": 67111805, "index_size": 1520405, "filter_size": 299461, "raw_key_size": 10471847, "raw_average_key_size": 87, "raw_value_size": 63038147, "raw_average_value_size": 526, "num_data_blocks": 16999, "num_entries": 119764, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:57.662 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7636: 119623 keys, 68930378 bytes
|
|
2020-03-24 10:19:57.662 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041597664901, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7636, "file_size": 68930378, "table_properties": {"data_size": 67109807, "index_size": 1520634, "filter_size": 299077, "raw_key_size": 10459509, "raw_average_key_size": 87, "raw_value_size": 63039638, "raw_average_value_size": 526, "num_data_blocks": 17005, "num_entries": 119623, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:58.322 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7637: 119585 keys, 68935708 bytes
|
|
2020-03-24 10:19:58.322 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598323227, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7637, "file_size": 68935708, "table_properties": {"data_size": 67113187, "index_size": 1522584, "filter_size": 299077, "raw_key_size": 10456085, "raw_average_key_size": 87, "raw_value_size": 63040738, "raw_average_value_size": 527, "num_data_blocks": 17001, "num_entries": 119585, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:58.478 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 5] Generated table #7638: 130345 keys, 13017705 bytes
|
|
2020-03-24 10:19:58.478 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598481750, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 7638, "file_size": 13017705, "table_properties": {"data_size": 12464446, "index_size": 226443, "filter_size": 325957, "raw_key_size": 3449039, "raw_average_key_size": 26, "raw_value_size": 10176799, "raw_average_value_size": 78, "num_data_blocks": 3137, "num_entries": 130345, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
|
|
2020-03-24 10:19:58.482 7f04083ff700 4 rocksdb: [db/compaction_job.cc:1395] [default] [JOB 5] Compacted 1@1 + 9@2 files to L2 => 564799788 bytes
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: (Original Log Time 2020/03/24-10:19:58.489937) [db/compaction_job.cc:768] [default] compacted to: files[0 0 9 0 0 0 0] max score 0.21, MB/sec: 107.7 rd, 106.1 wr, level 2, files in(1, 9) out(9) MB in(12.3, 534.3) out(538.6), read-write-amplify(87.9) write-amplify(43.6) OK, records in: 1496626, records dropped: 110994 output_compression: NoCompression
|
|
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: (Original Log Time 2020/03/24-10:19:58.489955) EVENT_LOG_v1 {"time_micros": 1585041598489948, "job": 5, "event": "compaction_finished", "compaction_time_micros": 5324534, "compaction_time_cpu_micros": 1306971, "output_level": 2, "num_output_files": 9, "total_output_size": 564799788, "num_input_records": 1496366, "num_output_records": 1385372, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 0, 9, 0, 0, 0, 0]}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490031, "job": 5, "event": "table_file_deletion", "file_number": 7629}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490043, "job": 5, "event": "table_file_deletion", "file_number": 7615}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490054, "job": 5, "event": "table_file_deletion", "file_number": 7614}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490076, "job": 5, "event": "table_file_deletion", "file_number": 7613}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490098, "job": 5, "event": "table_file_deletion", "file_number": 7612}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490106, "job": 5, "event": "table_file_deletion", "file_number": 7611}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490117, "job": 5, "event": "table_file_deletion", "file_number": 7610}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490137, "job": 5, "event": "table_file_deletion", "file_number": 7609}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490147, "job": 5, "event": "table_file_deletion", "file_number": 7608}
|
|
2020-03-24 10:19:58.486 7f04083ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1585041598490156, "job": 5, "event": "table_file_deletion", "file_number": 7607}
|
|
2020-03-24 10:19:58.486 7f0410ca0700 1 osd.5 1071 finished manual compaction in 5.45607 seconds
|
