Ceph » bluestore

Originally appeared in https://tracker.ceph.com/issues/45519
but cloning to another ticket since looks unrelated.

2020-05-28T13:12:08.551 INFO:teuthology.orchestra.run.smithi186.stdout:[ RUN ] ObjectStore/StoreTestSpecificAUSize.ExcessiveFragmentation/2
2020-05-28T13:12:20.161 INFO:teuthology.orchestra.run.smithi186.stdout:written 104857600
2020-05-28T13:12:33.316 INFO:teuthology.orchestra.run.smithi186.stdout:written 209715200
2020-05-28T13:12:38.655 INFO:teuthology.orchestra.run.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-1967-g2a01d33/rpm/el8/BUILD/ceph-16.0.0-1967-g2a01d33/src/os/bluestore/BlueFS.cc: In function 'int BlueFS::_flush_range(BlueFS::FileWriter*, uint64_t, uint64_t)' thread 7f3dca7df700 time 2020-05-28T13:12:38.650207+0000
2020-05-28T13:12:38.656 INFO:teuthology.orchestra.run.smithi186.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.0.0-1967-g2a01d33/rpm/el8/BUILD/ceph-16.0.0-1967-g2a01d33/src/os/bluestore/BlueFS.cc: 2746: ceph_abort_msg("bluefs enospc")
2020-05-28T13:12:38.656 INFO:teuthology.orchestra.run.smithi186.stderr: ceph version 16.0.0-1967-g2a01d33 (2a01d3330fdf6c2b0908352bc9de48f0d6be148c) pacific (dev)
2020-05-28T13:12:38.656 INFO:teuthology.orchestra.run.smithi186.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f3dd3122a46]
2020-05-28T13:12:38.656 INFO:teuthology.orchestra.run.smithi186.stderr: 2: (BlueFS::_flush_range(BlueFS::FileWriter*, unsigned long, unsigned long)+0x1a60) [0x5634eb10edf0]
2020-05-28T13:12:38.656 INFO:teuthology.orchestra.run.smithi186.stderr: 3: (BlueFS::_flush(BlueFS::FileWriter*, bool)+0xf3) [0x5634eb10f4c3]
2020-05-28T13:12:38.657 INFO:teuthology.orchestra.run.smithi186.stderr: 4: (BlueRocksWritableFile::Flush()+0x41) [0x5634eb136611]
2020-05-28T13:12:38.657 INFO:teuthology.orchestra.run.smithi186.stderr: 5: (rocksdb::LegacyWritableFileWrapper::Flush(rocksdb::IOOptions const&, rocksdb::IODebugContext*)+0x1f) [0x5634eb1f759f]
2020-05-28T13:12:38.657 INFO:teuthology.orchestra.run.smithi186.stderr: 6: (rocksdb::WritableFileWriter::Flush()+0x22d) [0x5634eb30b5fd]
2020-05-28T13:12:38.657 INFO:teuthology.orchestra.run.smithi186.stderr: 7: (rocksdb::WritableFileWriter::Sync(bool)+0x1f) [0x5634eb30b77f]
2020-05-28T13:12:38.658 INFO:teuthology.orchestra.run.smithi186.stderr: 8: (rocksdb::BuildTable(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rocksdb::Env*, rocksdb::FileSystem*, rocksdb::ImmutableCFOptions const&, rocksdb::MutableCFOptions const&, rocksdb::FileOptions const&, rocksdb::TableCache*, rocksdb::InternalIteratorBase<rocksdb::Slice>*, std::vector<std::unique_ptr<rocksdb::FragmentedRangeTombstoneIterator, std::default_delete<rocksdb::FragmentedRangeTombstoneIterator> >, std::allocator<std::unique_ptr<rocksdb::FragmentedRangeTombstoneIterator, std::default_delete<rocksdb::FragmentedRangeTombstoneIterator> > > >, rocksdb::FileMetaData*, rocksdb::InternalKeyComparator const&, std::vector<std::unique_ptr<rocksdb::IntTblPropCollectorFactory, std::default_delete<rocksdb::IntTblPropCollectorFactory> >, std::allocator<std::unique_ptr<rocksdb::IntTblPropCollectorFactory, std::default_delete<rocksdb::IntTblPropCollectorFactory> > > > const*, unsigned int, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::vector<unsigned long, std::allocator<unsigned long> >, unsigned long, rocksdb::SnapshotChecker*, rocksdb::CompressionType, unsigned long, rocksdb::CompressionOptions const&, bool, rocksdb::InternalStats*, rocksdb::TableFileCreationReason, rocksdb::EventLogger*, int, rocksdb::Env::IOPriority, rocksdb::TableProperties*, int, unsigned long, unsigned long, rocksdb::Env::WriteLifeTimeHint, unsigned long)+0x2ddd) [0x5634eb3d992d]
2020-05-28T13:12:38.658 INFO:teuthology.orchestra.run.smithi186.stderr: 9: (rocksdb::FlushJob::WriteLevel0Table()+0x1003) [0x5634eb26ebb3]
2020-05-28T13:12:38.659 INFO:teuthology.orchestra.run.smithi186.stderr: 10: (rocksdb::FlushJob::Run(rocksdb::LogsWithPrepTracker*, rocksdb::FileMetaData*)+0xcd) [0x5634eb270c4d]
2020-05-28T13:12:38.659 INFO:teuthology.orchestra.run.smithi186.stderr: 11: (rocksdb::DBImpl::FlushMemTableToOutputFile(rocksdb::ColumnFamilyData*, rocksdb::MutableCFOptions const&, bool*, rocksdb::JobContext*, rocksdb::SuperVersionContext*, std::vector<unsigned long, std::allocator<unsigned long> >&, unsigned long, rocksdb::SnapshotChecker*, rocksdb::LogBuffer*, rocksdb::Env::Priority)+0x3c1) [0x5634eb21b091]
2020-05-28T13:12:38.659 INFO:teuthology.orchestra.run.smithi186.stderr: 12: (rocksdb::DBImpl::FlushMemTablesToOutputFiles(rocksdb::autovector<rocksdb::DBImpl::BGFlushArg, 8ul> const&, bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, rocksdb::Env::Priority)+0x49b) [0x5634eb21ddcb]
2020-05-28T13:12:38.659 INFO:teuthology.orchestra.run.smithi186.stderr: 13: (rocksdb::DBImpl::BackgroundFlush(bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, rocksdb::FlushReason*, rocksdb::Env::Priority)+0xaf5) [0x5634eb21ee95]
2020-05-28T13:12:38.659 INFO:teuthology.orchestra.run.smithi186.stderr: 14: (rocksdb::DBImpl::BackgroundCallFlush(rocksdb::Env::Priority)+0xc8) [0x5634eb225548]
2020-05-28T13:12:38.660 INFO:teuthology.orchestra.run.smithi186.stderr: 15: (rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long)+0x24a) [0x5634eb3b0cba]
2020-05-28T13:12:38.660 INFO:teuthology.orchestra.run.smithi186.stderr: 16: (rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*)+0x5d) [0x5634eb3b0e3d]
2020-05-28T13:12:38.660 INFO:teuthology.orchestra.run.smithi186.stderr: 17: (()+0xc2b23) [0x7f3dd1e4eb23]
2020-05-28T13:12:38.660 INFO:teuthology.orchestra.run.smithi186.stderr: 18: (()+0x82de) [0x7f3dddafe2de]
2020-05-28T13:12:38.660 INFO:teuthology.orchestra.run.smithi186.stderr: 19: (clone()+0x43) [0x7f3dd152b133]