Project

General

Profile

Actions

Bug #15386

closed

bluestore+spdk results in osd abort with _read_fsid unparsable uuid

Added by Mark Nelson about 8 years ago. Updated about 5 years ago.

Status:
Can't reproduce
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2016-04-05 10:21:24.278399 7f794acc2b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
2016-04-05 10:21:24.278725 7f794acc2b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
2016-04-05 10:21:24.278751 7f794acc2b00  0 ceph version 10.1.0 (96ae8bd25f31862dbd5302f304ebf8bf1166aba6), process ceph-osd, pid 81666
2016-04-05 10:21:24.278938 7f794acc2b00 -1 WARNING: experimental feature 'bluestore' is enabled
Please be aware that this feature is experimental, untested,
unsupported, and may result in data corruption, data loss,
and/or irreparable damage to your cluster.  Do not use
feature with important data.

2016-04-05 10:21:24.279178 7f794acc2b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
2016-04-05 10:21:24.366839 7f794acc2b00 -1 bluestore(/tmp/cbt/mnt/osd-device-0-data) _read_fsid unparsable uuid 
2016-04-05 10:21:24.375218 7f7944357700 -1 *** Caught signal (Aborted) **
 in thread 7f7944357700

 ceph version 10.1.0 (96ae8bd25f31862dbd5302f304ebf8bf1166aba6)
 1: (()+0x8f5a6a) [0x7f794b5d8a6a]
 2: (()+0xf130) [0x7f7949111130]
 3: (gsignal()+0x37) [0x7f7946fb15d7]
 4: (abort()+0x148) [0x7f7946fb2cc8]
 5: (rte_log()+0) [0x7f794a3ef46a]
 6: (rte_eal_init()+0xc3b) [0x7f794a3f0cfb]
 7: (()+0x77ad45) [0x7f794b45dd45]
 8: (()+0x77b3ed) [0x7f794b45e3ed]
 9: (()+0xb51e0) [0x7f794790a1e0]
 10: (()+0x7df5) [0x7f7949109df5]
 11: (clone()+0x6d) [0x7f79470721ad]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
   -20> 2016-04-05 10:21:24.271130 7f794acc2b00  5 asok(0x7f7955744000) register_command perfcounters_dump hook 0x7f7955694030
   -19> 2016-04-05 10:21:24.271162 7f794acc2b00  5 asok(0x7f7955744000) register_command 1 hook 0x7f7955694030
   -18> 2016-04-05 10:21:24.271166 7f794acc2b00  5 asok(0x7f7955744000) register_command perf dump hook 0x7f7955694030
   -17> 2016-04-05 10:21:24.271173 7f794acc2b00  5 asok(0x7f7955744000) register_command perfcounters_schema hook 0x7f7955694030
   -16> 2016-04-05 10:21:24.271181 7f794acc2b00  5 asok(0x7f7955744000) register_command 2 hook 0x7f7955694030
   -15> 2016-04-05 10:21:24.271184 7f794acc2b00  5 asok(0x7f7955744000) register_command perf schema hook 0x7f7955694030
   -14> 2016-04-05 10:21:24.271187 7f794acc2b00  5 asok(0x7f7955744000) register_command perf reset hook 0x7f7955694030
   -13> 2016-04-05 10:21:24.271193 7f794acc2b00  5 asok(0x7f7955744000) register_command config show hook 0x7f7955694030
   -12> 2016-04-05 10:21:24.271199 7f794acc2b00  5 asok(0x7f7955744000) register_command config set hook 0x7f7955694030
   -11> 2016-04-05 10:21:24.271202 7f794acc2b00  5 asok(0x7f7955744000) register_command config get hook 0x7f7955694030
   -10> 2016-04-05 10:21:24.271204 7f794acc2b00  5 asok(0x7f7955744000) register_command config diff hook 0x7f7955694030
    -9> 2016-04-05 10:21:24.271210 7f794acc2b00  5 asok(0x7f7955744000) register_command log flush hook 0x7f7955694030
    -8> 2016-04-05 10:21:24.271217 7f794acc2b00  5 asok(0x7f7955744000) register_command log dump hook 0x7f7955694030
    -7> 2016-04-05 10:21:24.271220 7f794acc2b00  5 asok(0x7f7955744000) register_command log reopen hook 0x7f7955694030
    -6> 2016-04-05 10:21:24.278399 7f794acc2b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
    -5> 2016-04-05 10:21:24.278725 7f794acc2b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
    -4> 2016-04-05 10:21:24.278751 7f794acc2b00  0 ceph version 10.1.0 (96ae8bd25f31862dbd5302f304ebf8bf1166aba6), process ceph-osd, pid 81666
    -3> 2016-04-05 10:21:24.278938 7f794acc2b00 -1 WARNING: experimental feature 'bluestore' is enabled
Please be aware that this feature is experimental, untested,
unsupported, and may result in data corruption, data loss,
and/or irreparable damage to your cluster.  Do not use
feature with important data.

    -2> 2016-04-05 10:21:24.279178 7f794acc2b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
    -1> 2016-04-05 10:21:24.366839 7f794acc2b00 -1 bluestore(/tmp/cbt/mnt/osd-device-0-data) _read_fsid unparsable uuid 
     0> 2016-04-05 10:21:24.375218 7f7944357700 -1 *** Caught signal (Aborted) **
 in thread 7f7944357700

 ceph version 10.1.0 (96ae8bd25f31862dbd5302f304ebf8bf1166aba6)
 1: (()+0x8f5a6a) [0x7f794b5d8a6a]
 2: (()+0xf130) [0x7f7949111130]
 3: (gsignal()+0x37) [0x7f7946fb15d7]
 4: (abort()+0x148) [0x7f7946fb2cc8]
 5: (rte_log()+0) [0x7f794a3ef46a]
 6: (rte_eal_init()+0xc3b) [0x7f794a3f0cfb]
 7: (()+0x77ad45) [0x7f794b45dd45]
 8: (()+0x77b3ed) [0x7f794b45e3ed]
 9: (()+0xb51e0) [0x7f794790a1e0]
 10: (()+0x7df5) [0x7f7949109df5]
 11: (clone()+0x6d) [0x7f79470721ad]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
   0/ 5 none
   0/ 0 lockdep
   0/ 0 context
   0/ 0 crush
   0/ 0 mds
   0/ 0 mds_balancer
   0/ 0 mds_locker
   0/ 0 mds_log
   0/ 0 mds_log_expire
   0/ 0 mds_migrator
   0/ 0 buffer
   0/ 0 timer
   0/ 0 filer
   0/ 1 striper
   0/ 0 objecter
   0/ 0 rados
   0/ 0 rbd
   0/ 5 rbd_mirror
   0/ 5 rbd_replay
   0/ 0 journaler
   0/ 0 objectcacher
   0/ 0 client
   0/ 0 osd
   0/ 0 optracker
   0/ 0 objclass
   0/ 0 filestore
   0/ 0 journal
   0/ 0 ms
   0/ 0 mon
   0/ 0 monc
   0/ 0 paxos
   0/ 0 tp
   0/ 0 auth
   1/ 5 crypto
   0/ 0 finisher
   0/ 0 heartbeatmap
   0/ 0 perfcounter
   0/ 0 rgw
   1/10 civetweb
   1/ 5 javaclient
   0/ 0 asok
   0/ 0 throttle
   0/ 0 refs
   1/ 5 xio
   1/ 5 compressor
   1/ 5 newstore
   0/ 0 bluestore
   0/ 0 bluefs
   0/ 0 bdev
   1/ 5 kstore
   4/ 5 rocksdb
   4/ 5 leveldb
   1/ 5 kinetic
   1/ 5 fuse
  -2/-2 (syslog threshold)
  -1/-1 (stderr threshold)
  max_recent     10000
  max_new         1000
  log_file /tmp/cbt/ceph/log/osd.0.log
--- end dump of recent events ---
2016-04-05 10:21:26.338429 7f57b6389b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
2016-04-05 10:21:26.338750 7f57b6389b00 -1 WARNING: the following dangerous and experimental features are enabled: bluestore,rocksdb
2016-04-05 10:21:26.338776 7f57b6389b00  0 ceph version 10.1.0 (96ae8bd25f31862dbd5302f304ebf8bf1166aba6), process ceph-osd, pid 81785
2016-04-05 10:21:26.339147 7f57b6389b00 -1 WARNING: experimental feature 'bluestore' is enabled
Please be aware that this feature is experimental, untested,
unsupported, and may result in data corruption, data loss,
and/or irreparable damage to your cluster.  Do not use
feature with important data.

2016-04-05 10:21:26.339271 7f57b6389b00 -1  ** ERROR: unable to open OSD superblock on /tmp/cbt/mnt/osd-device-0-data: (2) No such file or directory
Actions #1

Updated by Haomai Wang about 8 years ago

hmm, I think the unparsed uuid problem isn't related to crash. Which tool are you used to deploy? From my view, it seemed dpdk libraries are dynamic linked causing crash.

Actions #2

Updated by Sage Weil about 7 years ago

  • Status changed from New to Can't reproduce
Actions #3

Updated by Chris Holcombe over 5 years ago

I was able to reproduce this locally on a virtual machine with lvm on ubuntu 18.04. It seems that LVM produces UUID's that aren't actually parseable uuid's.

lvdisplay 
  --- Logical volume ---
  LV Path                /dev/ceph-c4ab42c6-3af5-4ce1-af42-2fc554fa4a93/osd-block-67bbb17f-2d55-47c3-ae69-646d3538505b
  LV Name                osd-block-67bbb17f-2d55-47c3-ae69-646d3538505b
  VG Name                ceph-c4ab42c6-3af5-4ce1-af42-2fc554fa4a93
  LV UUID                clN8W5-WZTD-bcQc-cR75-TeoQ-nwII-HfP4am
  LV Write Access        read/write
  LV Creation host, time ceph1, 2018-09-17 23:33:30 +0000
  LV Status              available
  # open                 0
  LV Size                1012.00 MiB
  Current LE             253
  Segments               1
  Allocation             inherit
  Read ahead sectors     0
  Block device           253:0

The value for LV UUID isn't a valid UUID is the problem. It's unique and a string but it doesn't follow the UUID standard from what I can tell.

dpkg -l | grep lvm
ii  liblvm2app2.2:amd64                   2.02.176-4.1ubuntu3                amd64        LVM2 application library
ii  liblvm2cmd2.02:amd64                  2.02.176-4.1ubuntu3                amd64        LVM2 command library
ii  lvm2                                  2.02.176-4.1ubuntu3                amd64        Linux Logical Volume Manager

Crash text:

23:33:30 [ERROR] ceph-osd cmd failed: . stderr: 2018-09-17 23:33:30.656226 7f422562be40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 
/build/ceph-roHgVA/ceph-12.2.4/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f422562be40 time 2018-09-17 23:33:30.692767
/build/ceph-roHgVA/ceph-12.2.4/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length)
 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xf5) [0x55fbeb477a95]
 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x520) [0x55fbeb3f96d0]
 3: (BlueStore::_open_db(bool)+0xc99) [0x55fbeb307519]
 4: (BlueStore::mkfs()+0x5b4) [0x55fbeb33ce14]
 5: (OSD::mkfs(CephContext*, ObjectStore*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, uuid_d, int)+0x259) [0x55fbeaeaeb69]
 6: (main()+0x10af) [0x55fbeadda60f]
 7: (__libc_start_main()+0xe7) [0x7f4222981b97]
 8: (_start()+0x2a) [0x55fbeae64bca]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2018-09-17 23:33:30.702789 7f422562be40 -1 /build/ceph-roHgVA/ceph-12.2.4/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f422562be40 time 2018-09-17 23:33:30.692767
/build/ceph-roHgVA/ceph-12.2.4/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length)

 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xf5) [0x55fbeb477a95]
 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x520) [0x55fbeb3f96d0]
 3: (BlueStore::_open_db(bool)+0xc99) [0x55fbeb307519]
 4: (BlueStore::mkfs()+0x5b4) [0x55fbeb33ce14]
 5: (OSD::mkfs(CephContext*, ObjectStore*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, uuid_d, int)+0x259) [0x55fbeaeaeb69]
 6: (main()+0x10af) [0x55fbeadda60f]
 7: (__libc_start_main()+0xe7) [0x7f4222981b97]
 8: (_start()+0x2a) [0x55fbeae64bca]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

   -12> 2018-09-17 23:33:30.656226 7f422562be40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 
     0> 2018-09-17 23:33:30.702789 7f422562be40 -1 /build/ceph-roHgVA/ceph-12.2.4/src/os/bluestore/BlueFS.cc: In function 'void BlueFS::add_block_extent(unsigned int, uint64_t, uint64_t)' thread 7f422562be40 time 2018-09-17 23:33:30.692767
/build/ceph-roHgVA/ceph-12.2.4/src/os/bluestore/BlueFS.cc: 172: FAILED assert(bdev[id]->get_size() >= offset + length)

 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xf5) [0x55fbeb477a95]
 2: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x520) [0x55fbeb3f96d0]
 3: (BlueStore::_open_db(bool)+0xc99) [0x55fbeb307519]
 4: (BlueStore::mkfs()+0x5b4) [0x55fbeb33ce14]
 5: (OSD::mkfs(CephContext*, ObjectStore*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, uuid_d, int)+0x259) [0x55fbeaeaeb69]
 6: (main()+0x10af) [0x55fbeadda60f]
 7: (__libc_start_main()+0xe7) [0x7f4222981b97]
 8: (_start()+0x2a) [0x55fbeae64bca]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

*** Caught signal (Aborted) **
 in thread 7f422562be40 thread_name:ceph-osd
 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
 1: (()+0x9ea3d8) [0x55fbeb4313d8]
 2: (()+0x12890) [0x7f4223ada890]
 3: (gsignal()+0xc7) [0x7f422299ee97]
 4: (abort()+0x141) [0x7f42229a0801]
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27f) [0x55fbeb477c1f]
 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x520) [0x55fbeb3f96d0]
 7: (BlueStore::_open_db(bool)+0xc99) [0x55fbeb307519]
 8: (BlueStore::mkfs()+0x5b4) [0x55fbeb33ce14]
 9: (OSD::mkfs(CephContext*, ObjectStore*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, uuid_d, int)+0x259) [0x55fbeaeaeb69]
 10: (main()+0x10af) [0x55fbeadda60f]
 11: (__libc_start_main()+0xe7) [0x7f4222981b97]
 12: (_start()+0x2a) [0x55fbeae64bca]
2018-09-17 23:33:30.705392 7f422562be40 -1 *** Caught signal (Aborted) **
 in thread 7f422562be40 thread_name:ceph-osd

 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
 1: (()+0x9ea3d8) [0x55fbeb4313d8]
 2: (()+0x12890) [0x7f4223ada890]
 3: (gsignal()+0xc7) [0x7f422299ee97]
 4: (abort()+0x141) [0x7f42229a0801]
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27f) [0x55fbeb477c1f]
 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x520) [0x55fbeb3f96d0]
 7: (BlueStore::_open_db(bool)+0xc99) [0x55fbeb307519]
 8: (BlueStore::mkfs()+0x5b4) [0x55fbeb33ce14]
 9: (OSD::mkfs(CephContext*, ObjectStore*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, uuid_d, int)+0x259) [0x55fbeaeaeb69]
 10: (main()+0x10af) [0x55fbeadda60f]
 11: (__libc_start_main()+0xe7) [0x7f4222981b97]
 12: (_start()+0x2a) [0x55fbeae64bca]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

     0> 2018-09-17 23:33:30.705392 7f422562be40 -1 *** Caught signal (Aborted) **
 in thread 7f422562be40 thread_name:ceph-osd

 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
 1: (()+0x9ea3d8) [0x55fbeb4313d8]
 2: (()+0x12890) [0x7f4223ada890]
 3: (gsignal()+0xc7) [0x7f422299ee97]
 4: (abort()+0x141) [0x7f42229a0801]
 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27f) [0x55fbeb477c1f]
 6: (BlueFS::add_block_extent(unsigned int, unsigned long, unsigned long)+0x520) [0x55fbeb3f96d0]
 7: (BlueStore::_open_db(bool)+0xc99) [0x55fbeb307519]
 8: (BlueStore::mkfs()+0x5b4) [0x55fbeb33ce14]
 9: (OSD::mkfs(CephContext*, ObjectStore*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, uuid_d, int)+0x259) [0x55fbeaeaeb69]
 10: (main()+0x10af) [0x55fbeadda60f]
 11: (__libc_start_main()+0xe7) [0x7f4222981b97]
 12: (_start()+0x2a) [0x55fbeae64bca]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

Actions #4

Updated by Chris Holcombe over 5 years ago

Note this also occurs with ceph 12.2.7 on bionic. It was installed via cloud archive:

cat /etc/apt/sources.list.d/cloudarchive-rocky.list
deb http://ubuntu-cloud.archive.canonical.com/ubuntu bionic-updates/rocky main

Actions #5

Updated by Chris Holcombe over 5 years ago

Tracing through the source code it looks like I'm barking up the wrong tree. I believe this is saying the /var/lib/ceph/osd/ceph-{id}/fsid file is empty and that's the issue. Not sure why it's not getting created.

Actions #6

Updated by Rainer Krienke about 5 years ago

I am just trying to set up ceph 13.2.4-1bionic on a Ubuntu 18.04.2 system and creating an osd I also get the _read_fsid unparsable uuid error. I installed ceph from this repos: https://download.ceph.com/debian-mimic.

root@ceph1:~# ceph-volume lvm prepare --bluestore --data /dev/sdg
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring i - osd new 6787ea06-2d31-4ea9-ac8b-342b1f3fe1de
Running command: /sbin/vgcreate --force --yes ceph-d0f54030-c146-46e7-bcaa-1b330705a874 /dev/sdg
stderr: /dev/sda1: read failed after 0 of 4096 at 299999625216: Ungültiges oder unvollständiges Multi-Byte
oder Wide-Zeichen
stderr: /dev/sda1: read failed after 0 of 4096 at 299999682560: Ungültiges oder unvollständiges Multi-Byte- oder Wide-Zeichen
stdout: Physical volume "/dev/sdg" successfully created.
stdout: Volume group "ceph-d0f54030-c146-46e7-bcaa-1b330705a874" successfully created
Running command: /sbin/lvcreate --yes l 100%FREE -n osd-block-6787ea06-2d31-4ea9-ac8b-342b1f3fe1de ceph-d0f54030-c146-46e7-bcaa-1b330705a874
stdout: Logical volume "osd-block-6787ea06-2d31-4ea9-ac8b-342b1f3fe1de" created.
Running command: /usr/bin/ceph-authtool --gen-print-key
Running command: /bin/mount -t tmpfs tmpfs /var/lib/ceph/osd/ceph-0
-
> Absolute path not found for executable: restorecon
--> Ensure $PATH environment variable contains common executable locations
Running command: /bin/chown -h ceph:ceph /dev/ceph-d0f54030-c146-46e7-bcaa-1b330705a874/osd-block-6787ea06-2d31-4ea9-ac8b-342b1f3fe1de
Running command: /bin/chown -R ceph:ceph /dev/dm-8
Running command: /bin/ln -s /dev/ceph-d0f54030-c146-46e7-bcaa-1b330705a874/osd-block-6787ea06-2d31-4ea9-ac8b-342b1f3fe1de /var/lib/ceph/osd/ceph-0/block
Running command: /usr/bin/ceph --cluster ceph --name client.bootstrap-osd --keyring /var/lib/ceph/bootstrap-osd/ceph.keyring mon getmap -o /var/lib/ceph/osd/ceph-0/activate.monmap
stderr: got monmap epoch 1
Running command: /usr/bin/ceph-authtool /var/lib/ceph/osd/ceph-0/keyring --create-keyring --name osd.0 --add-key AQDTXmpc+qimCRAAGxN43r61iW4FDNMJs5lzQA==
stdout: creating /var/lib/ceph/osd/ceph-0/keyring
added entity osd.0 auth auth(auid = 18446744073709551615 key=AQDTXmpc+qimCRAAGxN43r61iW4FDNMJs5lzQA== with 0 caps)
Running command: /bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/keyring
Running command: /bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0/
Running command: /usr/bin/ceph-osd --cluster ceph --osd-objectstore bluestore --mkfs -i 0 --monmap /var/lib/ceph/osd/ceph-0/activate.monmap --keyfile - --osd-data /var/lib/ceph/osd/ceph-0/ --osd-uuid 6787ea06-2d31-4ea9-ac8b-342b1f3fe1de --setuser ceph --setgroup ceph
stderr: 2019-02-18 08:29:25.544 7fdaa50ed240 -1 bluestore(/var/lib/ceph/osd/ceph-0/) read_fsid unparsable uuid
stderr: /build/ceph-13.2.4/src/os/bluestore/KernelDevice.cc: In function 'virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOContext*, bool)' thread 7fdaa50ed240 time 2019-02-18 08:29:25.592655
stderr: /build/ceph-13.2.4/src/os/bluestore/KernelDevice.cc: 821: FAILED assert((uint64_t)r == len)
stderr: ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable)
stderr: 1: (ceph::
_ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7fda9c50d3e2]
stderr: 2: (()+0x26d5a7) [0x7fda9c50d5a7]

Actions

Also available in: Atom PDF