Project

General

Profile

Support #19093

Failed to deploy multiple SPDK blueStore OSD instances per node

Added by tangwenjun tang about 7 years ago. Updated almost 7 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Tags:
Reviewed:
Affected Versions:
Pull request ID:

Description

I succeed to create first osd when Useing the following command
ceph osd create
rm -rf /var/lib/ceph/osd/ceph-0/
mkdir /var/lib/ceph/osd/ceph-0/
chown ceph:ceph /var/lib/ceph/osd/ceph-0/
ceph-osd -i 0 --mkfs --osd-data=/var/lib/ceph/osd/ceph-0 -c /etc/ceph/ceph.conf --debug_osd 20 --mkkey
ceph-osd -i 0

but when I try to create the second osd, it failed ,I just would to know what's wrong with me

the ceph.conf about osd is that:
[osd]
bluestore = true
[osd.0]
host = ceph105
osd data = /var/lib/ceph/osd/ceph-0/
bluestore_block_path = spdk:55cd2e404c7e1063
[osd.1]
host = ceph105
osd data = /var/lib/ceph/osd/ceph-1/
bluestore_block_path = spdk:55cd2e404bde228b

the log of osd 1 is that :

5> 2017-02-27 20:57:15.558494 7f341d1e7cc0  1 - - start start
-4> 2017-02-27 20:57:15.558564 7f341d1e7cc0 2 osd.1 0 mounting /var/lib/ceph/osd/ceph-1/ /var/lib/ceph/osd/ceph-1/journal
-3> 2017-02-27 20:57:15.558582 7f341d1e7cc0 1 bluestore(/var/lib/ceph/osd/ceph-1/) mount path /var/lib/ceph/osd/ceph-1/
-2> 2017-02-27 20:57:15.558618 7f341d1e7cc0 1 bdev create path /var/lib/ceph/osd/ceph-1//block type ust-nvme
-1> 2017-02-27 20:57:15.558629 7f341d1e7cc0 1 bdev() open path /var/lib/ceph/osd/ceph-1//block
0> 2017-02-27 20:57:29.605138 7f3412ca9700 -1 /srv/autobuild-ceph/gitbuilder.git/build/rpmbuild/BUILD/ceph-12.0.0/src/common/Mutex.cc: In function 'Mutex::~Mutex()' thread 7f3412ca9700 time 2017-02-27 20:57:29.601701
/srv/autobuild-ceph/gitbuilder.git/build/rpmbuild/BUILD/ceph-12.0.0/src/common/Mutex.cc: 77: FAILED assert(nlock == 0)
ceph version 12.0.0-607-gadf051e (adf051e01678cb9e6810b0be0b1cfbe3be1cbbf9)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x7f341dbcff10]
2: (Mutex::~Mutex()+0x14e) [0x7f341db9531e]
3: (()+0x38e69) [0x7f3419a60e69]
4: (()+0x38eb5) [0x7f3419a60eb5]
5: (rte_exit()+0xae) [0x7f341ddc73ae]
6: (()+0xbc4f33) [0x7f341ddcaf33]
7: (rte_eal_init()+0xa43) [0x7f341ddbfd23]
8: (()+0x965075) [0x7f341db6b075]
9: (()+0x9654bd) [0x7f341db6b4bd]
10: (()+0xb5220) [0x7f341a3b7220]
11: (()+0x7dc5) [0x7f341a827dc5]
12: (clone()+0x6d) [0x7f3419b1eced]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

History

#1 Updated by Nathan Cutler about 7 years ago

  • Tracker changed from Tasks to Support
  • Project changed from Stable releases to Ceph

#2 Updated by Sage Weil almost 7 years ago

  • Status changed from New to Rejected

see #16966

Also available in: Atom PDF