Bug #9917: RADOSGW: Not able to create Swift objects with erasure coded pool - rgw - Ceph

Actions

Copy link

Bug #9917

closed

RADOSGW: Not able to create Swift objects with erasure coded pool

Added by pushpesh sharma over 9 years ago. Updated over 9 years ago.

Status:

Won't Fix

Priority:

Normal

Assignee:

Target version:

% Done:

Source:

other

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

ceph@Ubuntu14:~/ceph-0.86/src$ MON=3 MDS=0 RGW=1 OSD=3 ./vstart.sh -d -n -x -r
going verbose **
[./fetch_config /tmp/fetched.ceph.conf.5971] === osd.2 ===
Stopping Ceph osd.2 on Ubuntu14...done === osd.1 ===
Stopping Ceph osd.1 on Ubuntu14...done === osd.0 ===
Stopping Ceph osd.0 on Ubuntu14...done === mon.c ===
Stopping Ceph mon.c on Ubuntu14...done === mon.b ===
Stopping Ceph mon.b on Ubuntu14...done === mon.a ===
Stopping Ceph mon.a on Ubuntu14...done
hostname Ubuntu14
ip 10.66.26.231
ip 10.66.26.231
creating /home/ceph/ceph-0.86/src/keyring
./monmaptool --create --clobber --add a 10.66.26.231:6789 --add b 10.66.26.231:6790 --add c 10.66.26.231:6791 --print /tmp/ceph_monmap.5970
./monmaptool: monmap file /tmp/ceph_monmap.5970
./monmaptool: generated fsid 666f92fe-5982-42c5-b8d7-867849eeb381
epoch 0
fsid 666f92fe-5982-42c5-b8d7-867849eeb381
last_changed 2014-10-28 15:50:41.096164
created 2014-10-28 15:50:41.096164
0: 10.66.26.231:6789/0 mon.a
1: 10.66.26.231:6790/0 mon.b
2: 10.66.26.231:6791/0 mon.c
./monmaptool: writing epoch 0 to /tmp/ceph_monmap.5970 (3 monitors)
rm -rf /home/ceph/ceph-0.86/src/dev/mon.a
mkdir -p /home/ceph/ceph-0.86/src/dev/mon.a
./ceph-mon --mkfs -c /home/ceph/ceph-0.86/src/ceph.conf -i a --monmap=/tmp/ceph_monmap.5970 --keyring=/home/ceph/ceph-0.86/src/keyring
./ceph-mon: set fsid to e4913316-61d9-47cb-909f-c3e70d926751
./ceph-mon: created monfs at /home/ceph/ceph-0.86/src/dev/mon.a for mon.a
rm -rf /home/ceph/ceph-0.86/src/dev/mon.b
mkdir -p /home/ceph/ceph-0.86/src/dev/mon.b
./ceph-mon --mkfs -c /home/ceph/ceph-0.86/src/ceph.conf -i b --monmap=/tmp/ceph_monmap.5970 --keyring=/home/ceph/ceph-0.86/src/keyring
./ceph-mon: set fsid to e4913316-61d9-47cb-909f-c3e70d926751
./ceph-mon: created monfs at /home/ceph/ceph-0.86/src/dev/mon.b for mon.b
rm -rf /home/ceph/ceph-0.86/src/dev/mon.c
mkdir -p /home/ceph/ceph-0.86/src/dev/mon.c
./ceph-mon --mkfs -c /home/ceph/ceph-0.86/src/ceph.conf -i c --monmap=/tmp/ceph_monmap.5970 --keyring=/home/ceph/ceph-0.86/src/keyring
./ceph-mon: set fsid to e4913316-61d9-47cb-909f-c3e70d926751
./ceph-mon: created monfs at /home/ceph/ceph-0.86/src/dev/mon.c for mon.c
./ceph-mon -i a -c /home/ceph/ceph-0.86/src/ceph.conf
./ceph-mon -i b -c /home/ceph/ceph-0.86/src/ceph.conf
./ceph-mon -i c -c /home/ceph/ceph-0.86/src/ceph.conf
./vstart.sh: 482: ./vstart.sh: btrfs: not found
add osd0 0d955f1d-debe-43c2-921b-3464b70d7865
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
0
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
add item id 0 name 'osd.0' weight 1 at location {host=Ubuntu14,root=default} to crush map
2014-10-28 15:50:52.320731 7f1259895900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2014-10-28 15:50:52.321044 7f1259895900 -1 journal check: ondisk fsid d1cec18a-c0fd-4cc5-ade6-24a84b463c36 doesn't match expected 0d955f1d-debe-43c2-921b-3464b70d7865, invalid (someone else's?) journal
2014-10-28 15:50:52.464316 7f1259895900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2014-10-28 15:50:52.466073 7f1259895900 -1 filestore(/home/ceph/ceph-0.86/src/dev/osd0) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2014-10-28 15:50:52.646634 7f1259895900 -1 created object store /home/ceph/ceph-0.86/src/dev/osd0 journal /home/ceph/ceph-0.86/src/dev/osd0.journal for osd.0 fsid e4913316-61d9-47cb-909f-c3e70d926751
2014-10-28 15:50:52.646721 7f1259895900 -1 auth: error reading file: /home/ceph/ceph-0.86/src/dev/osd0/keyring: can't open /home/ceph/ceph-0.86/src/dev/osd0/keyring: (2) No such file or directory
2014-10-28 15:50:52.646993 7f1259895900 -1 created new key in keyring /home/ceph/ceph-0.86/src/dev/osd0/keyring
adding osd0 key to auth repository

DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH ***
added key for osd.0
start osd0
./ceph-osd -i 0 -c /home/ceph/ceph-0.86/src/ceph.conf
starting osd.0 at :/0 osd_data /home/ceph/ceph-0.86/src/dev/osd0 /home/ceph/ceph-0.86/src/dev/osd0.journal
./vstart.sh: 482: ./vstart.sh: btrfs: not found
add osd1 9bbca84a-dac3-41dd-8003-67da1d33d71e
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH ***
1
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH
add item id 1 name 'osd.1' weight 1 at location {host=Ubuntu14,root=default}
to crush map
2014-10-28 15:50:55.168752 7f378303b900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2014-10-28 15:50:55.169446 7f378303b900 -1 journal check: ondisk fsid 180077ad-32df-44ec-91f0-016965fb3aec doesn't match expected 9bbca84a-dac3-41dd-8003-67da1d33d71e, invalid (someone else's?) journal
2014-10-28 15:50:55.384939 7f378303b900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2014-10-28 15:50:55.387164 7f378303b900 -1 filestore(/home/ceph/ceph-0.86/src/dev/osd1) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2014-10-28 15:50:55.517814 7f378303b900 -1 created object store /home/ceph/ceph-0.86/src/dev/osd1 journal /home/ceph/ceph-0.86/src/dev/osd1.journal for osd.1 fsid e4913316-61d9-47cb-909f-c3e70d926751
2014-10-28 15:50:55.517898 7f378303b900 -1 auth: error reading file: /home/ceph/ceph-0.86/src/dev/osd1/keyring: can't open /home/ceph/ceph-0.86/src/dev/osd1/keyring: (2) No such file or directory
2014-10-28 15:50:55.517968 7f378303b900 -1 created new key in keyring /home/ceph/ceph-0.86/src/dev/osd1/keyring
adding osd1 key to auth repository
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
added key for osd.1
start osd1
./ceph-osd -i 1 -c /home/ceph/ceph-0.86/src/ceph.conf
starting osd.1 at :/0 osd_data /home/ceph/ceph-0.86/src/dev/osd1 /home/ceph/ceph-0.86/src/dev/osd1.journal
./vstart.sh: 482: ./vstart.sh: btrfs: not found
add osd2 b1153298-059b-4723-b5dd-d5cd6c72e74c
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
2
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
add item id 2 name 'osd.2' weight 1 at location {host=Ubuntu14,root=default}
to crush map
2014-10-28 15:50:58.110529 7fd9dbd60900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2014-10-28 15:50:58.115296 7fd9dbd60900 -1 journal check: ondisk fsid 01ef45f0-d87b-40e9-afe5-5a5974414957 doesn't match expected b1153298-059b-4723-b5dd-d5cd6c72e74c, invalid (someone else's?) journal
2014-10-28 15:50:58.496037 7fd9dbd60900 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2014-10-28 15:50:58.501966 7fd9dbd60900 -1 filestore(/home/ceph/ceph-0.86/src/dev/osd2) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory
2014-10-28 15:50:58.733315 7fd9dbd60900 -1 created object store /home/ceph/ceph-0.86/src/dev/osd2 journal /home/ceph/ceph-0.86/src/dev/osd2.journal for osd.2 fsid e4913316-61d9-47cb-909f-c3e70d926751
2014-10-28 15:50:58.733399 7fd9dbd60900 -1 auth: error reading file: /home/ceph/ceph-0.86/src/dev/osd2/keyring: can't open /home/ceph/ceph-0.86/src/dev/osd2/keyring: (2) No such file or directory
2014-10-28 15:50:58.733467 7fd9dbd60900 -1 created new key in keyring /home/ceph/ceph-0.86/src/dev/osd2/keyring
adding osd2 key to auth repository
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH **
added key for osd.2
start osd2
./ceph-osd -i 2 -c /home/ceph/ceph-0.86/src/ceph.conf
starting osd.2 at :/0 osd_data /home/ceph/ceph-0.86/src/dev/osd2 /home/ceph/ceph-0.86/src/dev/osd2.journal
start rgw on http://localhost:8000
setting up user testid
2014-10-28 15:50:59.192996 7f0dbca31840 0 couldn't find old data placement pools config, setting up new ones for the zone
setting up user tester
started. stop.sh to stop. see out/* (e.g. 'tail -f out/????') for debug output.
export PYTHONPATH=./pybind
export LD_LIBRARY_PATH=.libs
ceph@Ubuntu14:~/ceph-0.86/src$ swift -A http://localhost:8000/auth -U tester:testing -K asdf list

./ceph osd pool delete .rgw .rgw --yes-i-really-really-mean-it;./ceph osd pool delete .log .log --yes-i-really-really-mean-it;./ceph osd pool delete .rgw.buckets.index .rgw.buckets.index --yes-i-really-really-mean-it;./ceph osd pool delete .rgw.control .rgw.control --yes-i-really-really-mean-it;./ceph osd pool delete .rgw.gc .rgw.gc --yes-i-really-really-mean-it;./ceph osd pool delete .rgw.buckets .rgw.buckets --yes-i-really-really-mean-it;./ceph osd pool delete .rgw.root .rgw.root --yes-i-really-really-mean-it;./ceph osd pool delete .users .users --yes-i-really-really-mean-it;./ceph osd pool delete .users.email .users.email --yes-i-really-really-mean-it;./ceph osd pool delete .users.swift .users.swift --yes-i-really-really-mean-it;./ceph osd pool delete .users.uid .users.uid --yes-i-really-really-mean-it;./ceph osd pool create .rgw.buckets 20 20 erasure;./ceph osd pool create .rgw.buckets.index 20 20 erasure;./ceph osd pool create .rgw.root 20 20 erasure;./ceph osd pool create .log 20 20 erasure; ./ceph osd pool create .rgw.control 20 20 erasure;./ceph osd pool create .rgw.gc 20 20 erasure; ./ceph osd pool create .rgw 20 20 erasure; ./ceph osd pool create .users 20 20 erasure; ./ceph osd pool create .users.email 20 20 erasure;./ceph osd pool create .users.swift 20 20 erasure;./ceph osd pool create .users.uid 20 20 erasure;./ceph osd pool create .rgw.buckets.extra 20 20 erasure
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH 
pool '.rgw' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.log' does not exist
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.buckets.index' does not exist
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.control' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.gc' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.buckets' does not exist
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.root' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users.email' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users.swift' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users.uid' removed
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.buckets' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.buckets.index' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.root' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.log' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.control' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw.gc' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.rgw' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users.email' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users.swift' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH *
pool '.users.uid' created
DEVELOPER MODE: setting PATH, PYTHONPATH and LD_LIBRARY_PATH **
pool '.rgw.buckets.extra' created
ceph@Ubuntu14:~/ceph-0.86/src$ ./radosgw-admin zone set ./zone.txt
2014-10-28 15:55:28.245478 7fae34c11840 0 couldn't find old data placement pools config, setting up new ones for the zone
2014-10-28 15:55:28.326468 7fae34c11840 0 couldn't find old data placement pools config, setting up new ones for the zone

ceph@Ubuntu14:~/ceph-0.86/src$ swift -A http://localhost:8000/auth -U tester:testing -K asdf list
ceph@Ubuntu14:~/ceph-0.86/src$ swift -A http://localhost:8000/auth -U tester:testing -K asdf upload mycontainer ceph
Error trying to create container 'mycontainer': 500 Internal Server Error: UnknownError
Object PUT failed: http://localhost:8000:8000/swift/v1/mycontainer/ceph 404 Not Found NoSuchBucket
ceph@Ubuntu14:~/ceph-0.86/src$ swift -A http://localhost:8000/auth -U tester:testing -K asdf list
ceph@Ubuntu14:~/ceph-0.86/src$ swift -A http://localhost:8000/auth -U tester:testing -K asdf upload mycontainer ceph
Error trying to create container 'mycontainer': 500 Internal Server Error: UnknownError
Object PUT failed: http://localhost:8000:8000/swift/v1/mycontainer/ceph 404 Not Found NoSuchBucket

Actions

Copy link

Also available in: Atom PDF

Project

General

Profile

Ceph » rgw

Custom queries

Bug #9917

RADOSGW: Not able to create Swift objects with erasure coded pool

Updated by pushpesh sharma over 9 years ago

Updated by pushpesh sharma over 9 years ago

Updated by Yehuda Sadeh over 9 years ago

Updated by pushpesh sharma over 9 years ago

Updated by Sage Weil over 9 years ago