Actions
Bug #10385
closedceph_objectstore_tool.py may race
Added by Loïc Dachary over 9 years ago. Updated over 9 years ago.
% Done:
0%
Source:
other
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
vstarting.... DONE
Wait for health_ok... DONE
Created Replicated pool #1
Created Erasure coded pool #2
Creating 4 objects in replicated pool
Creating 4 objects in erasure coded pool
Test invalid parameters
ERROR:Bad message to stderr "OSD has the store locked
"
Test --op list variants
OSD has the store locked
ERROR:Bad exit status 1 from ./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pretty-format=false
Traceback (most recent call last):
File "./test/ceph_objectstore_tool.py", line 902, in <module>
status = main(sys.argv[1:])
File "./test/ceph_objectstore_tool.py", line 479, in main
(pgid, jsondict) = json.loads(JSONOBJ[0])[0]
IndexError: list index out of range
if the osd take too long to shutdown, ceph-objectstore-tool may fail because they are still locking the files.
Updated by Loïc Dachary over 9 years ago
vstarting.... DONE
Wait for health_ok... DONE
DEBUG:./ceph osd pool create rep_pool 4 4 replicated
Created Replicated pool #1
DEBUG:./ceph osd erasure-code-profile set testecprofile ruleset-failure-domain=osd
DEBUG:./ceph osd erasure-code-profile get testecprofile
DEBUG:./ceph osd pool create ec_pool 4 4 erasure testecprofile
Created Erasure coded pool #2
Creating 4 objects in replicated pool
DEBUG:mkdir -p /tmp/data.604
DEBUG:rm -f /tmp/data.604/-REPobject1
DEBUG:./rados -p rep_pool -N '' put REPobject1 /tmp/data.604/-REPobject1
DEBUG:rm -f /tmp/data.604/-REPobject2
DEBUG:./rados -p rep_pool -N '' put REPobject2 /tmp/data.604/-REPobject2
DEBUG:./rados -p rep_pool -N '' setxattr REPobject2 key2-1 val2-1
DEBUG:./rados -p rep_pool -N '' setomapheader REPobject2 hdr2
DEBUG:./rados -p rep_pool -N '' setomapval REPobject2 okey2-1 oval2-1
DEBUG:rm -f /tmp/data.604/ns1-REPobject1
DEBUG:./rados -p rep_pool -N 'ns1' put REPobject1 /tmp/data.604/ns1-REPobject1
DEBUG:rm -f /tmp/data.604/ns1-REPobject2
DEBUG:./rados -p rep_pool -N 'ns1' put REPobject2 /tmp/data.604/ns1-REPobject2
DEBUG:./rados -p rep_pool -N 'ns1' setxattr REPobject2 key2-1 val2-1
DEBUG:./rados -p rep_pool -N 'ns1' setomapheader REPobject2 hdr2
DEBUG:./rados -p rep_pool -N 'ns1' setomapval REPobject2 okey2-1 oval2-1
Creating 4 objects in erasure coded pool
DEBUG:rm -f /tmp/data.604/-ECobject1
DEBUG:./rados -p ec_pool -N '' put ECobject1 /tmp/data.604/-ECobject1
DEBUG:rm -f /tmp/data.604/-ECobject2
DEBUG:./rados -p ec_pool -N '' put ECobject2 /tmp/data.604/-ECobject2
DEBUG:./rados -p ec_pool -N '' setxattr ECobject2 key2-1 val2-1
DEBUG:rm -f /tmp/data.604/ns1-ECobject1
DEBUG:./rados -p ec_pool -N 'ns1' put ECobject1 /tmp/data.604/ns1-ECobject1
DEBUG:rm -f /tmp/data.604/ns1-ECobject2
DEBUG:./rados -p ec_pool -N 'ns1' put ECobject2 /tmp/data.604/ns1-ECobject2
DEBUG:./rados -p ec_pool -N 'ns1' setxattr ECobject2 key2-1 val2-1
DEBUG:{'': {'REPobject2': {'xattr': {'key2-1': 'val2-1'}, 'omapheader': 'hdr2', 'omap': {'okey2-1': 'oval2-1'}}, 'ECobject2': {'xattr': {'key2-1': 'val2-1'}, 'omap': {}}, 'REPobject1': {'xattr': {}, 'omap': {}}, 'ECobject1': {'xattr': {}, 'omap': {}}}, 'ns1': {'REPobject2': {'xattr': {'key2-1': 'val2-1'}, 'omapheader': 'hdr2', 'omap': {'okey2-1': 'oval2-1'}}, 'ECobject2': {'xattr': {'key2-1': 'val2-1'}, 'omap': {}}, 'REPobject1': {'xattr': {}, 'omap': {}}, 'ECobject1': {'xattr': {}, 'omap': {}}}}
=== mon.a ===
Stopping Ceph mon.a on fold...kill 1062...done
=== osd.3 ===
Stopping Ceph osd.3 on fold...kill 14287...kill 14287...done
=== osd.2 ===
Stopping Ceph osd.2 on fold...kill 11384...kill 11384...done
=== osd.1 ===
Stopping Ceph osd.1 on fold...kill 8269...kill 8269...done
=== osd.0 ===
Stopping Ceph osd.0 on fold...kill 5234...kill 5234...done
DEBUG:['1.0', '1.1', '1.2', '1.3']
DEBUG:['2.0s0', '2.0s1', '2.0s2', '2.1s0', '2.1s1', '2.1s2', '2.2s0', '2.2s1', '2.2s2', '2.3s0', '2.3s1', '2.3s2']
DEBUG:['1.0', '1.1']
DEBUG:['2.0s0', '2.0s1', '2.0s2', '2.1s0', '2.1s1', '2.1s2']
DEBUG:1.0
DEBUG:osd0
Test invalid parameters
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 1.0
INFO:Correctly failed with message "stdout is a tty and no --file filename specified"
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 1.0 --file -
INFO:Correctly failed with message "stdout is a tty and no --file filename specified"
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --pgid 1.0 --file /tmp/foo.604
ERROR:Bad message to stderr "OSD has the store locked
"
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --file /tmp/foo.604
INFO:Correctly failed with message "open: No such file or directory"
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --pgid 1.0
INFO:Correctly failed with message "stdin is a tty and no --file filename specified"
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --pgid 1.0 --file -
INFO:Correctly failed with message "stdin is a tty and no --file filename specified"
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --type foobar --op list --pgid 1.0
INFO:Correctly failed with message "Must provide --type (filestore, memstore, keyvaluestore-dev)"
DEBUG:./ceph-objectstore-tool --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --type memstore --op list --pgid 1.0
INFO:Correctly failed with message "Must provide --data-path"
DEBUG:./ceph-objectstore-tool --type filestore --data-path ceph_objectstore_tool_dir/dev/osd0 --op list --pgid 1.0
INFO:Correctly failed with message "Must provide --journal-path"
Test --op list variants
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pretty-format=false
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pretty-format=false
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pgid 1.0 --pretty-format=false
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pgid 1.0 --pretty-format=false
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pgid 1.0 REPobject1 --pretty-format=false
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pgid 1.0 REPobject1 --pretty-format=false
Test --op list by generating json for all objects using default format
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op list --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op list --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op list --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op list --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op list --pgid 2.0s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op list --pgid 2.0s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op list --pgid 2.0s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op list --pgid 2.1s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op list --pgid 2.1s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list --pgid 2.1s2
Test get-bytes and set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes /tmp/getbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes /tmp/setbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-bytes -
DEBUG:diff -q /tmp/setbytes.604 /tmp/testbytes.604
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' set-bytes
Test list-attrs get-attr
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-attr _key2-1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-attr _key2-1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 3521648588, "max": 0, "oid": "REPobject2", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' get-attr _key2-1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 623868980, "max": 0, "oid": "REPobject1", "namespace": "", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-attr _key2-1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-attr _key2-1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.0 '["1.0", {"hash": 1510571612, "max": 0, "oid": "REPobject2", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' get-attr _key2-1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' list-attrs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --pgid 1.1 '["1.1", {"hash": 1397205569, "max": 0, "oid": "REPobject1", "namespace": "ns1", "snapid": -2, "key": "", "pool": 1}]' list-attrs
Test pg info
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op info --pgid 1.0 | grep '"pgid": "1.0"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op info --pgid 1.0 | grep '"pgid": "1.0"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op info --pgid 1.0 | grep '"pgid": "1.0"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op info --pgid 1.1 | grep '"pgid": "1.1"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op info --pgid 1.1 | grep '"pgid": "1.1"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op info --pgid 1.1 | grep '"pgid": "1.1"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op info --pgid 1.2 | grep '"pgid": "1.2"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op info --pgid 1.2 | grep '"pgid": "1.2"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op info --pgid 1.2 | grep '"pgid": "1.2"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op info --pgid 1.3 | grep '"pgid": "1.3"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op info --pgid 1.3 | grep '"pgid": "1.3"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op info --pgid 1.3 | grep '"pgid": "1.3"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op info --pgid 2.0s0 | grep '"pgid": "2.0s0"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op info --pgid 2.0s1 | grep '"pgid": "2.0s1"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op info --pgid 2.0s2 | grep '"pgid": "2.0s2"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op info --pgid 2.1s0 | grep '"pgid": "2.1s0"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op info --pgid 2.1s1 | grep '"pgid": "2.1s1"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op info --pgid 2.1s2 | grep '"pgid": "2.1s2"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op info --pgid 2.2s0 | grep '"pgid": "2.2s0"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op info --pgid 2.2s1 | grep '"pgid": "2.2s1"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op info --pgid 2.2s2 | grep '"pgid": "2.2s2"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op info --pgid 2.3s0 | grep '"pgid": "2.3s0"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op info --pgid 2.3s1 | grep '"pgid": "2.3s1"'
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op info --pgid 2.3s2 | grep '"pgid": "2.3s2"'
Test pg logging
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op log --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op log --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op log --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op log --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op log --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op log --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op log --pgid 1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op log --pgid 1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op log --pgid 1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op log --pgid 1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op log --pgid 1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op log --pgid 1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op log --pgid 2.0s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op log --pgid 2.0s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op log --pgid 2.0s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op log --pgid 2.1s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op log --pgid 2.1s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op log --pgid 2.1s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op log --pgid 2.2s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op log --pgid 2.2s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op log --pgid 2.2s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op log --pgid 2.3s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op log --pgid 2.3s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op log --pgid 2.3s2
Test list-pgs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op list-pgs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op list-pgs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op list-pgs
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op list-pgs
Test pg export
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 1.0 > /tmp/test.604/osd0/1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op export --pgid 1.0 > /tmp/test.604/osd1/1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op export --pgid 1.0 > /tmp/test.604/osd2/1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 1.1 --file - > /tmp/test.604/osd0/1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op export --pgid 1.1 --file - > /tmp/test.604/osd2/1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op export --pgid 1.1 --file - > /tmp/test.604/osd3/1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 1.2 --file /tmp/test.604/osd0/1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op export --pgid 1.2 --file /tmp/test.604/osd1/1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op export --pgid 1.2 --file /tmp/test.604/osd3/1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 1.3 --file /tmp/test.604/osd0/1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op export --pgid 1.3 --file /tmp/test.604/osd1/1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op export --pgid 1.3 --file /tmp/test.604/osd2/1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op export --pgid 2.0s0 --file /tmp/test.604/osd3/2.0s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op export --pgid 2.0s1 --file /tmp/test.604/osd1/2.0s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op export --pgid 2.0s2 --file /tmp/test.604/osd2/2.0s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op export --pgid 2.1s0 --file /tmp/test.604/osd2/2.1s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op export --pgid 2.1s1 --file /tmp/test.604/osd3/2.1s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 2.1s2 --file /tmp/test.604/osd0/2.1s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op export --pgid 2.2s0 --file /tmp/test.604/osd3/2.2s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op export --pgid 2.2s1 --file /tmp/test.604/osd1/2.2s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 2.2s2 --file /tmp/test.604/osd0/2.2s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op export --pgid 2.3s0 --file /tmp/test.604/osd3/2.3s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op export --pgid 2.3s1 --file /tmp/test.604/osd2/2.3s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op export --pgid 2.3s2 --file /tmp/test.604/osd0/2.3s2
Test pg removal
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op remove --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op remove --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op remove --pgid 1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op remove --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op remove --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op remove --pgid 1.1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op remove --pgid 1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op remove --pgid 1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op remove --pgid 1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op remove --pgid 1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op remove --pgid 1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op remove --pgid 1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op remove --pgid 2.0s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op remove --pgid 2.0s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op remove --pgid 2.0s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op remove --pgid 2.1s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op remove --pgid 2.1s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op remove --pgid 2.1s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op remove --pgid 2.2s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op remove --pgid 2.2s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op remove --pgid 2.2s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op remove --pgid 2.3s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op remove --pgid 2.3s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op remove --pgid 2.3s2
Test pg import
DEBUG:cat /tmp/test.604/osd2/1.1 |./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op import
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op import --file - < /tmp/test.604/osd2/2.1s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op import --file /tmp/test.604/osd2/2.0s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op import --file /tmp/test.604/osd2/2.3s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op import --file /tmp/test.604/osd2/1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd2 --journal-path ceph_objectstore_tool_dir/dev/osd2.journal --op import --file /tmp/test.604/osd2/1.0
DEBUG:cat /tmp/test.604/osd0/1.1 |./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --file - < /tmp/test.604/osd0/2.2s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --file /tmp/test.604/osd0/2.3s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --file /tmp/test.604/osd0/1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --file /tmp/test.604/osd0/1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --file /tmp/test.604/osd0/2.1s2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd0 --journal-path ceph_objectstore_tool_dir/dev/osd0.journal --op import --file /tmp/test.604/osd0/1.0
DEBUG:cat /tmp/test.604/osd3/1.1 |./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op import
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op import --file - < /tmp/test.604/osd3/2.2s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op import --file /tmp/test.604/osd3/2.1s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op import --file /tmp/test.604/osd3/1.2
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op import --file /tmp/test.604/osd3/2.3s0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd3 --journal-path ceph_objectstore_tool_dir/dev/osd3.journal --op import --file /tmp/test.604/osd3/2.0s0
DEBUG:cat /tmp/test.604/osd1/1.2 |./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op import
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op import --file - < /tmp/test.604/osd1/1.3
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op import --file /tmp/test.604/osd1/2.2s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op import --file /tmp/test.604/osd1/2.0s1
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op import --file /tmp/test.604/osd1/1.0
DEBUG:./ceph-objectstore-tool --data-path ceph_objectstore_tool_dir/dev/osd1 --journal-path ceph_objectstore_tool_dir/dev/osd1.journal --op import --file /tmp/test.604/osd1/1.0
Verify replicated import data
DEBUG:find ceph_objectstore_tool_dir/dev -name 'REPobject2_*__*'
DEBUG:diff -q /tmp/data.604/-REPobject2 ceph_objectstore_tool_dir/dev/osd2/current/1.0_head/REPobject2__head_D1E817CC__1
DEBUG:diff -q /tmp/data.604/-REPobject2 ceph_objectstore_tool_dir/dev/osd0/current/1.0_head/REPobject2__head_D1E817CC__1
DEBUG:diff -q /tmp/data.604/-REPobject2 ceph_objectstore_tool_dir/dev/osd1/current/1.0_head/REPobject2__head_D1E817CC__1
DEBUG:find ceph_objectstore_tool_dir/dev -name 'REPobject1_*_ns1_*'
DEBUG:diff -q /tmp/data.604/ns1-REPobject1 ceph_objectstore_tool_dir/dev/osd2/current/1.1_head/REPobject1__head_5347AA41_ns1_1
DEBUG:diff -q /tmp/data.604/ns1-REPobject1 ceph_objectstore_tool_dir/dev/osd0/current/1.1_head/REPobject1__head_5347AA41_ns1_1
DEBUG:diff -q /tmp/data.604/ns1-REPobject1 ceph_objectstore_tool_dir/dev/osd3/current/1.1_head/REPobject1__head_5347AA41_ns1_1
DEBUG:find ceph_objectstore_tool_dir/dev -name 'REPobject1_*__*'
DEBUG:diff -q /tmp/data.604/-REPobject1 ceph_objectstore_tool_dir/dev/osd2/current/1.0_head/REPobject1__head_252F7C34__1
DEBUG:diff -q /tmp/data.604/-REPobject1 ceph_objectstore_tool_dir/dev/osd0/current/1.0_head/REPobject1__head_252F7C34__1
DEBUG:diff -q /tmp/data.604/-REPobject1 ceph_objectstore_tool_dir/dev/osd1/current/1.0_head/REPobject1__head_252F7C34__1
DEBUG:find ceph_objectstore_tool_dir/dev -name 'REPobject2_*_ns1_*'
DEBUG:diff -q /tmp/data.604/ns1-REPobject2 ceph_objectstore_tool_dir/dev/osd2/current/1.0_head/REPobject2__head_5A097E5C_ns1_1
DEBUG:diff -q /tmp/data.604/ns1-REPobject2 ceph_objectstore_tool_dir/dev/osd0/current/1.0_head/REPobject2__head_5A097E5C_ns1_1
DEBUG:diff -q /tmp/data.604/ns1-REPobject2 ceph_objectstore_tool_dir/dev/osd1/current/1.0_head/REPobject2__head_5A097E5C_ns1_1
vstarting.... DONE
Wait for health_ok... DONE
Verify erasure coded import data
DEBUG:./rados -p ec_pool -N '' get ECobject1 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/-ECobject1 /tmp/tmp.604
DEBUG:./rados -p ec_pool -N 'ns1' get ECobject1 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/ns1-ECobject1 /tmp/tmp.604
DEBUG:./rados -p ec_pool -N 'ns1' get ECobject2 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/ns1-ECobject2 /tmp/tmp.604
DEBUG:./rados -p ec_pool -N '' get ECobject2 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/-ECobject2 /tmp/tmp.604
DEBUG:./rados mkpool import-rados-pool
Test import-rados
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd2/1.1
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd2/1.3
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd2/1.0
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd0/1.1
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd0/1.2
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd0/1.3
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd0/1.0
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd3/1.1
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd3/1.2
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd1/1.2
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd1/1.3
DEBUG:./ceph-objectstore-tool import-rados import-rados-pool /tmp/test.604/osd1/1.0
DEBUG:./rados -p import-rados-pool -N '' get REPobject2 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/-REPobject2 /tmp/tmp.604
DEBUG:./rados -p import-rados-pool -N 'ns1' get REPobject1 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/ns1-REPobject1 /tmp/tmp.604
DEBUG:./rados -p import-rados-pool -N '' get REPobject1 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/-REPobject1 /tmp/tmp.604
DEBUG:./rados -p import-rados-pool -N 'ns1' get REPobject2 /tmp/tmp.604
DEBUG:diff -q /tmp/data.604/ns1-REPobject2 /tmp/tmp.604
TEST FAILED WITH 1 ERRORS
=== mon.a ===
Stopping Ceph mon.a on fold...kill 21424...done
=== osd.3 ===
Stopping Ceph osd.3 on fold...kill 21591...kill 21591...done
=== osd.2 ===
Stopping Ceph osd.2 on fold...kill 21570...kill 21570...done
=== osd.1 ===
Stopping Ceph osd.1 on fold...kill 21558...kill 21558...done
=== osd.0 ===
Stopping Ceph osd.0 on fold...kill 21545...kill 21545...done
Actions