Bug #7260
rados api test LibRadosList.ListObjectsNS failed
Status:
Can't reproduce
Priority:
Normal
Assignee:
-
Category:
librados
Target version:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
logs: ubuntu@teuthology:/a/teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana/53137
2014-01-25T19:50:23.210 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: [ RUN ] LibRadosList.ListObjectsNS 2014-01-25T19:50:24.146 INFO:teuthology.task.thrashosds.thrasher:in_osds: [0, 5, 2, 1, 3] out_osds: [4] dead_osds: [] live_osds: [1, 0, 3, 2, 5, 4] 2014-01-25T19:50:24.146 INFO:teuthology.task.thrashosds.thrasher:choose_action: min_in 3 min_out 0 min_live 2 min_dead 0 2014-01-25T19:50:24.146 INFO:teuthology.task.thrashosds.thrasher:Adding osd 4 2014-01-25T19:50:24.147 DEBUG:teuthology.orchestra.run:Running [10.214.131.15]: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd in 4' 2014-01-25T19:50:24.335 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 702: oids not in use 50 2014-01-25T19:50:24.336 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RemovingSnap 79 2014-01-25T19:50:25.566 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 703: oids not in use 50 2014-01-25T19:50:25.566 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RemovingSnap 82 2014-01-25T19:50:26.667 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 704: oids not in use 50 2014-01-25T19:50:26.667 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RollingBack 27 to 64 2014-01-25T19:50:26.685 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 705: oids not in use 50 2014-01-25T19:50:26.685 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 50 current snap is 83 2014-01-25T19:50:26.685 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 4 2014-01-25T19:50:26.686 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 0 to 56 tid 1 ranges are [0~56,431893~609366,1810895~692777,3077696~154197] 2014-01-25T19:50:26.718 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 431893 to 1041259 tid 2 ranges are [0~56,431893~609366,1810895~692777,3077696~154197] 2014-01-25T19:50:26.759 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 1810895 to 2503672 tid 3 ranges are [0~56,431893~609366,1810895~692777,3077696~154197] 2014-01-25T19:50:26.774 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 3077696 to 3231893 tid 4 ranges are [0~56,431893~609366,1810895~692777,3077696~154197] 2014-01-25T19:50:26.775 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 706: oids not in use 49 2014-01-25T19:50:26.775 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Deleting 18 current snap is 83 2014-01-25T19:50:27.508 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-50 2014-01-25T19:50:27.581 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 2 to plana267720-50 2014-01-25T19:50:27.581 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 3 to plana267720-50 2014-01-25T19:50:27.581 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 4 to plana267720-50 2014-01-25T19:50:27.790 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 707: oids not in use 50 2014-01-25T19:50:27.790 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Snapping 2014-01-25T19:50:28.100 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 708: oids not in use 50 2014-01-25T19:50:28.101 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 18 current snap is 84 2014-01-25T19:50:28.101 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 4 2014-01-25T19:50:28.101 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 0 to 56 tid 1 ranges are [0~56,471952~704398,1886710~584591,3211345~458411] 2014-01-25T19:50:28.131 INFO:teuthology.orchestra.run.err:[10.214.131.15]: marked in osd.4. 2014-01-25T19:50:28.134 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 471952 to 1176350 tid 2 ranges are [0~56,471952~704398,1886710~584591,3211345~458411] 2014-01-25T19:50:28.141 INFO:teuthology.task.thrashosds.thrasher:Added osd 4 2014-01-25T19:50:28.170 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 1886710 to 2471301 tid 3 ranges are [0~56,471952~704398,1886710~584591,3211345~458411] 2014-01-25T19:50:28.201 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 3211345 to 3669756 tid 4 ranges are [0~56,471952~704398,1886710~584591,3211345~458411] 2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 709: oids not in use 49 2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Reading 21 2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 710: oids not in use 48 2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Snapping 2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 711: oids not in use 48 2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 37 current snap is 85 2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 2 2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-37 from 0 to 56 tid 1 ranges are [0~56,532110~400000] 2014-01-25T19:50:29.888 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-37 from 532110 to 932110 tid 2 ranges are [0~56,532110~400000] 2014-01-25T19:50:29.889 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 712: oids not in use 47 2014-01-25T19:50:29.889 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 47 current snap is 85 2014-01-25T19:50:29.889 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 1 2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-47 from 0 to 56 tid 1 ranges are [0~56] 2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 713: oids not in use 46 2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 32 current snap is 85 2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 2 2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-32 from 0 to 56 tid 1 ranges are [0~56,572169~408355] 2014-01-25T19:50:29.915 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-32 from 572169 to 980524 tid 2 ranges are [0~56,572169~408355] 2014-01-25T19:50:29.917 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 714: oids not in use 45 2014-01-25T19:50:29.917 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Reading 38 2014-01-25T19:50:29.918 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 715: oids not in use 44 2014-01-25T19:50:29.918 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RollingBack 34 to 83 2014-01-25T19:50:31.274 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-37 2014-01-25T19:50:31.274 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 2 to plana267720-37 2014-01-25T19:50:31.528 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-47 2014-01-25T19:50:31.540 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: test/librados/list.cc:55: Failure 2014-01-25T19:50:31.541 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: Value of: rados_objects_list_next(ctx, &entry, __null) 2014-01-25T19:50:31.541 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: Actual: -2 2014-01-25T19:50:31.541 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: Expected: 0 2014-01-25T19:50:31.611 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-18 2014-01-25T19:50:32.321 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: [ FAILED ] LibRadosList.ListObjectsNS (9111 ms) ubuntu@teuthology:/a/teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana/53137$ cat config.yaml archive_path: /var/lib/teuthworker/archive/teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana/53137 description: upgrade/parallel/stress-split/{0-cluster/start.yaml 1-dumpling-install/dumpling.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/snaps-few-objects.yaml 6-next-mon/monb.yaml 7-workload/rados_api_tests.yaml 8-next-mon/monc.yaml 9-workload/rados_api_tests.yaml distro/ubuntu_12.04.yaml} email: null job_id: '53137' kernel: &id001 kdb: true sha1: 80213a84a96c3040f5824bce646a184d5dd3dd2b last_in_suite: false machine_type: plana name: teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana nuke-on-error: true os_type: ubuntu os_version: '12.04' overrides: admin_socket: branch: master ceph: conf: mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 5 log-whitelist: - slow request - wrongly marked me down - objects unfound and apparently lost - log bound mismatch sha1: 97edd2fcad04e8766f965e3c487d469afbdb5a3f ceph-deploy: branch: dev: master conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: debug mon: 1 debug ms: 20 debug paxos: 20 osd default pool size: 2 install: ceph: sha1: 97edd2fcad04e8766f965e3c487d469afbdb5a3f s3tests: branch: master workunit: sha1: 97edd2fcad04e8766f965e3c487d469afbdb5a3f owner: scheduled_teuthology@teuthology roles: - - mon.a - mon.b - mds.a - osd.0 - osd.1 - osd.2 - - osd.3 - osd.4 - osd.5 - mon.c - - client.0 targets: ubuntu@plana25.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDb9VTEJ4O9jWD648xvOkmufCrA4/rhKbYxzCLsFS+UWykzp/s1MCNv/xzv78ZzOYjWCnY4UGPuvaFSTT42dBxf3yqExzfI0hOOB/x7Jz4kNjEyNV/o37LGcYriJTCPIMjnzghdt+w4bWp/ApUkzEwj2fsRMiLlv2OMkcBNmPsbxeM7wRzlyS3EPTWeqUtIndeM6wkle8j0dOBAA/kcjGamHcKG2N8zJixMTgjqFhsf/Wtq2van5D8c0p44W+lclITPUGWU/aP8DhVj+DZBk8bAn34ZBxFpwEpJbSh4oFEQyuyWP3HSkh9sAQr8Tpm4w1JzJ8NDAvclRDzL8pDLfum3 ubuntu@plana26.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7ggZ7aqae7QJjZ2+KyYSYys2vhqpMkjksuRNBQ+pjdzcHSSbxSRtDxGyZcucG0e3K0O2KJUkco/38peR9dU4iyL0oEdAEs6+391mBDBd5PmLhGeINaIpE6Q9TUGh7jMVdNqsKX03K8cmyd0ryR+QGJZC8aKlRCo0ZsbY9Pb5/tML1zDy/9V/n9bHxvqxSdh8LGJAOzt6+zxMKbLyTULT89lPni/uxB+dmErEDCzG3LG3BghU+t1LjIKSL5N6bhJqBztdGjctX6as4mpmatbwkYowCrJH3PV7DVy3MuXDxl93yLyrm7TiVjb3KjhT9RcfHVq23M4otok9OVV0AXvNV ubuntu@plana27.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCmAllWdNHyJODY7XW7HQlPIXlyBPD3vwP9DIeNnFB5u1zgrHaE9+XQdBMPWkrIM62wXQ69rebuGHxU3U0bZgoAtL7Rx0PMzHSUsCkkNjatySPrapKbCSS4dbJXJxIXp4FdVqIdJxGJtJcex8Jwy0JhA9CbAHaQgL+xWG0jFG64Q5GzeGFyF09QBBqR34jI13DYJUXiZzAOQJZ0ooliqGgwJJVuYMDt7TDcfoM5jaoZgA03/sh2RTZk3wEGCP2vcwrF4QocPCr6Aw405dZ8f6OhJlPLIgxZkKEvasJhL+M27G+Jv5gcvFpDVK3cteBiEA+NfR332iIy3ab83B6BxUCt tasks: - internal.lock_machines: - 3 - plana - internal.save_config: null - internal.check_lock: null - internal.connect: null - internal.check_conflict: null - internal.check_ceph_data: null - internal.vm_setup: null - kernel: *id001 - internal.base: null - internal.archive: null - internal.coredump: null - internal.sudo: null - internal.syslog: null - internal.timer: null - chef: null - clock.check: null - install: branch: dumpling - ceph: fs: xfs - install.upgrade: osd.0: null - ceph.restart: daemons: - osd.0 - osd.1 - osd.2 - thrashosds: chance_pgnum_grow: 1 chance_pgpnum_fix: 1 timeout: 1200 - ceph.restart: daemons: - mon.a wait-for-healthy: false wait-for-osds-up: true - rados: clients: - client.0 objects: 50 op_weights: delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 - ceph.restart: daemons: - mon.b wait-for-healthy: false wait-for-osds-up: true - workunit: branch: dumpling clients: client.0: - rados/test.sh - install.upgrade: mon.c: null - ceph.restart: daemons: - mon.c wait-for-healthy: false wait-for-osds-up: true - ceph.wait_for_mon_quorum: - a - b - c - workunit: branch: dumpling clients: client.0: - rados/test.sh
History
#1 Updated by Sage Weil about 10 years ago
- Status changed from New to Can't reproduce
reopen if we see this now that the enumerator/iterator changes are in place