Project

General

Profile

Bug #7260

rados api test LibRadosList.ListObjectsNS failed

Added by Tamilarasi muthamizhan about 10 years ago. Updated about 10 years ago.

Status:
Can't reproduce
Priority:
Normal
Assignee:
-
Category:
librados
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

logs: ubuntu@teuthology:/a/teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana/53137


2014-01-25T19:50:23.210 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: [ RUN      ] LibRadosList.ListObjectsNS
2014-01-25T19:50:24.146 INFO:teuthology.task.thrashosds.thrasher:in_osds:  [0, 5, 2, 1, 3]  out_osds:  [4] dead_osds:  [] live_osds:  [1, 0, 3, 2, 5, 4]
2014-01-25T19:50:24.146 INFO:teuthology.task.thrashosds.thrasher:choose_action: min_in 3 min_out 0 min_live 2 min_dead 0
2014-01-25T19:50:24.146 INFO:teuthology.task.thrashosds.thrasher:Adding osd 4
2014-01-25T19:50:24.147 DEBUG:teuthology.orchestra.run:Running [10.214.131.15]: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph osd in 4'
2014-01-25T19:50:24.335 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 702: oids not in use 50
2014-01-25T19:50:24.336 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RemovingSnap 79
2014-01-25T19:50:25.566 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 703: oids not in use 50
2014-01-25T19:50:25.566 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RemovingSnap 82
2014-01-25T19:50:26.667 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 704: oids not in use 50
2014-01-25T19:50:26.667 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RollingBack 27 to 64
2014-01-25T19:50:26.685 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 705: oids not in use 50
2014-01-25T19:50:26.685 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 50 current snap is 83
2014-01-25T19:50:26.685 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 4
2014-01-25T19:50:26.686 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 0 to 56 tid 1 ranges are [0~56,431893~609366,1810895~692777,3077696~154197]
2014-01-25T19:50:26.718 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 431893 to 1041259 tid 2 ranges are [0~56,431893~609366,1810895~692777,3077696~154197]
2014-01-25T19:50:26.759 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 1810895 to 2503672 tid 3 ranges are [0~56,431893~609366,1810895~692777,3077696~154197]
2014-01-25T19:50:26.774 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-50 from 3077696 to 3231893 tid 4 ranges are [0~56,431893~609366,1810895~692777,3077696~154197]
2014-01-25T19:50:26.775 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 706: oids not in use 49
2014-01-25T19:50:26.775 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Deleting 18 current snap is 83
2014-01-25T19:50:27.508 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-50
2014-01-25T19:50:27.581 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 2 to plana267720-50
2014-01-25T19:50:27.581 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 3 to plana267720-50
2014-01-25T19:50:27.581 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 4 to plana267720-50
2014-01-25T19:50:27.790 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 707: oids not in use 50
2014-01-25T19:50:27.790 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Snapping
2014-01-25T19:50:28.100 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 708: oids not in use 50
2014-01-25T19:50:28.101 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 18 current snap is 84
2014-01-25T19:50:28.101 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 4
2014-01-25T19:50:28.101 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 0 to 56 tid 1 ranges are [0~56,471952~704398,1886710~584591,3211345~458411]
2014-01-25T19:50:28.131 INFO:teuthology.orchestra.run.err:[10.214.131.15]: marked in osd.4.
2014-01-25T19:50:28.134 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 471952 to 1176350 tid 2 ranges are [0~56,471952~704398,1886710~584591,3211345~458411]
2014-01-25T19:50:28.141 INFO:teuthology.task.thrashosds.thrasher:Added osd 4
2014-01-25T19:50:28.170 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 1886710 to 2471301 tid 3 ranges are [0~56,471952~704398,1886710~584591,3211345~458411]
2014-01-25T19:50:28.201 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-18 from 3211345 to 3669756 tid 4 ranges are [0~56,471952~704398,1886710~584591,3211345~458411]
2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 709: oids not in use 49
2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Reading 21
2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 710: oids not in use 48
2014-01-25T19:50:28.203 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Snapping
2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 711: oids not in use 48
2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 37 current snap is 85
2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 2
2014-01-25T19:50:29.865 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-37 from 0 to 56 tid 1 ranges are [0~56,532110~400000]
2014-01-25T19:50:29.888 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-37 from 532110 to 932110 tid 2 ranges are [0~56,532110~400000]
2014-01-25T19:50:29.889 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 712: oids not in use 47
2014-01-25T19:50:29.889 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 47 current snap is 85
2014-01-25T19:50:29.889 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 1
2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-47 from 0 to 56 tid 1 ranges are [0~56]
2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 713: oids not in use 46
2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing 32 current snap is 85
2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: waiting_on = 2
2014-01-25T19:50:29.890 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-32 from 0 to 56 tid 1 ranges are [0~56,572169~408355]
2014-01-25T19:50:29.915 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Writing plana267720-32 from 572169 to 980524 tid 2 ranges are [0~56,572169~408355]
2014-01-25T19:50:29.917 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 714: oids not in use 45
2014-01-25T19:50:29.917 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: Reading 38
2014-01-25T19:50:29.918 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: 715: oids not in use 44
2014-01-25T19:50:29.918 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: RollingBack 34 to 83
2014-01-25T19:50:31.274 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-37
2014-01-25T19:50:31.274 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 2 to plana267720-37
2014-01-25T19:50:31.528 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-47
2014-01-25T19:50:31.540 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: test/librados/list.cc:55: Failure
2014-01-25T19:50:31.541 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: Value of: rados_objects_list_next(ctx, &entry, __null)
2014-01-25T19:50:31.541 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]:   Actual: -2
2014-01-25T19:50:31.541 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: Expected: 0
2014-01-25T19:50:31.611 INFO:teuthology.task.rados.rados.0.out:[10.214.131.14]: finishing write tid 1 to plana267720-18
2014-01-25T19:50:32.321 INFO:teuthology.task.workunit.client.0.out:[10.214.131.14]: [  FAILED  ] LibRadosList.ListObjectsNS (9111 ms)

ubuntu@teuthology:/a/teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana/53137$ cat config.yaml 
archive_path: /var/lib/teuthworker/archive/teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana/53137
description: upgrade/parallel/stress-split/{0-cluster/start.yaml 1-dumpling-install/dumpling.yaml
  2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-mon/mona.yaml 5-workload/snaps-few-objects.yaml
  6-next-mon/monb.yaml 7-workload/rados_api_tests.yaml 8-next-mon/monc.yaml 9-workload/rados_api_tests.yaml
  distro/ubuntu_12.04.yaml}
email: null
job_id: '53137'
kernel: &id001
  kdb: true
  sha1: 80213a84a96c3040f5824bce646a184d5dd3dd2b
last_in_suite: false
machine_type: plana
name: teuthology-2014-01-25_19:40:02-upgrade:parallel-master-testing-basic-plana
nuke-on-error: true
os_type: ubuntu
os_version: '12.04'
overrides:
  admin_socket:
    branch: master
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug ms: 1
        debug osd: 5
    log-whitelist:
    - slow request
    - wrongly marked me down
    - objects unfound and apparently lost
    - log bound mismatch
    sha1: 97edd2fcad04e8766f965e3c487d469afbdb5a3f
  ceph-deploy:
    branch:
      dev: master
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 97edd2fcad04e8766f965e3c487d469afbdb5a3f
  s3tests:
    branch: master
  workunit:
    sha1: 97edd2fcad04e8766f965e3c487d469afbdb5a3f
owner: scheduled_teuthology@teuthology
roles:
- - mon.a
  - mon.b
  - mds.a
  - osd.0
  - osd.1
  - osd.2
- - osd.3
  - osd.4
  - osd.5
  - mon.c
- - client.0
targets:
  ubuntu@plana25.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDb9VTEJ4O9jWD648xvOkmufCrA4/rhKbYxzCLsFS+UWykzp/s1MCNv/xzv78ZzOYjWCnY4UGPuvaFSTT42dBxf3yqExzfI0hOOB/x7Jz4kNjEyNV/o37LGcYriJTCPIMjnzghdt+w4bWp/ApUkzEwj2fsRMiLlv2OMkcBNmPsbxeM7wRzlyS3EPTWeqUtIndeM6wkle8j0dOBAA/kcjGamHcKG2N8zJixMTgjqFhsf/Wtq2van5D8c0p44W+lclITPUGWU/aP8DhVj+DZBk8bAn34ZBxFpwEpJbSh4oFEQyuyWP3HSkh9sAQr8Tpm4w1JzJ8NDAvclRDzL8pDLfum3
  ubuntu@plana26.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7ggZ7aqae7QJjZ2+KyYSYys2vhqpMkjksuRNBQ+pjdzcHSSbxSRtDxGyZcucG0e3K0O2KJUkco/38peR9dU4iyL0oEdAEs6+391mBDBd5PmLhGeINaIpE6Q9TUGh7jMVdNqsKX03K8cmyd0ryR+QGJZC8aKlRCo0ZsbY9Pb5/tML1zDy/9V/n9bHxvqxSdh8LGJAOzt6+zxMKbLyTULT89lPni/uxB+dmErEDCzG3LG3BghU+t1LjIKSL5N6bhJqBztdGjctX6as4mpmatbwkYowCrJH3PV7DVy3MuXDxl93yLyrm7TiVjb3KjhT9RcfHVq23M4otok9OVV0AXvNV
  ubuntu@plana27.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCmAllWdNHyJODY7XW7HQlPIXlyBPD3vwP9DIeNnFB5u1zgrHaE9+XQdBMPWkrIM62wXQ69rebuGHxU3U0bZgoAtL7Rx0PMzHSUsCkkNjatySPrapKbCSS4dbJXJxIXp4FdVqIdJxGJtJcex8Jwy0JhA9CbAHaQgL+xWG0jFG64Q5GzeGFyF09QBBqR34jI13DYJUXiZzAOQJZ0ooliqGgwJJVuYMDt7TDcfoM5jaoZgA03/sh2RTZk3wEGCP2vcwrF4QocPCr6Aw405dZ8f6OhJlPLIgxZkKEvasJhL+M27G+Jv5gcvFpDVK3cteBiEA+NfR332iIy3ab83B6BxUCt
tasks:
- internal.lock_machines:
  - 3
  - plana
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    branch: dumpling
- ceph:
    fs: xfs
- install.upgrade:
    osd.0: null
- ceph.restart:
    daemons:
    - osd.0
    - osd.1
    - osd.2
- thrashosds:
    chance_pgnum_grow: 1
    chance_pgpnum_fix: 1
    timeout: 1200
- ceph.restart:
    daemons:
    - mon.a
    wait-for-healthy: false
    wait-for-osds-up: true
- rados:
    clients:
    - client.0
    objects: 50
    op_weights:
      delete: 50
      read: 100
      rollback: 50
      snap_create: 50
      snap_remove: 50
      write: 100
    ops: 4000
- ceph.restart:
    daemons:
    - mon.b
    wait-for-healthy: false
    wait-for-osds-up: true
- workunit:
    branch: dumpling
    clients:
      client.0:
      - rados/test.sh
- install.upgrade:
    mon.c: null
- ceph.restart:
    daemons:
    - mon.c
    wait-for-healthy: false
    wait-for-osds-up: true
- ceph.wait_for_mon_quorum:
  - a
  - b
  - c
- workunit:
    branch: dumpling
    clients:
      client.0:
      - rados/test.sh

History

#1 Updated by Sage Weil about 10 years ago

  • Status changed from New to Can't reproduce

reopen if we see this now that the enumerator/iterator changes are in place

Also available in: Atom PDF