Project

General

Profile

Bug #3538

rbd fsx test causes osd attr value mismatch err

Added by Tamilarasi muthamizhan over 11 years ago. Updated over 11 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs: ubuntu@teuthology:/a/teuthology-2012-11-23_07:00:03-regression-testing-master-basic/2882

2012-11-23 12:10:07.005589 7ff1d9356700  0 log [ERR] : 3.3 osd.1: soid 688efe43/rbd_header.101739bfd31f/head//3 attr value mismatch _
2012-11-23 12:10:07.005598 7ff1d9356700  0 log [ERR] : 3.3 scrub 0 missing, 1 inconsistent objects
2012-11-23 12:10:07.015564 7ff1d9356700  0 log [ERR] : 3.3 scrub 1 errors

ubuntu@teuthology:/a/teuthology-2012-11-23_07:00:03-regression-testing-master-basic/2882$ cat config.yaml 
kernel: &id001
  kdb: true
  sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66
nuke-on-error: true
overrides:
  ceph:
    conf:
      client:
        rbd cache: true
      global:
        ms inject socket failures: 5000
    fs: ext4
    log-whitelist:
    - slow request
    sha1: 60b84b095b1009a305d4d6a5b16f88571cbd3150
  s3tests:
    branch: testing
  workunit:
    sha1: 60b84b095b1009a305d4d6a5b16f88571cbd3150
roles:
- - mon.a
  - osd.0
  - osd.1
  - osd.2
- - mds.a
  - osd.3
  - osd.4
  - osd.5
- - client.0
targets:
  ubuntu@plana38.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDARPmUWw72IMuZaJozKLrN06DeIgQacSM4fOhaa9jLxqnt8VZRSynN2sMzbKfA+JjLgz69zBawXb0TiVu0cbdqzPV94FylkRduEcZYM9zeD3B74BKZTltZgmugaEPv20olaEfseYMV52VTDNMKSdKPbYmYOVCCpzDJAJIuWJ51UdngsBMDPwTqys49Dcj9Gul71L0FDUSa+pavNG5Ricao6tJyv6rgVrUIz8UfutVB/5xYjwYnR8yFDQuKhmteY+kk3ve8nqgNR9VjuRjfP5mg5jT5e5CtDi1OSCWUi6lJKepv+IVKCSs1vc/1WpHiNLYCLNh9PImzi5GlljuS7o7x
  ubuntu@plana40.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEwyNlwC9Utqf3PCjL2JR4wwDkzpdEJuW93DOW82vYVisYEGod454JwXeNkjqzTUk6tXeRoUM9f/C6sZS3LFgHcMYt6m0sxP8DC4qU+q0YxCw9zLY8bXKe4DDjijM62h/SnyqyOWIh9amGT7wRwZEHBV1BKvZbNxQIJ7ESkuKsk/tJfWKhq7dSw6E/+MZ4yQtXvTyaJ3pK96Hq2uoUkawv+FxXBrzG3FtTTYA8gqA1SIiV3erEIQuBK/WD74i5yK4rwpfGTo7jNc0V6wrwO1BKFj/OGjSC+2LSAkBgf8WLe6UL/dHr3bBEyzm0V4xMf5Iqb8JGvkaXNEfbFqzKC2Wv
  ubuntu@plana42.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzQfmtpfECJ+NZaaiSH/R8X+dGXHH+aDTCKGLLiHhW9fttxzfzcJJaBx1b664D3ynZAC7NiaegfLDTCMW7FFVDUltMQcWjsM4BqfFipIquDP4KOclCc6EwG5aYG/MLCJwL6sovt1uKg00bSkVQsUSHBgZbMJKCjCbBb0XPxfuS4dppA3diEZBOMt1YHr+NdV7sace/Gc7YBlGsNOinnqkKfVWIpfYCiTQ18cvaisSEHsQR6zhKqrX4afQk13cTjdvZeQp9AXxRIf1g9fq2zHVWMdJdVNR8D0BSBtfAzMqIqZ8qcJqmzQN0Zq9Wk9Y021vMFORZy2SFI6c7yBWDJLdT
tasks:
- internal.lock_machines: 3
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock: null
- ceph:
    log-whitelist:
    - wrongly marked me down
    - objects unfound and apparently lost
- thrashosds:
    timeout: 1200
- rbd_fsx:
    clients:
    - client.0
    ops: 2000
ubuntu@teuthology:/a/teuthology-2012-11-23_07:00:03-regression-testing-master-basic/2882$ cat summary.yaml 
ceph-sha1: 60b84b095b1009a305d4d6a5b16f88571cbd3150
client.0-kernel-sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66
description: collection:rbd-thrash clusters:6-osd-3-machine.yaml fs:ext4.yaml msgr-failures:few.yaml
  thrashers:default.yaml workloads:rbd_fsx_cache_writeback.yaml
duration: 3292.6934950351715
failure_reason: '"2012-11-23 12:10:07.005597 osd.4 10.214.131.2:6803/13653 12 : [ERR]
  3.3 osd.1: soid 688efe43/rbd_header.101739bfd31f/head//3 attr value mismatch _" 
  in cluster log'
flavor: basic
mds.a-kernel-sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66
mon.a-kernel-sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66
owner: scheduled_teuthology@teuthology
success: false

History

#1 Updated by Sage Weil over 11 years ago

  • Priority changed from Normal to Urgent

#2 Updated by Samuel Just over 11 years ago

This may have been fixed by 58890cfad5f7bee933baa599a68e6c65993379d4. Watch operations weren't marked as writes, and so would bypass the scrub plug possibly causing different results between primary and replica.
-Sam

#3 Updated by Sage Weil over 11 years ago

  • Status changed from New to Resolved

Also available in: Atom PDF