Bug #3538
rbd fsx test causes osd attr value mismatch err
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Logs: ubuntu@teuthology:/a/teuthology-2012-11-23_07:00:03-regression-testing-master-basic/2882
2012-11-23 12:10:07.005589 7ff1d9356700 0 log [ERR] : 3.3 osd.1: soid 688efe43/rbd_header.101739bfd31f/head//3 attr value mismatch _ 2012-11-23 12:10:07.005598 7ff1d9356700 0 log [ERR] : 3.3 scrub 0 missing, 1 inconsistent objects 2012-11-23 12:10:07.015564 7ff1d9356700 0 log [ERR] : 3.3 scrub 1 errors ubuntu@teuthology:/a/teuthology-2012-11-23_07:00:03-regression-testing-master-basic/2882$ cat config.yaml kernel: &id001 kdb: true sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66 nuke-on-error: true overrides: ceph: conf: client: rbd cache: true global: ms inject socket failures: 5000 fs: ext4 log-whitelist: - slow request sha1: 60b84b095b1009a305d4d6a5b16f88571cbd3150 s3tests: branch: testing workunit: sha1: 60b84b095b1009a305d4d6a5b16f88571cbd3150 roles: - - mon.a - osd.0 - osd.1 - osd.2 - - mds.a - osd.3 - osd.4 - osd.5 - - client.0 targets: ubuntu@plana38.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDARPmUWw72IMuZaJozKLrN06DeIgQacSM4fOhaa9jLxqnt8VZRSynN2sMzbKfA+JjLgz69zBawXb0TiVu0cbdqzPV94FylkRduEcZYM9zeD3B74BKZTltZgmugaEPv20olaEfseYMV52VTDNMKSdKPbYmYOVCCpzDJAJIuWJ51UdngsBMDPwTqys49Dcj9Gul71L0FDUSa+pavNG5Ricao6tJyv6rgVrUIz8UfutVB/5xYjwYnR8yFDQuKhmteY+kk3ve8nqgNR9VjuRjfP5mg5jT5e5CtDi1OSCWUi6lJKepv+IVKCSs1vc/1WpHiNLYCLNh9PImzi5GlljuS7o7x ubuntu@plana40.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEwyNlwC9Utqf3PCjL2JR4wwDkzpdEJuW93DOW82vYVisYEGod454JwXeNkjqzTUk6tXeRoUM9f/C6sZS3LFgHcMYt6m0sxP8DC4qU+q0YxCw9zLY8bXKe4DDjijM62h/SnyqyOWIh9amGT7wRwZEHBV1BKvZbNxQIJ7ESkuKsk/tJfWKhq7dSw6E/+MZ4yQtXvTyaJ3pK96Hq2uoUkawv+FxXBrzG3FtTTYA8gqA1SIiV3erEIQuBK/WD74i5yK4rwpfGTo7jNc0V6wrwO1BKFj/OGjSC+2LSAkBgf8WLe6UL/dHr3bBEyzm0V4xMf5Iqb8JGvkaXNEfbFqzKC2Wv ubuntu@plana42.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzQfmtpfECJ+NZaaiSH/R8X+dGXHH+aDTCKGLLiHhW9fttxzfzcJJaBx1b664D3ynZAC7NiaegfLDTCMW7FFVDUltMQcWjsM4BqfFipIquDP4KOclCc6EwG5aYG/MLCJwL6sovt1uKg00bSkVQsUSHBgZbMJKCjCbBb0XPxfuS4dppA3diEZBOMt1YHr+NdV7sace/Gc7YBlGsNOinnqkKfVWIpfYCiTQ18cvaisSEHsQR6zhKqrX4afQk13cTjdvZeQp9AXxRIf1g9fq2zHVWMdJdVNR8D0BSBtfAzMqIqZ8qcJqmzQN0Zq9Wk9Y021vMFORZy2SFI6c7yBWDJLdT tasks: - internal.lock_machines: 3 - internal.save_config: null - internal.check_lock: null - internal.connect: null - internal.check_conflict: null - kernel: *id001 - internal.base: null - internal.archive: null - internal.coredump: null - internal.syslog: null - internal.timer: null - chef: null - clock: null - ceph: log-whitelist: - wrongly marked me down - objects unfound and apparently lost - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 2000 ubuntu@teuthology:/a/teuthology-2012-11-23_07:00:03-regression-testing-master-basic/2882$ cat summary.yaml ceph-sha1: 60b84b095b1009a305d4d6a5b16f88571cbd3150 client.0-kernel-sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66 description: collection:rbd-thrash clusters:6-osd-3-machine.yaml fs:ext4.yaml msgr-failures:few.yaml thrashers:default.yaml workloads:rbd_fsx_cache_writeback.yaml duration: 3292.6934950351715 failure_reason: '"2012-11-23 12:10:07.005597 osd.4 10.214.131.2:6803/13653 12 : [ERR] 3.3 osd.1: soid 688efe43/rbd_header.101739bfd31f/head//3 attr value mismatch _" in cluster log' flavor: basic mds.a-kernel-sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66 mon.a-kernel-sha1: 35152979e6181b1fbb4b61c3ff641c14df53ad66 owner: scheduled_teuthology@teuthology success: false
History
#1 Updated by Sage Weil over 11 years ago
- Priority changed from Normal to Urgent
#2 Updated by Samuel Just over 11 years ago
This may have been fixed by 58890cfad5f7bee933baa599a68e6c65993379d4. Watch operations weren't marked as writes, and so would bypass the scrub plug possibly causing different results between primary and replica.
-Sam
#3 Updated by Sage Weil over 11 years ago
- Status changed from New to Resolved