Bug #10299: "ObjectCacher.cc: 530: FAILED assert(i->empty())" in rbd-firefly-distro-basic-multi run - rbd - Ceph

Actions

Copy link

Bug #10299

closed

"ObjectCacher.cc: 530: FAILED assert(i->empty())" in rbd-firefly-distro-basic-multi run

Added by Yuri Weinstein over 9 years ago. Updated about 9 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Jason Dillaman

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

giant, firefly, dumpling

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-12-09_23:00:03-rbd-firefly-distro-basic-multi/646076/

2014-12-10T20:33:15.075 INFO:teuthology.orchestra.run.burnupi62.stdout:1856 clone    15 order 25 su 524288 sc 5
2014-12-10T20:33:17.412 INFO:teuthology.orchestra.run.burnupi62.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14
2014-12-10T20:33:18.139 INFO:teuthology.orchestra.run.burnupi62.stdout:1857 write    0x751dbe8 thru    0x752837d    (0xa796 bytes)
2014-12-10T20:33:18.143 INFO:teuthology.orchestra.run.burnupi62.stdout:1858 flatten
2014-12-10T20:33:21.993 INFO:teuthology.orchestra.run.burnupi62.stderr:osdc/ObjectCacher.cc: In function 'ObjectCacher::~ObjectCacher()' thread 7fbfd01517c0 time 2014-12-10 20:33:21.992430
2014-12-10T20:33:21.994 INFO:teuthology.orchestra.run.burnupi62.stderr:osdc/ObjectCacher.cc: 530: FAILED assert(i->empty())
2014-12-10T20:33:21.994 INFO:teuthology.orchestra.run.burnupi62.stderr: ceph version 0.80.7-155-gdd7c8c2 (dd7c8c2bc6b2810ff7f483af940fa09dbe74e83a)
2014-12-10T20:33:21.994 INFO:teuthology.orchestra.run.burnupi62.stderr: 1: (ObjectCacher::~ObjectCacher()+0x1ad) [0x7fbfcfce3f9d]
2014-12-10T20:33:21.995 INFO:teuthology.orchestra.run.burnupi62.stderr: 2: (librbd::ImageCtx::~ImageCtx()+0x2a) [0x7fbfcfc92a1a]
2014-12-10T20:33:21.995 INFO:teuthology.orchestra.run.burnupi62.stderr: 3: (librbd::close_image(librbd::ImageCtx*)+0x92) [0x7fbfcfca62a2]
2014-12-10T20:33:21.995 INFO:teuthology.orchestra.run.burnupi62.stderr: 4: (librbd::refresh_parent(librbd::ImageCtx*)+0x4b) [0x7fbfcfcaba9b]
2014-12-10T20:33:21.996 INFO:teuthology.orchestra.run.burnupi62.stderr: 5: (librbd::ictx_refresh(librbd::ImageCtx*)+0xd67) [0x7fbfcfc9da17]
2014-12-10T20:33:21.996 INFO:teuthology.orchestra.run.burnupi62.stderr: 6: (librbd::ictx_check(librbd::ImageCtx*)+0x119) [0x7fbfcfc9eac9]
2014-12-10T20:33:21.996 INFO:teuthology.orchestra.run.burnupi62.stderr: 7: (librbd::info(librbd::ImageCtx*, rbd_image_info_t&, unsigned long)+0x58) [0x7fbfcfca1bb8]
2014-12-10T20:33:21.996 INFO:teuthology.orchestra.run.burnupi62.stderr: 8: (check_size()+0x2e) [0x4041ae]
2014-12-10T20:33:21.997 INFO:teuthology.orchestra.run.burnupi62.stderr: 9: (test()+0x375) [0x4058e5]
2014-12-10T20:33:21.997 INFO:teuthology.orchestra.run.burnupi62.stderr: 10: (main()+0x7df) [0x40327f]
2014-12-10T20:33:21.997 INFO:teuthology.orchestra.run.burnupi62.stderr: 11: (__libc_start_main()+0xf5) [0x7fbfce66aec5]
2014-12-10T20:33:21.998 INFO:teuthology.orchestra.run.burnupi62.stderr: 12: ceph_test_librbd_fsx() [0x4035f3]
2014-12-10T20:33:21.998 INFO:teuthology.orchestra.run.burnupi62.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-12-10T20:33:21.998 INFO:teuthology.orchestra.run.burnupi62.stderr:terminate called after throwing an instance of 'ceph::FailedAssertion'

Actions

Copy link

Updated by Josh Durgin over 9 years ago

Category set to librbd
Priority changed from Normal to Urgent
Backport set to giant, firefly, dumpling

Based on that log it looks like the write (doing copy-up, and thus reading from the parent) was still in flight when the next i/o started and refreshed the parent info, noticing that it had been flattened and closing the parent ImageCtx.

Actions

Copy link