Bug #12885: rbd export-diff crashes in librbd::simple_diff_cb - rbd - Ceph

Actions

Copy link

Bug #12885

closed

rbd export-diff crashes in librbd::simple_diff_cb

Added by Thorvald Natvig over 8 years ago. Updated over 8 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Jason Dillaman

Target version:

% Done:

Source:

Community (user)

Tags:

Backport:

hammer

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

Ceph - v0.94.3

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

When doing rbd export-diff, I get a crash. Most other images on the same cluster work fine.

rbd info AlignNav-db::

rbd image 'AlignNav-db':
size 11100 MB in 2775 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.6bb2042eb141f2
format: 2
features: layering
flags:
parent: rbd/_align_partial_db@2015-08-29.001
overlap: 11100 MB

rbd export-diff AlignNav-db fil::

librbd/internal.cc: In function 'int librbd::simple_diff_cb(uint64_t, size_t, int, void*)' thread 7f7539f20840 time 2015-08-31 10:48:36.797179
librbd/internal.cc: 2815: FAILED assert(exists)

(full log attached)

This is the 0.94.3-1trusty release.

Files

Download all files

rbd.export-diff.crash.txt (41.9 KB) rbd.export-diff.crash.txt		Thorvald Natvig, 08/31/2015 06:45 PM
client.admin.21649.log.gz (73.3 KB) client.admin.21649.log.gz		Thorvald Natvig, 09/08/2015 05:40 PM

Related issues 1 (0 open — 1 closed)

Actions

Copy link

Updated by Loïc Dachary over 8 years ago

Project changed from Ceph to rbd

Actions

Copy link

Updated by Jason Dillaman over 8 years ago

Status changed from New to Need More Info

Can you please add the following to your ceph.conf, re-run the failed 'rbd export-diff', and attach the resulting log? I have a theory as to the cause but I will need the logs to verify. Thanks.

ceph.conf

[client]
debug rados = 20
debug rbd = 20
log file = /path/to/log/file/$name.$pid.log

Actions

Copy link

Updated by Thorvald Natvig over 8 years ago

File client.admin.21649.log.gz client.admin.21649.log.gz added

Here you go. Had to compress it to avoid "request entity too large".

Actions

Copy link

Updated by Jason Dillaman over 8 years ago

Status changed from Need More Info to In Progress
Assignee set to Jason Dillaman
Source changed from other to Community (user)

Thanks for the prompt reply, your logs confirmed my suspicion. For a short-term workaround until the fix propagates down to Hammer, you should create a snapshot on AlignNav-db, run a regular 'rbd export AlignNav-db@<base snap>', then you should be able to run 'rbd export diff --from-snap AlignNav-db@<base snap> AlignNav-db@<incremental snap>' to acquire your incremental diffs.

Actions

Copy link