Project

General

Profile

Actions

Bug #15755

closed

rbd-mirror crashed with assertion failure during the sync in-progress

Added by Kumar Hemanth almost 8 years ago. Updated almost 8 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Jason Dillaman
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
jewel
Regression:
Severity:
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Description of problem:
-----------------------
Hosted a VM using a Qemu client on a 10GB image created on primary rbd client, as the image started synchronizing rbd-mirror daemon crashed

Version-Release number of selected component (if applicable):
ceph v10.2.0.1
rbd-mirror-10.2.0-1.el7cp.x86_64

Steps to Reproduce:
1. Configured rbd-mirror with pool mode mirroring
2. Created few images from primary rbd client
3. mapped one of the image on a qemu client and hosted a VM
4. As installation of VM was in-progress , Verify the sync status on secondary rbd client.

Actual results:
Sync failed and there was a crash

Expected results:
sync should have been successful

Full bt :- http://pastebin.test.redhat.com/371778

librbd/journal/Replay.cc: In function 'librbd::AioCompletion* librbd::journal::Replay<ImageCtxT>::create_aio_modify_completion(Context*, Context*, bool*) [with ImageCtxT = librbd::ImageCtx]' thread 7f2a6dffb700 time 2016-05-05 21:08:09.712560
librbd/journal/Replay.cc: 774: FAILED assert(m_on_aio_ready == nullptr)
ceph version 10.2.0-1.el7cp (3a9fba20ec743699b69bd0181dd6c54dc01c64b9)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f2af5b40645]
2: (librbd::journal::Replay<librbd::ImageCtx>::create_aio_modify_completion(Context*, Context*, bool*)+0x5b0) [0x7f2af5a23370]
3: (librbd::journal::Replay<librbd::ImageCtx>::handle_event(librbd::journal::AioWriteEvent const&, Context*, Context*)+0x98) [0x7f2af5a23f58]
4: (librbd::journal::Replay<librbd::ImageCtx>::process(ceph::buffer::list::iterator*, Context*, Context*)+0x4d2) [0x7f2af5a28d72]
5: (rbd::mirror::ImageReplayer<librbd::ImageCtx>::process_entry()+0xfd) [0x7f2af59729cd]
6: (rbd::mirror::ImageReplayer<librbd::ImageCtx>::handle_replay_ready()+0x24d) [0x7f2af597369d]
7: (rbd::mirror::ImageReplayer<librbd::ImageCtx>::handle_process_entry_ready(int)+0x7a) [0x7f2af596d75a]
8: (Context::complete(int)+0x9) [0x7f2af596b269]
9: (ThreadPool::worker(ThreadPool::WorkThread*)+0xa7e) [0x7f2af5b3192e]
10: (ThreadPool::WorkThread::entry()+0x10) [0x7f2af5b32800]
11: (()+0x7dc5) [0x7f2aeb07fdc5]
12: (clone()+0x6d) [0x7f2ae9f6628d]

Related issues 1 (0 open1 closed)

Copied to rbd - Backport #15818: jewel: rbd-mirror crashed with assertion failure during the sync in-progressResolvedJason DillamanActions
Actions #1

Updated by Jason Dillaman almost 8 years ago

  • Status changed from New to In Progress
  • Assignee set to Jason Dillaman
Actions #2

Updated by Jason Dillaman almost 8 years ago

  • Status changed from In Progress to Fix Under Review
Actions #3

Updated by Ken Dreyer almost 8 years ago

  • Backport set to jewel
Actions #4

Updated by Jason Dillaman almost 8 years ago

  • Tracker changed from Bug to Backport
  • Subject changed from rbd-mirror crashed with assertion failure during the sync in-progress to jewel: rbd-mirror crashed with assertion failure during the sync in-progress
  • Status changed from Fix Under Review to In Progress
Actions #5

Updated by Jason Dillaman almost 8 years ago

  • Tracker changed from Backport to Bug
  • Subject changed from jewel: rbd-mirror crashed with assertion failure during the sync in-progress to rbd-mirror crashed with assertion failure during the sync in-progress
  • Status changed from In Progress to Pending Backport
  • % Done set to 0
  • Backport set to jewel
  • Release deleted (jewel)
Actions #6

Updated by Jason Dillaman almost 8 years ago

  • Copied to Backport #15818: jewel: rbd-mirror crashed with assertion failure during the sync in-progress added
Actions #7

Updated by Jason Dillaman almost 8 years ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF