Feature #10098
closedwanted: command to clear 'incomplete' PGs
0%
Description
Hello,
Please create a command that would clear 'incomplete' PGs.
Perhaps ceph pg force_create_pg could be extended to recreate incomplete PGs. (Recreate means create blank PG.)
This would be helpful for recovering the cluster to working order and with less data loss than entirely deleting the pool with incomplete PGs.
Midway through this November, I see three people on the mailing list wishing for this tool!
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-November/044451.html
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-November/044540.html
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-November/044533.html
Thanks for a great project with a lot of potential!
Chad.
Updated by Jifeng Yin almost 9 years ago
Wait, 'force_create_pg' cannot recreate incomplete PGs? If that, could you please let me know how to deal with the incomplete PGs?
Updated by Samuel Just almost 9 years ago
Probably ceph_objectstore_tool --[unsafe?]-mark-complete <pgid> on a down osd.
Definitely need to set:
info.last_epoch_started to current
info.history.last_epoch_started current
info.history.last_epoch_clean to current
info.last_backfill = MAX
Updated by Aaron T almost 9 years ago
I have this exact problem on my 0.94.1.2 cluster. It's production but the data is mostly-replaceable, so I'm willing to test patches if you need testers. ceph_objectstore_tool --mark-complete <pgid> gets my vote :)
Updated by Mykola Golub almost 9 years ago
I have a patch for ceph-objectstore-tool, which adds mark-complete operation:
https://github.com/ceph/ceph/pull/5031
Aaron, you might want to try it on your own risk.
Updated by Aaron T almost 9 years ago
Mykola Golub wrote:
I have a patch for ceph-objectstore-tool, which adds mark-complete operation:
https://github.com/ceph/ceph/pull/5031
Aaron, you might want to try it on your own risk.
Mykola,
Thank you for the opportunity to help test -- unfortunately, we just finished rebuilding our cluster not 24 hours before your comment. We're running 9.0.1 now and playing with erasure coding :) Hopefully no more incomplete PGs will occur, but if they do, we'll be more than happy to test your patch.
-Aaron
Updated by Loïc Dachary over 8 years ago
- Status changed from New to Fix Under Review
Updated by David Zafman over 8 years ago
- Status changed from Fix Under Review to Resolved
- Assignee set to David Zafman
6907778d
Updated by Loïc Dachary about 8 years ago
- Status changed from Resolved to Pending Backport
- Backport set to hammer
Updated by Loïc Dachary about 8 years ago
- Copied to Backport #14899: hammer: wanted: command to clear 'incomplete' PGs added
Updated by Loïc Dachary about 8 years ago
- Status changed from Pending Backport to Resolved