Project

General

Profile

Activity

From 04/21/2019 to 05/20/2019

05/20/2019

11:47 PM Backport #39719 (In Progress): luminous: short pg log+nautilus-p2p-stress-split: "Error: finished...
David Zafman
01:38 PM Bug #39555: backfill_toofull while OSDs are not full (Unneccessary HEALTH_ERR)
Just to chime in: We too have seen this (on 13.2.5) on OSDs that are only 10-20% full.
It always (magically) clear...
Erik Lindahl
10:38 AM Bug #39978 (Duplicate): Adding OSD to Luminous Cluster will crash the active mon
I recently upgraded my cluster to Luminous v12.2.11. While adding a new OSD the active monitor crashes (attempt to fr... Henry Spanka
07:34 AM Bug #39972 (Fix Under Review): librados 'buffer::create' and related functions are not exported i...
Jason Dillaman
06:51 AM Bug #39972 (Resolved): librados 'buffer::create' and related functions are not exported in C++ API
Currently, there is no way to create any 'buffer::raw' objects since they are no longer exposed (since Nautilus) via ... Jason Dillaman
02:45 AM Backport #39514 (In Progress): nautilus: osd: segv in _preboot -> heartbeat
https://github.com/ceph/ceph/pull/28164 Prashant D

05/18/2019

10:04 AM Feature #39966 (New): mon: allow log messages to be throttled and/or force trimming
If some daemon is sending a lot of cluster log messages, we need a way to
- throttle, filter, or block them
- for...
Sage Weil

05/17/2019

06:41 AM Bug #39956: OSD:Cancel copy op causes memory leak
If two clients access the same snap object at the same time, and the object needs to promote, before the promote is c... tao ning
02:46 AM Bug #39956 (New): OSD:Cancel copy op causes memory leak
ceph version 12.2.7
==00:00:06:00.712 3722687== 15,237,248 (2,770,560 direct, 12,466,688 indirect) bytes in 3,848 ...
tao ning
03:13 AM Backport #39512 (In Progress): nautilus: osd acting cycle
https://github.com/ceph/ceph/pull/28160 Prashant D

05/16/2019

04:21 PM Bug #38827: valgrind: UninitCondition in ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authent...
The RGW verify suite has commented out the lines running valgrind on the mon.
https://github.com/ceph/ceph/pull/2815...
Ali Maredia
11:31 AM Backport #38850: upgrade: 1 nautilus mon + 1 luminous mon can't automatically form quorum
I have been working on it, able to reproduce, just unable yet to pin down the cause.
Reproducing basically takes t...
Joao Eduardo Luis
02:00 AM Backport #39422 (In Progress): mimic: Don't mark removed osds in when running "ceph osd in any|al...
https://github.com/ceph/ceph/pull/28142 Prashant D
01:41 AM Backport #39476 (In Progress): nautilus: segv in fgets() in collect_sys_info reading /proc/cpuinfo
https://github.com/ceph/ceph/pull/28141 Prashant D

05/15/2019

03:50 PM Backport #39373 (In Progress): luminous: ceph tell osd.xx bench help : gives wrong help
Nathan Cutler
03:44 PM Backport #38750 (In Progress): luminous: should report EINVAL in ErasureCode::parse() if m<=0
Nathan Cutler
03:36 PM Backport #38880 (In Progress): luminous: ENOENT in collection_move_rename on EC backfill target
Nathan Cutler
06:59 AM Backport #39374 (In Progress): mimic: ceph tell osd.xx bench help : gives wrong help
https://github.com/ceph/ceph/pull/28097 Prashant D

05/14/2019

11:49 AM Backport #39720 (In Progress): mimic: short pg log+nautilus-p2p-stress-split: "Error: finished ti...
Nathan Cutler
11:48 AM Backport #39721 (In Progress): nautilus: short pg log+nautilus-p2p-stress-split: "Error: finished...
Nathan Cutler
11:41 AM Backport #39744 (Resolved): mimic: mon: "FAILED assert(pending_finishers.empty())" when paxos res...
https://github.com/ceph/ceph/pull/28540 Nathan Cutler
11:41 AM Backport #39743 (Resolved): nautilus: mon: "FAILED assert(pending_finishers.empty())" when paxos ...
https://github.com/ceph/ceph/pull/28528 Nathan Cutler
11:40 AM Backport #39738 (Resolved): nautilus: Binary data in OSD log from "CRC header" message
https://github.com/ceph/ceph/pull/28504 Nathan Cutler
11:40 AM Backport #39737 (Resolved): mimic: Binary data in OSD log from "CRC header" message
https://github.com/ceph/ceph/pull/28503 Nathan Cutler

05/13/2019

11:15 PM Bug #39723 (Duplicate): osd: valgrind Leak_DefinitelyLost
... Patrick Donnelly
10:17 PM Backport #39721 (Resolved): nautilus: short pg log+nautilus-p2p-stress-split: "Error: finished ti...
https://github.com/ceph/ceph/pull/28088 David Zafman
10:16 PM Backport #39720 (Resolved): mimic: short pg log+nautilus-p2p-stress-split: "Error: finished tid 3...
https://github.com/ceph/ceph/pull/28089 David Zafman
10:16 PM Backport #39719 (Resolved): luminous: short pg log+nautilus-p2p-stress-split: "Error: finished ti...
https://github.com/ceph/ceph/pull/28185 David Zafman
08:21 PM Bug #39304 (Pending Backport): short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 whe...
David Zafman
08:09 PM Bug #39304 (Resolved): short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when last_a...
David Zafman
08:08 PM Bug #39582 (Pending Backport): Binary data in OSD log from "CRC header" message
David Zafman
03:31 AM Bug #39665: kstore: memory may leak on KStore::_do_read_stripe
https://github.com/ceph/ceph/pull/28056 Shanchun Lv
02:27 AM Backport #39421 (In Progress): nautilus: Don't mark removed osds in when running "ceph osd in any...
https://github.com/ceph/ceph/pull/28072 Prashant D

05/12/2019

12:24 AM Bug #24974: Segmentation fault in tcmalloc::ThreadCache::ReleaseToCentralCache()
dzafman-2019-05-09_20:06:24-rados-wip-zafman-testing-distro-basic-smithi/3943901... David Zafman

05/11/2019

03:43 PM Backport #39205: nautilus: osd: leaked pg refs on shutdown
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27803
merged
Yuri Weinstein

05/10/2019

09:27 PM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
The bucket was created on 2017-01-26 while the cluster was running the 0.94.3 (Hammer) release. Also the cluster has... Bryan Stillwell
09:22 PM Bug #39484 (Pending Backport): mon: "FAILED assert(pending_finishers.empty())" when paxos restart
Sage Weil
09:13 PM Backport #38881 (Resolved): nautilus: ENOENT in collection_move_rename on EC backfill target
Nathan Cutler
03:19 PM Backport #38881: nautilus: ENOENT in collection_move_rename on EC backfill target
Neha Ojha wrote:
> https://github.com/ceph/ceph/pull/27654
merged
Yuri Weinstein
09:12 PM Backport #39504 (Resolved): nautilus: Give recovery for inactive PGs a higher priority
Nathan Cutler
03:18 PM Backport #39504: nautilus: Give recovery for inactive PGs a higher priority
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27854
merged
Yuri Weinstein
05:32 PM Bug #38345: mon: segv in MonOpRequest::~MonOpRequest OpHistory::cleanup
/a/nojha-2019-05-10_00:33:57-upgrade-wip-parial-recovery-2019-05-09-distro-basic-smithi/3943156/ Neha Ojha
12:33 PM Backport #39206 (Resolved): mimic: osd: leaked pg refs on shutdown
Nathan Cutler
12:23 PM Backport #39220 (Resolved): mimic: osd: FAILED ceph_assert(attrs || !pg_log.get_missing().is_miss...
Nathan Cutler
12:23 PM Backport #38443 (Resolved): mimic: osd-markdown.sh can fail with CLI_DUP_COMMAND=1
Nathan Cutler
12:22 PM Backport #38879 (Resolved): mimic: ENOENT in collection_move_rename on EC backfill target
Nathan Cutler
12:13 PM Bug #39555: backfill_toofull while OSDs are not full (Unneccessary HEALTH_ERR)
I'm having this issue on Nautilus (14.2.1) but there is no way OSDs can be full as I'm not using more than 6.8% raw s... Alex Cucu
11:00 AM Backport #39700 (Resolved): nautilus: [RFE] If the nodeep-scrub/noscrub flags are set in pools in...
https://github.com/ceph/ceph/pull/29991 Nathan Cutler
11:00 AM Backport #39699 (Resolved): nautilus: OSD down on snaptrim.
https://github.com/ceph/ceph/pull/28203 Nathan Cutler
11:00 AM Backport #39698 (Resolved): mimic: OSD down on snaptrim.
https://github.com/ceph/ceph/pull/28202 Nathan Cutler
10:59 AM Backport #39694 (Rejected): luminous: _txc_add_transaction error (39) Directory not empty not han...
Nathan Cutler
10:59 AM Backport #39693 (Resolved): nautilus: _txc_add_transaction error (39) Directory not empty not han...
https://github.com/ceph/ceph/pull/29115 Nathan Cutler
10:58 AM Backport #39692 (Resolved): mimic: _txc_add_transaction error (39) Directory not empty not handle...
https://github.com/ceph/ceph/pull/29217 Nathan Cutler
10:56 AM Backport #39682 (Resolved): nautilus: filestore pre-split may not split enough directories
https://github.com/ceph/ceph/pull/29988 Nathan Cutler
10:56 AM Backport #39681 (Rejected): luminous: filestore pre-split may not split enough directories
Nathan Cutler
08:29 AM Bug #39665 (Resolved): kstore: memory may leak on KStore::_do_read_stripe
On testing kstore, we found that memory leaks when execute read ops. The root cause is when execute read ops, the in-... Shanchun Lv
04:02 AM Bug #39661: kstore: memory may leak on KStore::_do_read_stripe
There is no need to cache the in-flight stripes on read process, we can just discard it on read ops. Shanchun Lv
03:53 AM Bug #39661 (New): kstore: memory may leak on KStore::_do_read_stripe
On testing kstore, we found that memory leaks when execute read ops. The root cause is when execute read ops, the in-... Shanchun Lv
03:34 AM Bug #39636 (Resolved): osd: PeeringState valgrind error UninitCondition
Kefu Chai
03:34 AM Bug #39636 (Fix Under Review): osd: PeeringState valgrind error UninitCondition
Kefu Chai
12:16 AM Bug #39659 (New): FAILED ceph_assert(info.history.same_interval_since != 0)
http://pulpito.ceph.com/sjust-2019-05-09_13:40:11-smoke-sjust-wip-peering-state-cleanup-distro-basic-smithi/3942704/ ... Samuel Just

05/09/2019

11:38 PM Bug #38893: RuntimeError: expected MON_CLOCK_SKEW but got none
rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados... Neha Ojha
04:22 PM Bug #38827: valgrind: UninitCondition in ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authent...
Is this being actively worked on?
How close are we to a fix on this?
I would like to make this a high priority ...
J. Eric Ivancich
03:48 PM Backport #39206: mimic: osd: leaked pg refs on shutdown
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27938
merged
Yuri Weinstein
02:22 PM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
The cluster itself followed this upgrade path:
0.94.10 -> 10.2.10 -> 12.2.5 -> 12.2.8
We will look into the histo...
Wes Dillingham
12:12 AM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
Hi Wes,
Can you check if the bucket on which you are seeing issues, was present in a jewel cluster. We have seen s...
Neha Ojha
07:14 AM Bug #39390 (Pending Backport): filestore pre-split may not split enough directories
Kefu Chai
07:10 AM Bug #38124: OSD down on snaptrim.
Greg Farnum wrote:
> No ETA; it'll have to wend its way through the backports process. I don't think any releases ar...
Erikas Kučinskis
03:40 AM Bug #39636: osd: PeeringState valgrind error UninitCondition
Found it, testing. Samuel Just
03:05 AM Backport #39375 (In Progress): nautilus: ceph tell osd.xx bench help : gives wrong help
https://github.com/ceph/ceph/pull/28035 Prashant D
02:05 AM Bug #21174 (Rejected): OSD crash: 903: FAILED assert(objiter->second->version > last_divergent_up...
I'm closing this bug. The hardware configuration must make data safe that has been sync'ed to disk. This requires th... David Zafman
01:49 AM Documentation #39011 (Resolved): Document how get_recovery_priority() and get_backfill_priority()...
David Zafman
01:49 AM Bug #39304 (Fix Under Review): short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 whe...
David Zafman
12:31 AM Bug #23145: OSD crashes during recovery of EC pg
FWIW, I'm running into this, too (on Nautilus). I've got 2 OSD's in this situation. Let me know if you want any debug... Richard Hesse

05/08/2019

11:57 PM Support #39594: OSD marked as down, had timed out after 15, handle_connect_reply connect got RESE...
The ceph-users mailing list might be good place to seek help on this kind of issue. Neha Ojha
09:33 PM Bug #38124 (Pending Backport): OSD down on snaptrim.
No ETA; it'll have to wend its way through the backports process. I don't think any releases are imminent so it shoul... Greg Farnum
09:24 PM Bug #39636: osd: PeeringState valgrind error UninitCondition
Rebuilding without inlining to narrow down the problem. Samuel Just
06:40 PM Bug #39636 (Resolved): osd: PeeringState valgrind error UninitCondition
... Patrick Donnelly
07:42 PM Backport #39220: mimic: osd: FAILED ceph_assert(attrs || !pg_log.get_missing().is_missing(soid) |...
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27940
merged
Yuri Weinstein
07:19 PM Backport #38443: mimic: osd-markdown.sh can fail with CLI_DUP_COMMAND=1
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27907
merged
Yuri Weinstein
07:18 PM Backport #38879: mimic: ENOENT in collection_move_rename on EC backfill target
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27943
merged
Yuri Weinstein
06:04 PM Bug #39581: osd/PG.cc: 2523: FAILED ceph_assert(scrub_queued)
/a/nojha-2019-05-07_17:20:56-rados-fix-pg-notify-distro-basic-smithi/3938003/ Neha Ojha
04:53 PM Bug #38195: osd-backfill-space.sh exposes rocksdb hang
another instance in mimic: /a/yuriw-2019-05-07_14:33:13-rados-wip-yuri-testing-2019-05-06-2158-mimic-distro-basic-smi... Neha Ojha
03:39 PM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
Hi Neha,
I am on Bryan's team. Bryan is out this week but is returning soon.
I was able to inspect logs for abo...
Wes Dillingham
03:19 PM Bug #39555: backfill_toofull while OSDs are not full (Unneccessary HEALTH_ERR)

The backfull_toofull state is like backfill_wait except that it indicates the reason that backfill can not proceed ...
David Zafman

05/07/2019

05:50 PM Bug #38724 (Pending Backport): _txc_add_transaction error (39) Directory not empty not handled on...
Sage Weil
05:38 PM Feature #38029 (Pending Backport): [RFE] If the nodeep-scrub/noscrub flags are set in pools inste...
Vikhyat Umrao
10:16 AM Bug #38124: OSD down on snaptrim.
Erikas Kučinskis wrote:
> Hi is there any ETA when the bug fix will be live?
Erikas Kučinskis
10:15 AM Bug #38124: OSD down on snaptrim.
Hi is there any ETA when the bug will be live? Erikas Kučinskis
07:30 AM Backport #39506: mimic: Give recovery for inactive PGs a higher priority
Assigning to Neha based on http://tracker.ceph.com/issues/39099#note-11 Nathan Cutler
07:29 AM Backport #39505: luminous: Give recovery for inactive PGs a higher priority
Assigning to Neha based on http://tracker.ceph.com/issues/39099#note-11 Nathan Cutler
06:13 AM Bug #16553: Removing Writeback Cache Tier Does not clean up Incomplete_Clones
Still hit the same issue on 12.2.10 Jun Yang
05:49 AM Backport #39311 (In Progress): mimic: crushtool crash on Fedora 28 and newer
https://github.com/ceph/ceph/pull/27986 Prashant D

05/06/2019

09:44 PM Bug #25182 (Resolved): Upmaps forgotten after restarting OSDs
Thanks for verifying the fixes Bryan. Looks like those are all backported to mimic + luminous. Josh Durgin
09:52 AM Support #39594 (New): OSD marked as down, had timed out after 15, handle_connect_reply connect go...
Hi,
recently we saw random slow requests in our cluster. in monitor ceph.log I could see that at the same time OSD...
Alon Avrahami
09:18 AM Bug #39555: backfill_toofull while OSDs are not full (Unneccessary HEALTH_ERR)
This may be the case indeed, but I'd expect that unless pgs are evacuated, the state would be backfill_wait, not back... Rene Diepstraten

05/05/2019

09:13 PM Bug #39152: nautilus osd crash: Caught signal (Aborted) tp_osd_tp
Sage Weil wrote:
> I'm guessing this is a dup of #38724
>
> Wen, can you tell us what the cluster workload was? ...
K Jarrett

05/04/2019

10:43 PM Bug #38345: mon: segv in MonOpRequest::~MonOpRequest OpHistory::cleanup
... Kefu Chai
06:35 PM Bug #39582 (Fix Under Review): Binary data in OSD log from "CRC header" message
David Zafman
01:14 AM Backport #39420 (In Progress): luminous: Don't mark removed osds in when running "ceph osd in any...
https://github.com/ceph/ceph/pull/27728 Neha Ojha
01:02 AM Bug #39304 (In Progress): short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when las...
David Zafman

05/03/2019

04:43 PM Bug #39582 (Resolved): Binary data in OSD log from "CRC header" message

This breaks grep'ing the osd logs.
Using cat -v we see the binary data:...
David Zafman
04:37 PM Bug #39581 (Duplicate): osd/PG.cc: 2523: FAILED ceph_assert(scrub_queued)

dzafman-2019-05-02_19:43:04-rados:thrash-wip-zafman-testing-distro-basic-smithi/3919741
This appears to be PG 2....
David Zafman
11:25 AM Bug #39555: backfill_toofull while OSDs are not full (Unneccessary HEALTH_ERR)
Greg Farnum wrote:
> The OSD can't count PGs being evacuated as if they were gone because something could go wrong. ...
Wido den Hollander
09:33 AM Feature #38370 (Resolved): ceph CLI ability to change file ownership
Nathan Cutler
09:32 AM Backport #38511 (Resolved): mimic: ceph CLI ability to change file ownership
Nathan Cutler
09:31 AM Bug #38537 (Resolved): mgr deadlock
Nathan Cutler
09:31 AM Backport #38561 (Resolved): mimic: mgr deadlock
Nathan Cutler
09:31 AM Bug #38377 (Resolved): OpTracker destruct assert when OSD destruct
Nathan Cutler
09:30 AM Backport #38646 (Resolved): mimic: OpTracker destruct assert when OSD destruct
Nathan Cutler
09:27 AM Backport #38879 (In Progress): mimic: ENOENT in collection_move_rename on EC backfill target
Nathan Cutler
05:02 AM Documentation #39011 (In Progress): Document how get_recovery_priority() and get_backfill_priorit...
David Zafman
04:22 AM Backport #39220 (In Progress): mimic: osd: FAILED ceph_assert(attrs || !pg_log.get_missing().is_m...
https://github.com/ceph/ceph/pull/27940 Prashant D
01:16 AM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
In both the set of logs you have shared so far, it seems that the object appears in the OSD log during omap-set-vals(... Neha Ojha
12:45 AM Backport #39206 (In Progress): mimic: osd: leaked pg refs on shutdown
https://github.com/ceph/ceph/pull/27938 Prashant D

05/02/2019

10:54 PM Bug #39383 (Resolved): Too much log output generated from PrimaryLogPG::do_backfill()
David Zafman
10:54 PM Backport #39389 (Resolved): nautilus: Too much log output generated from PrimaryLogPG::do_backfi...
David Zafman
10:53 PM Bug #38325 (Resolved): Code to strip | from core pattern isn't right
David Zafman
10:51 PM Backport #38565 (Resolved): mimic: Code to strip | from core pattern isn't right
David Zafman
10:18 PM Backport #38565: mimic: Code to strip | from core pattern isn't right
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26811
merged
Yuri Weinstein
10:15 PM Backport #38507: mimic: ENOENT on setattrs (obj was recently deleted)
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26709
merged
Yuri Weinstein
10:14 PM Backport #38511: mimic: ceph CLI ability to change file ownership
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26760
merged
Yuri Weinstein
10:09 PM Backport #38561: mimic: mgr deadlock
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26833
merged
Yuri Weinstein
10:08 PM Backport #38646: mimic: OpTracker destruct assert when OSD destruct
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26862
merged
Yuri Weinstein
07:54 PM Bug #23879: test_mon_osdmap_prune.sh fails
/a/yuriw-2019-05-01_19:40:05-rados-wip-yuri3-testing-2019-04-30-1543-mimic-distro-basic-smithi/3916650/ Neha Ojha
07:52 PM Backport #38879: mimic: ENOENT in collection_move_rename on EC backfill target
This failure was seen in mimic: /a/yuriw-2019-04-30_20:31:27-rados-wip-yuri3-testing-2019-04-30-1543-mimic-distro-bas... Neha Ojha
05:40 PM Bug #39152: nautilus osd crash: Caught signal (Aborted) tp_osd_tp
I'm guessing this is a dup of #38724
Wen, can you tell us what the cluster workload was? rgw? rbd? cephfs? Thanks!
Sage Weil
05:10 PM Documentation #39011: Document how get_recovery_priority() and get_backfill_priority() impacts re...

Now we need to include new recovery priority boost.
/// base recovery priority for MRecoveryReserve (inactive PG...
David Zafman
04:33 PM Bug #38724 (Fix Under Review): _txc_add_transaction error (39) Directory not empty not handled on...
https://github.com/ceph/ceph/pull/27929 Sage Weil
04:18 PM Bug #39570 (Fix Under Review): nautilus with requrie_osd_release < nautilus cannot increase pg_num
https://github.com/ceph/ceph/pull/27928 Sage Weil
03:59 PM Bug #39570 (Resolved): nautilus with requrie_osd_release < nautilus cannot increase pg_num
On Mon, 29 Apr 2019, Alexander Y. Fomichev wrote:
> Hi,
>
> I just upgraded from mimic to nautilus(14.2.0) and...
Sage Weil

05/01/2019

10:55 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned
The OSDs definitely had objects corresponding to the maps, but they failed the CRC check when trying to read them. Al... Erik Lindahl
09:25 PM Bug #39525 (Need More Info): lz4 compressor corrupts data when buffers are unaligned
Was the problem 1) that different OSDs needed different maps, and they had mismatched CRCs when exported from a 13.2.... Greg Farnum
09:24 PM Bug #39490 (Resolved): osd: failed to encode map e26 with expected crc
Neha Ojha
09:24 PM Bug #39509 (Need More Info): segm fault when invoke MergeOperatorRouter::Name()
We'll need more information on how and where this occurred. Neha Ojha
09:11 PM Bug #39555: backfill_toofull while OSDs are not full (Unneccessary HEALTH_ERR)
The OSD can't count PGs being evacuated as if they were gone because something could go wrong. So it's stuck seeing i... Greg Farnum
08:10 AM Bug #39555 (Resolved): backfill_toofull while OSDs are not full (Unneccessary HEALTH_ERR)
This week I ran into an issue where ceph reports HEALTH_ERR because pgs are backfill_toofull.
None of the OSDs are o...
Rene Diepstraten
09:06 PM Bug #39449: Uninit in EVP_DecryptFinal_ex on ceph::crypto::onwire::AES128GCM_OnWireRxHandler::aut...
We probably need to backport this? Neha Ojha
08:50 PM Backport #39044 (Resolved): mimic: osd/PGLog: preserve original_crt to check rollbackability
Nathan Cutler
03:48 PM Backport #39044: mimic: osd/PGLog: preserve original_crt to check rollbackability
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27629
merged
Yuri Weinstein
08:49 PM Backport #39342 (Resolved): mimic: ceph-objectstore-tool rename dump-import to dump-export
Nathan Cutler
03:47 PM Backport #39342: mimic: ceph-objectstore-tool rename dump-import to dump-export
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27635
merged
Yuri Weinstein
08:48 PM Backport #39433 (Resolved): mimic: Degraded PG does not discover remapped data on originating OSD
Nathan Cutler
03:45 PM Backport #39433: mimic: Degraded PG does not discover remapped data on originating OSD
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/27745
merged
Yuri Weinstein
08:45 PM Backport #39506 (Need More Info): mimic: Give recovery for inactive PGs a higher priority
Nathan Cutler
08:45 PM Backport #39505 (Need More Info): luminous: Give recovery for inactive PGs a higher priority
Nathan Cutler
04:34 PM Backport #39563 (In Progress): luminous: Error message displayed when mon_osd_max_split_count wou...
Nathan Cutler
04:33 PM Backport #39563 (Resolved): luminous: Error message displayed when mon_osd_max_split_count would ...
https://github.com/ceph/ceph/pull/27908 Nathan Cutler
04:32 PM Bug #39353 (Pending Backport): Error message displayed when mon_osd_max_split_count would be exce...
Nathan Cutler
03:47 PM Bug #39353: Error message displayed when mon_osd_max_split_count would be exceeded is not as user...
https://github.com/ceph/ceph/pull/27647 merged Yuri Weinstein
02:24 PM Bug #39099: Give recovery for inactive PGs a higher priority
David, we should discuss whether we want to backport this all the way to luminous or just to nautilus. Neha Ojha
02:28 AM Bug #39304: short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when last_acked_tid wa...

I have a version that not only copies the existing dups, but if copy_up_to is excluding any log entries it adds tho...
David Zafman
01:38 AM Bug #23879: test_mon_osdmap_prune.sh fails
/a/yuriw-2019-04-29_22:14:10-rados-wip-yuri2-testing-2019-04-29-1936-mimic-distro-basic-smithi/3910028 Neha Ojha

04/30/2019

11:06 PM Bug #39304: short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when last_acked_tid wa...

Before fix:...
David Zafman
01:26 AM Bug #39304: short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when last_acked_tid wa...
2119'372 (write 2775265) does not get identified as a dup when the log boundaries are (2119'372,2119'373], while 2119... Neha Ojha
12:51 AM Bug #39304: short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when last_acked_tid wa...

Probably 1.1.short_pg_log.yaml produces this
osd_max_pg_log_entries: 2
osd_min_pg_log_entri...
David Zafman
12:08 AM Bug #39304: short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when last_acked_tid wa...

Before changing primaries from 3 to 0, these 4 operations came in with versions 2119'370 (write 726564), 2119'371 (...
David Zafman
07:47 PM Bug #39484: mon: "FAILED assert(pending_finishers.empty())" when paxos restart
Updated the PR. Please put further code reviews there. :) Greg Farnum
06:37 PM Bug #39484: mon: "FAILED assert(pending_finishers.empty())" when paxos restart
Hmm probably! Greg Farnum
02:50 AM Bug #39484: mon: "FAILED assert(pending_finishers.empty())" when paxos restart
Greg Farnum wrote:
> pending_finishers get moved into committing_finishers once they have been submitted to disk, so...
haitao chen
12:03 AM Bug #39484 (Fix Under Review): mon: "FAILED assert(pending_finishers.empty())" when paxos restart
https://github.com/ceph/ceph/pull/27877 Greg Farnum
07:04 PM Bug #39553 (New): PeeringState: cache PeeringListener indirections
perf_counter refs, etc should be immutable, so PeeringState may as well cache them. Add a call to do so as to avoid ... Samuel Just
06:58 PM Bug #39552 (New): mons fail to process send_alive message causing pg stuck creating
sjust-2019-04-28_20:59:54-rados-wip-sjust-peering-refactor-distro-basic-smithi/3905696/
PG 200.3 is stuck creating...
Samuel Just
05:43 PM Bug #39546: Warning about past_interval bounds on deleting pg
sjust-2019-04-26_14:00:33-rados-wip-sjust-peering-refactor-distro-basic-mira/3897200/ Samuel Just
05:43 PM Bug #39546 (Resolved): Warning about past_interval bounds on deleting pg
cluster [ERR] 4.7
required past_interval bounds are empty [228,226) but past_intervals is not: ([166,225]
a...
Samuel Just
11:36 AM Backport #39539 (Resolved): nautilus: osd/ReplicatedBackend.cc: 1321: FAILED assert(get_parent()-...
https://github.com/ceph/ceph/pull/28219 Nathan Cutler
11:36 AM Backport #39538 (Resolved): mimic: osd/ReplicatedBackend.cc: 1321: FAILED assert(get_parent()->ge...
https://github.com/ceph/ceph/pull/28259 Nathan Cutler
11:36 AM Backport #39537 (Resolved): luminous: osd/ReplicatedBackend.cc: 1321: FAILED assert(get_parent()-...
https://github.com/ceph/ceph/pull/28989 Nathan Cutler
01:32 AM Bug #38846 (In Progress): dump_pgstate_history doesn't really produce useful json output, needs a...
Brad Hubbard
12:39 AM Backport #39218 (In Progress): luminous: osd: FAILED ceph_assert(attrs || !pg_log.get_missing().i...
https://github.com/ceph/ceph/pull/27878 Prashant D

04/29/2019

11:21 PM Backport #39219 (In Progress): nautilus: osd: FAILED ceph_assert(attrs || !pg_log.get_missing().i...
https://github.com/ceph/ceph/pull/27839 Prashant D
11:18 PM Bug #38784 (Pending Backport): osd: FAILED ceph_assert(attrs || !pg_log.get_missing().is_missing(...
Prashant D
06:29 AM Bug #38784 (In Progress): osd: FAILED ceph_assert(attrs || !pg_log.get_missing().is_missing(soid)...
Prashant D
10:40 PM Bug #39484 (In Progress): mon: "FAILED assert(pending_finishers.empty())" when paxos restart
Hmm this doesn't make a lot of sense. finish_contexts() swaps out the input list with a local one before running fini... Greg Farnum
09:22 PM Bug #39484: mon: "FAILED assert(pending_finishers.empty())" when paxos restart
pending_finishers get moved into committing_finishers once they have been submitted to disk, so we probably want to f... Greg Farnum
10:16 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned
Hi Greg,
That might actually explain how it happened originally; we auto-deploy hosts with salt, and noticed that ...
Erik Lindahl
09:15 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned
Hmm are the working and broken OSDs actually running the same binary version? It should work anyway but a bug around ... Greg Farnum
05:23 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned
I might have gotten slightly further.
1) On one of the the broken OSDs, the current_epoch is 34626 (clean_thru is...
Erik Lindahl
03:58 PM Bug #39525 (Resolved): lz4 compressor corrupts data when buffers are unaligned
In conjunction with taking a new storage server online we observed that 5 out of the 6 SSDs we use to store metadata ... Erik Lindahl
09:23 PM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
Unfortunately I didn't turn up debug logging for every OSD in the cluster so I don't have those logs. I'll reproduce... Bryan Stillwell
08:58 PM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
Bryan, could you also upload osd.516 and osd.563 logs from the same time period as you've provided for osd.503. Neha Ojha
09:02 PM Bug #38724: _txc_add_transaction error (39) Directory not empty not handled on operation 21 (op 1...
A user saw this and uploaded with debug 20 on OSD and bluestone: 2d8d22f4-580b-4b57-a13a-f49dade34ba7 Greg Farnum
08:53 PM Bug #39304: short pg log+nautilus-p2p-stress-split: "Error: finished tid 3 when last_acked_tid wa...

After writing tids 1,2,3 the output shows finishing tids 1,2,3,4,5. We can see that the 3rd set of writes was inte...
David Zafman
10:30 AM Backport #39504 (In Progress): nautilus: Give recovery for inactive PGs a higher priority
Nathan Cutler
10:23 AM Backport #39520 (Rejected): luminous: snaps missing in mapper, should be: ca was r -2...repaired
Nathan Cutler
10:23 AM Backport #39519 (Resolved): nautilus: snaps missing in mapper, should be: ca was r -2...repaired
https://github.com/ceph/ceph/pull/28205 Nathan Cutler
10:23 AM Backport #39518 (Resolved): mimic: snaps missing in mapper, should be: ca was r -2...repaired
https://github.com/ceph/ceph/pull/28232 Nathan Cutler
10:23 AM Backport #39517 (Resolved): nautilus: Improvements to standalone tests.
https://github.com/ceph/ceph/pull/30528 Nathan Cutler
10:22 AM Backport #39516 (Resolved): nautilus: osd-backfill-space.sh test failed in TEST_backfill_multi_pa...
https://github.com/ceph/ceph/pull/28187 Nathan Cutler
10:22 AM Backport #39515 (Rejected): luminous: osd: segv in _preboot -> heartbeat
Nathan Cutler
10:22 AM Backport #39514 (Resolved): nautilus: osd: segv in _preboot -> heartbeat
https://github.com/ceph/ceph/pull/28164 Nathan Cutler
10:22 AM Backport #39513 (Resolved): mimic: osd: segv in _preboot -> heartbeat
https://github.com/ceph/ceph/pull/28220 Nathan Cutler
10:22 AM Backport #39512 (Resolved): nautilus: osd acting cycle
https://github.com/ceph/ceph/pull/28160 Nathan Cutler

04/28/2019

02:09 PM Bug #39509 (Need More Info): segm fault when invoke MergeOperatorRouter::Name()
(gdb) bt
#0 0x00007f60321804ab in raise () from /lib64/libpthread.so.0
#1 0x000055aafad0501a in handle_fatal_sign...
Zengran Zhang
08:19 AM Bug #39449: Uninit in EVP_DecryptFinal_ex on ceph::crypto::onwire::AES128GCM_OnWireRxHandler::aut...
/a/kchai-2019-04-27_02:20:42-rados-wip-kefu-testing-2019-04-26-2318-distro-basic-smithi/3898463/remote/smithi017/log/... Kefu Chai
12:29 AM Bug #38124 (Fix Under Review): OSD down on snaptrim.
David Zafman

04/27/2019

11:26 PM Bug #38124: OSD down on snaptrim.

The following script sometimes hits the race and crashes an OSD. I've removed the assert and the script has been r...
David Zafman
04:39 AM Documentation #3466: rados manpage: bench still documents "read" rather than "seq/rand"
Dan Mick wrote:
> rados bench read has been replaced with "seq" and "rand", the latter of which is
> still unimplem...
James McClune

04/26/2019

11:45 PM Bug #39152: nautilus osd crash: Caught signal (Aborted) tp_osd_tp
A similar issue was reported on ceph-users: "Nautilus (14.2.0) OSDs crashing at startup after removing a pool contain... Neha Ojha
11:19 PM Bug #38124 (In Progress): OSD down on snaptrim.

I am able to reproduce this, so I'll work on a fix.
David Zafman
11:01 PM Bug #39441 (Pending Backport): osd acting cycle
Neha Ojha
04:23 PM Bug #39441 (Fix Under Review): osd acting cycle
Neha Ojha
10:27 PM Bug #38840 (Pending Backport): snaps missing in mapper, should be: ca was r -2...repaired
David Zafman
12:04 AM Bug #38840: snaps missing in mapper, should be: ca was r -2...repaired
David Zafman
06:55 PM Bug #39333 (Pending Backport): osd-backfill-space.sh test failed in TEST_backfill_multi_partial()
David Zafman
05:12 PM Bug #39333: osd-backfill-space.sh test failed in TEST_backfill_multi_partial()
David Zafman
06:23 PM Bug #39439 (Pending Backport): osd: segv in _preboot -> heartbeat
Sage Weil
05:27 PM Feature #39162 (Pending Backport): Improvements to standalone tests.
David Zafman
03:51 PM Feature #38617 (Fix Under Review): osd: Better error message when OSD count is less than osd_pool...
Neha Ojha
03:46 PM Backport #39506 (Rejected): mimic: Give recovery for inactive PGs a higher priority
Nathan Cutler
03:46 PM Backport #39505 (Rejected): luminous: Give recovery for inactive PGs a higher priority
Nathan Cutler
03:46 PM Backport #39504 (Resolved): nautilus: Give recovery for inactive PGs a higher priority
https://github.com/ceph/ceph/pull/27854 Nathan Cutler
08:59 AM Backport #39204 (In Progress): luminous: osd: leaked pg refs on shutdown
https://github.com/ceph/ceph/pull/27810 Prashant D
03:45 AM Backport #39205 (In Progress): nautilus: osd: leaked pg refs on shutdown
https://github.com/ceph/ceph/pull/27803 Prashant D
01:40 AM Bug #39484: mon: "FAILED assert(pending_finishers.empty())" when paxos restart
Upload the core dump log file.
And the ceph -s:
!ceph_status.png!
mon.b01 crashs again and again.
haitao chen
12:03 AM Bug #35808 (Need More Info): ceph osd ok-to-stop result dosen't match the real situation
Can the reporter test this with the change in https://github.com/ceph/ceph/pull/27503 and report back? David Zafman

04/25/2019

11:58 PM Bug #38930 (Duplicate): ceph osd safe-to-destroy wrongly approves any out osd

We can backport pull request https://github.com/ceph/ceph/pull/27503 for http://tracker.ceph.com/issues/39099 which...
David Zafman
11:55 PM Bug #38930 (Pending Backport): ceph osd safe-to-destroy wrongly approves any out osd
David Zafman
11:54 PM Bug #39099 (Pending Backport): Give recovery for inactive PGs a higher priority
David Zafman
09:39 PM Bug #39490 (In Progress): osd: failed to encode map e26 with expected crc
should be fixed by https://github.com/ceph/ceph/pull/27623 Neha Ojha
08:28 PM Bug #39490 (Resolved): osd: failed to encode map e26 with expected crc

upgrade:nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-override...
Neha Ojha
08:34 PM Bug #36748: ms_deliver_verify_authorizer no AuthAuthorizeHandler found for protocol 0
... Neha Ojha
08:13 PM Bug #38483: FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_wake_split_child(PG*)
/a/nojha-2019-04-25_05:43:35-rados-wip-39441-distro-basic-smithi/3892156/ Neha Ojha
08:10 PM Bug #37797: radosbench tests hit ENOSPC
This one appeared again.
/a/nojha-2019-04-25_05:43:35-rados-wip-39441-distro-basic-smithi/3892141/
Neha Ojha
12:27 PM Bug #39484 (Resolved): mon: "FAILED assert(pending_finishers.empty())" when paxos restart
We are running ceph 13.2.5 on Centos Linux 7.5.1804, and the ceph cluster consists of 5 ceph-mon. Every 30 seconds, w... yu feng
08:07 AM Bug #26958: osd/ReplicatedBackend.cc: 1321: FAILED assert(get_parent()->get_log().get_log().objec...
... Nathan Cutler
07:46 AM Backport #39476 (Resolved): nautilus: segv in fgets() in collect_sys_info reading /proc/cpuinfo
https://github.com/ceph/ceph/pull/28141 Nathan Cutler
07:46 AM Backport #39475 (Resolved): mimic: segv in fgets() in collect_sys_info reading /proc/cpuinfo
https://github.com/ceph/ceph/pull/28206 Nathan Cutler
07:46 AM Backport #39474 (Resolved): luminous: segv in fgets() in collect_sys_info reading /proc/cpuinfo
https://github.com/ceph/ceph/pull/32349 Nathan Cutler
07:45 AM Backport #39419 (In Progress): nautilus: rados/upgrade/nautilus-x-singleton: mon.c@1(electing).el...
Nathan Cutler
06:13 AM Bug #39443: "ceph daemon" does not support ceph args
Sure, 'debug_ms' was just an example to illustrate the problem. Yes the most (if not all) ceph args do not make sense... Mykola Golub
03:53 AM Bug #39333 (Fix Under Review): osd-backfill-space.sh test failed in TEST_backfill_multi_partial()
David Zafman

04/24/2019

09:31 PM Bug #35808: ceph osd ok-to-stop result dosen't match the real situation
This may be fixed by https://github.com/ceph/ceph/pull/27503 David Zafman
07:40 PM Bug #39441: osd acting cycle
https://github.com/ceph/ceph/pull/24004 was not backported to mimic, which might explain why the octopus osd is calcu... Neha Ojha
06:51 PM Bug #39443: "ceph daemon" does not support ceph args
I'm not sure this is a problem — "ceph daemon" is just for talking to a local Unix socket; it doesn't engage in any o... Greg Farnum
10:32 AM Bug #39443 (New): "ceph daemon" does not support ceph args
This works:... Mykola Golub
06:49 PM Bug #38345: mon: segv in MonOpRequest::~MonOpRequest OpHistory::cleanup
We're also seeing Bus Errors instead of segfaults in the OpHistory cleanup at #24664 so these may be related... Greg Farnum
06:47 PM Bug #39336 (Duplicate): "*** Caught signal (Bus error) **" in upgrade:luminous-x-mimic
Greg Farnum
06:41 PM Bug #39175: RGW DELETE calls partially missed shortly after OSD startup
Bryan Stillwell wrote:
> I could grab you the debug logs, but that could take a while. Which knobs do you want me t...
Neha Ojha
01:26 PM Bug #39449: Uninit in EVP_DecryptFinal_ex on ceph::crypto::onwire::AES128GCM_OnWireRxHandler::aut...
PRs:
* https://github.com/ceph/teuthology/pull/1274
* https://github.com/ceph/ceph/pull/27265
Gist:
* https:...
Radoslaw Zarzynski
01:24 PM Bug #39449 (Resolved): Uninit in EVP_DecryptFinal_ex on ceph::crypto::onwire::AES128GCM_OnWireRxH...
... Sage Weil
01:18 PM Backport #39431 (In Progress): luminous: Degraded PG does not discover remapped data on originati...
Ashish Singh
12:35 PM Backport #39433 (In Progress): mimic: Degraded PG does not discover remapped data on originating OSD
Ashish Singh
12:33 PM Backport #39432 (In Progress): nautilus: Degraded PG does not discover remapped data on originati...
Ashish Singh

04/23/2019

10:09 PM Bug #39441 (Resolved): osd acting cycle
osd.9 (mimic)... Sage Weil
06:07 PM Bug #26958 (Pending Backport): osd/ReplicatedBackend.cc: 1321: FAILED assert(get_parent()->get_lo...
Sage Weil
01:50 AM Bug #26958 (Fix Under Review): osd/ReplicatedBackend.cc: 1321: FAILED assert(get_parent()->get_lo...
Neha Ojha
06:05 PM Bug #38296 (Pending Backport): segv in fgets() in collect_sys_info reading /proc/cpuinfo
Sage Weil
06:04 PM Bug #39439 (Fix Under Review): osd: segv in _preboot -> heartbeat
https://github.com/ceph/ceph/pull/27729 Sage Weil
06:01 PM Bug #39439 (Resolved): osd: segv in _preboot -> heartbeat
... Sage Weil
05:47 PM Bug #39150: mon: "FAILED ceph_assert(session_map.sessions.empty())" when out of quorum
/ceph/teuthology-archive/pdonnell-2019-04-17_06:12:56-kcephfs-wip-pdonnell-testing-20190417.032809-distro-basic-smith... Patrick Donnelly
01:07 PM Backport #39433 (Resolved): mimic: Degraded PG does not discover remapped data on originating OSD
https://github.com/ceph/ceph/pull/27745 Nathan Cutler
01:07 PM Backport #39432 (Resolved): nautilus: Degraded PG does not discover remapped data on originating OSD
https://github.com/ceph/ceph/pull/27744 Nathan Cutler
01:07 PM Backport #39431 (Resolved): luminous: Degraded PG does not discover remapped data on originating OSD
https://github.com/ceph/ceph/pull/27751 Nathan Cutler
01:05 PM Backport #39422 (Resolved): mimic: Don't mark removed osds in when running "ceph osd in any|all|*"
https://github.com/ceph/ceph/pull/28142 Nathan Cutler
01:05 PM Backport #39421 (Resolved): nautilus: Don't mark removed osds in when running "ceph osd in any|al...
https://github.com/ceph/ceph/pull/28072 Nathan Cutler
01:05 PM Backport #39420 (Resolved): luminous: Don't mark removed osds in when running "ceph osd in any|al...
https://github.com/ceph/ceph/pull/27728 Nathan Cutler
01:04 PM Backport #39419 (Resolved): nautilus: rados/upgrade/nautilus-x-singleton: mon.c@1(electing).elect...
https://github.com/ceph/ceph/pull/27771 Nathan Cutler
11:03 AM Bug #24419: ceph-objectstore-tool unable to open mon store
Were you able to figure out why? Kevin Cao
10:52 AM Support #39319: Every 15 min - Monitor daemon marked osd.x down, but it is still running
2019-04-23 13:36:20.668791 osd.2 [WRN] Monitor daemon marked osd.2 down, but it is still running
2019-04-23 13:40:36...
Vladimir Savinov
10:51 AM Support #39319: Every 15 min - Monitor daemon marked osd.x down, but it is still running
I add "debug ms = 1" line in [osd] adm view log monitor in /var/log/ceph
...
mon.greend02-n02ceph02@1(peon) e3 ms...
Vladimir Savinov
06:41 AM Backport #39042 (In Progress): luminous: osd/PGLog: preserve original_crt to check rollbackability
https://github.com/ceph/ceph/pull/27715 Prashant D

04/22/2019

11:32 PM Bug #38296 (In Progress): segv in fgets() in collect_sys_info reading /proc/cpuinfo
Brad Hubbard
05:52 PM Bug #38296: segv in fgets() in collect_sys_info reading /proc/cpuinfo
https://github.com/ceph/ceph/pull/27707
(looks like the buffer is only 100 chars, and /proc/cpuinfo frequently exc...
Sage Weil
05:52 PM Bug #38296 (Fix Under Review): segv in fgets() in collect_sys_info reading /proc/cpuinfo
https://github.com/ceph/ceph/pull/27707
(looks like the buffer is only 100 chars, and /proc/cpuinfo frequently exc...
Sage Weil
05:48 PM Bug #38296: segv in fgets() in collect_sys_info reading /proc/cpuinfo
saw this again: ... Sage Weil
09:17 PM Bug #39402 (New): Can't remove ghost PGs
This is on the downstream long-running cluster. I can grant SSH access to whomever needs it.
This bug is similar ...
David Galloway
06:26 PM Bug #39263 (Pending Backport): rados/upgrade/nautilus-x-singleton: mon.c@1(electing).elector(11) ...
Only this commit needs to be backported to nautilus https://github.com/ceph/ceph/pull/27622/commits/ccb86682361cf20bd... Neha Ojha
05:08 PM Bug #39398 (Fix Under Review): osd: fast_info need update when pglog rewind
Neha Ojha
08:43 AM Bug #39398 (Duplicate): osd: fast_info need update when pglog rewind
When the pglog need rewind, the info.last_update will need to change to
older value, current impl of PG::_prepare_wr...
Zengran Zhang
01:50 PM Bug #37679 (Fix Under Review): osd: pull object from the shard who missing it
Sage Weil
07:50 AM Bug #26958: osd/ReplicatedBackend.cc: 1321: FAILED assert(get_parent()->get_log().get_log().objec...
http://qa-proxy.ceph.com/teuthology/xxg-2019-04-19_03:19:09-rados-wip-yanj-testing-fixpeerings-190418-distro-basic-sm... xie xingguo
02:28 AM Bug #37439 (Pending Backport): Degraded PG does not discover remapped data on originating OSD
Sage Weil
 

Also available in: Atom