Project

General

Profile

Activity

From 02/04/2019 to 03/05/2019

03/05/2019

11:17 PM Bug #26971: failed to become clean before timeout expired
Reproduced on master in 1 of 10 duplicate runs:
dzafman-2019-03-05_10:43:39-rados:thrash-master-distro-basic-smith...
David Zafman
07:01 PM Bug #26971: failed to become clean before timeout expired
Seen recently in luminous.
yuriw-2019-02-28_14:42:05-rados-wip-yuri4-testing-2019-02-27-2159-luminous-distro-basi...
David Zafman
10:37 PM Bug #38484 (Resolved): osd: InvalidRead, PG use-after-free putting ref
Neha Ojha
10:09 PM Bug #38525 (Resolved): qa/standalone/osd/pg-split-merge.sh fails
Neha Ojha
08:48 PM Bug #38594 (New): mimic: common/Mutex.cc: 110: FAILED assert(r == 0) in powercycle
... Neha Ojha
08:22 PM Bug #38592 (Duplicate): mon,osd: src/common/TrackedOp.cc: 163: FAILED ceph_assert((sharded_in_fli...
... Sage Weil
06:03 PM Bug #38499 (Need More Info): ceph-mon segfaults at startup
Nathan Cutler
03:12 PM Feature #21073 (Resolved): mgr: ceph/rgw: show hostnames and ports in ceph -s status output
Sage Weil
10:51 AM Bug #38582 (New): Pool storage MAX AVAIL reduction seems higher when single OSD reweight is done

i have a 5 node ceph 11.2.0 cluster with 335 osds. Each OSD is a 4TB HDD. It has one EC 4+1 pool.
Due to high st...
Nokia ceph-users
03:28 AM Backport #38511 (In Progress): mimic: ceph CLI ability to change file ownership
https://github.com/ceph/ceph/pull/26760 Prashant D
01:52 AM Backport #38510 (In Progress): luminous: ceph CLI ability to change file ownership
https://github.com/ceph/ceph/pull/26758 Prashant D
01:49 AM Backport #38507 (In Progress): mimic: ENOENT on setattrs (obj was recently deleted)
https://github.com/ceph/ceph/pull/26709 Prashant D
01:36 AM Bug #38579 (Need More Info): osd: should not mark cluster_messenger when commited new osdmap

when we run some fault test in Luminous 12.2.10, got coredump like ...
bing lin

03/04/2019

10:14 PM Support #38475: PG stuck in creating state
Support tickets will get a lot more eyes if you email the issue to ceph-users. :) Greg Farnum
10:07 PM Bug #38499: ceph-mon segfaults at startup
This must be running the labs or something, where's a log Abhi? Greg Farnum
09:23 PM Bug #37808: osd: osdmap cache weak_refs assert during shutdown
Argh, I can't find it now but I'm pretty sure I saw a PR go by that purported to fix this. The claimed issue is that ... Greg Farnum
05:36 PM Bug #37808: osd: osdmap cache weak_refs assert during shutdown
the rgw/multisite suite has been reproducing this reliably - probably because it runs with 'wait-for-scrub: false' Casey Bodley
03:14 PM Bug #38484 (Fix Under Review): osd: InvalidRead, PG use-after-free putting ref
https://github.com/ceph/ceph/pull/26742 Sage Weil
02:31 PM Bug #38219: rebuild-mondb hangs
/a/sage-2019-03-03_23:01:07-rados-wip-sage3-testing-2019-03-03-1043-distro-basic-smithi/3664297
Sage Weil
12:14 PM Backport #38567 (Resolved): luminous: osd_recovery_priority is not documented (but osd_recovery_o...
https://github.com/ceph/ceph/pull/27471 Nathan Cutler
12:14 PM Backport #38566 (Resolved): mimic: osd_recovery_priority is not documented (but osd_recovery_op_p...
https://github.com/ceph/ceph/pull/26901 Nathan Cutler
12:13 PM Backport #38565 (Resolved): mimic: Code to strip | from core pattern isn't right
https://github.com/ceph/ceph/pull/26811 Nathan Cutler
12:12 PM Backport #38562 (Resolved): luminous: mgr deadlock
https://github.com/ceph/ceph/pull/26830 Nathan Cutler
12:12 PM Backport #38561 (Resolved): mimic: mgr deadlock
https://github.com/ceph/ceph/pull/26833 Nathan Cutler
10:51 AM Bug #38322: luminous: mons do not trim maps until restarted
seen this issue with 10.2.4 Swami Reddy

03/03/2019

04:52 PM Documentation #38558 (New): doc: osd [test-]reweight-by-utilization is not properly documented in...
Looks like:... Марк Коренберг
02:11 AM Bug #38537 (Pending Backport): mgr deadlock
Kefu Chai

03/02/2019

02:31 PM Bug #38484: osd: InvalidRead, PG use-after-free putting ref
/a/sage-2019-03-02_01:13:07-rados-wip-sage2-testing-2019-03-01-1553-distro-basic-smithi/3656299 Sage Weil
02:29 PM Bug #38555 (Can't reproduce): scrub error on ec pg, got 6579891/0 or 7569408/6832128 bytes
... Sage Weil
01:53 AM Bug #38525 (Fix Under Review): qa/standalone/osd/pg-split-merge.sh fails
Neha Ojha
01:45 AM Documentation #23999 (Pending Backport): osd_recovery_priority is not documented (but osd_recover...
Neha Ojha
01:33 AM Backport #38552 (Resolved): mimic: core: lazy omap stat collection
https://github.com/ceph/ceph/pull/29189 Brad Hubbard
01:33 AM Backport #38551 (Resolved): luminous: core: lazy omap stat collection
https://github.com/ceph/ceph/pull/29190 Brad Hubbard

03/01/2019

11:06 PM Bug #23875 (Need More Info): Removal of snapshot with corrupt replica crashes osd
David Zafman
11:04 PM Bug #38325 (Pending Backport): Code to strip | from core pattern isn't right
David Zafman
09:46 PM Bug #38484 (Can't reproduce): osd: InvalidRead, PG use-after-free putting ref
i think i must have mixed up my test branches or something. i can't reproduce this. Sage Weil
09:45 PM Bug #38483 (In Progress): FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_wake_...
Sage Weil
06:22 PM Feature #38550: osd: Implement lazy omap usage statistics per osd
From - https://tracker.ceph.com/issues/38136 Vikhyat Umrao
06:21 PM Feature #38550 (Duplicate): osd: Implement lazy omap usage statistics per osd
This https://github.com/ceph/ceph/pull/26614 implements per pg and it would be good to summarize them per osd. Vikhyat Umrao
06:02 PM Feature #38136 (Pending Backport): core: lazy omap stat collection
Vikhyat Umrao
05:01 PM Bug #38537 (Fix Under Review): mgr deadlock
https://github.com/ceph/ceph/pull/26723 Sage Weil
02:29 PM Bug #38537 (Resolved): mgr deadlock
... Sage Weil
03:40 PM Backport #38507 (New): mimic: ENOENT on setattrs (obj was recently deleted)
Nathan Cutler
04:13 AM Backport #38507 (In Progress): mimic: ENOENT on setattrs (obj was recently deleted)
-https://github.com/ceph/ceph/pull/26708- Prashant D
03:28 PM Bug #36306 (Resolved): monstore tool rebuild does not generate creating_pgs
Nathan Cutler
03:27 PM Backport #36434 (Resolved): luminous: monstore tool rebuild does not generate creating_pgs
Nathan Cutler
03:26 PM Bug #36497 (Resolved): FAILED ceph_assert(can_write == WriteStatus::NOWRITE) in ProtocolV1::repla...
Nathan Cutler
03:26 PM Backport #37905 (Resolved): luminous: FAILED ceph_assert(can_write == WriteStatus::NOWRITE) in Pr...
Nathan Cutler
03:26 PM Backport #37904 (Resolved): mimic: FAILED ceph_assert(can_write == WriteStatus::NOWRITE) in Proto...
Nathan Cutler
03:25 PM Bug #24676 (Resolved): FreeBSD/Linux integration - monitor map with wrong sa_family
Nathan Cutler
03:24 PM Backport #37972 (Resolved): luminous: FreeBSD/Linux integration - monitor map with wrong sa_family
Nathan Cutler
02:40 PM Documentation #23999: osd_recovery_priority is not documented (but osd_recovery_op_priority is)
https://github.com/ceph/ceph/pull/26705/commits/9475acb9805abeb6ab631df912cdbce0a7f34d3d Neha Ojha
10:29 AM Bug #38053 (Resolved): Add hashinfo testing for dump command of ceph-objectstore-tool
Nathan Cutler
10:28 AM Backport #38140 (Resolved): luminous: Add hashinfo testing for dump command of ceph-objectstore-tool
Nathan Cutler
10:28 AM Backport #38141 (Resolved): mimic: Add hashinfo testing for dump command of ceph-objectstore-tool
Nathan Cutler
10:14 AM Bug #38295 (Resolved): luminous->(mimic,nautilus): PGMapDigest decode error on luminous end
Nathan Cutler
10:14 AM Backport #38342 (Resolved): mimic: luminous->(mimic,nautilus): PGMapDigest decode error on lumino...
Nathan Cutler
05:28 AM Bug #38525: qa/standalone/osd/pg-split-merge.sh fails
looks like the test is broken. we aren't reliably making a gap, so it would usually pass for the wrong reason. Sage Weil
05:27 AM Bug #38525 (Resolved): qa/standalone/osd/pg-split-merge.sh fails
... Sage Weil
03:10 AM Bug #38077: Marking all OSDs as "out" does not trigger a HEALTH_ERR state
Hi,I don't know whether my opinion is right or not, but I think the status should be HEALTH_WARN when OSDs being mark... richael zhuang
02:24 AM Backport #38506 (In Progress): luminous: ENOENT on setattrs (obj was recently deleted)
https://github.com/ceph/ceph/pull/26706 Prashant D
12:10 AM Bug #38238: rados/test.sh: api_aio_pp doesn't seem to start
/a/sage-2019-02-28_12:30:17-rados-wip-sage-testing-2019-02-27-1720-distro-basic-smithi/3649931
description: rados/...
Sage Weil

02/28/2019

07:35 PM Backport #36434: luminous: monstore tool rebuild does not generate creating_pgs
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25825
merged
Yuri Weinstein
07:29 PM Backport #37905: luminous: FAILED ceph_assert(can_write == WriteStatus::NOWRITE) in ProtocolV1::r...
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25956
merged
Yuri Weinstein
07:24 PM Backport #37972: luminous: FreeBSD/Linux integration - monitor map with wrong sa_family
Mykola Golub wrote:
> https://github.com/ceph/ceph/pull/26042
merged
Yuri Weinstein
07:24 PM Backport #38140: luminous: Add hashinfo testing for dump command of ceph-objectstore-tool
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26284
merged
Yuri Weinstein
04:32 PM Bug #38358: short pg log + cache tier ceph_test_rados out of order reply
This is on luminous:
/a/teuthology-2019-02-23_01:30:03-rados-luminous-distro-basic-smithi/3627561/
We recently ...
Neha Ojha
03:25 PM Bug #38184: osd: recovery does not preserve copy-on-write allocations between object clones after...
This is indeed the current behavior. The OSD isn't clever enough to preserve the shared allocations across recovery.... Sage Weil
01:54 PM Bug #38513 (Rejected): luminous: "AsyncReserver.h: 190: FAILED assert(!queue_pointers.count(item)...
Run: http://pulpito.ceph.com/yuriw-2019-02-27_17:20:44-rados-wip-yuri3-testing-2019-02-25-2101-luminous-distro-basic-... Yuri Weinstein
12:36 PM Backport #38511 (Resolved): mimic: ceph CLI ability to change file ownership
https://github.com/ceph/ceph/pull/26760 Nathan Cutler
12:36 PM Backport #38510 (Resolved): luminous: ceph CLI ability to change file ownership
https://github.com/ceph/ceph/pull/26758 Nathan Cutler
12:36 PM Backport #38507 (Resolved): mimic: ENOENT on setattrs (obj was recently deleted)
https://github.com/ceph/ceph/pull/26709 Nathan Cutler
12:36 PM Backport #38506 (Resolved): luminous: ENOENT on setattrs (obj was recently deleted)
https://github.com/ceph/ceph/pull/26706 Nathan Cutler

02/27/2019

11:50 PM Feature #38136: core: lazy omap stat collection
Brad Hubbard wrote:
> Backporting https://github.com/ceph/ceph/pull/26614 may be easier Vikhyat if/when it merges?
...
Vikhyat Umrao
10:59 PM Bug #38431 (Resolved): osd: leaked pg refs on shutdown
Sage Weil
10:59 PM Bug #38477 (Resolved): upgrade to nautilus leaves v1: osd blacklist entries
Sage Weil
04:29 PM Backport #38342: mimic: luminous->(mimic,nautilus): PGMapDigest decode error on luminous end
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26451
merged
Yuri Weinstein
04:24 PM Bug #38238: rados/test.sh: api_aio_pp doesn't seem to start
/a/rdias-2019-02-26_22:35:27-rados-wip-rdias2-testing-distro-basic-smithi/3642422
description: rados/thrash/{0-siz...
Sage Weil
03:35 PM Bug #38307: ceph-osd fails to bind to IPv6 interface for public_network
Jesse, what's the value of the ms_bind_ipv6 and ms_bind_ipv4 in your configuration when you hit this problem?
My t...
Ricardo Dias
01:55 PM Bug #38499 (Need More Info): ceph-mon segfaults at startup
... Abhishek Lekshmanan
08:54 AM Feature #38496 (New): ceph.in: use same units for displaying ceph osd df
... Марк Коренберг
12:03 AM Bug #38184: osd: recovery does not preserve copy-on-write allocations between object clones after...
Anyone? Vitaliy Filippov

02/26/2019

09:01 PM Bug #37808: osd: osdmap cache weak_refs assert during shutdown
/ceph/teuthology-archive/pdonnell-2019-02-26_07:49:50-multimds-wip-pdonnell-testing-20190226.051327-distro-basic-smit... Patrick Donnelly
02:35 PM Bug #38484 (Resolved): osd: InvalidRead, PG use-after-free putting ref
... Sage Weil
02:34 PM Bug #38403: osd: leaked from OSDMap::apply_incremental
/a/sage-2019-02-26_12:41:21-rados:verify-wip-sage-testing-2019-02-25-1642-distro-basic-smithi/3641678
Sage Weil
01:21 PM Bug #38483 (Fix Under Review): FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_...
https://github.com/ceph/ceph/pull/26651 Sage Weil
12:40 PM Bug #38483 (Resolved): FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_wake_spl...
... Sage Weil

02/25/2019

11:08 PM Bug #38433 (Duplicate): rados/test.sh timeout
#38238 Sage Weil
10:55 PM Bug #38477 (Fix Under Review): upgrade to nautilus leaves v1: osd blacklist entries
https://github.com/ceph/ceph/pull/26640 Sage Weil
07:13 PM Bug #38477 (Resolved): upgrade to nautilus leaves v1: osd blacklist entries
after a mimic -> nautilus upgrade,... Sage Weil
08:37 PM Backport #38141: mimic: Add hashinfo testing for dump command of ceph-objectstore-tool
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26283
merged
Yuri Weinstein
06:53 PM Bug #38377 (Fix Under Review): OpTracker destruct assert when OSD destruct
Greg Farnum
06:41 PM Bug #38295 (Fix Under Review): luminous->(mimic,nautilus): PGMapDigest decode error on luminous end
Follow-up fix: https://github.com/ceph/ceph/pull/26636 Sage Weil
02:44 PM Feature #38370 (Pending Backport): ceph CLI ability to change file ownership
Sage Weil
02:43 PM Bug #38432 (Pending Backport): ENOENT on setattrs (obj was recently deleted)
Sage Weil
12:15 PM Support #38475 (New): PG stuck in creating state
Hi,
After one big fail of my ceph cluster I would like force create PGs (beacause old pgs are lost definitively).
...
Simon Falicon
11:21 AM Feature #38136: core: lazy omap stat collection
Backporting https://github.com/ceph/ceph/pull/26614 may be easier Vikhyat if/when it merges? Brad Hubbard
04:08 AM Backport #38443 (In Progress): mimic: osd-markdown.sh can fail with CLI_DUP_COMMAND=1
-https://github.com/ceph/ceph/pull/26618- Prashant D
01:56 AM Bug #37772: unittest_seastar_messenger fails with debug build
Hi,I tested both ceph master and ceph14.0.1 on X86 and the unittest_seastar_messenger passed with debug build. So I d... richael zhuang
01:03 AM Backport #38442 (In Progress): luminous: osd-markdown.sh can fail with CLI_DUP_COMMAND=1
https://github.com/ceph/ceph/pull/26616 Prashant D

02/24/2019

03:30 PM Bug #24320: out of order reply and/or osd assert with set-chunks-read.yaml
... Sage Weil
03:28 PM Bug #21592: LibRadosCWriteOps.CmpExt got 0 instead of -4095-1
/a/sage-2019-02-23_23:02:18-rados-wip-sage2-testing-2019-02-23-1354-distro-basic-smithi/3631993 Sage Weil
03:27 PM Bug #24990: api_watch_notify: LibRadosWatchNotify.Watch3Timeout failed
... Sage Weil
03:26 PM Bug #38358: short pg log + cache tier ceph_test_rados out of order reply
/a/sage-2019-02-23_23:02:18-rados-wip-sage2-testing-2019-02-23-1354-distro-basic-smithi/3631889 Sage Weil
07:52 AM Feature #38462 (New): Store comments to config options stored in monitors (i.e. ceph config dump)
It will be nice to have ability to add arbitrary comments to any option stored. In Ceph.conf it is possible. I see it... Марк Коренберг
06:47 AM Bug #38461 (New): Ceph osd out is the same as ceph osd reweight 0 (result in same bucket weights)
http://docs.ceph.com/docs/mimic/rados/operations/add-or-rm-osds says:... Марк Коренберг

02/23/2019

04:43 PM Feature #38458 (New): Ceph does not have command to show current osd primary-affinity
It will be nice to have ability to show current primary-affinity value for an osd. Марк Коренберг

02/22/2019

09:19 PM Backport #38423: luminous: osd/TestPGLog.cc: Verify that dup_index is being trimmed
Thanks for the tidy up Nathan. Brad Hubbard
05:45 PM Bug #22525 (Resolved): auth: ceph auth add does not sanity-check caps
Nathan Cutler
05:45 PM Backport #23670 (Resolved): luminous: auth: ceph auth add does not sanity-check caps
Nathan Cutler
05:27 PM Feature #37597 (Resolved): ceph-objectstore-tool: Add HashInfo to object dump output
Nathan Cutler
05:27 PM Backport #37690 (Resolved): luminous: ceph-objectstore-tool: Add HashInfo to object dump output
Nathan Cutler
05:26 PM Bug #37776 (Resolved): workunits/rados/test_health_warnings.sh fails with <9 osds down
Nathan Cutler
05:26 PM Backport #37815 (Resolved): luminous: workunits/rados/test_health_warnings.sh fails with <9 osds ...
Nathan Cutler
05:26 PM Bug #24601 (Resolved): FAILED assert(is_up(osd)) in OSDMap::get_inst(int)
Nathan Cutler
05:26 PM Backport #37833 (Resolved): luminous: FAILED assert(is_up(osd)) in OSDMap::get_inst(int)
Nathan Cutler
05:17 PM Bug #38431 (Fix Under Review): osd: leaked pg refs on shutdown
https://github.com/ceph/ceph/pull/26595 Sage Weil
05:06 PM Bug #38431: osd: leaked pg refs on shutdown
This appears to be as simple as a queued write in progress when shutdown happens:... Sage Weil
12:55 PM Bug #38431 (Resolved): osd: leaked pg refs on shutdown
/a/sage-2019-02-21_21:52:17-rados-wip-sage3-testing-2019-02-21-1359-distro-basic-smithi/3622562
w/ pg ref logs
Sage Weil
04:47 PM Bug #37808: osd: osdmap cache weak_refs assert during shutdown
/a/sage-2019-02-22_15:54:54-rados-wip-sage2-testing-2019-02-22-0711-distro-basic-smithi/3626248 Sage Weil
04:17 PM Bug #38070 (Resolved): A PG repairing doesn't mean PG is damaged
Nathan Cutler
04:17 PM Backport #38207 (Resolved): luminous: A PG repairing doesn't mean PG is damaged
Nathan Cutler
04:07 PM Backport #38317 (Resolved): mimic: filestore: fsync(2) return value not checked
Nathan Cutler
04:07 PM Bug #37593 (Resolved): ec pool lost data due to snap clone
Nathan Cutler
04:06 PM Backport #37993 (Resolved): luminous: ec pool lost data due to snap clone
Nathan Cutler
04:06 PM Cleanup #38025 (Resolved): qa/overrides/short_pg_log.yaml: reduce osd_{min,max}_pg_log_entries
Nathan Cutler
04:06 PM Backport #38046 (Resolved): luminous: qa/overrides/short_pg_log.yaml: reduce osd_{min,max}_pg_log...
Nathan Cutler
04:06 PM Bug #37919 (Resolved): osd/ECBackend.cc: 1547: FAILED ceph_assert(!(*m).is_missing(hoid))
Nathan Cutler
04:06 PM Backport #38105 (Resolved): luminous: osd/ECBackend.cc: 1547: FAILED ceph_assert(!(*m).is_missing...
Nathan Cutler
03:41 PM Backport #38450 (In Progress): mimic: src/osd/OSDMap.h: 1065: FAILED assert(__null != pool)
Nathan Cutler
02:36 PM Backport #38450 (Resolved): mimic: src/osd/OSDMap.h: 1065: FAILED assert(__null != pool)
https://github.com/ceph/ceph/pull/29976 Nathan Cutler
03:39 PM Backport #38243 (Resolved): mimic: scrub warning check incorrectly uses mon scrub interval
Nathan Cutler
03:36 PM Bug #38238: rados/test.sh: api_aio_pp doesn't seem to start
ceph-client.admin.19974.log.gz is aio_pp
it starts, gets a few tests in, then the log stops unexpectedly......
Sage Weil
03:03 PM Bug #38238: rados/test.sh: api_aio_pp doesn't seem to start
another instance:
/a/sage-2019-02-21_21:52:17-rados-wip-sage3-testing-2019-02-21-1359-distro-basic-smithi/3622638
...
Sage Weil
03:09 PM Backport #38162 (In Progress): luminous: maybe_remove_pg_upmaps incorrectly cancels valid pending...
Nathan Cutler
02:57 PM Bug #38432 (Fix Under Review): ENOENT on setattrs (obj was recently deleted)
https://github.com/ceph/ceph/pull/26591 Sage Weil
12:59 PM Bug #38432 (Resolved): ENOENT on setattrs (obj was recently deleted)
... Sage Weil
02:34 PM Backport #38443 (Resolved): mimic: osd-markdown.sh can fail with CLI_DUP_COMMAND=1
https://github.com/ceph/ceph/pull/27907 Nathan Cutler
02:34 PM Backport #38442 (Resolved): luminous: osd-markdown.sh can fail with CLI_DUP_COMMAND=1
https://github.com/ceph/ceph/pull/26616 (merged for v12.2.12)
backport of follow-up fix: https://github.com/ceph/cep...
Nathan Cutler
02:33 PM Backport #38437 (Resolved): mimic: crc cache should be invalidated when posting preallocated rx b...
https://github.com/ceph/ceph/pull/29247 Nathan Cutler
02:33 PM Backport #38436 (Resolved): luminous: crc cache should be invalidated when posting preallocated r...
https://github.com/ceph/ceph/pull/29248 Nathan Cutler
01:18 PM Bug #38425 (Duplicate): mon: segmentation fault in AuthMonitor::create_pending
just fixed this, #38372 Sage Weil
04:45 AM Bug #38425: mon: segmentation fault in AuthMonitor::create_pending
Here's a different stack trace that's probably related:
/ceph/teuthology-archive/pdonnell-2019-02-19_07:16:18-fs-w...
Patrick Donnelly
04:42 AM Bug #38425 (Duplicate): mon: segmentation fault in AuthMonitor::create_pending
... Patrick Donnelly
01:14 PM Bug #38372 (Resolved): segfault in "AuthMonitor::increase_max_global_id()"
Sage Weil
01:11 PM Bug #38416 (Pending Backport): crc cache should be invalidated when posting preallocated rx buffers
Sage Weil
01:10 PM Bug #36337: OSDs crash with failed assertion in PGLog::merge_log as logs do not overlap
... Sage Weil
01:06 PM Bug #38433 (Duplicate): rados/test.sh timeout
... Sage Weil
06:03 AM Backport #38398 (In Progress): mimic: rados_shutdown hang forever in ~objecter()
https://github.com/ceph/ceph/pull/26583 Prashant D
03:35 AM Backport #38400 (In Progress): luminous: rados_shutdown hang forever in ~objecter()
https://github.com/ceph/ceph/pull/26579 Prashant D

02/21/2019

11:29 PM Backport #23670: luminous: auth: ceph auth add does not sanity-check caps
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/24906
merged
Yuri Weinstein
11:26 PM Backport #37690: luminous: ceph-objectstore-tool: Add HashInfo to object dump output
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25722
merged
Yuri Weinstein
11:25 PM Backport #37815: luminous: workunits/rados/test_health_warnings.sh fails with <9 osds down
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25851
merged
Yuri Weinstein
11:24 PM Backport #37833: luminous: FAILED assert(is_up(osd)) in OSDMap::get_inst(int)
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25853
merged
Yuri Weinstein
11:24 PM Backport #38424 (In Progress): mimic: osd/TestPGLog.cc: Verify that dup_index is being trimmed
https://github.com/ceph/ceph/pull/26578 Brad Hubbard
11:15 PM Backport #38424 (Resolved): mimic: osd/TestPGLog.cc: Verify that dup_index is being trimmed
https://github.com/ceph/ceph/pull/26578 Brad Hubbard
11:23 PM Backport #38207: luminous: A PG repairing doesn't mean PG is damaged
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26305
merged
Yuri Weinstein
11:19 PM Backport #38423 (In Progress): luminous: osd/TestPGLog.cc: Verify that dup_index is being trimmed
Brad Hubbard
11:10 PM Backport #38423: luminous: osd/TestPGLog.cc: Verify that dup_index is being trimmed
https://github.com/ceph/ceph/pull/26574 Brad Hubbard
11:10 PM Backport #38423 (Resolved): luminous: osd/TestPGLog.cc: Verify that dup_index is being trimmed
https://github.com/ceph/ceph/pull/26574 Brad Hubbard
11:05 PM Bug #38406: osd/TestPGLog.cc: Verify that dup_index is being trimmed
https://github.com/ceph/ceph/pull/26533 Brad Hubbard
08:27 PM Bug #38406 (Pending Backport): osd/TestPGLog.cc: Verify that dup_index is being trimmed
Neha Ojha
10:52 PM Cleanup #38422 (New): qa/suites/rados/verify: coverage review tasks
Tracker for verify coverage review tasks Brad Hubbard
10:50 PM Cleanup #38421 (New): qa/suites/rados/objectstore: coverage review tasks
Tracker for objectstore coverage review tasks. Brad Hubbard
10:11 PM Backport #38317: mimic: filestore: fsync(2) return value not checked
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26438
merged
Yuri Weinstein
09:54 PM Backport #37993: luminous: ec pool lost data due to snap clone
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26078
merged
Yuri Weinstein
09:53 PM Backport #38046: luminous: qa/overrides/short_pg_log.yaml: reduce osd_{min,max}_pg_log_entries
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26148
merged
Yuri Weinstein
09:53 PM Backport #38105: luminous: osd/ECBackend.cc: 1547: FAILED ceph_assert(!(*m).is_missing(hoid))
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26236
merged
Yuri Weinstein
09:35 PM Bug #38083 (Resolved): mimic: test_kvstore_tool.sh: mkfs failed: (22) Invalid argument
Neha Ojha
08:24 PM Bug #38083: mimic: test_kvstore_tool.sh: mkfs failed: (22) Invalid argument
https://github.com/ceph/ceph/pull/26573 Neha Ojha
08:23 PM Bug #38083 (Fix Under Review): mimic: test_kvstore_tool.sh: mkfs failed: (22) Invalid argument
Sage Weil
08:31 PM Bug #26970 (Pending Backport): src/osd/OSDMap.h: 1065: FAILED assert(__null != pool)
Neha Ojha
07:19 PM Bug #26970: src/osd/OSDMap.h: 1065: FAILED assert(__null != pool)
Seen in mimic: /a/yuriw-2019-02-20_20:24:46-rados-wip-yuri3-testing-2019-02-20-1755-mimic-distro-basic-smithi/3619026... Neha Ojha
06:59 PM Bug #26970: src/osd/OSDMap.h: 1065: FAILED assert(__null != pool)
This was fixed as cfe6ca82ed800e81e286396b5b7783ca299325f0 in larger pull request https://github.com/ceph/ceph/pull/2... David Zafman
05:34 PM Backport #38243: mimic: scrub warning check incorrectly uses mon scrub interval
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26493
merged
Yuri Weinstein
01:15 PM Bug #38358: short pg log + cache tier ceph_test_rados out of order reply
/a/sage-2019-02-21_06:38:51-rados-wip-sage-testing-2019-02-20-2138-distro-basic-smithi/3620775 Sage Weil
09:13 AM Bug #23320 (Resolved): OSD suicide itself because of a firewall rule but reports a received signal
Mykola Golub
06:33 AM Bug #38377: OpTracker destruct assert when OSD destruct
Greg Farnum wrote:
> Is this a custom build? Where did it come from?
aha,ceph version is Luminous 12.2.10,
see [...
bing lin
03:36 AM Bug #24866 (Resolved): FAILED assert(0 == "past_interval start interval mismatch") in check_past_...
Sage Weil
03:34 AM Bug #38417 (New): ceph tell mon.a help timeout
... Sage Weil
02:04 AM Bug #23879: test_mon_osdmap_prune.sh fails
http://pulpito.ceph.com/gregf-2019-02-19_21:22:48-rados:monthrash-master-distro-basic-mira/3614157/ Greg Farnum
12:49 AM Feature #38136: core: lazy omap stat collection
Vikhyat Umrao wrote:
> I am checking if we can backport only this to luminous - https://github.com/ceph/ceph/pull/18...
Vikhyat Umrao
12:40 AM Feature #38136: core: lazy omap stat collection
I am checking if we can backport only this to luminous - https://github.com/ceph/ceph/pull/18096/commits/13295a38839d... Vikhyat Umrao

02/20/2019

11:44 PM Bug #38416 (Fix Under Review): crc cache should be invalidated when posting preallocated rx buffers
https://github.com/ceph/ceph/pull/26552 Ilya Dryomov
11:27 PM Bug #38416 (Resolved): crc cache should be invalidated when posting preallocated rx buffers
Otherwise, if the buffer was previously checksummed, the client will spin on "bad crc in data" errors forever. Ilya Dryomov
11:28 PM Bug #27988 (Need More Info): Warn if queue of scrubs ready to run exceeds some threshold
This is put on the back burner until we decide what to do next David Zafman
11:16 PM Bug #38333 (Duplicate): mon crash in AuthMonitor::Incremental::encode buffer code
oh, i bet it was the same auth thing i just fixed: #38372 Sage Weil
10:05 PM Bug #38333: mon crash in AuthMonitor::Incremental::encode buffer code
Is it possible this is a result of some of the buffer list stuff we know was broken? Greg Farnum
11:16 PM Bug #38372: segfault in "AuthMonitor::increase_max_global_id()"
actually, the original crash here was slightly different than I thought: the old assign_global_id() was passed false ... Sage Weil
11:10 PM Bug #38372 (Fix Under Review): segfault in "AuthMonitor::increase_max_global_id()"
https://github.com/ceph/ceph/pull/26550 Sage Weil
10:27 PM Bug #38372 (In Progress): segfault in "AuthMonitor::increase_max_global_id()"
Monitor.cc auth methods protected by auth_lock, but AuthMontior' assign_global_id() is under the normal mon->lock Sage Weil
10:27 PM Bug #38372: segfault in "AuthMonitor::increase_max_global_id()"
I see the last log lines from the bad thread are... Greg Farnum
10:20 PM Bug #38372: segfault in "AuthMonitor::increase_max_global_id()"
Sage just rewrote part of this and I see it's under the ProtocolV2 stack, so giving it to him... Greg Farnum
10:59 PM Backport #38244 (In Progress): luminous: scrub warning check incorrectly uses mon scrub interval
David Zafman
10:09 AM Backport #38244 (Need More Info): luminous: scrub warning check incorrectly uses mon scrub interval
see the mimic backport for why this is non-trivial Nathan Cutler
10:51 PM Bug #38212: Rare qa/standalone/osd/osd-markdown.sh mon start-up error
So the problem is that the test checks for a failure return, and it's getting a failure return in the wrong place? Do... Greg Farnum
10:46 PM Bug #38248: qa/standalone/osd/pg-split-merge.sh TEST_import_after_merge_and_gap() test fails
Do we know what PRs this test branch covered? Three jobs hitting a new bug is certainly suspicious! Greg Farnum
10:43 PM Bug #38306: ceph-mon: "*** Caught signal (Segmentation fault) **" in upgrade:luminous-x-mimic
Is it possible we did a naughty backport that made these both pop up close together? :/ Greg Farnum
10:40 PM Bug #38356 (Duplicate): standalone/osd/osd-markdown.sh fails in TEST_markdown_boot
Greg Farnum
10:37 PM Bug #38377: OpTracker destruct assert when OSD destruct
Is this a custom build? Where did it come from? Greg Farnum
10:31 PM Bug #38238: rados/test.sh: api_aio_pp doesn't seem to start
Ah, /a/sage-2019-02-07_22:38:18-rados-master-distro-basic-smithi/3561540 appears to be it Greg Farnum
10:28 PM Bug #38238: rados/test.sh: api_aio_pp doesn't seem to start
The referenced log doesn't seem to be this bug, as it got stuck on a crashed OSD... Greg Farnum
10:17 PM Bug #38381: Rados.get_fsid() returning bytes in python3
https://github.com/ceph/ceph/pull/26514 Greg Farnum
10:14 PM Bug #38402: ceph-objectstore-tool on down osd w/ not enough in osds
I see we have a bunch of live OSDs which are not marked in; perhaps this is the same as #37439? Greg Farnum
12:58 PM Bug #38402 (Can't reproduce): ceph-objectstore-tool on down osd w/ not enough in osds
crush couldn't quite do it:... Sage Weil
10:12 PM Bug #38172: segv in rocksdb NewIterator
We can bump back up if it appears again or close it if we don't see it reappear. Greg Farnum
07:19 PM Bug #38344 (Resolved): src/osd/PG.h: 1245: FAILED ceph_assert(prev >= 0)
David Zafman
03:17 PM Bug #38406 (Resolved): osd/TestPGLog.cc: Verify that dup_index is being trimmed
Modify existing tests to verify that dup_index is getting trimmed. Neha Ojha
01:11 PM Bug #20909: Error ETIMEDOUT: crush test failed with -110: timed out during smoke test (5 seconds)
... Sage Weil
01:10 PM Bug #38403 (Duplicate): osd: leaked from OSDMap::apply_incremental
... Sage Weil
01:08 PM Bug #36739: ENOENT in collection_move_rename on EC backfill target
/a/sage-2019-02-19_23:03:51-rados-wip-sage3-testing-2019-02-19-1008-distro-basic-smithi/3614320 Sage Weil
01:06 PM Bug #20798: LibRadosLockECPP.LockExclusiveDurPP gets EEXIST
/a/sage-2019-02-19_23:03:51-rados-wip-sage3-testing-2019-02-19-1008-distro-basic-smithi/3614261 Sage Weil
01:04 PM Bug #38359 (Pending Backport): osd-markdown.sh can fail with CLI_DUP_COMMAND=1
Sage Weil
01:02 PM Bug #36304 (Resolved): FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_wake_spl...
Sage Weil
01:00 PM Bug #37808: osd: osdmap cache weak_refs assert during shutdown
Sage Weil
12:17 PM Bug #16890: rbd diff outputs nothing when the image is layered and with a writeback cache tier
rebased PR posted at https://github.com/ceph/ceph/pull/26542 Kefu Chai
10:44 AM Backport #38400 (Resolved): luminous: rados_shutdown hang forever in ~objecter()
https://github.com/ceph/ceph/pull/26579 Nathan Cutler
10:43 AM Backport #38398 (Resolved): mimic: rados_shutdown hang forever in ~objecter()
https://github.com/ceph/ceph/pull/26583 Nathan Cutler
10:08 AM Backport #38243: mimic: scrub warning check incorrectly uses mon scrub interval
First attempted backport, https://github.com/ceph/ceph/pull/26356, was closed. Nathan Cutler
08:57 AM Backport #38162: luminous: maybe_remove_pg_upmaps incorrectly cancels valid pending upmaps
https://github.com/ceph/ceph/pull/26127 xie xingguo

02/19/2019

06:17 PM Bug #38384 (Resolved): ceph_mon --help mon broken
Patrick Donnelly
06:08 PM Bug #38384 (Resolved): ceph_mon --help mon broken

http://qa-proxy.ceph.com/teuthology/dzafman-2019-02-19_08:38:36-rados-wip-zafman-testing-38344-distro-basic-smithi/...
David Zafman
05:36 PM Bug #38372: segfault in "AuthMonitor::increase_max_global_id()"
http://qa-proxy.ceph.com/teuthology/jdillaman-2019-02-19_09:50:43-rbd-wip-jd-testing-distro-basic-smithi/3612490/teut... Jason Dillaman
04:05 PM Bug #38381 (Fix Under Review): Rados.get_fsid() returning bytes in python3
Jason Dillaman
03:24 PM Bug #38381 (In Progress): Rados.get_fsid() returning bytes in python3
Jason Dillaman
03:24 PM Bug #38381: Rados.get_fsid() returning bytes in python3
Jason Dillaman
03:13 PM Bug #38381 (Resolved): Rados.get_fsid() returning bytes in python3
Hello,
I've found a bug in librados which causing big issues in Openstack projects (glance_store, cinder, nova).
...
Michal Arbet
03:36 PM Bug #24866: FAILED assert(0 == "past_interval start interval mismatch") in check_past_interval_bo...
... Sage Weil
03:34 PM Bug #24866 (Fix Under Review): FAILED assert(0 == "past_interval start interval mismatch") in che...
https://github.com/ceph/ceph/pull/26513 Sage Weil
02:44 PM Bug #37766 (Pending Backport): rados_shutdown hang forever in ~objecter()
Kefu Chai
02:30 PM Bug #38359: osd-markdown.sh can fail with CLI_DUP_COMMAND=1
/a/sage-2019-02-18_23:58:27-rados-wip-sage-testing-2019-02-18-1341-distro-basic-smithi/3609330 Sage Weil
09:21 AM Bug #38377 (Resolved): OpTracker destruct assert when OSD destruct
coredump... bing lin
02:46 AM Bug #38375 (Need More Info): OSD segmentation fault on rbd create
Random segfault when attempting to create an rbd on an erasure encoded pool.
ceph version 12.2.10 (177915764b7528...
Ryan Farrington

02/18/2019

10:15 PM Bug #38372 (Resolved): segfault in "AuthMonitor::increase_max_global_id()"
... Jason Dillaman
10:06 PM Feature #38370 (Fix Under Review): ceph CLI ability to change file ownership
Greg Farnum
06:21 PM Feature #38370 (Resolved): ceph CLI ability to change file ownership
When creating/fetching a key/monmap/crushmap it might be useful (especially for file used by a process later) to appl... Sébastien Han
10:02 PM Bug #38307: ceph-osd fails to bind to IPv6 interface for public_network
You going to open a PR for this, Jesse? Greg Farnum
09:31 PM Bug #36304 (Fix Under Review): FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_...
https://github.com/ceph/ceph/pull/26492 Sage Weil
09:30 PM Bug #36304: FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_wake_split_child(PG*)
aha:
during startup, we load pg 2.fs1, but fail to prime it from init():...
Sage Weil
05:32 PM Bug #36304: FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_wake_split_child(PG*)
We have logs here: /a/nojha-2019-02-11_18:58:45-rados:thrash-erasure-code-wip-test-revert-distro-basic-smithi/3575122 Neha Ojha
09:03 PM Bug #38320 (Resolved): leak in OSD::ms_handle_authentication()
Sage Weil
09:02 PM Bug #38359 (Fix Under Review): osd-markdown.sh can fail with CLI_DUP_COMMAND=1
https://github.com/ceph/ceph/pull/26489 Sage Weil
06:57 PM Feature #38029 (Fix Under Review): [RFE] If the nodeep-scrub/noscrub flags are set in pools inste...
Neha Ojha
06:55 PM Feature #38029: [RFE] If the nodeep-scrub/noscrub flags are set in pools instead of global cluste...
https://github.com/ceph/ceph/pull/26488 Mohamad Gebai
02:30 PM Bug #38322: luminous: mons do not trim maps until restarted
I have a feeling this is actually due to what led me to open this PR: https://github.com/ceph/ceph/pull/19076
The ...
Joao Eduardo Luis

02/17/2019

02:16 PM Bug #36304: FAILED ceph_assert(p != pg_slots.end()) in OSDShard::register_and_wake_split_child(PG*)
reproduced, but without logs..... Sage Weil
02:05 PM Bug #20909: Error ETIMEDOUT: crush test failed with -110: timed out during smoke test (5 seconds)
... Sage Weil
02:04 AM Bug #38344 (Fix Under Review): src/osd/PG.h: 1245: FAILED ceph_assert(prev >= 0)
David Zafman

02/16/2019

07:45 PM Bug #38359 (Resolved): osd-markdown.sh can fail with CLI_DUP_COMMAND=1
... Sage Weil
03:49 PM Bug #38358 (Resolved): short pg log + cache tier ceph_test_rados out of order reply
the combination of
- *1-pg-log-overrides/short_pg_log.yaml*
and
- *workloads/cache-agent-small.yaml*
and ...
Sage Weil
03:37 PM Bug #38357 (Pending Backport): ClsLock.TestExclusiveEphemeralStealEphemeral failed
... Sage Weil
03:34 PM Bug #38356 (Duplicate): standalone/osd/osd-markdown.sh fails in TEST_markdown_boot
... Kefu Chai
10:58 AM Backport #38239 (Resolved): mimic: radosbench tests hit ENOSPC
Nathan Cutler
10:55 AM Backport #38352 (Rejected): luminous: Limit loops waiting for force-backfill/force-recovery to ha...
Nathan Cutler
10:55 AM Backport #38351 (Resolved): mimic: Limit loops waiting for force-backfill/force-recovery to happen
https://github.com/ceph/ceph/pull/29245 Nathan Cutler

02/15/2019

11:19 PM Bug #38294 (Rejected): osd/PG.cc: 6141: FAILED ceph_assert(info.history.same_interval_since != 0)...
no logs Sage Weil
11:17 PM Bug #38330 (Resolved): osd/OSD.cc: 1515: abort() in Service::build_incremental_map_msg
Sage Weil
02:45 PM Bug #38330 (Fix Under Review): osd/OSD.cc: 1515: abort() in Service::build_incremental_map_msg
https://github.com/ceph/ceph/pull/26448 Sage Weil
01:33 PM Bug #38330 (Resolved): osd/OSD.cc: 1515: abort() in Service::build_incremental_map_msg
... Sage Weil
10:46 PM Backport #38208 (Resolved): mimic: A PG repairing doesn't mean PG is damaged
David Zafman
10:39 PM Backport #38208: mimic: A PG repairing doesn't mean PG is damaged
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26304
merged
Yuri Weinstein
10:37 PM Backport #38239: mimic: radosbench tests hit ENOSPC
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26354
merged
Yuri Weinstein
10:26 PM Bug #38309 (Pending Backport): Limit loops waiting for force-backfill/force-recovery to happen
David Zafman
10:06 PM Bug #38345: mon: segv in MonOpRequest::~MonOpRequest OpHistory::cleanup
/a/sage-2019-02-15_20:30:53-upgrade:mimic-x-wip-mimic-upgrade-distro-basic-smithi/3595562 Sage Weil
06:31 PM Bug #38345 (Resolved): mon: segv in MonOpRequest::~MonOpRequest OpHistory::cleanup
... Sage Weil
05:56 PM Bug #38344: src/osd/PG.h: 1245: FAILED ceph_assert(prev >= 0)
I have seen a similar failure here: /a/nojha-2019-02-13_14:45:41-rados:thrash-erasure-code-wip-test-revert-2-distro-b... Neha Ojha
05:47 PM Bug #38344: src/osd/PG.h: 1245: FAILED ceph_assert(prev >= 0)
Just prior to the crash pg 4.13 ended up with a local_num_bytes of -42624KiB.... David Zafman
05:22 PM Bug #38344 (Resolved): src/osd/PG.h: 1245: FAILED ceph_assert(prev >= 0)

http://pulpito.ceph.com/dzafman-2019-02-14_22:11:34-rados:thrash-master-distro-basic-smithi/3593928...
David Zafman
04:58 PM Backport #38342 (In Progress): mimic: luminous->(mimic,nautilus): PGMapDigest decode error on lum...
Nathan Cutler
04:49 PM Backport #38342 (Resolved): mimic: luminous->(mimic,nautilus): PGMapDigest decode error on lumino...
https://github.com/ceph/ceph/pull/26451 Nathan Cutler
04:44 PM Bug #37965 (Can't reproduce): rados/upgrade test fails
Sage Weil
04:43 PM Bug #38295 (Pending Backport): luminous->(mimic,nautilus): PGMapDigest decode error on luminous end
the commit to backport to mimic is e4ae368ff7a5396194f8bdd5692429af5457998b Sage Weil
04:42 PM Bug #38283 (Resolved): max-pg-per-osd tests failing
Sage Weil
04:40 PM Bug #38320 (In Progress): leak in OSD::ms_handle_authentication()
https://github.com/ceph/ceph/pull/26353 Sage Weil
04:39 PM Bug #24667 (Can't reproduce): osd: SIGSEGV in MMgrReport::encode_payload
Sage Weil
04:06 PM Backport #38341 (Resolved): mimic: pg stuck in backfill_wait with plenty of disk space
https://github.com/ceph/ceph/pull/28201 Nathan Cutler
03:13 PM Bug #38333 (Duplicate): mon crash in AuthMonitor::Incremental::encode buffer code
... Sage Weil
10:53 AM Bug #38322: luminous: mons do not trim maps until restarted
Here's an example on v12.2.8. The mon db is normally trim at around 700MB, but after some backfilling its currently a... Dan van der Ster
02:06 AM Bug #38012: osd bad crc cause the whole cluster stop accepting new request.
Josh Durgin wrote:
> It seems the first step would be reporting the crc mismatches via a perfcounter. Then the mgr c...
frank lin
01:14 AM Backport #38317 (In Progress): mimic: filestore: fsync(2) return value not checked
https://github.com/ceph/ceph/pull/26438 Prashant D
12:56 AM Bug #38325: Code to strip | from core pattern isn't right
I tried openSUSE and it doesn't add back the pipe character when doing sysctl -w, so it should never have been stripp... David Zafman

02/14/2019

11:46 PM Bug #38309 (Fix Under Review): Limit loops waiting for force-backfill/force-recovery to happen
David Zafman
01:00 AM Bug #38309 (Resolved): Limit loops waiting for force-backfill/force-recovery to happen

while loops in qa/standalone/osd/osd-backfill-prio.sh and qa/standalone/osd/osd-recovery-prio.sh can loop until teu...
David Zafman
09:00 PM Bug #38325 (Fix Under Review): Code to strip | from core pattern isn't right
David Zafman
08:57 PM Bug #38325 (Resolved): Code to strip | from core pattern isn't right
David Zafman
07:25 PM Bug #37875: osdmaps aren't being cleaned up automatically on healthy cluster
We have seen the same behavior with luminous and +2500 osds in late 2017. Analyzed with Joao then, but he could not r... Joachim Kraftmayer
06:37 PM Bug #38034 (Pending Backport): pg stuck in backfill_wait with plenty of disk space
David Zafman
04:02 PM Bug #38282 (Resolved): cephtool/test.sh failure in test_mon_osd_pool_set
Kefu Chai
11:58 AM Bug #38282: cephtool/test.sh failure in test_mon_osd_pool_set
/a/kchai-2019-02-14_06:27:37-rados-wip-kefu2-testing-2019-02-14-1156-distro-basic-smithi/3590390 Kefu Chai
03:56 PM Bug #38293 (Duplicate): qa/standalone/osd/osd-backfill-prio.sh failed
David Zafman
01:31 PM Bug #38322 (Closed): luminous: mons do not trim maps until restarted
Reported by several users, most recently at https://marc.info/?l=ceph-devel&m=154955388914036&w=2 Sage Weil
11:23 AM Bug #38320 (Resolved): leak in OSD::ms_handle_authentication()
... Kefu Chai
11:03 AM Backport #38317 (Resolved): mimic: filestore: fsync(2) return value not checked
https://github.com/ceph/ceph/pull/26438 Nathan Cutler
11:02 AM Backport #38316 (Resolved): luminous: filestore: fsync(2) return value not checked
https://github.com/ceph/ceph/pull/26871 Nathan Cutler
09:40 AM Bug #21194: mon clock skew test is fragile
/a/kchai-2019-02-14_06:27:37-rados-wip-kefu2-testing-2019-02-14-1156-distro-basic-smithi/3590540/ Kefu Chai

02/13/2019

11:36 PM Bug #38034 (Fix Under Review): pg stuck in backfill_wait with plenty of disk space
Neha Ojha
11:09 PM Bug #38307 (Resolved): ceph-osd fails to bind to IPv6 interface for public_network

When trying to start ceph-osd configured for IPv6, interface binding fails.
Configure in ceph.conf:
[global]
p...
Jesse Williamson
09:24 PM Bug #38282: cephtool/test.sh failure in test_mon_osd_pool_set
I have a feeling #38283 has the same root cause... Sage Weil
09:02 PM Bug #38282 (Fix Under Review): cephtool/test.sh failure in test_mon_osd_pool_set
https://github.com/ceph/ceph/pull/26413 Sage Weil
08:59 PM Bug #38282: cephtool/test.sh failure in test_mon_osd_pool_set
... Sage Weil
08:19 PM Bug #38293: qa/standalone/osd/osd-backfill-prio.sh failed

This test shouldn't loop forever so that teuthology has to time-out. I'll fix that elsewhere.
The mon received ...
David Zafman
12:37 PM Bug #38293 (Duplicate): qa/standalone/osd/osd-backfill-prio.sh failed
... Sage Weil
06:09 PM Subtask #37731: upgrade/luminous-x - add "require-osd-release nautilus" and clean up
https://github.com/ceph/ceph/pull/26302 Yuri Weinstein
04:49 PM Bug #38306 (New): ceph-mon: "*** Caught signal (Segmentation fault) **" in upgrade:luminous-x-mimic
Run: http://pulpito.ceph.com/teuthology-2019-02-13_02:25:02-upgrade:luminous-x-mimic-distro-basic-smithi/
Job: ['358...
Yuri Weinstein
01:31 PM Bug #38295 (Fix Under Review): luminous->(mimic,nautilus): PGMapDigest decode error on luminous end
fixed by a patch to MMonMgrDigest in https://github.com/ceph/ceph/pull/26389 Sage Weil
01:18 PM Bug #38295: luminous->(mimic,nautilus): PGMapDigest decode error on luminous end
This appears to be broken since mimic, and triggers if you upgrade a mgr before all mons are upgrade.
We call enco...
Sage Weil
12:49 PM Bug #38295 (Resolved): luminous->(mimic,nautilus): PGMapDigest decode error on luminous end
... Sage Weil
12:59 PM Bug #38296 (Resolved): segv in fgets() in collect_sys_info reading /proc/cpuinfo
... Sage Weil
12:48 PM Bug #38294 (Resolved): osd/PG.cc: 6141: FAILED ceph_assert(info.history.same_interval_since != 0)...
... Sage Weil
12:40 PM Bug #38258 (Pending Backport): filestore: fsync(2) return value not checked
Sage Weil
12:40 PM Bug #37910 (Resolved): segv during crc of incoming message front
https://github.com/ceph/ceph/pull/26391 Sage Weil
12:39 PM Bug #38024 (Resolved): segv, heap corruption in ec encode_and_write
https://github.com/ceph/ceph/pull/26391 Sage Weil
12:38 PM Bug #37808: osd: osdmap cache weak_refs assert during shutdown
/a/sage-2019-02-13_00:42:53-rados-wip-sage2-testing-2019-02-12-1700-distro-basic-smithi/3581795 Sage Weil
12:34 PM Bug #24866: FAILED assert(0 == "past_interval start interval mismatch") in check_past_interval_bo...
/a/sage-2019-02-13_00:42:53-rados-wip-sage2-testing-2019-02-12-1700-distro-basic-smithi/3581667
description: rados...
Sage Weil
01:15 AM Bug #23937: FAILED assert(info.history.same_interval_since != 0)
I think it was resolved by this https://github.com/ceph/ceph/pull/20571
and the related issue is http://tracker.ceph...
huang jun

02/12/2019

11:38 PM Bug #38083: mimic: test_kvstore_tool.sh: mkfs failed: (22) Invalid argument
This seems to reliably fail in mimic only with rhel_latest.yaml.
http://pulpito.ceph.com/nojha-2019-02-12_21:14:17...
Neha Ojha
10:51 PM Bug #38283 (Resolved): max-pg-per-osd tests failing
... Sage Weil
10:49 PM Bug #38282 (Resolved): cephtool/test.sh failure in test_mon_osd_pool_set
... Sage Weil
05:47 PM Feature #36737 (Resolved): Allow multi instances of "make tests" on the same machine
Kefu Chai
08:06 AM Feature #36737 (Pending Backport): Allow multi instances of "make tests" on the same machine
Nathan Cutler
05:47 PM Backport #38266 (Resolved): mimic: test: Allow multi instances of "make tests" on the same machine
Kefu Chai
08:07 AM Backport #38266: mimic: test: Allow multi instances of "make tests" on the same machine
h3. original description
Currently it's only possible to run `...make; make tests -j8; ctest ...` on the same mach...
Nathan Cutler
08:04 AM Backport #38266 (In Progress): mimic: test: Allow multi instances of "make tests" on the same mac...
https://github.com/ceph/ceph/pull/26376 Kefu Chai
07:58 AM Backport #38266 (Resolved): mimic: test: Allow multi instances of "make tests" on the same machine
https://github.com/ceph/ceph/pull/26376 Kefu Chai
04:10 PM Backport #38277 (Resolved): mimic: osd_map_message_max default is too high?
https://github.com/ceph/ceph/pull/29242 Nathan Cutler
04:10 PM Backport #38276 (Resolved): luminous: osd_map_message_max default is too high?
https://github.com/ceph/ceph/pull/28640 Nathan Cutler
04:10 PM Backport #38275 (Resolved): mimic: Fix recovery and backfill priority handling
https://github.com/ceph/ceph/pull/27081 Nathan Cutler
04:09 PM Backport #38274 (Resolved): luminous: Fix recovery and backfill priority handling
https://github.com/ceph/ceph/pull/26793 Nathan Cutler
03:32 PM Bug #38040 (Pending Backport): osd_map_message_max default is too high?
Sage Weil
03:10 PM Backport #38096 (Resolved): mimic: doc/rados/configuration: refresh osdmap section
Nathan Cutler
03:05 AM Backport #38096 (In Progress): mimic: doc/rados/configuration: refresh osdmap section
https://github.com/ceph/ceph/pull/26373 Prashant D
03:07 PM Backport #37689 (Resolved): mimic: ceph-objectstore-tool: Add HashInfo to object dump output
Nathan Cutler
12:03 AM Backport #37689: mimic: ceph-objectstore-tool: Add HashInfo to object dump output
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25721
merged
Yuri Weinstein
03:07 PM Backport #37992 (Resolved): mimic: ec pool lost data due to snap clone
Nathan Cutler
12:02 AM Backport #37992: mimic: ec pool lost data due to snap clone
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26077
merged
Yuri Weinstein
03:01 PM Backport #38106 (Resolved): mimic: osd/ECBackend.cc: 1547: FAILED ceph_assert(!(*m).is_missing(ho...
Nathan Cutler
12:00 AM Backport #38106: mimic: osd/ECBackend.cc: 1547: FAILED ceph_assert(!(*m).is_missing(hoid))
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26239
merged
Yuri Weinstein
02:49 PM Bug #27985 (Resolved): force-backfill sets forced_recovery instead of forced_backfill in 13.2.1
Nathan Cutler
02:49 PM Backport #38111 (Resolved): mimic: force-backfill sets forced_recovery instead of forced_backfill...
Nathan Cutler
12:06 PM Bug #23937: FAILED assert(info.history.same_interval_since != 0)
huang jun wrote:
> @rafal what the status of this issue now? did you resolve the problem?
I had to redeploy this ...
Rafal Wadolowski
04:21 AM Bug #23937: FAILED assert(info.history.same_interval_since != 0)
@rafal what the status of this issue now? did you resolve the problem? huang jun
08:02 AM Backport #38073 (Resolved): luminous: build/ops: Allow multi instances of "make tests" on the sam...
Kefu Chai
03:56 AM Bug #38034: pg stuck in backfill_wait with plenty of disk space

I created a simple fix for this scenario in https://github.com/ceph/ceph/pull/20933. The result is probably this s...
David Zafman
02:58 AM Backport #38095 (In Progress): luminous: doc/rados/configuration: refresh osdmap section
https://github.com/ceph/ceph/pull/26372 Prashant D
12:05 AM Bug #36517: client crashes osd with empty object name
Ok, thank you Noah! Much appreciated. I'll have a look at this soon. Jesse Williamson

02/11/2019

09:58 PM Bug #36517: client crashes osd with empty object name
Jesse,
This is still a bug in the latest master. Also, it appears to be worse than before--it seems as though raw ...
Noah Watkins
09:07 PM Backport #38111: mimic: force-backfill sets forced_recovery instead of forced_backfill in 13.2.1
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26324
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
m...
Yuri Weinstein
05:13 PM Bug #38172: segv in rocksdb NewIterator
I'm guessing this is a dup of #38024 Sage Weil
05:11 PM Bug #38258 (Fix Under Review): filestore: fsync(2) return value not checked
https://github.com/ceph/ceph/pull/26366 Sage Weil
02:33 PM Bug #38258 (Resolved): filestore: fsync(2) return value not checked
WBThrottle is the main one, but there are also fsync(2) calls in the write guard code that should be checked. Sage Weil
02:48 PM Bug #24685: config options: possible inconsistency between flag 'can_update_at_runtime' and 'flag...
Yes, I can edit them now. Thanks Nathan :) Tatjana Dehler
02:36 PM Bug #24685: config options: possible inconsistency between flag 'can_update_at_runtime' and 'flag...
@Tatjana - I added you to the "ceph developers" group so you should be able to change Status etc. fields. Nathan Cutler
02:35 PM Bug #24685 (Resolved): config options: possible inconsistency between flag 'can_update_at_runtime...
Nathan Cutler
11:05 AM Bug #24685: config options: possible inconsistency between flag 'can_update_at_runtime' and 'flag...
I retested it and the issue is gone from my point of view. Unfortunately I can't tell which pull request fixed it.
...
Tatjana Dehler
12:35 PM Backport #38256 (Need More Info): luminous: OSD crashes when loading pgs with "FAILED assert(inte...
Nathan Cutler
12:35 PM Backport #38256 (New): luminous: OSD crashes when loading pgs with "FAILED assert(interval.last >...
Sage writes in https://github.com/ceph/ceph/pull/25800
We're having a hard time root causing http://tracker.ceph.c...
Nathan Cutler
12:31 PM Backport #38256 (In Progress): luminous: OSD crashes when loading pgs with "FAILED assert(interva...
Nathan Cutler
12:30 PM Backport #38256 (Duplicate): luminous: OSD crashes when loading pgs with "FAILED assert(interval....
Nathan Cutler
12:30 PM Bug #21142 (Pending Backport): OSD crashes when loading pgs with "FAILED assert(interval.last > l...
Nathan Cutler
03:08 AM Backport #38243 (In Progress): mimic: scrub warning check incorrectly uses mon scrub interval
https://github.com/ceph/ceph/pull/26356 Prashant D
01:15 AM Backport #38240 (In Progress): luminous: radosbench tests hit ENOSPC
https://github.com/ceph/ceph/pull/26355 Prashant D
01:12 AM Backport #38239 (In Progress): mimic: radosbench tests hit ENOSPC
https://github.com/ceph/ceph/pull/26354 Prashant D

02/09/2019

02:13 AM Bug #36739 (Fix Under Review): ENOENT in collection_move_rename on EC backfill target
Neha Ojha
01:49 AM Bug #38195: osd-backfill-space.sh exposes rocksdb hang

Also, seen in http://qa-proxy.ceph.com/teuthology/dzafman-2019-02-07_22:34:38-rados-wip-dzafman-testing3-distro-bas...
David Zafman
01:44 AM Bug #38248 (New): qa/standalone/osd/pg-split-merge.sh TEST_import_after_merge_and_gap() test fails

http://pulpito.ceph.com/dzafman-2019-02-07_22:34:38-rados-wip-dzafman-testing3-distro-basic-smithi/
3564438 356444...
David Zafman
12:42 AM Bug #38041 (Pending Backport): Fix recovery and backfill priority handling
David Zafman
12:39 AM Bug #37393 (Resolved): mimic: osd-backfill-stats.sh fails in rados/standalone/osd.yaml
David Zafman

02/08/2019

10:51 PM Bug #21142 (Resolved): OSD crashes when loading pgs with "FAILED assert(interval.last > last)"
Josh Durgin
09:25 PM Bug #24866: FAILED assert(0 == "past_interval start interval mismatch") in check_past_interval_bo...
Looks like this is still possible to hit:
http://pulpito.ceph.com/nojha-2019-02-08_05:52:40-rados-wip-36739-2019-0...
Josh Durgin
06:11 PM Bug #38212: Rare qa/standalone/osd/osd-markdown.sh mon start-up error

This is not actually causing a test failure. It shows that a test FOR failure is being blocked by this bug.
I t...
David Zafman
04:28 PM Bug #38040 (Fix Under Review): osd_map_message_max default is too high?
* https://github.com/ceph/ceph/pull/26340
* https://github.com/ceph/ceph/pull/26413
* https://github.com/ceph/ceph/...
Sage Weil
03:56 PM Bug #38195: osd-backfill-space.sh exposes rocksdb hang

The workaround was for a specific case but I'm seeing lots more failures in master:
http://pulpito.ceph.com/dzaf...
David Zafman
02:48 PM Backport #38244 (Resolved): luminous: scrub warning check incorrectly uses mon scrub interval
https://github.com/ceph/ceph/pull/26557 Nathan Cutler
02:48 PM Backport #38243 (Resolved): mimic: scrub warning check incorrectly uses mon scrub interval
https://github.com/ceph/ceph/pull/26493 Nathan Cutler
02:47 PM Backport #38240 (Resolved): luminous: radosbench tests hit ENOSPC
https://github.com/ceph/ceph/pull/26355 Nathan Cutler
02:47 PM Backport #38239 (Resolved): mimic: radosbench tests hit ENOSPC
https://github.com/ceph/ceph/pull/26354 Nathan Cutler
02:41 PM Bug #38238 (Duplicate): rados/test.sh: api_aio_pp doesn't seem to start
... Sage Weil
03:11 AM Documentation #23999: osd_recovery_priority is not documented (but osd_recovery_op_priority is)
http://docs.ceph.com/docs/mimic/rados/configuration/osd-config-ref/
Recover op priority is documented here.
Марк Коренберг
02:42 AM Documentation #23999 (In Progress): osd_recovery_priority is not documented (but osd_recovery_op_...
David Zafman

02/07/2019

11:57 PM Bug #36748 (Can't reproduce): ms_deliver_verify_authorizer no AuthAuthorizeHandler found for prot...
Sage Weil
07:19 PM Bug #23031: FAILED assert(!parent->get_log().get_missing().is_missing(soid))
This should be assigned to http://tracker.ceph.com/users/3114 but doesn't show up on assignee list. David Zafman
07:08 PM Bug #37264 (Pending Backport): scrub warning check incorrectly uses mon scrub interval
David Zafman
04:46 PM Bug #36494 (Resolved): Change osd_objectstore default to bluestore
Nathan Cutler
03:36 PM Bug #36494: Change osd_objectstore default to bluestore
@Nathan Let's not backport this to luminous and mimic. Neha Ojha
04:46 PM Backport #37995 (Rejected): luminous: Change osd_objectstore default to bluestore
Nathan Cutler
04:46 PM Backport #37994 (Rejected): mimic: Change osd_objectstore default to bluestore
Nathan Cutler
04:36 PM Bug #37665 (Resolved): ceph-objectstore-tool export from luminous, import to master clears same_i...
Nathan Cutler
04:36 PM Backport #37821 (Resolved): mimic: ceph-objectstore-tool export from luminous, import to master c...
Nathan Cutler
04:31 PM Backport #38111 (In Progress): mimic: force-backfill sets forced_recovery instead of forced_backf...
Nathan Cutler
03:48 AM Bug #38219 (Resolved): rebuild-mondb hangs
http://pulpito.ceph.com/sage-2019-02-06_23:33:50-rados-master-distro-basic-smithi/... Sage Weil

02/06/2019

10:46 PM Backport #38207 (In Progress): luminous: A PG repairing doesn't mean PG is damaged
David Zafman
12:33 PM Backport #38207 (Resolved): luminous: A PG repairing doesn't mean PG is damaged
https://github.com/ceph/ceph/pull/26305 Nathan Cutler
10:44 PM Backport #38208 (In Progress): mimic: A PG repairing doesn't mean PG is damaged
David Zafman
12:33 PM Backport #38208 (Resolved): mimic: A PG repairing doesn't mean PG is damaged
https://github.com/ceph/ceph/pull/26304 Nathan Cutler
10:42 PM Bug #38124: OSD down on snaptrim.
I was theorizing in a bug scrub that maybe the PG was running behind on OSDMaps and so missing the nosnaptrim flag up... Greg Farnum
10:15 PM Bug #38024: segv, heap corruption in ec encode_and_write
related? submit_transaction and bufferlist::rebuild()...
/a/sage-2019-02-06_15:56:08-rados-wip-sage-testing-2019-...
Sage Weil
10:09 PM Bug #38198 (Duplicate): ceph-mon sometimes fails to start (only seen in odd-markdown.sh)
Neha Ojha
10:06 PM Bug #38195 (Resolved): osd-backfill-space.sh exposes rocksdb hang
Neha Ojha
04:44 PM Bug #38195: osd-backfill-space.sh exposes rocksdb hang
Workaround merged, so changed priority from Urgent to High. David Zafman
10:01 PM Bug #37804 (Closed): "monmaptool: too many arguments" in perf siute
Seems better now http://pulpito.ceph.com/teuthology-2019-01-25_03:57:03-perf-basic-master-distro-basic-smithi/ Yuri Weinstein
09:37 PM Backport #37821: mimic: ceph-objectstore-tool export from luminous, import to master clears same_...
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25856
merged
Yuri Weinstein
09:29 PM Bug #37808: osd: osdmap cache weak_refs assert during shutdown
/a/sage-2019-02-06_15:56:42-rados-wip-msgr2-peer-addr-distro-basic-smithi/3557216
rados/singleton-flat/valgrind-le...
Sage Weil
09:12 PM Bug #37797 (Pending Backport): radosbench tests hit ENOSPC
looks like we are hitting this in mimic as well: /a/yuriw-2019-02-06_16:30:03-rados-wip-yuri4-testing-2019-02-05-1539... Neha Ojha
08:59 PM Feature #38215 (New): Add bulk operation (--op bulk) to ceph-objectstore-tool

Instead of adding an individual bulk operation for rm-omap like in https://github.com/ceph/ceph/pull/22379, I sugge...
David Zafman
07:58 PM Bug #37393 (In Progress): mimic: osd-backfill-stats.sh fails in rados/standalone/osd.yaml
David Zafman
06:15 PM Bug #38041 (Fix Under Review): Fix recovery and backfill priority handling
Neha Ojha
04:42 PM Bug #38027 (Resolved): osd/osd-backfill-space.sh fails
David Zafman
04:38 PM Bug #38212 (New): Rare qa/standalone/osd/osd-markdown.sh mon start-up error

http://pulpito.ceph.com/dzafman-2019-02-05_11:42:47-rados-wip-zafman-testing2-distro-basic-smithi/3553445
It hap...
David Zafman
12:45 PM Bug #37618 (Resolved): Command failed on smithi191 with status 1: '\n sudo yum -y install ceph-ra...
Nathan Cutler
12:45 PM Backport #37688 (Resolved): mimic: Command failed on smithi191 with status 1: '\n sudo yum -y ins...
Nathan Cutler
04:09 AM Backport #37688: mimic: Command failed on smithi191 with status 1: '\n sudo yum -y install ceph-r...
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26201
merged
Yuri Weinstein
12:44 PM Bug #36686 (Resolved): osd: pg log hard limit can cause crash during upgrade
Nathan Cutler
12:44 PM Backport #37902 (Resolved): mimic: osd: pg log hard limit can cause crash during upgrade
Nathan Cutler
04:08 AM Backport #37902: mimic: osd: pg log hard limit can cause crash during upgrade
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/26206
merged
Yuri Weinstein
12:33 PM Backport #38206 (Resolved): mimic: osds allows to partially start more than N+2
https://github.com/ceph/ceph/pull/29241 Nathan Cutler
12:33 PM Backport #38205 (Resolved): luminous: osds allows to partially start more than N+2
https://github.com/ceph/ceph/pull/31858 Nathan Cutler
11:02 AM Bug #38076 (Pending Backport): osds allows to partially start more than N+2
Kefu Chai
09:02 AM Bug #37404 (Resolved): OSD mkfs might assert when working agains bluestore disk that already has ...
Igor Fedotov
08:57 AM Backport #37496 (Resolved): mimic: OSD mkfs might assert when working agains bluestore disk that ...
Igor Fedotov
04:09 AM Backport #37496: mimic: OSD mkfs might assert when working agains bluestore disk that already has...
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/25385
merged
Yuri Weinstein
01:04 AM Documentation #23999: osd_recovery_priority is not documented (but osd_recovery_op_priority is)
I don't see osd_recovery_op_priority documentation, so I propose adding these lines to doc/rados/configuration/pool-p... David Zafman

02/05/2019

11:27 PM Bug #38195: osd-backfill-space.sh exposes rocksdb hang

https://github.com/ceph/ceph/pull/26290 has a workaround for this issue.
David Zafman
07:03 PM Bug #38195: osd-backfill-space.sh exposes rocksdb hang

After adding code to send a SEGV on kill_daemon timeout I got the following stack traces....
David Zafman
07:01 PM Bug #38195 (New): osd-backfill-space.sh exposes rocksdb hang

After increasing the timeout for backfills finish for http://tracker.ceph.com/issues/38027 we see this kill_daemons...
David Zafman
11:22 PM Bug #38198 (Duplicate): ceph-mon sometimes fails to start (only seen in odd-markdown.sh)

http://pulpito.ceph.com/dzafman-2019-02-05_11:42:47-rados-wip-zafman-testing2-distro-basic-smithi/3553445
<pre...
David Zafman
11:17 PM Bug #38070 (Pending Backport): A PG repairing doesn't mean PG is damaged
David Zafman
07:04 PM Bug #38011 (Closed): [Mimic version]extra null list in json output of command: ceph osd crush tre...
Noah Watkins
06:32 PM Bug #38011: [Mimic version]extra null list in json output of command: ceph osd crush tree --forma...
Looks like this was from running an old monitor, and should be fixed in newer release. Noah Watkins
04:56 PM Bug #37886 (Resolved): Adding back the IOPS line for client and recovery IO in cluster logs
Nathan Cutler
04:48 PM Bug #38184 (New): osd: recovery does not preserve copy-on-write allocations between object clones...
Hi. I've already reported it in issue 36614, but here is a more concrete case.
- Start with a bluestore Ceph clust...
Vitaliy Filippov
04:22 PM Backport #38140 (In Progress): luminous: Add hashinfo testing for dump command of ceph-objectstor...
Nathan Cutler
04:20 PM Backport #38141 (In Progress): mimic: Add hashinfo testing for dump command of ceph-objectstore-tool
Nathan Cutler

02/04/2019

10:47 PM Bug #38027: osd/osd-backfill-space.sh fails

dzafman-2019-02-04_11:24:54-rados-wip-zafman-testing2-distro-basic-smithi/3549933
Before mon shutdowns it appear...
David Zafman
10:23 PM Bug #38124: OSD down on snaptrim.
Hello,
I have collected additional information Sage asked. Attached log has debug_osd=20 set.
How this happ...
Darius Kasparavičius
08:49 PM Backport #38107 (Resolved): mimic: Adding back the IOPS line for client and recovery IO in cluste...
https://github.com/ceph/ceph/pull/26208 Neha Ojha
08:47 PM Bug #37886: Adding back the IOPS line for client and recovery IO in cluster logs
merged https://github.com/ceph/ceph/pull/26208 Yuri Weinstein
08:04 PM Bug #38172 (New): segv in rocksdb NewIterator
... Sage Weil
07:58 PM Bug #37393: mimic: osd-backfill-stats.sh fails in rados/standalone/osd.yaml
/a/yuriw-2019-02-02_14:56:39-rados-wip-yuri4-testing-2019-01-31-2315-mimic-distro-basic-smithi/3542409/ Neha Ojha
07:55 PM Bug #38083: mimic: test_kvstore_tool.sh: mkfs failed: (22) Invalid argument
/a/yuriw-2019-02-02_14:56:39-rados-wip-yuri4-testing-2019-01-31-2315-mimic-distro-basic-smithi/3542404/ Neha Ojha
06:09 PM Backport #38108 (Resolved): luminous: Adding back the IOPS line for client and recovery IO in clu...
https://github.com/ceph/ceph/pull/26207 Neha Ojha
11:22 AM Backport #38163 (Resolved): mimic: maybe_remove_pg_upmaps incorrectly cancels valid pending upmaps
Included in https://github.com/ceph/ceph/pull/27963 Nathan Cutler
11:22 AM Backport #38162 (Resolved): luminous: maybe_remove_pg_upmaps incorrectly cancels valid pending up...
https://github.com/ceph/ceph/pull/26127 Nathan Cutler
05:50 AM Bug #38159 (New): ec does not recover below min_size
... Sage Weil
05:26 AM Bug #17257: ceph_test_rados_api_lock fails LibRadosLockPP.LockExclusiveDurPP
/a/sage-2019-02-03_18:58:17-rados-wip-sage2-testing-2019-02-03-1047-distro-basic-smithi/3545716
Sage Weil
 

Also available in: Atom