Activity

From 02/06/2020 to 03/06/2020

10:13 PM Bug #44362 (In Progress): osd: uninitialized memory in sendmsg: Sage Weil
03:15 AM Bug #44362: osd: uninitialized memory in sendmsg: It seems to me that the specific commit just exposed an existing issue that for some reason did't show up before (lik... Yehuda Sadeh
07:23 PM Bug #44400 (Won't Fix): Marking OSD out causes primary-affinity 0 to be ignored when up_set has n...: Process:
Set primary-affinity 0 on osd.0
Watch 'ceph osd ls-by-primary osd.0' until it has 0 PGs listed.
Mark os... Wes Dillingham
07:12 PM Bug #43150: osd-scrub-snaps.sh fails: https://github.com/ceph/ceph/pull/33274 merged Yuri Weinstein
04:09 PM Bug #43365 (Fix Under Review): Nautilus: Random mon crashes in failed assertion at ceph::time_det...: Sage Weil
12:58 PM Bug #43365: Nautilus: Random mon crashes in failed assertion at ceph::time_detail::signedspan: Hi,
same behaviour for us: one of the 3 mons crashes randomly, nearly once per day.
We are using Ceph 14.2.6 PVE ... David DELON
04:09 PM Bug #44311: crash in Objecter and CRUSH map lookup: Is this something that started appearing recently? Do you have a commit or version that works for this same command? ... Neha Ojha
02:48 PM Bug #44184: Slow / Hanging Ops after pool creation: We've got similar case with a plenty of slow op indications many of them are osd_op_create ones.
Which eventually g... Igor Fedotov
12:34 AM Bug #44388 (New): osd: valgrind: Invalid read of size 8: ... Patrick Donnelly

11:30 PM Bug #44022 (Fix Under Review): mimic: Receiving MLogRec in Started/Primary/Peering/GetInfo causes...: In any case, https://github.com/ceph/ceph/pull/33590 will just prevent it from crashing. Neha Ojha
11:22 PM Bug #44022: mimic: Receiving MLogRec in Started/Primary/Peering/GetInfo causes an osd crash: The part that I don't understand is when osd.6 responded, the epoch_sent/epoch_requested(4115/4100) seem correct
<... Neha Ojha
03:45 AM Bug #44022: mimic: Receiving MLogRec in Started/Primary/Peering/GetInfo causes an osd crash: On osd.8(mimic)
This is when we request the log from osd.6... Neha Ojha
02:29 AM Bug #44022: mimic: Receiving MLogRec in Started/Primary/Peering/GetInfo causes an osd crash: ... Neha Ojha
09:50 PM Support #22749 (Closed): dmClock OP classification: J. Eric Ivancich
09:11 PM Bug #42328 (Resolved): osd/PrimaryLogPG.cc: 3962: ceph_abort_msg("out of order op"): Jason Dillaman
06:22 PM Backport #43472 (Resolved): mimic: negative num_objects can set PG_STATE_DEGRADED: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33331
m... Nathan Cutler
06:21 PM Backport #43320 (Resolved): mimic: PeeringState::GoClean will call purge_strays unconditionally: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33329
m... Nathan Cutler
06:20 PM Backport #42998 (Resolved): mimic: acting_recovery_backfill won't catch all up peers: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33324
m... Nathan Cutler
06:20 PM Backport #42852 (Resolved): mimic: format error: ceph osd stat --format=json: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33322
m... Nathan Cutler
06:18 PM Backport #43881 (Resolved): mimic: mon: segv in MonOpRequest::~MonOpRequest OpHistory::cleanup: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33154
m... Nathan Cutler
06:18 PM Backport #43987 (Resolved): mimic: osd: Allow 64-char hostname to be added as the "host" in CRUSH: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33145
m... Nathan Cutler
06:17 PM Backport #43652 (Resolved): mimic: Improve upmap change reporting in logs: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/32717
m... Nathan Cutler
06:17 PM Backport #40890 (Resolved): mimic: Pool settings aren't populated to OSD after restart.: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/32125
m... Nathan Cutler
06:16 PM Backport #42879 (Resolved): mimic: ceph_test_admin_socket_output fails in rados qa suite: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33323
m... Nathan Cutler
06:16 PM Backport #43630 (Resolved): mimic: segv in collect_sys_info: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/32902
m... Nathan Cutler
04:16 PM Bug #39525 (Fix Under Review): lz4 compressor corrupts data when buffers are unaligned: Thanks to Dan we have a reproducer! I cleaned it up a bit, rebased on master, added a workaround to the LZ4 plugin, ... Sage Weil
03:44 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: No, not positive. Very early on we did play around with compression also for the metadata, but in the end decided lat... Erik Lindahl
03:26 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: Erik Lindahl wrote:
> Hi,
>
> Oops; Sorry Dan, but I just realised I misled you. While we do have aggressive LZ4 ... Dan van der Ster
10:57 AM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: Hi,
Oops; Sorry Dan, but I just realised I misled you. While we do have aggressive LZ4 enabled by *default* (in pa... Erik Lindahl
10:34 AM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: I got confirmation from Troy and Erik -- both are using lz4 compression like us.
I'm trying to reproduce using uni... Dan van der Ster
12:55 PM Backport #44324 (Resolved): nautilus: Receiving RemoteBackfillReserved in WaitLocalBackfillReserv...: https://github.com/ceph/ceph/pull/34512 Nathan Cutler

04:47 PM Bug #44248 (Resolved): Receiving RemoteBackfillReserved in WaitLocalBackfillReserved can cause th...: ... Neha Ojha
01:25 PM Backport #44206: nautilus: osd segv in ceph::buffer::v14_2_0::ptr::release (PGTempMap::decode): Started a backport here https://github.com/ceph/ceph/pull/33483 Dan van der Ster
09:49 AM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: > o->decode(obl); <------ HERE
I have gdb working now on a coredump so can confirm that:... Dan van der Ster
01:00 AM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: ^^ Is a weird red-herring. The FFFFFFFF is because the osdmap contains the crc32c in the last 4 bytes, so that cancel... Dan van der Ster
01:23 AM Bug #43914: nautilus: ceph tell command times out: This is on nautilus: /a/nojha-2020-02-21_20:34:10-upgrade:mimic-x:stress-split-nautilus-distro-basic-smithi/4788575/
... Neha Ojha
01:14 AM Bug #44062: LibRadosWatchNotify.WatchNotify failure: /a/sage-2020-02-21_21:08:33-rados-wip-sage3-testing-2020-02-21-1218-distro-basic-smithi/4788714... Sage Weil

10:48 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: Found something. The crc32c for all my *good* maps is FFFFFFFF (and I assure you they are different maps.. gsutil out... Dan van der Ster
10:16 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: Just to provide the same update I gave to Dan van der Ster over email:
IIRC, we saw this 1-2 times more after the ... Erik Lindahl
09:42 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: This is continuing to happen for us. Log file here.
ceph-post-file: 589aa7aa-7a80-49a2-ba55-376e467c4550 Troy Ablan
10:19 PM Bug #42830: problem returning mon to cluster: Seeing the same here in 13.2.8 starting a new empty mon. Leader's CPU goes to 100%, until an election is called then ... Dan van der Ster
09:03 PM Bug #44243 (Can't reproduce): memstore make check test fails: ... Sage Weil
01:29 PM Bug #42328 (New): osd/PrimaryLogPG.cc: 3962: ceph_abort_msg("out of order op"): It looks like this is still occurring even with a branch that included 8182f52149: http://qa-proxy.ceph.com/teutholo... Jason Dillaman
01:21 PM Bug #42347: nautilus assert during osd shutdown: FAILED ceph_assert((sharded_in_flight_list.back(...: Bastian Mäuser wrote:
> This is still an issue on 14.2.6 (at least the one shipped with proxmox)
It will appear i... Sage Weil
12:49 AM Bug #41240: All of the cluster SSDs aborted at around the same time and will not start.: FTR this looks identical to https://tracker.ceph.com/issues/39525#note-6 Dan van der Ster
12:25 AM Bug #44062: LibRadosWatchNotify.WatchNotify failure: So the timeout, as previously mentioned, was 10 seconds although osd_default_notify_timeout is 30 seconds by default.... Brad Hubbard

07:02 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: ok, the first crash isn't becuase we just got bad data.. it's because we just read bad data off of disk. see:... Sage Weil
04:09 PM Bug #39525: lz4 compressor corrupts data when buffers are unaligned: Notes from CERN incident:
- identical corruption, different OSDmaps on different OSDs:... Sage Weil
05:40 PM Bug #44229 (New): monclient: _check_auth_rotating possible clock skew, rotating keys expired way ...: seems to affect cephadm bootstrap tests
first, the error message doesn't make sense, since the bound 2020-02-20T16... Sage Weil
12:20 PM Bug #44184: Slow / Hanging Ops after pool creation: Neha Ojha wrote:
> Hi Wido,
>
> I did come across something like this while investigating https://tracker.ceph.co... Wido den Hollander
12:42 AM Bug #44217 (Can't reproduce): Leaked connection (alloc from AsyncMessenger::add_accept): ... Brad Hubbard

11:42 PM Bug #44076 (Fix Under Review): mon: update + monmap update triggers spawn loop: Sage Weil
10:45 PM Bug #44157 (Resolved): cli throws bad exceptoin on control-c: Sage Weil
10:11 PM Bug #44120 (Need More Info): NVMEDevice failed in certain NVMe Disk: Can you attach logs from the crash? Which version are using? Neha Ojha
10:08 PM Bug #44184 (Need More Info): Slow / Hanging Ops after pool creation: Hi Wido,
I did come across something like this while investigating https://tracker.ceph.com/issues/43048. It was a... Neha Ojha
07:18 PM Bug #44184: Slow / Hanging Ops after pool creation: On the Ceph users list there are multiple reports of people experiencing this:
- https://www.spinics.net/lists/cep... Wido den Hollander
04:55 PM Bug #37656 (New): FileStore::_do_transaction() crashed with error 17 (merge collection vs osd res...: /a/teuthology-2020-02-11_02:30:03-upgrade:mimic-x-nautilus-distro-basic-smithi/4753470/
upgrade:mimic-x/stress-spl... Neha Ojha
11:00 AM Bug #43151 (Resolved): ok-to-stop incorrect for some ec pgs: While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are ... Nathan Cutler
11:00 AM Bug #43721 (Resolved): qa/standalone/misc/ok-to-stop.sh occasionally fails: While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are ... Nathan Cutler
10:59 AM Backport #44206 (Resolved): nautilus: osd segv in ceph::buffer::v14_2_0::ptr::release (PGTempMap:...: https://github.com/ceph/ceph/pull/33530 Nathan Cutler

07:55 PM Bug #43903 (Pending Backport): osd segv in ceph::buffer::v14_2_0::ptr::release (PGTempMap::decode): Sage Weil
07:52 PM Bug #44062: LibRadosWatchNotify.WatchNotify failure: ... Sage Weil
04:43 PM Bug #44184 (Need More Info): Slow / Hanging Ops after pool creation: On a cluster with 1405 OSDs I've ran into a situation for the second time now where a pool creation resulted into mas... Wido den Hollander
10:28 AM Backport #44085 (Resolved): nautilus: rebuild-mondb doesn't populate mgr commands -> pg dump EINVAL: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33278
m... Nathan Cutler
10:28 AM Backport #44082 (Resolved): nautilus: expected MON_CLOCK_SKEW but got none: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33276
m... Nathan Cutler
10:27 AM Backport #43772 (Resolved): nautilus: qa/standalone/misc/ok-to-stop.sh occasionally fails: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/32844
m... Nathan Cutler
10:27 AM Backport #43239 (Resolved): nautilus: ok-to-stop incorrect for some ec pgs: This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/32844
m... Nathan Cutler

11:55 PM Feature #44025: Make it harder to set pool replica size to 1: Neha Ojha wrote:
> Setting pool size to 1 is dangerous. Add an option like yes_i_really_really_mean_it, similar to w... Neha Ojha
11:50 PM Feature #44025 (Resolved): Make it harder to set pool replica size to 1: Setting pool size to 1 is dangerous. Add an option like yes_i_really_really_mean_it, similar to what we have for pool... Neha Ojha
11:53 PM Bug #44024 (Fix Under Review): change in utime_t rendering ('T' separator) conflicts with cache t...: Sage Weil
11:26 PM Bug #44024 (Resolved): change in utime_t rendering ('T' separator) conflicts with cache tiering h...: crash like... Sage Weil
06:15 PM Bug #44022 (Resolved): mimic: Receiving MLogRec in Started/Primary/Peering/GetInfo causes an osd ...: The crash happens on a mimic OSD. Telemetry crash reports have been reporting similar crashes in 14.2.4(may or may no... Neha Ojha
12:50 PM Bug #44015 (New): Cant compile src/tools/rados/rados.cc on 32 bit systems: On my machine size_t is unsigned int. This causes an overflow in src/tools/rados/rados.cc:776: max_obj_len = 5ull * 1... Stefan Bischoff
04:48 AM Bug #43048: nautilus: upgrade/mimic-x/stress-split: failed to recover before timeout expired: For all log entries of all OSDs at 2020-01-28 03:18 with pg[ information and osd primary these are the log lines th... David Zafman
03:26 AM Bug #43048: nautilus: upgrade/mimic-x/stress-split: failed to recover before timeout expired: From mgr.x's log after the last time pg_stats are received we see ... Neha Ojha
03:42 AM Bug #44004: "ceph" command crashes: not reproducible in my testbed. Kefu Chai
03:36 AM Bug #44004: "ceph" command crashes: Sometimes the "ceph" command fails with a segmentation fault, here is the core_backtrace. It seems that it has someth... Xuehan Xu
02:59 AM Bug #44004 (Can't reproduce): "ceph" command crashes: On the most recent master, after building, I ran the command "./bin/ceph -s --connect-timeout 1 -c /home/xuxuehan/cep... Xuehan Xu
01:37 AM Feature #42638 (Fix Under Review): Allow specifying pg_autoscale_mode when creating a new pool: Neha Ojha

« Previous

Also available in: Atom

Ceph » RADOS

Activity

Project

General

Profile

Ceph » RADOS

Activity

Activity

03/06/2020

03/05/2020

03/04/2020

03/03/2020

03/02/2020

03/01/2020

02/29/2020

02/28/2020

02/27/2020

02/26/2020

02/25/2020

02/24/2020

02/23/2020

02/22/2020

02/21/2020

02/20/2020

02/19/2020

02/18/2020

02/17/2020

02/16/2020

02/15/2020

02/14/2020

02/13/2020

02/12/2020

02/11/2020

02/10/2020

02/09/2020

02/08/2020

02/07/2020

02/06/2020