General

Profile

Brad Hubbard's activity

From 07/15/2019 to 08/13/2019

08/13/2019

10:44 AM Messengers Bug #40026: segfaults in ProtocolV2::write_message()
OK, I think I see what's happening here. I'll write it up and work out a PR when I get a chance. Basically, when we c... Brad Hubbard
09:35 AM Messengers Bug #40026: segfaults in ProtocolV2::write_message()
I managed to reproduce this rerunning the job from #41214 after three or four repetitions. The coredump is similar bu... Brad Hubbard
04:40 AM Messengers Bug #40026: segfaults in ProtocolV2::write_message()
Thread 3 is shutting down the mon client.... Brad Hubbard
02:20 AM Messengers Bug #40026: segfaults in ProtocolV2::write_message()
We are in a block that checks whether session_stream_handlers.tx is valid so I'm going to assume for now that this is... Brad Hubbard
02:14 AM Messengers Bug #40026: segfaults in ProtocolV2::write_message()
We obtain the value for %rdi from an object at the address of %r15.... Brad Hubbard
01:28 AM Messengers Bug #40026: segfaults in ProtocolV2::write_message()
From the instance in #41214... Brad Hubbard
01:25 AM RADOS Bug #41214 (Duplicate): Segmentation fault in mon/test_config_key_caps.sh
Brad Hubbard

08/12/2019

08:23 AM Ceph Revision 4b0bdb4c (ceph): luminous: tests: Convert to boost::regex and add blocking scrub
Convert lazy_omap_stats_test to boost::regex since std::regex is not
fully implemented in the C++ libs used to compil...
Brad Hubbard

08/07/2019

05:42 AM Ceph Revision 4c2150d9 (ceph): luminous: osd: Implement lazy omap usage statistics
Opportunistic gathering of omap statistics during deep scrub.
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(che...
Brad Hubbard
05:42 AM Ceph Revision ad6b3234 (ceph): luminous: tests: Add test for lazy omap stat collection
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 88e9ca58a06ba572ff4c6f6125a8ba7f8e0a7795)
Brad Hubbard
05:42 AM Ceph Revision be2db0f3 (ceph): luminous: osd: Modify lazy omap stats to only show one copy
Only show stats from the primary to get more in line with other pg stats
representations.
Signed-off-by: Brad Hubbar...
Brad Hubbard
12:02 AM RADOS Bug #40765 (In Progress): mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/m...
Brad Hubbard

08/06/2019

03:07 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
Correcting my statement in comment #12.... Brad Hubbard

08/05/2019

06:44 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
I was discussing this with Josh Durgin and he noticed the reuse of the bufferlist for the read and mentioned we'd had... Brad Hubbard

08/02/2019

11:34 PM teuthology Bug #14500: "Error reading SSH protocol banner" in rados-infernalis-distro-basic-openstack
A note to anyone seeing this currently. "Error reading SSH protocol banner" is kind of a catch-all error for paramiko... Brad Hubbard

08/01/2019

05:41 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
Simplified test case.... Brad Hubbard
03:42 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
Ok, slowly closing in on this I think.... Brad Hubbard

07/31/2019

12:58 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
Client:... Brad Hubbard

07/30/2019

11:40 PM RADOS Backport #40744 (Resolved): nautilus: core: lazy omap stat collection
Brad Hubbard

07/26/2019

10:18 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
I dumped out the log (500 lines, attached) almost exclusively this sequence so we're not communicating with osd.3.
...
Brad Hubbard
06:58 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
Looking at a live process it doesn't seem to be a deadlock or "hang" but more like some sort of livelock where the 'm... Brad Hubbard
06:29 AM RADOS Bug #40765: mimic: "Command failed (workunit test rados/test.sh)" in smoke/master/mimic
Still working on this but steps to reproduce...... Brad Hubbard
05:01 AM Ceph Bug #40926 (Duplicate): "Command failed (workunit test rados/test.sh)" in rados
... Brad Hubbard

07/24/2019

08:17 AM RADOS Bug #40835: OSDCap.PoolClassRNS test aborts
Brad Hubbard
04:55 AM Ceph Bug #40916 (New): run-cli-tests: env-vs-args.t fails
... Brad Hubbard

07/23/2019

04:37 AM RADOS Backport #38551 (In Progress): luminous: core: lazy omap stat collection
https://github.com/ceph/ceph/pull/29190 Brad Hubbard
03:53 AM Ceph Revision 58ff13d3 (ceph): mimic: tests: Add test for lazy omap stat collection
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 88e9ca58a06ba572ff4c6f6125a8ba7f8e0a7795)
Brad Hubbard
03:53 AM Ceph Revision 96666445 (ceph): mimic: osd: Modify lazy omap stats to only show one copy
Only show stats from the primary to get more in line with other pg stats
representations.
Signed-off-by: Brad Hubbar...
Brad Hubbard
03:53 AM Ceph Revision b535be0a (ceph): mimic: osd: Implement lazy omap usage statistics
Opportunistic gathering of omap statistics during deep scrub.
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(che...
Brad Hubbard
03:44 AM RADOS Backport #38552 (In Progress): mimic: core: lazy omap stat collection
https://github.com/ceph/ceph/pull/29189 Brad Hubbard
03:14 AM RADOS Backport #40744 (In Progress): nautilus: core: lazy omap stat collection
Nautilus only requires https://github.com/ceph/ceph/pull/28070 as it already has https://github.com/ceph/ceph/pull/26... Brad Hubbard
03:08 AM Ceph Revision 0cc014f0 (ceph): osd: Modify lazy omap stats to only show one copy
Only show stats from the primary to get more in line with other pg stats
representations.
Signed-off-by: Brad Hubbar...
Brad Hubbard
03:08 AM Ceph Revision 565ac08c (ceph): tests: Add test for lazy omap stat collection
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
(cherry picked from commit 88e9ca58a06ba572ff4c6f6125a8ba7f8e0a7795)
Brad Hubbard

07/22/2019

04:03 AM RADOS Bug #40835 (New): OSDCap.PoolClassRNS test aborts
Brad Hubbard
02:59 AM RADOS Bug #40835 (Can't reproduce): OSDCap.PoolClassRNS test aborts
Brad Hubbard
12:01 AM RADOS Bug #40835: OSDCap.PoolClassRNS test aborts
... Brad Hubbard
12:00 AM RADOS Bug #40835 (Resolved): OSDCap.PoolClassRNS test aborts
... Brad Hubbard

07/19/2019

10:46 AM RADOS Bug #24835: osd daemon spontaneous segfault
Thanks for the response Soenke. If we haven't seen it again in a few months time I guess we can close this. Brad Hubbard
02:42 AM RADOS Bug #24835: osd daemon spontaneous segfault
Soenke or Christian,
Are you still seeing this issue?
Brad Hubbard
02:38 AM RADOS Bug #36250 (Can't reproduce): ceph-osd process crashing
Brad Hubbard
02:36 AM RADOS Bug #38892: /ceph/src/tools/kvstore_tool.cc:266:1: internal compiler error: Segmentation fault
Brad Hubbard

07/18/2019

04:03 AM RADOS Bug #40410: ceph pg query Segmentation fault in 12.2.10
I understand, thanks Han. Brad Hubbard

07/17/2019

04:50 AM RADOS Bug #40410: ceph pg query Segmentation fault in 12.2.10
Brad Hubbard
04:49 AM RADOS Bug #40410: ceph pg query Segmentation fault in 12.2.10
qingbo han wrote:
> hi Brad Hubbard:
> I think your theory is correct. I run ceph pg query correctly when I uli...
Brad Hubbard

07/16/2019

04:28 AM RADOS Bug #40410: ceph pg query Segmentation fault in 12.2.10
Hello Han,
Many thanks to Radoslaw Zarzynski for the fruitful discussion we had regarding this issue last night. I...
Brad Hubbard

07/15/2019

01:29 AM RADOS Bug #40410: ceph pg query Segmentation fault in 12.2.10
Still looking into this. The issue in the new core is the same as the original coredump. Brad Hubbard
 

Also available in: Atom