Bug #9211: osdmap blacklist encoding order is nondeterministic - Ceph - Ceph

Actions

Copy link

Bug #9211

closed

osdmap blacklist encoding order is nondeterministic

Added by Sage Weil over 9 years ago. Updated over 9 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Sage Weil

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

firefly

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

remote/mira072/log/ceph.log.gz:2014-08-23 12:01:03.721984 mon.0 10.214.133.120:6789/0 53 : [ERR]  mon.0 ScrubResult(keys {auth=44,logm=683,mdsmap=25,monmap=3,osdmap=25,pgmap=315,pgmap_meta=6,pgmap_osd=4,pgmap_pg=528} crc {auth=4209285804,logm=2238267865,mdsmap=2767932129,monmap=653474887,osdmap=2545043410,pgmap=31513418,pgmap_meta=3419943079,pgmap_osd=989743183,pgmap_pg=4085051609})
remote/mira072/log/ceph.log.gz:2014-08-23 12:01:03.722006 mon.0 10.214.133.120:6789/0 54 : [ERR]  mon.2 ScrubResult(keys {auth=44,logm=683,mdsmap=25,monmap=3,osdmap=25,pgmap=315,pgmap_meta=6,pgmap_osd=4,pgmap_pg=528} crc {auth=4209285804,logm=2238267865,mdsmap=2767932129,monmap=653474887,osdmap=1415955463,pgmap=31513418,pgmap_meta=3419943079,pgmap_osd=989743183,pgmap_pg=4085051609})
ubuntu@teuthology:/a/teuthology-2014-08-22_23:08:02-kcephfs-master-testing-basic-multi/444478$

Actions

Copy link

Updated by Sage Weil over 9 years ago

Subject changed from mon scrub mismatch to osdmap blacklist encoding order is nondeterministic
Status changed from New to In Progress
Backport set to firefly

flab:444478 05:51 PM $ diff -u /tmp/[ab]
--- /tmp/a    2014-08-25 17:51:16.806511139 -0700
+++ /tmp/b    2014-08-25 17:51:19.754271767 -0700
@@ -14,8 +14,8 @@
 osd.2 up   in  weight 1 up_from 4 up_thru 6 down_at 0 last_clean_interval [0,0) 10.214.134.104:6800/8166 10.214.134.104:6801/8166 10.214.134.104:6802/8166 10.214.134.104:6803/8166 exists,up 4bd9551b-8fae-4e0a-90d4-5caff367f489
 osd.3 up   in  weight 1 up_from 4 up_thru 6 down_at 0 last_clean_interval [0,0) 10.214.134.104:6805/8167 10.214.134.104:6806/8167 10.214.134.104:6807/8167 10.214.134.104:6808/8167 exists,up 7ef3a19c-3b7f-4827-9257-be5c5919dc35

-blacklist 10.214.133.120:6811/8270 expires 2014-08-23 12:23:03.822850
 blacklist 10.214.133.120:6810/8270 expires 2014-08-23 12:21:08.017007
+blacklist 10.214.133.120:6811/8270 expires 2014-08-23 12:23:03.822850
 blacklist 10.214.134.104:6811/8440 expires 2014-08-23 12:24:15.290762
 blacklist 10.214.133.120:6812/8270 expires 2014-08-23 12:33:18.524793
 blacklist 10.214.134.104:6810/8440 expires 2014-08-23 12:21:38.815838

Actions

Copy link