Project

General

Profile

Bug #12973

failed to encode map e428 with expected crc

Added by Sage Weil almost 5 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
hammer
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

I saw this on a non-upgrade run. Several consecutive maps failed on all osds:

2015-09-06 10:02:04.248680 osd.0 10.214.131.116:6800/15033 8 : cluster [WRN] failed to encode map e430 with expected crc
2015-09-06 10:02:08.031573 osd.0 10.214.131.116:6800/15033 9 : cluster [WRN] failed to encode map e431 with expected crc
2015-09-06 10:02:08.031573 osd.0 10.214.131.116:6800/15033 9 : cluster [WRN] failed to encode map e431 with expected crc
2015-09-06 10:02:08.031573 osd.0 10.214.131.116:6800/15033 9 : cluster [WRN] failed to encode map e431 with expected crc
2015-09-06 10:02:09.034509 osd.0 10.214.131.116:6800/15033 10 : cluster [WRN] failed to encode map e432 with expected crc
2015-09-06 10:02:09.034509 osd.0 10.214.131.116:6800/15033 10 : cluster [WRN] failed to encode map e432 with expected crc
2015-09-06 10:02:09.034509 osd.0 10.214.131.116:6800/15033 10 : cluster [WRN] failed to encode map e432 with expected crc
2015-09-06 10:02:09.035914 osd.1 10.214.131.116:6807/15134 3 : cluster [WRN] failed to encode map e428 with expected crc
2015-09-06 10:02:09.035914 osd.1 10.214.131.116:6807/15134 3 : cluster [WRN] failed to encode map e428 with expected crc
2015-09-06 10:02:09.035914 osd.1 10.214.131.116:6807/15134 3 : cluster [WRN] failed to encode map e428 with expected crc
2015-09-06 10:02:10.056499 osd.0 10.214.131.116:6800/15033 11 : cluster [WRN] failed to encode map e433 with expected crc
2015-09-06 10:02:10.056499 osd.0 10.214.131.116:6800/15033 11 : cluster [WRN] failed to encode map e433 with expected crc
2015-09-06 10:02:10.056499 osd.0 10.214.131.116:6800/15033 11 : cluster [WRN] failed to encode map e433 with expected crc

/a/sage-2015-09-06_05:36:07-rados-wip-sage-testing---basic-multi/1044853

Added code to osd to dump encoded map at debug level 20 so that we can see what varies between this and the mon if it comes up again in qa.

Associated revisions

Revision 3084453b (diff)
Added by Sage Weil almost 5 years ago

rados: 'failed to encode ...' warnings are normal on upgrades

Fixes: #12973
Signed-off-by: Sage Weil <>

Revision b748c358 (diff)
Added by Sage Weil over 4 years ago

rados: 'failed to encode ...' warnings are normal on upgrades

Fixes: #12973
Signed-off-by: Sage Weil <>
(cherry picked from commit 3084453b047ca8b6bd0ce56e4e5a7ecce71753bc)

Conflicts:
suites/rados/upgrade/hammer-x-singleton/3-thrash/default.yaml does not exist in hammer

Revision 4cbf1770 (diff)
Added by Loic Dachary over 4 years ago

rados: 'failed to encode ...' warnings are normal on upgrades

http://tracker.ceph.com/issues/12973 Fixes: #12973

Signed-off-by: Loic Dachary <>

Revision 769512cf (diff)
Added by Loic Dachary over 4 years ago

rados: 'failed to encode ...' warnings are normal on upgrades (part 2)

http://tracker.ceph.com/issues/12973 Fixes: #12973

Signed-off-by: Loic Dachary <>
(cherry picked from commit 4cbf1770397e4c97aa1d0486ac7f7a3e1da98771)

Conflicts:
suites/upgrade/hammer/point-to-point/point-to-point.yaml does not exist in hammer

History

#1 Updated by Sage Weil almost 5 years ago

/a/sage-2015-09-06_10:35:10-rados-master---basic-multi/1045144

#2 Updated by Kefu Chai almost 5 years ago

/a/kchai-2015-09-07_23:23:54-rados-wip-kefu-testing---basic-multi/1046355/remote/burnupi26/log/ceph-osd.0.log.gz

with the "osd: dump full map bl at 20 when crc doesn't match" commit.

#4 Updated by Kefu Chai almost 5 years ago

  • Assignee set to Kefu Chai

sage, is there any wild guess on this? i will try to take a stab on it tomorrow.

#6 Updated by Sage Weil almost 5 years ago

  • Status changed from Fix Under Review to Resolved

#7 Updated by Loic Dachary over 4 years ago

  • Status changed from Resolved to In Progress
  • Assignee changed from Kefu Chai to Loic Dachary
  • Backport set to hammer

#8 Updated by Loic Dachary over 4 years ago

  • Status changed from In Progress to Resolved

#9 Updated by Loic Dachary over 4 years ago

  • Project changed from Ceph to ceph-qa-suite

Also available in: Atom PDF