Project

General

Profile

Actions

Bug #9744

closed

cephx: verify_reply couldn't decrypt with error: error decoding block for decryption

Added by Dmitry Smirnov over 9 years ago. Updated about 8 years ago.

Status:
Won't Fix
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Community (user)
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Shortly after upgrade 0.80.5 to 0.80.6 cluster became slow and then almost completely stopped
with several OSDs exhibiting slow requests over 1000 seconds old and several PGs stuck
in "peering" and/or "inactive" state for a while.
Quick peek into their logs revealed the following:

2014-10-11 11:03:31.783967 7fcee3a48700  0 cephx: verify_reply couldn't decrypt with error: error decoding block for decryption
2014-10-11 11:03:31.783977 7fcee3a48700  0 -- 192.168.0.2:6815/6585 >> 192.168.0.201:6800/13398 pipe(0x7fcf26052280 sd=22 :46446 s=1 pgs=0 cs=0 l=1 c=0x7fcf118006e0).failed verifying authorize reply
2014-10-11 11:03:46.856869 7fcee3a48700  0 cephx: verify_reply couldn't decrypt with error: error decoding block for decryption
2014-10-11 11:03:46.856879 7fcee3a48700  0 -- 192.168.0.2:6815/6585 >> 192.168.0.201:6800/13398 pipe(0x7fcf26052280 sd=22 :46522 s=1 pgs=0 cs=0 l=1 c=0x7fcf118006e0).failed verifying authorize reply

Restarting affected OSDs help for some time but then (some times later) the same error strikes back.
Apart from upgrade and adding another node with one OSD on it there were no changes to configuration.
Strangest thing is that it appears that only some OSDs are affected even where there are more than
one OSD on the host some seems to stuck with "verify_reply couldn't decrypt" while others
seems to be active and log no errors.

Could it be a regression or am I missing something? How to troubleshoot this issue? Thanks.


Related issues 1 (0 open1 closed)

Has duplicate Ceph - Bug #13527: moniter segmentation faultDuplicate10/19/2015

Actions
Actions

Also available in: Atom PDF