Project

General

Profile

Actions
Copy link

Bug #47566

open

test_crash.sh fails to find expected number of crashes

Added by Neha Ojha over 3 years ago. Updated over 3 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2020-09-21T20:17:00.356 INFO:tasks.workunit.client.0.smithi160.stderr:++ ceph crash ls
2020-09-21T20:17:00.356 INFO:tasks.workunit.client.0.smithi160.stderr:++ wc -l
2020-09-21T20:17:00.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~36s
2020-09-21T20:17:00.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~36s
2020-09-21T20:17:00.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~36s
2020-09-21T20:17:00.759 INFO:tasks.workunit.client.0.smithi160.stderr:+ '[' 3 = 4 ']'
2020-09-21T20:17:00.759 INFO:tasks.workunit.client.0.smithi160.stderr:+ exit 1
2020-09-21T20:17:00.759 DEBUG:teuthology.orchestra.run:got remote process result: 1
2020-09-21T20:17:00.760 INFO:tasks.workunit:Stopping ['rados/test_crash.sh'] on client.0..

The test expects 3 crashes:

# must be 3 crashdumps registered and moved to crash/posted
[ $(ceph crash ls | wc -l) = 4 ]  || exit 1   # 4 here bc of the table header

But we only have 2

nojha@teuthology:/ceph/teuthology-archive/teuthology-2020-09-21_07:01:02-rados-master-distro-basic-smithi/5456453/remote/smithi160/crash/posted$ ls -l
total 0
drwxrwxr-x 1 teuthworker teuthworker 3 Sep 21 20:31 2020-09-21T20:16:22.351559Z_1ec9e326-433b-48ff-a125-35da1f4b7e3a
drwxrwxr-x 1 teuthworker teuthworker 3 Sep 21 20:31 2020-09-21T20:16:22.351846Z_b681d32e-5078-4a58-8a70-b0580fe480a3

Actions
Copy link
 #1

Updated by Neha Ojha over 3 years ago 

2020-09-21T20:16:31.756+0000 7f8880980700 -1 mgr handle_command module 'crash' command handler threw exception: 'utf-8' codec can't decode byte 0x88 in position 708: invalid start byte
2020-09-21T20:16:31.756+0000 7f8880980700 20 mgr ~Gil Destroying new thread state 0x55b6b5985200
2020-09-21T20:16:31.756+0000 7f8880980700 -1 mgr.server reply reply (22) Invalid argument UnicodeDecodeError: 'utf-8' codec can't decode byte 0x88 in position 708: invalid start byte

2020-09-21T20:16:31.756+0000 7f8880980700  1 -- [v2:172.21.15.160:6824/27292,v1:172.21.15.160:6825/27292] --> 172.21.15.160:0/1266057845 -- mgr_command_reply(tid 0: -22 UnicodeDecodeError: 'utf-8' codec can't decode byte 0x88 in position 708: invalid start byte
Actions
Copy link

Also available in: Atom PDF