Project

General

Profile

Actions
Copy link

Bug #14461

closed

test hung "joining thrashosds" in hammer tests

Added by Yuri Weinstein over 8 years ago. Updated about 7 years ago.

Status:
Can't reproduce
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/hammer-x
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

See in several runs lately
Run: http://pulpito.ceph.com/teuthology-2016-01-21_02:10:09-upgrade:hammer-x-jewel-distro-basic-vps/
Job: 35922
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2016-01-21_02:10:09-upgrade:hammer-x-jewel-distro-basic-vps/35922/teuthology.log

2016-01-21T05:29:14.252 INFO:teuthology.orchestra.run.vpm154:Running: 'rmdir /home/ubuntu/cephtest/apache'
2016-01-21T05:29:14.323 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart
2016-01-21T05:29:14.323 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart
2016-01-21T05:29:14.323 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart
2016-01-21T05:29:14.323 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds
2016-01-21T05:29:14.323 INFO:tasks.thrashosds:joining thrashosds

no progress after this command...

Related issues 1 (0 open — 1 closed)

Related to Ceph - Bug #16331: teuthology hang joining thrashosds, specifically Thrasher.threadCan't reproduceDavid Zafman06/15/2016

Actions
Actions
Copy link
 #1

Updated by Zack Cerza over 8 years ago

  • Project changed from teuthology to 23
Actions
Copy link
 #2

Updated by Yuri Weinstein over 8 years ago

  • Project changed from 23 to Ceph
Actions
Copy link
 #3

Updated by Sage Weil about 8 years ago

  • Status changed from New to Rejected

not enough info to tell what happened.

Actions
Copy link
 #5

Updated by Loïc Dachary about 8 years ago

  • Status changed from Rejected to Need More Info

http://pulpito.ceph.com/loic-2016-02-16_22:00:52-rados-hammer-backports---basic-multi/12298/

2016-02-16T22:57:05.496 INFO:tasks.rados.rados.0.smithi026.stdout:3999: snap_remove snap 415
2016-02-16T22:57:06.666 INFO:tasks.rados.rados.0.smithi026.stdout:3999: done (0 left)
2016-02-16T22:57:06.669 INFO:tasks.rados.rados.0.smithi026.stderr:0 errors.
2016-02-16T22:57:06.669 INFO:tasks.rados.rados.0.smithi026.stderr:
2016-02-16T22:57:06.675 INFO:tasks.ceph.ceph_manager:removing pool_name unique_pool_0
2016-02-16T22:57:06.675 INFO:teuthology.orchestra.run.smithi026:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados rmpool unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it'
2016-02-16T22:57:08.074 INFO:teuthology.orchestra.run.smithi026.stdout:successfully deleted pool unique_pool_0
2016-02-16T22:57:08.076 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds
2016-02-16T22:57:08.115 INFO:tasks.thrashosds:joining thrashosds
Actions
Copy link
 #6

Updated by Loïc Dachary about 8 years ago

  • Subject changed from test hung "joining thrashosds" in upgrade:hammer-x-jewel-distro-basic-vps to test hung "joining thrashosds" in hammer tests
Actions
Copy link
 #7

Updated by Yuri Weinstein over 7 years ago

  • Related to Bug #16331: teuthology hang joining thrashosds, specifically Thrasher.thread added
Actions
Copy link
 #8

Updated by Yuri Weinstein over 7 years ago

Run: http://pulpito.ceph.com/teuthology-2016-08-05_03:00:02-rados-hammer-distro-basic-vps/
Jobs: 350230
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2016-08-05_03:00:02-rados-hammer-distro-basic-vps/350230/teuthology.log

2016-08-05T05:41:02.497 INFO:tasks.rados.rados.0.vpm163.stdout:3990: done (8 left)
2016-08-05T05:41:02.527 INFO:tasks.rados.rados.0.vpm163.stdout:3992: done (7 left)
2016-08-05T05:41:02.528 INFO:tasks.rados.rados.0.vpm163.stdout:3993: done (6 left)
2016-08-05T05:41:02.528 INFO:tasks.rados.rados.0.vpm163.stdout:3994: done (5 left)
2016-08-05T05:41:02.528 INFO:tasks.rados.rados.0.vpm163.stdout:3995: done (4 left)
2016-08-05T05:41:02.528 INFO:tasks.rados.rados.0.vpm163.stdout:3996: done (3 left)
2016-08-05T05:41:02.528 INFO:tasks.rados.rados.0.vpm163.stdout:3997: done (2 left)
2016-08-05T05:41:02.529 INFO:tasks.rados.rados.0.vpm163.stdout:3998: done (1 left)
2016-08-05T05:41:02.565 INFO:tasks.rados.rados.0.vpm163.stdout:3999: done (0 left)
2016-08-05T05:41:02.568 INFO:tasks.rados.rados.0.vpm163.stderr:0 errors.
2016-08-05T05:41:02.568 INFO:tasks.rados.rados.0.vpm163.stderr:
2016-08-05T05:41:02.649 INFO:tasks.ceph.ceph_manager:removing pool_name unique_pool_0
2016-08-05T05:41:02.649 INFO:teuthology.orchestra.run.vpm163:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados rmpool unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it'
2016-08-05T05:41:03.630 INFO:teuthology.orchestra.run.vpm163.stdout:successfully deleted pool unique_pool_0
2016-08-05T05:41:03.631 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds
2016-08-05T05:41:03.791 INFO:tasks.thrashosds:joining thrashosds
2016-08-05T05:41:03.792 ERROR:teuthology.run_tasks:Manager failed: thrashosds
Actions
Copy link
 #9

Updated by Josh Durgin about 7 years ago

  • Status changed from Need More Info to Can't reproduce
Actions
Copy link

Also available in: Atom PDF