Project

General

Profile

Bug #48776

ObjectStore/StoreTest hangs

Added by Neha Ojha about 3 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Target version:
-
% Done:

100%

Source:
Tags:
Backport:
pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2021-01-04T10:43:47.212 INFO:teuthology.orchestra.run.smithi179.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/2
2021-01-04T10:43:49.845 INFO:teuthology.orchestra.run.smithi179.stderr:create collection + objects
2021-01-04T10:43:49.851 INFO:teuthology.orchestra.run.smithi179.stdout:overwrites
2021-01-04T22:34:06.167 DEBUG:teuthology.exit:Got signal 15; running 2 handlers...
2021-01-04T22:34:06.224 DEBUG:teuthology.task.console_log:Killing console logger for smithi179
2021-01-04T22:34:06.225 DEBUG:teuthology.task.console_log:Killing console logger for smithi179
2021-01-04T22:34:06.226 DEBUG:teuthology.exit:Finished running handlers

/a/teuthology-2021-01-04_07:01:02-rados-master-distro-basic-smithi/5753718


Related issues

Duplicated by bluestore - Bug #48876: osd crash in bluestore code Duplicate
Copied to bluestore - Backport #48950: pacific: ObjectStore/StoreTest hangs Resolved

History

#1 Updated by Neha Ojha about 3 years ago

/a/teuthology-2021-01-05_07:01:02-rados-master-distro-basic-smithi/5755704

#2 Updated by Neha Ojha about 3 years ago

  • Subject changed from ObjectStore/StoreTest.IORemount/2 hangs to ObjectStore/StoreTest hangs
2021-01-07T03:55:45.424 INFO:teuthology.orchestra.run.smithi109.stdout:[       OK ] ObjectStore/StoreTest.ColSplitTest2Clones/1 (16750 ms)
2021-01-07T03:55:45.424 INFO:teuthology.orchestra.run.smithi109.stdout:[ RUN      ] ObjectStore/StoreTest.ColSplitTest2Clones/2
2021-01-07T15:10:23.147 DEBUG:teuthology.exit:Got signal 15; running 2 handlers...
2021-01-07T15:10:23.223 DEBUG:teuthology.task.console_log:Killing console logger for smithi109
2021-01-07T15:10:23.223 DEBUG:teuthology.task.console_log:Killing console logger for smithi109
2021-01-07T15:10:23.224 DEBUG:teuthology.exit:Finished running handlers

/a/nojha-2021-01-07_00:06:49-rados-master-distro-basic-smithi/5761077

#3 Updated by Neha Ojha about 3 years ago

2021-01-06T19:01:26.695 INFO:teuthology.orchestra.run.smithi094.stdout:[       OK ] ObjectStore/StoreTest.IORemount/1 (1326 ms)
2021-01-06T19:01:26.695 INFO:teuthology.orchestra.run.smithi094.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/2
2021-01-06T19:01:29.259 INFO:teuthology.orchestra.run.smithi094.stderr:create collection + objects
2021-01-06T19:01:29.263 INFO:teuthology.orchestra.run.smithi094.stdout:overwrites
2021-01-07T06:46:22.721 DEBUG:teuthology.exit:Got signal 15; running 2 handlers...

/a/jafaj-2021-01-05_16:20:30-rados-wip-jan-testing-2021-01-05-1401-distro-basic-smithi/5757055

#4 Updated by Neha Ojha about 3 years ago

Here's a test that's hung, logs in ubuntu@smithi013.

2021-01-15T19:45:58.973 INFO:teuthology.orchestra.run.smithi013.stdout:==> rm -r memstore.test_temp_dir
2021-01-15T19:45:58.977 INFO:teuthology.orchestra.run.smithi013.stdout:[       OK ] ObjectStore/StoreTest.IORemount/0 (96 ms)
2021-01-15T19:45:58.977 INFO:teuthology.orchestra.run.smithi013.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/1
2021-01-15T19:45:59.599 INFO:teuthology.orchestra.run.smithi013.stderr:create collection + objects
2021-01-15T19:45:59.599 INFO:teuthology.orchestra.run.smithi013.stdout:overwrites
2021-01-15T19:46:00.459 INFO:teuthology.orchestra.run.smithi013.stdout:==> rm -r filestore.test_temp_dir
2021-01-15T19:46:00.464 INFO:teuthology.orchestra.run.smithi013.stdout:[       OK ] ObjectStore/StoreTest.IORemount/1 (1487 ms)
2021-01-15T19:46:00.464 INFO:teuthology.orchestra.run.smithi013.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/2
2021-01-15T19:46:03.352 INFO:teuthology.orchestra.run.smithi013.stderr:create collection + objects
2021-01-15T19:46:03.356 INFO:teuthology.orchestra.run.smithi013.stdout:overwrites

/a/yuriw-2021-01-15_19:06:33-rados-wip-yuri8-testing-master-2021-01-15-0935-distro-basic-smithi/5789354

#5 Updated by Igor Fedotov about 3 years ago

IMO this PR is a culprit: https://github.com/ceph/ceph/pull/30027

Will try to fix after weekend.

#6 Updated by Igor Fedotov about 3 years ago

  • Duplicated by Bug #48876: osd crash in bluestore code added

#7 Updated by Igor Fedotov about 3 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 38934

#8 Updated by Neha Ojha about 3 years ago

  • Priority changed from Normal to Urgent

#9 Updated by Neha Ojha about 3 years ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport set to pacific

#11 Updated by Nathan Cutler about 3 years ago

#12 Updated by Yuri Weinstein about 3 years ago

Neha Ojha wrote:

pacific backport - https://github.com/ceph/ceph/pull/38989

merged

#13 Updated by Igor Fedotov about 3 years ago

  • Status changed from Pending Backport to Resolved

Also available in: Atom PDF