Project

General

Profile

Actions
Copy link

Bug #48776

closed

ObjectStore/StoreTest hangs

Added by Neha Ojha over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Target version:
-
% Done:

100%

Source:
Tags:
Backport:
pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
38934
Crash signature (v1):
Crash signature (v2):

Description

2021-01-04T10:43:47.212 INFO:teuthology.orchestra.run.smithi179.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/2
2021-01-04T10:43:49.845 INFO:teuthology.orchestra.run.smithi179.stderr:create collection + objects
2021-01-04T10:43:49.851 INFO:teuthology.orchestra.run.smithi179.stdout:overwrites
2021-01-04T22:34:06.167 DEBUG:teuthology.exit:Got signal 15; running 2 handlers...
2021-01-04T22:34:06.224 DEBUG:teuthology.task.console_log:Killing console logger for smithi179
2021-01-04T22:34:06.225 DEBUG:teuthology.task.console_log:Killing console logger for smithi179
2021-01-04T22:34:06.226 DEBUG:teuthology.exit:Finished running handlers

/a/teuthology-2021-01-04_07:01:02-rados-master-distro-basic-smithi/5753718

Related issues 2 (0 open — 2 closed)

Has duplicate bluestore - Bug #48876: osd crash in bluestore codeDuplicate

Actions
Copied to bluestore - Backport #48950: pacific: ObjectStore/StoreTest hangsResolvedActions
Actions
Copy link
 #1

Updated by Neha Ojha over 3 years ago

/a/teuthology-2021-01-05_07:01:02-rados-master-distro-basic-smithi/5755704

Actions
Copy link
 #2

Updated by Neha Ojha over 3 years ago

  • Subject changed from ObjectStore/StoreTest.IORemount/2 hangs to ObjectStore/StoreTest hangs
2021-01-07T03:55:45.424 INFO:teuthology.orchestra.run.smithi109.stdout:[       OK ] ObjectStore/StoreTest.ColSplitTest2Clones/1 (16750 ms)
2021-01-07T03:55:45.424 INFO:teuthology.orchestra.run.smithi109.stdout:[ RUN      ] ObjectStore/StoreTest.ColSplitTest2Clones/2
2021-01-07T15:10:23.147 DEBUG:teuthology.exit:Got signal 15; running 2 handlers...
2021-01-07T15:10:23.223 DEBUG:teuthology.task.console_log:Killing console logger for smithi109
2021-01-07T15:10:23.223 DEBUG:teuthology.task.console_log:Killing console logger for smithi109
2021-01-07T15:10:23.224 DEBUG:teuthology.exit:Finished running handlers

/a/nojha-2021-01-07_00:06:49-rados-master-distro-basic-smithi/5761077

Actions
Copy link
 #3

Updated by Neha Ojha over 3 years ago 

2021-01-06T19:01:26.695 INFO:teuthology.orchestra.run.smithi094.stdout:[       OK ] ObjectStore/StoreTest.IORemount/1 (1326 ms)
2021-01-06T19:01:26.695 INFO:teuthology.orchestra.run.smithi094.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/2
2021-01-06T19:01:29.259 INFO:teuthology.orchestra.run.smithi094.stderr:create collection + objects
2021-01-06T19:01:29.263 INFO:teuthology.orchestra.run.smithi094.stdout:overwrites
2021-01-07T06:46:22.721 DEBUG:teuthology.exit:Got signal 15; running 2 handlers...

/a/jafaj-2021-01-05_16:20:30-rados-wip-jan-testing-2021-01-05-1401-distro-basic-smithi/5757055

Actions
Copy link
 #4

Updated by Neha Ojha over 3 years ago

Here's a test that's hung, logs in ubuntu@smithi013.

2021-01-15T19:45:58.973 INFO:teuthology.orchestra.run.smithi013.stdout:==> rm -r memstore.test_temp_dir
2021-01-15T19:45:58.977 INFO:teuthology.orchestra.run.smithi013.stdout:[       OK ] ObjectStore/StoreTest.IORemount/0 (96 ms)
2021-01-15T19:45:58.977 INFO:teuthology.orchestra.run.smithi013.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/1
2021-01-15T19:45:59.599 INFO:teuthology.orchestra.run.smithi013.stderr:create collection + objects
2021-01-15T19:45:59.599 INFO:teuthology.orchestra.run.smithi013.stdout:overwrites
2021-01-15T19:46:00.459 INFO:teuthology.orchestra.run.smithi013.stdout:==> rm -r filestore.test_temp_dir
2021-01-15T19:46:00.464 INFO:teuthology.orchestra.run.smithi013.stdout:[       OK ] ObjectStore/StoreTest.IORemount/1 (1487 ms)
2021-01-15T19:46:00.464 INFO:teuthology.orchestra.run.smithi013.stdout:[ RUN      ] ObjectStore/StoreTest.IORemount/2
2021-01-15T19:46:03.352 INFO:teuthology.orchestra.run.smithi013.stderr:create collection + objects
2021-01-15T19:46:03.356 INFO:teuthology.orchestra.run.smithi013.stdout:overwrites

/a/yuriw-2021-01-15_19:06:33-rados-wip-yuri8-testing-master-2021-01-15-0935-distro-basic-smithi/5789354

Actions
Copy link
 #5

Updated by Igor Fedotov over 3 years ago

IMO this PR is a culprit: https://github.com/ceph/ceph/pull/30027

Will try to fix after weekend.

Actions
Copy link
 #6

Updated by Igor Fedotov over 3 years ago

  • Has duplicate Bug #48876: osd crash in bluestore code added
Actions
Copy link
 #7

Updated by Igor Fedotov over 3 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 38934
Actions
Copy link
 #8

Updated by Neha Ojha over 3 years ago

  • Priority changed from Normal to Urgent
Actions
Copy link
 #9

Updated by Neha Ojha over 3 years ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport set to pacific
Actions
Copy link
 #11

Updated by Nathan Cutler over 3 years ago

Actions
Copy link
 #12

Updated by Yuri Weinstein over 3 years ago

Neha Ojha wrote:

pacific backport - https://github.com/ceph/ceph/pull/38989

merged

Actions
Copy link
 #13

Updated by Igor Fedotov over 3 years ago

  • Status changed from Pending Backport to Resolved
Actions
Copy link

Also available in: Atom PDF