Project

General

Profile

Actions
Copy link

Bug #23922

closed

ENOMEM from ceph_test_rados and ceph_test_cls_rbd (hammer client)

Added by Sage Weil almost 6 years ago. Updated almost 6 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Kefu Chai
Category:
Tests
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2018-04-28T15:37:50.349 INFO:tasks.workunit.client.2.smithi018.stdout:[----------] 18 tests from TestClsRbd
2018-04-28T15:37:50.350 INFO:tasks.workunit.client.2.smithi018.stdout:test/cls_rbd/test_cls_rbd.cc:71: Failure
2018-04-28T15:37:50.350 INFO:tasks.workunit.client.2.smithi018.stdout:Value of: create_one_pool_pp(_pool_name, _rados)
2018-04-28T15:37:50.350 INFO:tasks.workunit.client.2.smithi018.stdout:  Actual: "cluster.connect failed with error -12" 
2018-04-28T15:37:50.350 INFO:tasks.workunit.client.2.smithi018.stdout:Expected: ""

/a/sage-2018-04-28_14:04:47-rados-wip-sage2-testing-2018-04-27-1740-distro-basic-smithi/2450864

and

2018-04-28T15:56:26.142 INFO:tasks.rados.rados.2.smithi169.stdout:ceph version 0.94.10-85-ga8e54ce (a8e54cee69fc2fdc8df27f35ebe1b56444f43317)
2018-04-28T15:56:26.142 INFO:tasks.rados.rados.2.smithi169.stdout:Configuration:
2018-04-28T15:56:26.142 INFO:tasks.rados.rados.2.smithi169.stdout:      Number of operations: 4000
2018-04-28T15:56:26.142 INFO:tasks.rados.rados.2.smithi169.stdout:      Number of objects: 50
2018-04-28T15:56:26.142 INFO:tasks.rados.rados.2.smithi169.stdout:      Max in flight operations: 16
2018-04-28T15:56:26.144 INFO:tasks.rados.rados.2.smithi169.stdout:      Object size (in bytes): 4000000
2018-04-28T15:56:26.144 INFO:tasks.rados.rados.2.smithi169.stdout:      Write stride min: 400000
2018-04-28T15:56:26.144 INFO:tasks.rados.rados.2.smithi169.stdout:      Write stride max: 800000
2018-04-28T15:56:26.149 INFO:tasks.rados.rados.2.smithi169.stderr:Error initializing rados test context: (12) Cannot allocate memory

/a/sage-2018-04-28_14:04:47-rados-wip-sage2-testing-2018-04-27-1740-distro-basic-smithi/2450999 (+ another instance in same set)
Actions
Copy link
 #2

Updated by Kefu Chai almost 6 years ago

failed to reproduce this issue locally.
adding

      client:
        log to stderr: true
        err to stderr: true
        debug monc: 10
        debug ms: 1
        debug rados: 10

rerunning at

- http://pulpito.ceph.com/kchai-2018-04-30_13:05:57-rados-master-distro-basic-mira/
- http://pulpito.ceph.com/kchai-2018-04-30_13:05:08-rados-master-distro-basic-smithi/

Actions
Copy link
 #3

Updated by Kefu Chai almost 6 years ago 

2018-04-30T13:24:53.576 INFO:tasks.workunit.client.2.mira011.stdout:[==========] Running 18 tests from 1 test case.
2018-04-30T13:24:53.576 INFO:tasks.workunit.client.2.mira011.stdout:[----------] Global test environment set-up.
2018-04-30T13:24:53.576 INFO:tasks.workunit.client.2.mira011.stdout:[----------] 18 tests from TestClsRbd
2018-04-30T13:24:53.579 INFO:tasks.workunit.client.2.mira011.stderr:2018-04-30 13:24:53.580286 7f5a35c34780 -1 WARNING: the following dangerous and experimental features are enabled: *
2018-04-30T13:24:53.582 INFO:tasks.workunit.client.2.mira011.stderr:2018-04-30 13:24:53.583391 7f5a35c34780 -1 WARNING: the following dangerous and experimental features are enabled: *
2018-04-30T13:24:53.582 INFO:tasks.workunit.client.2.mira011.stderr:2018-04-30 13:24:53.583518 7f5a35c34780 10 monclient(hunting): build_initial_monmap
2018-04-30T13:24:53.582 INFO:tasks.workunit.client.2.mira011.stderr:2018-04-30 13:24:53.583634 7f5a35c34780 -1 *** experimental feature 'ms-type-async' is not enabled ***
2018-04-30T13:24:53.582 INFO:tasks.workunit.client.2.mira011.stderr:This feature is marked as experimental, which means it
2018-04-30T13:24:53.582 INFO:tasks.workunit.client.2.mira011.stderr: - is untested
2018-04-30T13:24:53.582 INFO:tasks.workunit.client.2.mira011.stderr: - is unsupported
2018-04-30T13:24:53.582 INFO:tasks.workunit.client.2.mira011.stderr: - may corrupt your data
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stderr: - may break your cluster is an unrecoverable fashion
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stderr:To enable this feature, add this to your ceph.conf:
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stderr:  enable experimental unrecoverable data corrupting features = ms-type-async
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stderr:
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stderr:2018-04-30 13:24:53.583652 7f5a35c34780 -1 unrecognized ms_type 'random'
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stdout:test/cls_rbd/test_cls_rbd.cc:71: Failure
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stdout:Value of: create_one_pool_pp(_pool_name, _rados)
2018-04-30T13:24:53.583 INFO:tasks.workunit.client.2.mira011.stdout:  Actual: "cluster.connect failed with error -12" 
2018-04-30T13:24:53.584 INFO:tasks.workunit.client.2.mira011.stdout:Expected: "" 
2018-04-30T13:24:53.584 INFO:tasks.workunit.client.2.mira011.stdout:[ RUN      ] TestClsRbd.copyup
2018-04-30T13:24:53.586 INFO:tasks.workunit.client.2.mira011.stderr:Segmentation fault (core dumped)
Actions
Copy link
 #4

Updated by Kefu Chai almost 6 years ago

  • Category set to Tests
  • Assignee set to Kefu Chai
Actions
Copy link
 #5

Updated by Kefu Chai almost 6 years ago

  • Status changed from 12 to Fix Under Review
Actions
Copy link
 #6

Updated by Sage Weil almost 6 years ago

  • Status changed from Fix Under Review to Resolved
Actions
Copy link

Also available in: Atom PDF