Project

General

Profile

Actions

Bug #9820

closed

mon connection hang on cephtool/test.sh

Added by Tamilarasi muthamizhan over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Joao Eduardo Luis
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

log: ubuntu@teuthology:/a/teuthology-2014-10-17_02:32:01-rados-giant-distro-basic-multi/553035

2014-10-17T04:22:03.842 INFO:tasks.workunit.client.0.burnupi49.stderr: test_mon_injectargs_SI: 114: expect_false ceph injectargs mon.a '--mon_pg_warn_min_objects 10F'
2014-10-17T04:22:03.842 INFO:tasks.workunit.client.0.burnupi49.stderr: expect_false: 27: set -x
2014-10-17T04:22:03.842 INFO:tasks.workunit.client.0.burnupi49.stderr: expect_false: 28: ceph injectargs mon.a '--mon_pg_warn_min_objects 10F'
2014-10-17T04:22:06.991 INFO:tasks.workunit.client.0.burnupi49.stderr:Error EINVAL: injectargs:Parse error setting mon_pg_warn_min_objects to '10F' using injectargs.
2014-10-17T04:22:06.991 INFO:tasks.workunit.client.0.burnupi49.stderr: failed to parse arguments: mon.a
2014-10-17T04:22:06.991 INFO:tasks.workunit.client.0.burnupi49.stderr:
...
...
...
2014-10-17T04:23:52.348 INFO:tasks.workunit.client.0.burnupi49.stderr: test_auth_profiles: 304: true
2014-10-17T04:23:52.349 INFO:tasks.workunit.client.0.burnupi49.stderr: test_auth_profiles: 305: check_response 'EACCES: access denied'
2014-10-17T04:23:52.349 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 39: expected_stderr_string='EACCES: access denied'
2014-10-17T04:23:52.349 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 40: retcode=
2014-10-17T04:23:52.349 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 41: expected_retcode=
2014-10-17T04:23:52.349 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 42: '[' '' -a '!=' ']'
2014-10-17T04:23:52.349 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 47: grep 'EACCES: access denied' /tmp/cephtool33072/test_invalid.33072
2014-10-17T04:23:52.349 INFO:tasks.workunit.client.0.burnupi49.stderr: test_auth_profiles: 306: ceph -n client.xx-profile-ro -k client.xx.keyring osd set noout
2014-10-17T04:23:52.512 INFO:tasks.workunit.client.0.burnupi49.stderr: test_auth_profiles: 306: true
2014-10-17T04:23:52.512 INFO:tasks.workunit.client.0.burnupi49.stderr: test_auth_profiles: 307: check_response 'EACCES: access denied'
2014-10-17T04:23:52.512 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 39: expected_stderr_string='EACCES: access denied'
2014-10-17T04:23:52.512 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 40: retcode=
2014-10-17T04:23:52.512 INFO:tasks.workunit.client.0.burnupi49.stderr: check_response: 41: expected_retcode=
...
...
2014-10-17T07:21:05.914 INFO:tasks.workunit.client.0.burnupi49.stderr:2014-10-17 07:21:05.913748 7f10ca083700  0 monclient: hunting for new mon
2014-10-17T07:21:21.712 INFO:tasks.workunit.client.0.burnupi49.stderr:2014-10-17 07:21:21.711422 7f10c25fa700  0 -- 10.214.136.32:0/1039362 >> 10.214.136.32:6789/0 pipe(0x7f10b8007420 sd=7 :46414 s=2 pgs=365 cs=1 l=1 c=0x7f10b8007e90).injecting socket failure
2014-10-17T07:21:21.712 INFO:tasks.workunit.client.0.burnupi49.stderr:2014-10-17 07:21:21.711538 7f10ca083700  0 monclient: hunting for new mon
2014-10-17T07:22:02.425 INFO:tasks.workunit.client.0.burnupi49.stderr:  test_auth_profiles: 1: rm -fr /tmp/cephtool33072
2014-10-17T07:22:02.428 INFO:tasks.workunit:Stopping ['cephtool'] on client.0...
2014-10-17T07:22:02.428 INFO:teuthology.orchestra.run.burnupi49:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.0'
2014-10-17T07:22:02.435 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/var/lib/teuthworker/src/ceph-qa-suite_giant/tasks/workunit.py", line 359, in _run_tests
    args=args,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 364, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 105, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on burnupi49 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5558afa03dbd1b20766b76e9410ef5bc3e73784f TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/cephtool/test.sh'

Actions #1

Updated by Sage Weil over 9 years ago

  • Subject changed from EACCESS when running cephtool/test.sh in the nightlies to mon connection hang on cephtool/test.sh
  • Assignee set to Joao Eduardo Luis
Actions #2

Updated by Sage Weil over 9 years ago

  • Status changed from New to Resolved
Actions

Also available in: Atom PDF