Project

General

Profile

Actions

Bug #11205

closed

"failed (workunit test fs/misc/filelock_interrupt.py)" in powercycle-hammer-distro-basic-multi run

Added by Yuri Weinstein about 9 years ago. Updated about 9 years ago.

Status:
Resolved
Priority:
Urgent
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.front.sepia.ceph.com/teuthology-2015-03-22_09:17:25-powercycle-hammer-distro-basic-multi/
Jobs: ['815838', '815852', '815866']
Logs for on: http://qa-proxy.ceph.com/teuthology/teuthology-2015-03-22_09:17:25-powercycle-hammer-distro-basic-multi/815852/

2015-03-22T09:51:44.009 INFO:tasks.thrashosds.thrasher:inject_pause on 1
2015-03-22T09:51:44.010 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3
2015-03-22T09:51:44.010 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False
2015-03-22T09:51:44.010 INFO:teuthology.orchestra.run.mira087:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3'
2015-03-22T09:51:46.731 INFO:tasks.workunit.client.0.plana70.stderr:Traceback (most recent call last):
2015-03-22T09:51:46.731 INFO:tasks.workunit.client.0.plana70.stderr:  File "/home/ubuntu/cephtest/workunit.client.0/fs/misc/filelock_interrupt.py", line 78, in <module>
2015-03-22T09:51:46.731 INFO:tasks.workunit.client.0.plana70.stderr:    main()
2015-03-22T09:51:46.731 INFO:tasks.workunit.client.0.plana70.stderr:  File "/home/ubuntu/cephtest/workunit.client.0/fs/misc/filelock_interrupt.py", line 41, in main
2015-03-22T09:51:46.731 INFO:tasks.workunit.client.0.plana70.stderr:    fcntl.fcntl(f1, fcntl.F_OFD_SETLK, lockdata)
2015-03-22T09:51:46.732 INFO:tasks.workunit.client.0.plana70.stderr:IOError: [Errno 22] Invalid argument
2015-03-22T09:51:46.735 INFO:tasks.workunit:Stopping ['fs/misc'] on client.0...
2015-03-22T09:51:46.735 INFO:teuthology.orchestra.run.plana70:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/workunit.client.0'
2015-03-22T09:51:46.810 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/var/lib/teuthworker/src/ceph-qa-suite_hammer/tasks/workunit.py", line 361, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 137, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed (workunit test fs/misc/filelock_interrupt.py) on plana70 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=120300febebdc34c23fc24633edfdc8faf65e93c TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/workunit.client.0/fs/misc/filelock_interrupt.py'
2015-03-22T09:51:46.835 ERROR:teuthology.run_tasks:Saw exception from tasks.
Actions #1

Updated by Greg Farnum about 9 years ago

  • Project changed from Ceph to CephFS
  • Assignee set to Yuri Weinstein

If we cherry-pick commit 4ececa3dc4a21b98f61a592da9e2be60a0d71625 to hammer then this shouldn't fail again. The commit got lost so it was only merged over the weekend, but it's low-risk as it just changes the workunit. I can do a manual cherry-pick on request.

Note that this error code is just because the installed kernel is too old to support the operations being tested, so it should not be considered a blocker. See #10217, which I have just updated with backport tags.

Actions #2

Updated by Yuri Weinstein about 9 years ago

  • Subject changed from failed (workunit test fs/misc/filelock_interrupt.py)" in powercycle-hammer-distro-basic-multi run to "failed (workunit test fs/misc/filelock_interrupt.py)" in powercycle-hammer-distro-basic-multi run
Actions #3

Updated by Yuri Weinstein about 9 years ago

I am rerunning failed jobs on 'testing' kernel and they mostly passed.
http://pulpito.front.sepia.ceph.com/teuthology-2015-03-23_16:52:36-powercycle-hammer-testing-basic-multi/

Not sure if we need to cherry-pick anything at the moment.

Actions #4

Updated by Zheng Yan about 9 years ago

Actions #5

Updated by Greg Farnum about 9 years ago

  • Status changed from New to Resolved

commit:e7e0ea626ecca7c74b76099a0c4fc016ca4e410f

Actions

Also available in: Atom PDF