Bug #10624: hung samba tests after lsof failure - CephFS - Ceph

Actions

Copy link

Bug #10624

closed

hung samba tests after lsof failure

Added by Greg Farnum over 9 years ago. Updated about 5 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Zheng Yan

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

hammer, firefly

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Component(FS):

Labels (FS):

Samba/CIFS

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

http://pulpito.ceph.com/teuthology-2015-01-21_23:14:02-samba-master-testing-basic-multi/717177/, and in one other recent run

2015-01-22T08:03:52.891 INFO:teuthology.orchestra.run.burnupi13.stdout:success: scan-ioctl
2015-01-22T08:03:52.900 DEBUG:teuthology.parallel:result is None
2015-01-22T08:03:52.900 DEBUG:teuthology.run_tasks:Unwinding manager samba
2015-01-22T08:03:52.900 INFO:tasks.samba:Stopping smbd processes...
2015-01-22T08:03:52.900 DEBUG:tasks.samba.smbd.0:waiting for process to exit
2015-01-22T08:03:58.900 INFO:tasks.samba.smbd.0:Stopped
2015-01-22T08:03:58.901 INFO:teuthology.orchestra.run.burnupi13:Running: "sudo rm -rf /usr/local/samba/etc/smb.conf '/usr/local/samba/private/*' /usr/local/samba/var/run/ /usr/local/samba/var/locks /usr/local/samba/var/lock" 
2015-01-22T08:03:58.915 INFO:teuthology.orchestra.run.burnupi13:Running: 'while sudo killall -9 smbd ; do sleep 1 ; done'
2015-01-22T08:04:00.015 INFO:teuthology.orchestra.run.burnupi13.stderr:smbd: no process found
2015-01-22T08:04:00.017 INFO:teuthology.orchestra.run.burnupi13:Running: 'sudo lsof /home/ubuntu/cephtest/mnt.0'
2015-01-22T08:04:00.159 ERROR:tasks.samba:Saw exception
Traceback (most recent call last):
  File "/var/lib/teuthworker/src/ceph-qa-suite_master/tasks/samba.py", line 230, in task
    backend,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 368, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 106, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on burnupi13 with status 1: 'sudo lsof /home/ubuntu/cephtest/mnt.0'
2015-01-22T08:04:00.160 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse
2015-01-22T08:04:00.160 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients...
2015-01-22T08:04:00.161 INFO:teuthology.orchestra.run.burnupi13:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 
2015-01-22T08:04:00.168 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0
2015-01-22T08:04:00.169 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@burnupi13.front.sepia.ceph.com...
2015-01-22T08:04:00.169 INFO:teuthology.orchestra.run.burnupi13:Running: 'sudo fusermount -u /home/ubuntu/cephtest/mnt.0'
2015-01-22T08:04:00.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.burnupi13.stderr:ceph-fuse[8673]: fuse finished with error 0

This might have to do with the other samba crashes on shutdown that Zheng is trying to fix with the upstream changes?

Actions

Copy link

Updated by Zheng Yan about 9 years ago

Assignee set to Greg Farnum

our samba branch is not updated for a long time. could you update it. (I have no write permission to that repository

Actions

Copy link

Updated by Greg Farnum about 9 years ago

Assignee changed from Greg Farnum to Zheng Yan

Last time I looked into this, it appeared the Samba gitbuilder wasn't actually using our Ceph samba repo — it's dead.

In particular, the current build is commit e66e06b60270239577fbf79c5f7b098dafc2458d:

commit e66e06b60270239577fbf79c5f7b098dafc2458d
Author: Volker Lendecke <vl@samba.org>
Date:   Wed Apr 8 16:46:44 2015 +0200

    fss: Fix CID 1293354 Wrong operator used

    Not used right now, but prevent future confusion.

    Signed-off-by: Volker Lendecke <vl@samba.org>
    Reviewed-by: David Disseldorp <ddiss@samba.org>

    Autobuild-User(master): David Disseldorp <ddiss@samba.org>
    Autobuild-Date(master): Wed Apr  8 19:36:36 CEST 2015 on sn-devel-104

Which is definitely not being pulled off the github Ceph Samba repo. :)

Anyway, I also don't have write permissions on that repository at the moment, but I'm working to get them for both of us.

Actions

Copy link