Bug #18883: qa: failures in samba suite - CephFS - Ceph

Actions

Copy link

Bug #18883

open

qa: failures in samba suite

Added by John Spray about 7 years ago. Updated over 4 years ago.

Status:

New

Priority:

Low

Assignee:

Category:

Testing

Target version:

% Done:

Source:

Development

Tags:

samba,qa

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Component(FS):

Samba VFS, qa-suite

Labels (FS):

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

First Samba run in ages:
http://pulpito.ceph.com/zack-2017-02-08_12:21:51-samba-master---basic-smithi/

Let's get this green again.

Actions

Copy link

Updated by Zheng Yan about 7 years ago

all failure have similar errors

2017-02-16T11:40:01.973 INFO:teuthology.orchestra.run.mira075.stderr:2017-02-16 11:40:01.968943 7f5dd5404ec0 -1 open: failed to lock pidfile /var/run/ceph/ceph-client.admin.pid because another process locked it.
2017-02-16T11:40:01.974 INFO:teuthology.orchestra.run.mira075.stderr:ceph-fuse[27075]: (33) Numerical argument out of domain
2017-02-16T11:40:01.978 ERROR:teuthology.run_tasks:Saw exception from tasks.

when daemonizing ceph-fuse. the child process failed to lock the pidfile because parent process has already locked it

Actions

Copy link

Updated by John Spray about 7 years ago

Weird, that was supposed to be fixed so that ceph-fuse never tries to create a pidfile: https://github.com/ceph/ceph/pull/12628

Actions

Copy link

Updated by John Spray about 7 years ago

Some of them are something different, too:

http://qa-proxy.ceph.com/teuthology/zack-2017-02-08_12:21:51-samba-master---basic-smithi/799005/teuthology.log

2017-02-08T20:26:32.007 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.019 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.040 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.054 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.069 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.082 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.096 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.108 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.123 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.137 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.150 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.166 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.180 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.191 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.206 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.219 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.231 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.243 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.258 INFO:teuthology.orchestra.run.smithi052.stdout:trying disconnect with async lock
2017-02-08T20:26:32.269 INFO:teuthology.orchestra.run.smithi052.stdout:trying open/disconnect
2017-02-08T20:26:32.305 INFO:teuthology.orchestra.run.smithi052.stdout:time: 2017-02-08 20:26:32.306535
2017-02-08T20:26:32.305 INFO:teuthology.orchestra.run.smithi052.stdout:success: disconnect
2017-02-08T20:26:32.352 INFO:teuthology.orchestra.run.smithi052.stdout:smbtorture 4.7.0pre1-GIT-ce9b72c
2017-02-08T20:26:32.356 INFO:teuthology.orchestra.run.smithi052.stdout:Using seed 1486585592
2017-02-08T20:26:32.357 INFO:teuthology.orchestra.run.smithi052.stdout:time: 2017-02-08 20:26:32.358843
2017-02-08T20:26:32.357 INFO:teuthology.orchestra.run.smithi052.stdout:test: samba3error
2017-02-08T20:26:32.357 INFO:teuthology.orchestra.run.smithi052.stdout:time: 2017-02-08 20:26:32.358984
2017-02-08T20:26:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:Failed to open connection - ERRDOS:ERRnoaccess
2017-02-08T20:26:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:time: 2017-02-08 20:26:32.374963
2017-02-08T20:26:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:error: samba3error [
2017-02-08T20:26:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:Unknown error/failure. Missing torture_fail() or torture_assert_*() call?
2017-02-08T20:26:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:]

Actions

Copy link

Updated by John Spray about 7 years ago

The weird "failed to lock pidfile" ones are all with the "mount/native.yaml" fragment

Actions

Copy link

Updated by John Spray about 7 years ago

Testing fix for the fuse thing here: https://github.com/ceph/ceph/pull/13498

Haven't looked into the smbtorture failure yet.

Actions

Copy link

Updated by Zheng Yan about 7 years ago

fix for the ceph-fuse bug: https://github.com/ceph/ceph/pull/13532

Actions

Copy link

Updated by John Spray about 7 years ago

Latest run:
http://pulpito.ceph.com/jspray-2017-02-20_12:27:44-samba-master-testing-basic-smithi/

Now we're seeing this:

2017-02-20T12:55:40.307 INFO:teuthology.orchestra.run.smithi193:Running: 'sudo mount -t cifs //172.21.15.193/ceph -o username=ubuntu,password=ubuntu /home/ubuntu/cephtest/mnt.1'
2017-02-20T12:55:40.630 INFO:teuthology.orchestra.run.smithi193.stderr:mount: //172.21.15.193/ceph is not a valid block device

Firewall issue perhaps?

I presume the "failed to decode message of type 42 v4: buffer::malformed_input: void spg_t::decode(ceph::buffer::list::iterator&) unknown encoding version > 1" is probably some unrelated kclient or protocol breakage.

Actions

Copy link

Updated by Zheng Yan about 7 years ago

Status changed from New to 12

[2017/02/27 09:11:27.919688,  0] ../lib/util/modules.c:48(load_module)
  Error loading module '/usr/local/samba/lib/vfs/ceph.so': libcephfs.so.1: cannot open shared object file: No such file or directory
[2017/02/27 09:11:27.919781,  0] ../source3/smbd/vfs.c:184(vfs_init_custom)
  error probing vfs module 'ceph': NT_STATUS_UNSUCCESSFUL

If I create libcephfs.so.1 manually

[2017/02/27 09:22:52.645290,  0] ../lib/util/modules.c:48(load_module)
  Error loading module '/usr/local/samba/lib/vfs/ceph.so': /usr/local/samba/lib/vfs/ceph.so: undefined symbol: ceph_lstat
[2017/02/27 09:22:52.645375,  0] ../source3/smbd/vfs.c:184(vfs_init_custom)
  error probing vfs module 'ceph': NT_STATUS_UNSUCCESSFUL

looks like samba package is not linked to libcephfs2

Actions

Copy link

Updated by John Spray about 7 years ago

Which packages were you seeing the linkage issue on? The centos ones?

Actions

Copy link

#10

Updated by Zheng Yan about 7 years ago

both ubuntu and centos samba packages have no dependency to libcephfs. It works when there happen to be libcephfs1.

Actions

Copy link

#11

Updated by Zheng Yan about 7 years ago

open ticket for samba build http://tracker.ceph.com/issues/19117

Actions

Copy link

#12

Updated by Patrick Donnelly about 6 years ago

Subject changed from Failures in samba suite to qa: failures in samba suite
Category changed from 43 to Testing
Priority changed from Normal to Low
Target version changed from v12.0.0 to v14.0.0
Source set to Development
Tags set to samba,qa
Component(FS) Samba VFS, qa-suite added