Bug #26863: qa: test_full_different_file "dd: error writing 'large_file': No space left on device" - CephFS - Ceph

Actions

Copy link

Bug #26863

closed

qa: test_full_different_file "dd: error writing 'large_file': No space left on device"

Added by Patrick Donnelly over 5 years ago. Updated about 4 years ago.

Status:

Can't reproduce

Priority:

High

Assignee:

Venky Shankar

Category:

Target version:

Ceph - v15.0.0

% Done:

Source:

Q/A

Tags:

Backport:

mimic,luminous

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

Ceph - v12.2.8

ceph-qa-suite:

Component(FS):

qa-suite

Labels (FS):

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

2018-08-04T06:09:55.766 INFO:teuthology.orchestra.run.smithi189:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.0" 
2018-08-04T06:09:55.774 INFO:teuthology.orchestra.run.smithi189.stdout:fuseblk
2018-08-04T06:09:55.774 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0
2018-08-04T06:09:55.774 INFO:teuthology.orchestra.run.smithi189:Running: 'cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0'
2018-08-04T06:09:59.157 INFO:teuthology.orchestra.run.smithi189.stderr:dd: error writing 'large_file': No space left on device
2018-08-04T06:09:59.157 INFO:teuthology.orchestra.run.smithi189.stderr:dd: closing output file 'large_file': No space left on device
2018-08-04T06:09:59.160 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ERROR
...
2018-08-04T06:10:13.504 INFO:tasks.cephfs_test_runner:======================================================================
2018-08-04T06:10:13.504 INFO:tasks.cephfs_test_runner:ERROR: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull)
2018-08-04T06:10:13.504 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2018-08-04T06:10:13.504 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2018-08-04T06:10:13.505 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri5-testing-2018-08-03-2359-luminous/qa/tasks/cephfs/test_full.py", line 202, in test_full_different_file
2018-08-04T06:10:13.505 INFO:tasks.cephfs_test_runner:    self._test_full(True)
2018-08-04T06:10:13.505 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri5-testing-2018-08-03-2359-luminous/qa/tasks/cephfs/test_full.py", line 197, in _test_full
2018-08-04T06:10:13.505 INFO:tasks.cephfs_test_runner:    self.mount_a.write_n_mb("large_file", 50, seek=0)
2018-08-04T06:10:13.505 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri5-testing-2018-08-03-2359-luminous/qa/tasks/cephfs/mount.py", line 344, in write_n_mb
2018-08-04T06:10:13.505 INFO:tasks.cephfs_test_runner:    ], wait=wait)
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_wip-yuri5-testing-2018-08-03-2359-luminous/qa/tasks/cephfs/mount.py", line 149, in run_shell
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:    stderr=StringIO(), wait=wait)
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 193, in run
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 423, in run
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:    r.wait()
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 155, in wait
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 177, in _raise_for_status
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:    node=self.hostname, label=self.label
2018-08-04T06:10:13.506 INFO:tasks.cephfs_test_runner:CommandFailedError: Command failed on smithi189 with status 1: 'cd /home/ubuntu/cephtest/mnt.0 && sudo dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0'

From a luminous run: /ceph/teuthology-archive/yuriw-2018-08-04_04:18:29-fs-wip-yuri5-testing-2018-08-03-2359-luminous-distro-basic-smithi/2864005/teuthology.log