Project

General

Profile

Bug #24522

blogbench.sh failed in upgrade:luminous-x-mimic-distro-basic-smithi

Added by Yuri Weinstein 6 months ago. Updated 3 months ago.

Status:
Resolved
Priority:
High
Assignee:
-
Category:
Testing
Target version:
Start date:
06/13/2018
Due date:
% Done:

0%

Source:
Q/A
Tags:
Backport:
mimic,luminous
Regression:
No
Severity:
4 - irritation
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/luminous-x
Component(FS):
qa-suite
Labels (FS):
qa
Pull request ID:

Description

Seems bionic specific
Run: http://pulpito.ceph.com/yuriw-2018-06-12_20:54:23-upgrade:luminous-x-mimic-distro-basic-smithi/
Jobs: '2659699', '2659715', '2659707', '2659723'
Logs: http://qa-proxy.ceph.com/teuthology/yuriw-2018-06-12_20:54:23-upgrade:luminous-x-mimic-distro-basic-smithi/2659699/teuthology.log

2018-06-12T21:20:56.011 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk
2018-06-12T21:20:56.012 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3
2018-06-12T21:20:56.012 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com...
2018-06-12T21:20:56.012 INFO:teuthology.orchestra.run.smithi107:Running: 'sudo fusermount -u /home/ubuntu/cephtest/mnt.3'
2018-06-12T21:20:56.115 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi107.stderr:ceph-fuse[10104]: fuse finished with error 0 and tester_r 0
2018-06-12T21:20:56.115 INFO:teuthology.orchestra.run.smithi107:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.3" 
2018-06-12T21:20:56.192 INFO:teuthology.orchestra.run.smithi107.stdout:ext2/ext3
2018-06-12T21:20:56.193 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
2018-06-12T21:20:56.193 INFO:teuthology.orchestra.run:waiting for 900
2018-06-12T21:20:56.193 INFO:teuthology.orchestra.run.smithi107:Running: 'rmdir -- /home/ubuntu/cephtest/mnt.3'
2018-06-12T21:20:56.267 INFO:teuthology.orchestra.run.smithi107:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.2" 
2018-06-12T21:20:56.340 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk
2018-06-12T21:20:56.340 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2
2018-06-12T21:20:56.341 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com...
2018-06-12T21:20:56.341 INFO:teuthology.orchestra.run.smithi107:Running: 'sudo fusermount -u /home/ubuntu/cephtest/mnt.2'
2018-06-12T21:20:56.442 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi107.stderr:ceph-fuse[10141]: fuse finished with error 0 and tester_r 0
2018-06-12T21:20:56.443 INFO:teuthology.orchestra.run.smithi107:Running: "stat --file-system '--printf=%T\n' -- /home/ubuntu/cephtest/mnt.2" 
2018-06-12T21:20:56.527 INFO:teuthology.orchestra.run.smithi107.stdout:ext2/ext3
2018-06-12T21:20:56.527 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3'
2018-06-12T21:20:56.528 INFO:teuthology.orchestra.run:waiting for 900
2018-06-12T21:20:56.552 INFO:teuthology.orchestra.run.smithi107:Running: 'rmdir -- /home/ubuntu/cephtest/mnt.2'
2018-06-12T21:20:56.628 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 86, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/parallel.py", line 55, in task
    p.spawn(_run_spawned, ctx, confg, taskname)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 85, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 99, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 22, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/parallel.py", line 63, in _run_spawned
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/full_sequential.py", line 30, in task
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/sequential.py", line 46, in task
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_yuriw_ceph_wip-yuriw-distros-master/qa/tasks/workunit.py", line 193, in task
    timeout=timeout,cleanup=cleanup)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 85, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 99, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 22, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/github.com_yuriw_ceph_wip-yuriw-distros-master/qa/tasks/workunit.py", line 479, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 193, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 423, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 155, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 177, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed (workunit test suites/blogbench.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-yuriw-distros-master TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/suites/blogbench.sh'
2018-06-12T21:20:56.756 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=76f58387ddec40329d619dd1a083ad6a
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 86, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/parallel.py", line 55, in task
    p.spawn(_run_spawned, ctx, confg, taskname)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 85, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 99, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 22, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/parallel.py", line 63, in _run_spawned
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/full_sequential.py", line 30, in task
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/sequential.py", line 46, in task
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 65, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_yuriw_ceph_wip-yuriw-distros-master/qa/tasks/workunit.py", line 193, in task
    timeout=timeout,cleanup=cleanup)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 85, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 99, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/parallel.py", line 22, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/github.com_yuriw_ceph_wip-yuriw-distros-master/qa/tasks/workunit.py", line 479, in _run_tests
    label="workunit test {workunit}".format(workunit=workunit)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 193, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 423, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 155, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 177, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed (workunit test suites/blogbench.sh) on smithi107 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-yuriw-distros-master TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h

Related issues

Copied to fs - Backport #24716: mimic: blogbench.sh failed in upgrade:luminous-x-mimic-distro-basic-smithi Resolved
Copied to fs - Backport #24717: luminous: blogbench.sh failed in upgrade:luminous-x-mimic-distro-basic-smithi Resolved

History

#1 Updated by Yuri Weinstein 6 months ago

  • ceph-qa-suite upgrade/hammer-jewel-x added

#2 Updated by Yuri Weinstein 6 months ago

  • ceph-qa-suite upgrade/luminous-x added
  • ceph-qa-suite deleted (upgrade/hammer-jewel-x)

#3 Updated by Greg Farnum 6 months ago

  • Project changed from Ceph to fs

#4 Updated by Patrick Donnelly 6 months ago

  • Category set to Testing
  • Priority changed from Normal to High
  • Target version set to v14.0.0
  • Backport set to mimic,luminous
  • Severity changed from 3 - minor to 4 - irritation
  • Affected Versions deleted (v13.0.0, v13.2.0, v14.0.0)
  • Component(FS) qa-suite added
  • Labels (FS) qa added

#5 Updated by Neha Ojha 6 months ago

Following is the problem:

2018-06-12T21:20:55.196 INFO:tasks.workunit.client.2.smithi107.stdout:blogbench-1.0/COPYING
2018-06-12T21:20:55.202 INFO:tasks.workunit.client.2.smithi107.stderr:/home/ubuntu/cephtest/clone.client.2/qa/workunits/suites/blogbench.sh: line 8: cd: too many arguments
2018-06-12T21:20:55.204 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.2...

#6 Updated by Patrick Donnelly 6 months ago

  • Status changed from New to Duplicate

Thanks Neha!

#7 Updated by Patrick Donnelly 6 months ago

  • Duplicates Bug #24518: "pjd.sh: line 7: cd: too many arguments" in fs suite added

#8 Updated by Neha Ojha 6 months ago

Patrick, this is a different script(blogbench.sh) not pjd.sh, so might not be a duplicate.

#9 Updated by Patrick Donnelly 6 months ago

  • Status changed from Duplicate to New

Whoops!

#10 Updated by Patrick Donnelly 6 months ago

  • Duplicates deleted (Bug #24518: "pjd.sh: line 7: cd: too many arguments" in fs suite)

#11 Updated by Neha Ojha 6 months ago

  • Status changed from New to Testing

#12 Updated by Abhishek Lekshmanan 6 months ago

  • Copied to Backport #24716: mimic: blogbench.sh failed in upgrade:luminous-x-mimic-distro-basic-smithi added

#13 Updated by Abhishek Lekshmanan 6 months ago

  • Copied to Backport #24717: luminous: blogbench.sh failed in upgrade:luminous-x-mimic-distro-basic-smithi added

#14 Updated by Patrick Donnelly 3 months ago

  • Status changed from Testing to Pending Backport

#16 Updated by Nathan Cutler 3 months ago

  • Status changed from Pending Backport to Resolved

Also available in: Atom PDF