Project

General

Profile

Actions
Copy link

Bug #9896

closed

krbd: EPERM from map-snapshot-io.sh

Added by Sage Weil over 9 years ago. Updated almost 7 years ago.

Status:
Resolved
Priority:
High
Assignee:
Ilya Dryomov
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2014-10-26T00:02:48.041 INFO:teuthology.orchestra.run.plana70:Running: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b05efddb77290b86eb5c150776c761ab84f66f37 TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits c
eph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/map-snapshot-io.sh'
2014-10-26T00:02:48.336 INFO:tasks.workunit.client.0.plana70.stderr:rbd: sysfs write failed
2014-10-26T00:02:48.378 INFO:tasks.workunit.client.0.plana70.stderr:rbd: map failed: (13) Permission denied
2014-10-26T00:02:48.381 INFO:tasks.workunit:Stopping ['rbd/map-snapshot-io.sh'] on client.0...
ubuntu@teuthology:/a/teuthology-2014-10-24_23:06:01-krbd-giant-testing-basic-multi/570830
Actions
Copy link
 #1

Updated by Sage Weil over 9 years ago

ubuntu@teuthology:/a/teuthology-2014-10-24_23:06:01-krbd-giant-testing-basic-multi/570827 too

Actions
Copy link
 #2

Updated by Ilya Dryomov over 9 years ago

  • Project changed from rbd to Linux kernel client
  • Subject changed from EPERM from map-snapshot-io.sh to krbd: EPERM from map-snapshot-io.sh
Actions
Copy link
 #3

Updated by Ilya Dryomov over 9 years ago

  • Priority changed from Urgent to High

/a/teuthology-2014-10-24_23:06:01-krbd-giant-testing-basic-multi/570830

2014-10-25T23:59:16.339176-07:00 plana70 kernel: imklog 5.8.6, log source = /proc/kmsg started.
2014-10-25T23:59:18.757915-07:00 plana70 kernel: [ 2568.505250] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-25T23:59:28.773855-07:00 plana70 kernel: [ 2578.527905] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-25T23:59:38.789864-07:00 plana70 kernel: [ 2588.549530] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-25T23:59:48.805878-07:00 plana70 kernel: [ 2598.572955] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-25T23:59:55.993841-07:00 plana70 kernel: [ 2605.765812] kvm: VM_EXIT_LOAD_IA32_PERF_GLOBAL_CTRL does not work properly. Using workaround
2014-10-25T23:59:58.821808-07:00 plana70 kernel: [ 2608.593613] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:00:03.417861-07:00 plana70 kernel: [ 2613.195335] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr,user_xattr
2014-10-26T00:00:08.837877-07:00 plana70 kernel: [ 2618.616782] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:00:18.853891-07:00 plana70 kernel: [ 2628.637555] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:00:28.869893-07:00 plana70 kernel: [ 2638.659562] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:00:38.885895-07:00 plana70 kernel: [ 2648.681604] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:00:48.897844-07:00 plana70 kernel: [ 2658.703516] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:00:58.917833-07:00 plana70 kernel: [ 2668.725607] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:01:08.933845-07:00 plana70 kernel: [ 2678.748247] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:01:18.945816-07:00 plana70 kernel: [ 2688.769612] libceph: mon2 10.214.137.124:6790 socket closed (con state CONNECTING)
2014-10-26T00:01:28.965849-07:00 plana70 kernel: [ 2698.793240] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:01:38.981891-07:00 plana70 kernel: [ 2708.814216] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:01:48.997887-07:00 plana70 kernel: [ 2718.835982] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:01:59.013888-07:00 plana70 kernel: [ 2728.857905] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:02:09.029890-07:00 plana70 kernel: [ 2738.880138] libceph: mon2 10.214.137.124:6790 socket closed (con state CONNECTING)
2014-10-26T00:02:19.045893-07:00 plana70 kernel: [ 2748.902651] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:02:29.061891-07:00 plana70 kernel: [ 2758.924663] libceph: mon0 10.214.137.124:6789 socket closed (con state NEGOTIATING)
2014-10-26T00:02:39.085881-07:00 plana70 kernel: [ 2768.948270] libceph: bad fsid, had 982481e3-641e-43a4-a9b3-0b64c2e5a731 got 3e715f99-2255-4493-8e8f-2937f08922f1
2014-10-26T00:02:39.085896-07:00 plana70 kernel: [ 2768.959127] libceph: auth method 'x' error -1
2014-10-26T00:02:49.093897-07:00 plana70 kernel: [ 2778.968280] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:02:59.121890-07:00 plana70 kernel: [ 2789.002115] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:03:09.133883-07:00 plana70 kernel: [ 2799.013879] libceph: bad fsid, had 982481e3-641e-43a4-a9b3-0b64c2e5a731 got 3e715f99-2255-4493-8e8f-2937f08922f1
2014-10-26T00:03:09.133899-07:00 plana70 kernel: [ 2799.024886] libceph: auth method 'x' error -1
2014-10-26T00:03:19.161887-07:00 plana70 kernel: [ 2809.056201] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:03:29.165890-07:00 plana70 kernel: [ 2819.066849] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:03:39.181882-07:00 plana70 kernel: [ 2829.079978] libceph: bad fsid, had 982481e3-641e-43a4-a9b3-0b64c2e5a731 got 3e715f99-2255-4493-8e8f-2937f08922f1
2014-10-26T00:03:39.181897-07:00 plana70 kernel: [ 2829.090849] libceph: auth method 'x' error -1
2014-10-26T00:03:49.205886-07:00 plana70 kernel: [ 2839.116270] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:03:59.205891-07:00 plana70 kernel: [ 2849.122323] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:04:09.241891-07:00 plana70 kernel: [ 2859.164385] libceph: mon1 10.214.137.128:6789 socket closed (con state CONNECTING)
2014-10-26T00:04:19.237885-07:00 plana70 kernel: [ 2869.166830] libceph: mon2 10.214.137.124:6790 socket closed (con state CONNECTING)
2014-10-26T00:04:29.253886-07:00 plana70 kernel: [ 2879.188366] libceph: mon2 10.214.137.124:6790 socket closed (con state CONNECTING)
2014-10-26T00:04:39.269855-07:00 plana70 kernel: [ 2889.210408] libceph: mon2 10.214.137.124:6790 socket closed (con state CONNECTING)
2014-10-26T00:04:50.285854-07:00 plana70 kernel: [ 2900.233118] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:04:59.301895-07:00 plana70 kernel: [ 2909.254563] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:05:09.317814-07:00 plana70 kernel: [ 2919.276434] libceph: mon0 10.214.137.124:6789 socket closed (con state CONNECTING)
2014-10-26T00:05:10.760367-07:00 plana70 kernel: Kernel logging (proc) stopped.

"libceph: bad fsid ..." suggests leftover kernel client state from a previous test on that box.

No kern.log in /a/teuthology-2014-10-24_23:06:01-krbd-giant-testing-basic-multi/570827.

Actions
Copy link
 #4

Updated by Ilya Dryomov about 9 years ago

  • Assignee set to Ilya Dryomov

Need to reproduce to confirm that this was a manifestation of #10352 and is therefore fixed.

Actions
Copy link
 #5

Updated by Ilya Dryomov almost 7 years ago

  • Status changed from New to Resolved

In addition to #10352, rbd_fio.py task was leaving rbd devices behind.

Actions
Copy link

Also available in: Atom PDF