Project

General

Profile

Bug #53418

[krbd] rbd: udev enumerate failed, retrying

Added by Deepika Upadhyay about 2 months ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

conn(0x7f51880588e0 msgr2=0x7f518805ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure
2021-11-27T05:14:38.887 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.888 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.888 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.891 INFO:tasks.workunit.client.0.smithi104.stderr:rbd: udev enumerate failed, retrying
s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2
2021-11-27T05:14:39.597 INFO:tasks.workunit.client.0.smithi104.stderr:rbd: sysfs write failed
2021-11-27T05:14:39.600 INFO:tasks.workunit.client.0.smithi104.stderr:+ sudo rbd map img209
2021-11-27T05:14:39.601 INFO:tasks.workunit.client.0.smithi104.stderr:+ sudo rbd map img215
  description: krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph
    ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate}
  email: null

http://qa-proxy.ceph.com/teuthology/ideepika-2021-11-27_04:26:14-krbd-pacific-16.2.7_RC1-testing-default-smithi/6530081/teuthology.log


Related issues

Related to Linux kernel client - Bug #53427: krbd_map failed with error code 91 New

History

#1 Updated by Deepika Upadhyay about 2 months ago

same issue, different test:

2021-11-28T19:19:58.692 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:19:58.704 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: sysfs write failed

2021-11-28T19:20:01.965 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:01.967 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:01.989 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:01.990 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.132 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:02.134 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.711 INFO:tasks.workunit.client.0.smithi132.stderr:2021-11-28T19:20:02.707+0000 7f72dd059700  0 -- 172.21.15.132:0/717600090 >> [v2:172.21.15.103:6824/18219,v1:172.21.15.103:6825/18219] conn(0x5650d999c150 msgr2=0x5650d999e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure
2021-11-28T19:20:02.711 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:02.713 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.757 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:02.759 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.767 INFO:tasks.workunit:Stopping ['rbd/krbd_udev_enumerate.sh'] on client.0...
2021-11-28T19:20:02.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2021-11-28T19:20:02.969 ERROR:teuthology.run_tasks:Saw exception from tasks.

rbd/krbd_udev_enumerate.sh

/ceph/teuthology-archive/ideepika-2021-11-28_18:59:04-krbd-pacific-16.2.7_RC1-distro-default-smithi/6532091/teuthology.log

#2 Updated by Deepika Upadhyay about 2 months ago

also for:

2021-11-28T19:18:44.923 INFO:tasks.workunit.client.0.smithi168.stderr:rbd: sysfs write failed
2021-11-28T19:18:44.923 INFO:tasks.workunit.client.0.smithi168.stderr:2021-11-28T19:18:44.923+0000 7fa9de3f8700  0 --  >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x559b18212eb0 msgr2=0x559b18217430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure

['rbd/kernel.sh']

#3 Updated by Deepika Upadhyay about 2 months ago

  • Related to Bug #53427: krbd_map failed with error code 91 added

Also available in: Atom PDF