Bug #53418: [krbd] rbd: udev enumerate failed, retrying - Linux kernel client - Ceph

Actions

Copy link

Bug #53418

open

[krbd] rbd: udev enumerate failed, retrying

Added by Deepika Upadhyay over 2 years ago. Updated over 2 years ago.

Status:

New

Priority:

Normal

Assignee:

Category:

Target version:

% Done:

Source:

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Crash signature (v1):

Crash signature (v2):

Description

conn(0x7f51880588e0 msgr2=0x7f518805ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure
2021-11-27T05:14:38.887 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.888 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.888 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.889 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ pids+=($!)
2021-11-27T05:14:38.890 INFO:tasks.workunit.client.0.smithi104.stderr:+ for i in {1..300}
2021-11-27T05:14:38.891 INFO:tasks.workunit.client.0.smithi104.stderr:rbd: udev enumerate failed, retrying

s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2
2021-11-27T05:14:39.597 INFO:tasks.workunit.client.0.smithi104.stderr:rbd: sysfs write failed
2021-11-27T05:14:39.600 INFO:tasks.workunit.client.0.smithi104.stderr:+ sudo rbd map img209
2021-11-27T05:14:39.601 INFO:tasks.workunit.client.0.smithi104.stderr:+ sudo rbd map img215

  description: krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph
    ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate}
  email: null

http://qa-proxy.ceph.com/teuthology/ideepika-2021-11-27_04:26:14-krbd-pacific-16.2.7_RC1-testing-default-smithi/6530081/teuthology.log

Related issues 1 (1 open — 0 closed)

Actions

Copy link

Updated by Deepika Upadhyay over 2 years ago

same issue, different test:

2021-11-28T19:19:58.692 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:19:58.704 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: sysfs write failed

2021-11-28T19:20:01.965 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:01.967 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:01.989 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:01.990 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.132 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:02.134 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.711 INFO:tasks.workunit.client.0.smithi132.stderr:2021-11-28T19:20:02.707+0000 7f72dd059700  0 -- 172.21.15.132:0/717600090 >> [v2:172.21.15.103:6824/18219,v1:172.21.15.103:6825/18219] conn(0x5650d999c150 msgr2=0x5650d999e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure
2021-11-28T19:20:02.711 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:02.713 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.757 INFO:tasks.workunit.client.0.smithi132.stdout:In some cases useful info is found in syslog - try "dmesg | tail".
2021-11-28T19:20:02.759 INFO:tasks.workunit.client.0.smithi132.stderr:rbd: map failed: (22) Invalid argument
2021-11-28T19:20:02.767 INFO:tasks.workunit:Stopping ['rbd/krbd_udev_enumerate.sh'] on client.0...
2021-11-28T19:20:02.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2021-11-28T19:20:02.969 ERROR:teuthology.run_tasks:Saw exception from tasks.

rbd/krbd_udev_enumerate.sh

/ceph/teuthology-archive/ideepika-2021-11-28_18:59:04-krbd-pacific-16.2.7_RC1-distro-default-smithi/6532091/teuthology.log

Actions

Copy link

Updated by Deepika Upadhyay over 2 years ago

also for:

2021-11-28T19:18:44.923 INFO:tasks.workunit.client.0.smithi168.stderr:rbd: sysfs write failed
2021-11-28T19:18:44.923 INFO:tasks.workunit.client.0.smithi168.stderr:2021-11-28T19:18:44.923+0000 7fa9de3f8700  0 --  >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x559b18212eb0 msgr2=0x559b18217430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure

['rbd/kernel.sh']

Actions

Copy link