Actions
Bug #22944
openInfiniband send_msg send returned error 32: (32) Broken pipe
% Done:
0%
Source:
Community (user)
Tags:
rdma, infiniband
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Description
Using CentOS 7.4, Mellanox OFED 4.2 on Connect-X 3 in Infiniband mode and Ceph 12.2.2 compiled with RDMA.
I've set:
ms type = async+rdma
I've fixed systemd units to allow RDMA device usage.
But I cannot get RDMA to work. Connections time out.
I sometimes get:
Infiniband send_msg send returned error 32: (32) Broken pipe
in monitor service journal.
RDMA by itself works just fine (verified with rping).
Ceph by itself also works just fine (verified without RDMA).
This happens even on one-node cluster when trying to access it from the very same node.
Please let me know how I can get you more info to debug it.
Files
Actions