Project

General

Profile

Actions
Copy link

Tasks #40937

open

Problem "open vSwitch" networkbond set_numa_affinity

Added by Mario Hosse almost 5 years ago. Updated almost 5 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
Ceph - v14.2.2
% Done:

0%

Tags:
set_numa_affinity open vSwitch
Reviewed:
Affected Versions:
Ceph - v14.2.1
Component(RADOS):
Pull request ID:

Description

Hello,

after installing ceph 14.2.1 (Proxmox 6.0-4-6.0) i have the following message example in syslog when starting osd:

Jul 22 11:53:48 prox1a ceph-osd[2731]: 2019-07-22 11:53:48.124 7f5e02576700 -1 osd.2 20115 set_numa_affinity unable to identify public interface 'ceph_public' numa node: (2) No such file or directory

After consultation in the proxmoxforum under:
[[https://forum.proxmox.com/threads/fragen-zu-ceph-nach-upgrade-5-4-auf-6-0.56209/]] in German.

Here it was determined that in the file:

ceph/src/common/pick_address.cc

to a path and a file which is not created by "open vSwitch" as a virtual network card:
int get_iface_numa_node(                                                    
  const std::string& iface,                                                
  int *node)                                                               
{                                                                        
  string fn = std::string("/sys/class/net/") + iface + "/device/numa_node";

Under /sys/class/net/ceph_public (my virtuell Bond) the path /device and file /device/numa_node is not created from "open vSwitch".

The network card is a virtual bond device over "open vSwitch" with two mellanox 40GB network cards.
So the osd can't find the file numa_node at startup and the error message is generated accordingly.
If you need more information, please do not hesitate to contact me.

Actions
Copy link

Also available in: Atom PDF