Project

General

Profile

Feature #46827

cephadm: Pin OSDs to pmem modules connected to specific CPUs

Added by Sebastian Wagner 3 months ago. Updated 3 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
cephadm
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

I have OSDs running on pmem modules, so i want to pin them to cpus that are connected to those modules. Same with nvmes.

Workaround would be to edit the systemd unit files (or the associated run scripts) for now. (just keep in mind they'll get rewritten, if you redeploy the daemon)

[root@rx24-1 ~]# ipmctl show -topology
DimmID | MemoryType                  | Capacity  | PhysicalID| DeviceLocator
==============================================================================
0x0001 | Logical Non-Volatile Device | 252.4 GiB | 0x0031    | CPU1_DIMM_A2
0x0101 | Logical Non-Volatile Device | 252.4 GiB | 0x003d    | CPU1_DIMM_D2
0x1001 | Logical Non-Volatile Device | 252.4 GiB | 0x0049    | CPU2_DIMM_A2
0x1101 | Logical Non-Volatile Device | 0.0 GiB   | 0x0055    | CPU2_DIMM_D2
N/A    | DDR4                        | 32.0 GiB  | 0x002f    | CPU1_DIMM_A1
N/A    | DDR4                        | 32.0 GiB  | 0x0033    | CPU1_DIMM_B1
N/A    | DDR4                        | 32.0 GiB  | 0x0036    | CPU1_DIMM_C1

plus

podman –cpuset-cpus=number

History

#1 Updated by Sebastian Wagner 3 months ago

  • Description updated (diff)

#2 Updated by Sebastian Wagner 3 months ago

  • Description updated (diff)

Also available in: Atom PDF