Project

General

Profile

Feature #48292

cephadm: allow more than 60 OSDs per host

Added by Sebastian Wagner 5 months ago. Updated about 19 hours ago.

Status:
New
Priority:
Normal
Category:
cephadm/osd
Target version:
-
% Done:

0%

Source:
Tags:
low-hanging-fruit
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

If the cluster is set to have very dense nodes (>60 OSDs per host) please make sure to assign sufficient ports for Ceph OSDs. The default (6800-7300) currently allows for no more than 62 OSDs per host.
For cluster with dense nodes like this please adjust the setting "ms_bind_port_max" to a suitable value. Each OSD will consume 8 additional ports.
For example, given a host that is set to run 96 OSDs, 768 ports will be needed. "ms_bind_port_max" should be set at least to 7568 by running

ceph config set osd.* ms_bind_port_max 7568.

History

#1 Updated by Sebastian Wagner 30 days ago

  • Tags set to low-hanging-fruit

#2 Updated by Sejal Welankar 2 days ago

Sebastian Wagner wrote:

If the cluster is set to have very dense nodes (>60 OSDs per host) please make sure to assign sufficient ports for Ceph OSDs. The default (6800-7300) currently allows for no more than 62 OSDs per host.
For cluster with dense nodes like this please adjust the setting "ms_bind_port_max" to a suitable value. Each OSD will consume 8 additional ports.
For example, given a host that is set to run 96 OSDs, 768 ports will be needed. "ms_bind_port_max" should be set at least to 7568 by running

[...]

Can I work on this issue?

#3 Updated by Sebastian Wagner about 19 hours ago

  • Assignee set to Sejal Welankar

Also available in: Atom PDF