Feature #48292: cephadm: allow more than 60 OSDs per host - Orchestrator - Ceph

Actions

Copy link

Feature #48292

closed

cephadm: allow more than 60 OSDs per host

Added by Sebastian Wagner over 3 years ago. Updated almost 3 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Sebastian Wagner

Category:

cephadm/osd

Target version:

% Done:

Source:

Tags:

low-hanging-fruit

Backport:

Reviewed:

Affected Versions:

Pull request ID:

42210

Description

If the cluster is set to have very dense nodes (>60 OSDs per host) please make sure to assign sufficient ports for Ceph OSDs. The default (6800-7300) currently allows for no more than 62 OSDs per host.
For cluster with dense nodes like this please adjust the setting "ms_bind_port_max" to a suitable value. Each OSD will consume 8 additional ports.
For example, given a host that is set to run 96 OSDs, 768 ports will be needed. "ms_bind_port_max" should be set at least to 7568 by running

ceph config set osd.* ms_bind_port_max 7568.

Related issues 2 (0 open — 2 closed)

Actions

Copy link

Updated by Sebastian Wagner about 3 years ago

Tags set to low-hanging-fruit

Actions

Copy link

Updated by Sejal Welankar about 3 years ago

Sebastian Wagner wrote:

If the cluster is set to have very dense nodes (>60 OSDs per host) please make sure to assign sufficient ports for Ceph OSDs. The default (6800-7300) currently allows for no more than 62 OSDs per host.
For cluster with dense nodes like this please adjust the setting "ms_bind_port_max" to a suitable value. Each OSD will consume 8 additional ports.
For example, given a host that is set to run 96 OSDs, 768 ports will be needed. "ms_bind_port_max" should be set at least to 7568 by running

[...]

Can I work on this issue?

Actions

Copy link