Project

General

Profile

Actions

Feature #48292

closed

cephadm: allow more than 60 OSDs per host

Added by Sebastian Wagner over 3 years ago. Updated almost 3 years ago.

Status:
Resolved
Priority:
Normal
Category:
cephadm/osd
Target version:
-
% Done:

0%

Source:
Tags:
low-hanging-fruit
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

If the cluster is set to have very dense nodes (>60 OSDs per host) please make sure to assign sufficient ports for Ceph OSDs. The default (6800-7300) currently allows for no more than 62 OSDs per host.
For cluster with dense nodes like this please adjust the setting "ms_bind_port_max" to a suitable value. Each OSD will consume 8 additional ports.
For example, given a host that is set to run 96 OSDs, 768 ports will be needed. "ms_bind_port_max" should be set at least to 7568 by running

ceph config set osd.* ms_bind_port_max 7568.

Related issues 2 (0 open2 closed)

Related to Orchestrator - Bug #50526: OSD massive creation: OSDs not createdResolvedJuan Miguel Olmo Martínez

Actions
Related to Orchestrator - Bug #47873: /usr/lib/sysctl.d/90-ceph-osd.conf getting installed in container, rendering it ineffectiveResolvedMichael Fritch

Actions
Actions

Also available in: Atom PDF