Actions
Bug #43680
closedparallelize osd provisioning
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Description
parallelism of the ssh orchestrator is not trivial:
sets the thread pool size to 1, which is really suboptimal. Changing this requires something like Lock to prevent conflicts
But this is still not really sufficient, if we have a big cluster, as we cannot increase this limit indefinitely as we're talking about kernel threads here. We can improve this by using something like https://pypi.org/project/parallel-ssh/ instead of remoto.
Regarding concurrency, there is a open PR ceph/ceph: Pull Request 26565 to allow executing multiple commands concurrent
So, these are the options we have right now:
| What | Effort | Result | |----------------------------------------|--------|---------------------| | increase thread pool size to 10 | small | limited improvement | | https://pypi.org/project/parallel-ssh/ | big | big improvement | | pyzmq instead of SSH | huge | everything parallel |
Updated by Sebastian Wagner about 4 years ago
- Priority changed from Normal to High
Updated by Sebastian Wagner about 4 years ago
- Status changed from New to Resolved
- Pull request ID set to 33463
Actions