Ceph » Orchestrator

Running cephadm on a dense node (with 120 disks in this case) fails when trying to process the ceph-volume inventory command.

occl@occldlr750-1 ~ $ sudo cephadm5-1 ceph-volume inventory --filter-for-batch --with-lsm --format json
Inferring fsid 7bb7ae12-d0de-11ec-ba3b-70b5e8f02f3e
Using recent ceph image quay.ceph.io/ceph-ci/ceph@sha256:69547787f6358c2b9d2246c0ef271bce085835a23db1ec667827f00ba1d27a70
Traceback (most recent call last):
  File "/usr/lib64/python3.6/asyncio/streams.py", line 488, in readline
    line = yield from self.readuntil(sep)
  File "/usr/lib64/python3.6/asyncio/streams.py", line 569, in readuntil
    offset)
asyncio.streams.LimitOverrunError: Separator is not found, and chunk exceed the limit

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/sbin/cephadm5-1", line 8812, in <module>
    main()
  File "/sbin/cephadm5-1", line 8800, in main
    r = ctx.func(ctx)
  File "/sbin/cephadm5-1", line 1886, in _infer_config
    return func(ctx)
  File "/sbin/cephadm5-1", line 1856, in _infer_fsid
    return func(ctx)
  File "/sbin/cephadm5-1", line 1914, in _infer_image
    return func(ctx)
  File "/sbin/cephadm5-1", line 1814, in _validate_fsid
    return func(ctx)
  File "/sbin/cephadm5-1", line 5056, in command_ceph_volume
    out, err, code = call_throws(ctx, c.run_cmd())
  File "/sbin/cephadm5-1", line 1614, in call_throws
    out, err, ret = call(ctx, command, desc, verbosity, timeout, **kwargs)
  File "/sbin/cephadm5-1", line 1596, in call
    stdout, stderr, returncode = async_run(run_with_timeout())
  File "/sbin/cephadm5-1", line 1536, in async_run
    return loop.run_until_complete(coro)
  File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
    return future.result()
  File "/sbin/cephadm5-1", line 1587, in run_with_timeout
    tee(process.stderr))
  File "/sbin/cephadm5-1", line 1568, in tee
    async for line in reader:
  File "/usr/lib64/python3.6/asyncio/streams.py", line 692, in __anext__
    val = yield from self.readline()
  File "/usr/lib64/python3.6/asyncio/streams.py", line 497, in readline
    raise ValueError(e.args[0])
ValueError: Separator is not found, and chunk exceed the limit