Activity
From 08/24/2022 to 09/22/2022
09/22/2022
- 05:29 PM Bug #57651 (Resolved): cephadm: serve loop just loops forever if migration_current is too high
- cephadm uses the config option mgr/cephadm/migration_current to track it doing a set of migration steps. In normal op...
- 05:18 PM Bug #55605 (Resolved): Rook orchestrator py exception with NFS commands
- 04:49 PM Backport #57601 (Resolved): quincy: Rook orchestrator py exception with NFS commands
- 03:48 PM Backport #57644 (In Progress): pacific: haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl s...
- 02:38 PM Backport #57644 (Resolved): pacific: haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl setting
- https://github.com/ceph/ceph/pull/48212
- 03:46 PM Backport #57645 (In Progress): quincy: haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl se...
- 02:39 PM Backport #57645 (Resolved): quincy: haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl setting
- https://github.com/ceph/ceph/pull/48211
- 02:33 PM Bug #57563 (Pending Backport): haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl setting
- 02:28 PM Bug #57305 (Closed): bootstrap mgr timeout is too short
- Closing because the timeout is configurable and the default values are good enough.
- 02:23 PM Backport #57639 (In Progress): pacific: cephadm: `ceph orch ps` doesn't list container versions i...
- 01:55 PM Backport #57639 (Resolved): pacific: cephadm: `ceph orch ps` doesn't list container versions in s...
- https://github.com/ceph/ceph/pull/48210
- 02:12 PM Feature #57254 (Closed): RGW deployment should fail early if port number is already in use
- Technically it should be possible to detect which ports are in use on all the nodes but there're more things to keep ...
- 02:01 PM Backport #57640 (In Progress): quincy: cephadm: `ceph orch ps` doesn't list container versions in...
- 01:55 PM Backport #57640 (Resolved): quincy: cephadm: `ceph orch ps` doesn't list container versions in so...
- https://github.com/ceph/ceph/pull/48208
- 01:54 PM Backport #57638 (Resolved): pacific: applying osd service spec with size filter fails if there's ...
- https://github.com/ceph/ceph/pull/48243
- 01:54 PM Backport #57637 (Resolved): quincy: applying osd service spec with size filter fails if there's t...
- https://github.com/ceph/ceph/pull/48242
- 01:51 PM Bug #57558 (Pending Backport): cephadm: `ceph orch ps` doesn't list container versions in some cases
- 01:46 PM Bug #57609 (Pending Backport): applying osd service spec with size filter fails if there's tiny (...
09/21/2022
- 09:30 PM Bug #57096: osd not restarting after upgrading to quincy due to podman args --cgroups=split
- @Ween I found another thing that may be helpful. For OSDs that are not attached to a spec you can make them attached ...
- 08:11 PM Backport #57601 (In Progress): quincy: Rook orchestrator py exception with NFS commands
- 04:54 PM Bug #54071: rados/cephadm/osds: Invalid command: missing required parameter hostname(<string>)
- /a/yuriw-2022-09-09_14:59:25-rados-wip-yuri2-testing-2022-09-06-1007-pacific-distro-default-smithi/7022651
- 01:39 PM Cleanup #57621 (New): cephadm: improve unit test coverage for cephadm binary
- As part of the process outlined in https://pad.ceph.com/p/cephadm-refactoring we want to have good test coverage in t...
09/20/2022
- 06:11 PM Bug #57175: cephadm: don't try to write client/os tuning files to offline hosts
- Laura Flores wrote:
> We tried upgrading the Gibba cluster to the quincy-release for 17.2.4 and experienced this iss... - 06:07 PM Bug #57175: cephadm: don't try to write client/os tuning files to offline hosts
- We tried upgrading the Gibba cluster to the quincy-release for 17.2.4 and experienced this issue, but with a drained ...
- 02:06 PM Bug #57290 (Resolved): orch/cephadm: task/test_cephadm failure due to: ERROR: A cluster with the ...
- 02:06 PM Backport #57398 (Resolved): pacific: orch/cephadm: task/test_cephadm failure due to: ERROR: A clu...
- 02:05 PM Bug #57268 (Resolved): rook: The CustomResourceDefinition "installations.operator.tigera.io" is i...
- 02:05 PM Backport #57503 (Resolved): pacific: rook: The CustomResourceDefinition "installations.operator.t...
- 01:33 PM Feature #57078 (Resolved): cephadm: cephadm should reconfig iscsi daemons if trusted_ip_list changes
- 01:33 PM Backport #57528 (Resolved): pacific: cephadm: cephadm should reconfig iscsi daemons if trusted_ip...
- 01:11 PM Bug #57335 (Resolved): cephadm gather-facts reports disk size incorecctly for native 4k sectors
- 01:11 PM Backport #57424 (Resolved): pacific: cephadm gather-facts reports disk size incorecctly for nativ...
- 01:10 PM Feature #54308 (Resolved): monitoring/prometheus: mgr/cephadm should support a data retention spe...
- 01:09 PM Backport #57427 (Resolved): pacific: monitoring/prometheus: mgr/cephadm should support a data ret...
- 01:07 PM Bug #56508 (Resolved): haproxy check fails for ceph-grafana service
- 01:07 PM Backport #57384 (Resolved): pacific: haproxy check fails for ceph-grafana service
- 07:56 AM Bug #57614 (Resolved): "ceph nfs cluster create ..." always show process bound to 2049: unable to...
- Here an example of the issue described in $subject:
root@devstack:/# ceph orch ls
NAME PORTS RUNNING ... - 05:46 AM Bug #57609 (Fix Under Review): applying osd service spec with size filter fails if there's tiny (...
- 05:33 AM Bug #57609 (Resolved): applying osd service spec with size filter fails if there's tiny (KB-sized...
- This issue came up on a system with a 4KB virtual floppy disk drive.
@ceph-volume inventory@ gives:...
09/19/2022
- 07:02 PM Bug #57422 (Resolved): cephadm: allow setting --storage.tsdb.retention.size for prometheus
- 07:01 PM Backport #57520 (Resolved): quincy: cephadm: allow setting --storage.tsdb.retention.size for prom...
- 07:01 PM Backport #57428 (Resolved): quincy: monitoring/prometheus: mgr/cephadm should support a data rete...
- 07:00 PM Bug #57096 (Resolved): osd not restarting after upgrading to quincy due to podman args --cgroups=...
- 06:59 PM Backport #57526 (Resolved): quincy: osd not restarting after upgrading to quincy due to podman ar...
- 06:58 PM Backport #57527 (Resolved): quincy: cephadm: cephadm should reconfig iscsi daemons if trusted_ip_...
- 06:57 PM Bug #57405 (Resolved): cephadm: tuned-profiles with dashes in name are automatically removed.
- 06:57 PM Backport #57525 (Resolved): quincy: cephadm: tuned-profiles with dashes in name are automatically...
- 06:57 PM Bug #57191 (Resolved): [cephadm] os tuned profile setting names are not validated from cephadm side
- 06:56 PM Bug #57192 (Resolved): [cephadm] os tuned profile placement hosts are not validated
- 06:56 PM Backport #57524 (Resolved): quincy: [cephadm] os tuned profile placement hosts are not validated
- 06:55 PM Bug #57369 (Resolved): cephadm: do not use "sudo" when checking host is reachable if user is root
- 06:55 PM Backport #57521 (Resolved): quincy: cephadm: do not use "sudo" when checking host is reachable if...
- 03:13 PM Backport #57601 (Resolved): quincy: Rook orchestrator py exception with NFS commands
- https://github.com/ceph/ceph/pull/48199
- 03:05 PM Bug #55605 (Pending Backport): Rook orchestrator py exception with NFS commands
- 01:12 PM Documentation #57596 (Rejected): MON Service
- Recently service specification using yaml has been introduced and the documentation has been added under https://docs...
- 12:31 PM Bug #54029: orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} test f...
- Failing with new timeout as well. Should we open a new tracker?...
09/18/2022
- 11:06 AM Bug #52321: qa/tasks/rook times out: 'check osd count' reached maximum tries (90) after waiting f...
- /a/yuriw-2022-09-14_20:04:05-rados-wip-yuri3-testing-2022-09-13-0928-distro-default-smithi/7033174
/a/yuriw-2022-0... - 11:01 AM Bug #57311: rook: ensure CRDs are installed first
- /a/yuriw-2022-09-14_20:04:05-rados-wip-yuri3-testing-2022-09-13-0928-distro-default-smithi/7033172
/a/yuriw-2022-0...
09/16/2022
- 03:17 PM Backport #57504 (Resolved): quincy: rook: The CustomResourceDefinition "installations.operator.ti...
09/15/2022
- 02:29 PM Bug #57563 (Fix Under Review): haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl setting
- 02:27 PM Bug #57563 (Resolved): haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl setting
- haproxy requires the `net.ipv4.ip_nonlocal_bind` sysctl setting otherwise it cannot bind to the configured ingress VI...
- 01:37 PM Bug #57558 (Resolved): cephadm: `ceph orch ps` doesn't list container versions in some cases
- If the software within a container returns its version as stdout, it's not listed as part of the `ceph orch ps` comma...
09/14/2022
- 08:08 PM Backport #57384 (In Progress): pacific: haproxy check fails for ceph-grafana service
- 08:00 PM Backport #57379 (In Progress): pacific: cephadm: bootstrap should return non-zero exit code when ...
- 07:56 PM Backport #57398 (In Progress): pacific: orch/cephadm: task/test_cephadm failure due to: ERROR: A ...
- 07:55 PM Backport #57427 (In Progress): pacific: monitoring/prometheus: mgr/cephadm should support a data ...
- 07:41 PM Backport #57376 (In Progress): pacific: mgr/dashboard: enable addition custom Prometheus alerts
- 07:20 PM Backport #57424 (In Progress): pacific: cephadm gather-facts reports disk size incorecctly for na...
- 07:16 PM Backport #57503 (In Progress): pacific: rook: The CustomResourceDefinition "installations.operato...
- 06:30 PM Backport #57528 (In Progress): pacific: cephadm: cephadm should reconfig iscsi daemons if trusted...
- 06:03 PM Backport #55955 (Rejected): pacific: cephadm/test_cephadm.sh: ERROR: A cluster with the same fsid...
- 06:03 PM Bug #55162 (Closed): cephadm/test_cephadm.sh: ERROR: A cluster with the same fsid already exists
09/13/2022
- 07:55 PM Bug #57174: NFS dashboard requires orchestrator backend to be set, but python shared lib does not
- I'm not sure which is the culprit.
- 07:21 PM Backport #57504 (In Progress): quincy: rook: The CustomResourceDefinition "installations.operator...
- 07:19 PM Backport #57521 (In Progress): quincy: cephadm: do not use "sudo" when checking host is reachable...
- 01:19 PM Backport #57521 (Resolved): quincy: cephadm: do not use "sudo" when checking host is reachable if...
- https://github.com/ceph/ceph/pull/48079
- 07:17 PM Backport #57524 (In Progress): quincy: [cephadm] os tuned profile placement hosts are not validated
- 03:57 PM Backport #57524 (Resolved): quincy: [cephadm] os tuned profile placement hosts are not validated
- https://github.com/ceph/ceph/pull/48078
- 07:10 PM Backport #57525 (In Progress): quincy: cephadm: tuned-profiles with dashes in name are automatica...
- 04:07 PM Backport #57525 (Resolved): quincy: cephadm: tuned-profiles with dashes in name are automatically...
- https://github.com/ceph/ceph/pull/48077
- 07:08 PM Backport #57527 (In Progress): quincy: cephadm: cephadm should reconfig iscsi daemons if trusted_...
- 04:07 PM Backport #57527 (Resolved): quincy: cephadm: cephadm should reconfig iscsi daemons if trusted_ip_...
- https://github.com/ceph/ceph/pull/48076
- 07:04 PM Backport #57526 (In Progress): quincy: osd not restarting after upgrading to quincy due to podman...
- 04:07 PM Backport #57526 (Resolved): quincy: osd not restarting after upgrading to quincy due to podman ar...
- https://github.com/ceph/ceph/pull/48075
- 06:59 PM Backport #57520 (In Progress): quincy: cephadm: allow setting --storage.tsdb.retention.size for p...
- 12:32 PM Backport #57520 (Resolved): quincy: cephadm: allow setting --storage.tsdb.retention.size for prom...
- https://github.com/ceph/ceph/pull/47943
- 04:19 PM Bug #57191: [cephadm] os tuned profile setting names are not validated from cephadm side
- this is now being covered as part of https://tracker.ceph.com/issues/57192 and is fixed in main and awaiting quincy b...
- 04:07 PM Backport #57528 (Resolved): pacific: cephadm: cephadm should reconfig iscsi daemons if trusted_ip...
- https://github.com/ceph/ceph/pull/48096
- 04:01 PM Feature #57078 (Pending Backport): cephadm: cephadm should reconfig iscsi daemons if trusted_ip_l...
- 03:59 PM Bug #57096 (Pending Backport): osd not restarting after upgrading to quincy due to podman args --...
- 03:58 PM Bug #57405 (Pending Backport): cephadm: tuned-profiles with dashes in name are automatically remo...
- 03:56 PM Bug #57192 (Pending Backport): [cephadm] os tuned profile placement hosts are not validated
- 02:02 PM Documentation #57522 (New): cephadm: document config options
- I don't see any clear docs on all the config options and what each of them does (e.g. mgr/cephadm/container_init). A ...
- 01:39 PM Bug #57101 (Resolved): cephadm rm-cluster tries to zap rootfs device
- 01:39 PM Backport #57130 (Resolved): quincy: cephadm rm-cluster tries to zap rootfs device
- 01:39 PM Backport #57131 (Resolved): pacific: cephadm rm-cluster tries to zap rootfs device
- 01:38 PM Bug #56973 (Resolved): cephadm: support quotes around public/cluster network in custom config dur...
- 01:38 PM Backport #57098 (Resolved): quincy: cephadm: support quotes around public/cluster network in cust...
- 01:37 PM Backport #57397 (Resolved): quincy: orch/cephadm: task/test_cephadm failure due to: ERROR: A clus...
- 12:56 PM Bug #57369 (Pending Backport): cephadm: do not use "sudo" when checking host is reachable if user...
- 12:23 PM Bug #57422 (Pending Backport): cephadm: allow setting --storage.tsdb.retention.size for prometheus
09/12/2022
- 08:04 PM Backport #57504 (Resolved): quincy: rook: The CustomResourceDefinition "installations.operator.ti...
- https://github.com/ceph/ceph/pull/48080
- 08:04 PM Backport #57503 (Resolved): pacific: rook: The CustomResourceDefinition "installations.operator.t...
- https://github.com/ceph/ceph/pull/48097
- 07:57 PM Bug #57268 (Pending Backport): rook: The CustomResourceDefinition "installations.operator.tigera....
- 07:33 PM Bug #57482: cephadm/smoke-roleless: nfs-ingress test times out
- ...
- 06:10 PM Bug #53939: ceph-nfs-upgrade, pacific: Upgrade Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading d...
- https://github.com/ceph/ceph/pull/47535 was merged Sep 6th. Interested to see if we see this failure any more with bu...
- 05:58 PM Bug #54419: `ceph orch upgrade start` seems to never reach completion
- Laura Flores wrote:
> @Venky @Adam is https://tracker.ceph.com/issues/57255 a dupe of this Tracker?
Most likely, ...
09/11/2022
- 09:56 PM Backport #57425 (Resolved): quincy: cephadm gather-facts reports disk size incorecctly for native...
09/09/2022
- 01:29 PM Feature #57095 (Resolved): cephadm: cephadm should update dashboard grafana-api-password setting ...
- 01:28 PM Backport #57149 (Resolved): quincy: cephadm: cephadm should update dashboard grafana-api-password...
09/08/2022
- 10:51 PM Bug #57482 (New): cephadm/smoke-roleless: nfs-ingress test times out
- http://pulpito.front.sepia.ceph.com/amathuri-2022-09-08_14:19:23-rados-wip-yuri5-testing-2022-09-06-1334-pacific-dist...
- 10:41 PM Bug #54419: `ceph orch upgrade start` seems to never reach completion
- @Venky @Adam is https://tracker.ceph.com/issues/57255 a dupe of this Tracker?
- 10:41 PM Bug #57255: rados/cephadm/mds_upgrade_sequence, pacific : cephadm [ERR] Upgrade: Paused due to UP...
- /a/amathuri-2022-09-08_14:19:23-rados-wip-yuri5-testing-2022-09-06-1334-pacific-distro-default-smithi/7020752
- 10:35 PM Bug #54071: rados/cephadm/osds: Invalid command: missing required parameter hostname(<string>)
- Marking as high since this persists in the rados suite.
/a/amathuri-2022-09-08_14:19:23-rados-wip-yuri5-testing-20... - 10:31 PM Bug #57269: rook: unable to read URL "https://docs.projectcalico.org/manifests/tigera-operator.yaml"
- /a/amathuri-2022-09-08_14:19:23-rados-wip-yuri5-testing-2022-09-06-1334-pacific-distro-default-smithi/7020530
- 05:06 PM Feature #57080 (Resolved): cephadm: support for Oracle Linux
- 05:05 PM Backport #57168 (Resolved): quincy: cephadm: support for Oracle Linux
- 05:05 PM Bug #56972 (Resolved): cephadm: _no_schedule label doesn't work with explicit host placements
- 05:05 PM Backport #57151 (Resolved): quincy: cephadm: _no_schedule label doesn't work with explicit host p...
- 05:04 PM Bug #57007 (Resolved): cephadm: osd config not updated if mon configuration changes
- 05:04 PM Backport #57102 (Resolved): quincy: cephadm: osd config not updated if mon configuration changes
- 05:03 PM Backport #57375 (Resolved): quincy: mgr/dashboard: enable addition custom Prometheus alerts
- 05:01 PM Bug #57032 (Resolved): cephadm: --no-overwrite flag for tuned-profile apply has no effect
- 05:01 PM Backport #57426 (Resolved): quincy: cephadm: --no-overwrite flag for tuned-profile apply has no e...
- 04:57 PM Bug #57060 (Resolved): cephadm won't deploy mon service, reports wrongly filtered out
- 04:57 PM Backport #57423 (Resolved): quincy: cephadm won't deploy mon service, reports wrongly filtered out
- 04:57 PM Backport #57383 (Resolved): quincy: haproxy check fails for ceph-grafana service
- 04:56 PM Bug #57304 (Resolved): Cannot bind RGW to loopback address
- 04:56 PM Backport #57382 (Resolved): quincy: Cannot bind RGW to loopback address
- 04:55 PM Backport #57378 (Resolved): quincy: cephadm: bootstrap should return non-zero exit code when appl...
- 04:55 PM Bug #57175 (Resolved): cephadm: don't try to write client/os tuning files to offline hosts
- 04:54 PM Backport #57377 (Resolved): quincy: cephadm: don't try to write client/os tuning files to offline...
- 04:25 PM Bug #57290: orch/cephadm: task/test_cephadm failure due to: ERROR: A cluster with the same fsid '...
- /a/yuriw-2022-09-07_00:05:42-rados-wip-yuri6-testing-2022-09-06-1353-quincy-distro-default-smithi/7016929
09/07/2022
- 09:58 PM Bug #57096: osd not restarting after upgrading to quincy due to podman args --cgroups=split
- Ween Jiann Lee wrote:
> Adam King wrote:
> > It would basically involve pausing the upgrade, modifying the service ... - 09:15 PM Bug #57449: qa: removal of host during QA
- to be clear, it isn't removing the host itself here, just the ceph.conf on the host. If anything, it appears https://...
- 07:49 PM Bug #57338: Orchestrator not correctly parsing extra_container_args for volumes
- Sake Paulusma wrote:
> Adam King wrote:
> > Hi, as a potential workaround for now, you could maybe split this into ... - 03:14 PM Bug #57462: cephadm removes config & keyring files in mid flight
- Bug 2024301 was the issue referenced above ... https://bugzilla.redhat.com/show_bug.cgi?id=2024301
- 02:29 PM Bug #57462 (Resolved): cephadm removes config & keyring files in mid flight
- During testing, cephadm spontaneously removes the ceph.conf and keyring files from the admin/mon node and creates new...
- 02:55 PM Bug #57422 (Fix Under Review): cephadm: allow setting --storage.tsdb.retention.size for prometheus
- 11:25 AM Bug #57422 (In Progress): cephadm: allow setting --storage.tsdb.retention.size for prometheus
- 01:45 PM Feature #54135: cephadm controlled upgrade
- Adam King wrote:
> controlled upgrade args should be available in 16.2.10 and 17.2.1
Adam, this appears to not be... - 10:23 AM Bug #57305: bootstrap mgr timeout is too short
- Raising the default timeout may also lead to slow reaction in case of real issue. IMHO no changes are needed since th...
- 05:33 AM Bug #56951: rook/smoke: Updating cephclusters/rook-ceph is forbidden
- /a/yuriw-2022-09-03_14:52:22-rados-wip-yuri-testing-2022-09-02-0945-quincy-distro-default-smithi/7009620
09/06/2022
- 06:05 PM Bug #55986: cephadm: Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.Test...
- /a/yuriw-2022-08-24_14:38:24-rados-wip-yuri8-testing-2022-08-22-0646-distro-default-smithi/6989639
- 05:50 PM Feature #57404 (Fix Under Review): mgr/nfs: Add a sectype field to nfs exports created by nfs mgr...
- 05:25 PM Bug #57269: rook: unable to read URL "https://docs.projectcalico.org/manifests/tigera-operator.yaml"
- /a/yuriw-2022-08-22_16:21:19-rados-wip-yuri8-testing-2022-08-22-0646-distro-default-smithi/6985225
- 04:04 PM Bug #57449 (Resolved): qa: removal of host during QA
- ...
- 03:59 PM Backport #57169 (Resolved): pacific: cephadm: support for Oracle Linux
- 03:57 PM Backport #57099 (Resolved): pacific: cephadm: support quotes around public/cluster network in cus...
- 03:57 PM Backport #57103 (Resolved): pacific: cephadm: osd config not updated if mon configuration changes
- 03:55 PM Backport #57148 (Resolved): pacific: cephadm: cephadm should update dashboard grafana-api-passwor...
- 08:49 AM Bug #57444 (Resolved): Raise an error if no tunable settings have been specified for tuned-profiles
- 05:19 AM Bug #57444 (Resolved): Raise an error if no tunable settings have been specified for tuned-profiles
For example, following bad YAML spec doesn't raise an error nor a warning when applied:...
09/05/2022
- 11:08 AM Feature #49159: "cephadm ceph-volume activate" does not support cephadm
- Hi,
I ran into the same problem as Kenneth after reinstalling the OS on a machine running OSDs to upgrade from EL7... - 02:03 AM Bug #57096: osd not restarting after upgrading to quincy due to podman args --cgroups=split
- Adam King wrote:
> It would basically involve pausing the upgrade, modifying the service spec for the osds and rgws ...
09/04/2022
- 02:56 PM Bug #55319: qa/suites/orch/cephadm/osds: Failure to create osd due to ceph-volume lvm batch failure
- https://pulpito.ceph.com/adking-2022-09-03_23:13:39-orch:cephadm-wip-adk3-testing-2022-09-03-1327-quincy-distro-defau...
- 09:13 AM Backport #57397: quincy: orch/cephadm: task/test_cephadm failure due to: ERROR: A cluster with th...
- /a/yuriw-2022-09-02_15:23:14-rados-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7008149
/a/yuriw... - 08:17 AM Bug #56951: rook/smoke: Updating cephclusters/rook-ceph is forbidden
- /a/yuriw-2022-09-02_15:23:14-rados-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7008143/
/a/yuri...
09/03/2022
- 07:45 PM Documentation #56953 (Resolved): Daemon colocation documentation incorrect
- 07:45 PM Backport #57412 (Resolved): pacific: Daemon colocation documentation incorrect
- 05:14 PM Backport #57412 (In Progress): pacific: Daemon colocation documentation incorrect
- 07:45 PM Backport #57413 (Resolved): quincy: Daemon colocation documentation incorrect
- 05:13 PM Backport #57413 (In Progress): quincy: Daemon colocation documentation incorrect
- 05:22 PM Backport #57377 (In Progress): quincy: cephadm: don't try to write client/os tuning files to offl...
- 05:20 PM Backport #57378 (In Progress): quincy: cephadm: bootstrap should return non-zero exit code when a...
- 05:19 PM Backport #57382 (In Progress): quincy: Cannot bind RGW to loopback address
- 05:17 PM Backport #57383 (In Progress): quincy: haproxy check fails for ceph-grafana service
- 05:15 PM Backport #57397 (In Progress): quincy: orch/cephadm: task/test_cephadm failure due to: ERROR: A c...
- 05:12 PM Backport #57423 (In Progress): quincy: cephadm won't deploy mon service, reports wrongly filtered...
- 03:54 PM Backport #57423 (Resolved): quincy: cephadm won't deploy mon service, reports wrongly filtered out
- https://github.com/ceph/ceph/pull/47946
- 05:10 PM Backport #57425 (In Progress): quincy: cephadm gather-facts reports disk size incorecctly for nat...
- 04:03 PM Backport #57425 (Resolved): quincy: cephadm gather-facts reports disk size incorecctly for native...
- https://github.com/ceph/ceph/pull/47945
- 05:03 PM Backport #57426 (In Progress): quincy: cephadm: --no-overwrite flag for tuned-profile apply has n...
- 04:03 PM Backport #57426 (Resolved): quincy: cephadm: --no-overwrite flag for tuned-profile apply has no e...
- https://github.com/ceph/ceph/pull/47944
- 05:01 PM Backport #57428 (In Progress): quincy: monitoring/prometheus: mgr/cephadm should support a data r...
- 04:03 PM Backport #57428 (Resolved): quincy: monitoring/prometheus: mgr/cephadm should support a data rete...
- https://github.com/ceph/ceph/pull/47943
- 04:51 PM Backport #57375 (In Progress): quincy: mgr/dashboard: enable addition custom Prometheus alerts
- 04:03 PM Backport #57427 (Resolved): pacific: monitoring/prometheus: mgr/cephadm should support a data ret...
- https://github.com/ceph/ceph/pull/48100
- 04:02 PM Backport #57424 (Resolved): pacific: cephadm gather-facts reports disk size incorecctly for nativ...
- https://github.com/ceph/ceph/pull/48098
- 03:59 PM Feature #54308 (Pending Backport): monitoring/prometheus: mgr/cephadm should support a data reten...
- 03:58 PM Bug #57032 (Pending Backport): cephadm: --no-overwrite flag for tuned-profile apply has no effect
- 03:55 PM Bug #57335 (Pending Backport): cephadm gather-facts reports disk size incorecctly for native 4k s...
- 03:53 PM Bug #57060 (Pending Backport): cephadm won't deploy mon service, reports wrongly filtered out
- 03:40 PM Bug #57422 (Resolved): cephadm: allow setting --storage.tsdb.retention.size for prometheus
- We covered --storage.tsdb.retention.time with https://tracker.ceph.com/issues/54308 so we should support size as well...
- 03:19 PM Bug #57303 (Resolved): rados/cephadm: Failed to fetch package version from https://shaman.ceph.co...
- 03:16 PM Bug #57270 (Resolved): cephadm: RuntimeError: Failed command: apt-get update: E: The repository '...
- 03:15 PM Backport #57297 (Resolved): quincy: cephadm: RuntimeError: Failed command: apt-get update: E: The...
- 03:14 PM Backport #57314 (Resolved): quincy: rados/cephadm: Failed to fetch package version from https://s...
- 03:13 PM Bug #57371: orch/cephadm: cephadm_iscsi test 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin ad...
- have now seen this failure on main branch
https://pulpito.ceph.com/adking-2022-09-01_18:55:50-orch:cephadm-main-di...
09/02/2022
- 08:05 PM Backport #57314: quincy: rados/cephadm: Failed to fetch package version from https://shaman.ceph....
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/47910
merged - 06:45 PM Backport #57413 (Resolved): quincy: Daemon colocation documentation incorrect
- https://github.com/ceph/ceph/pull/47947
- 06:45 PM Backport #57412 (Resolved): pacific: Daemon colocation documentation incorrect
- https://github.com/ceph/ceph/pull/47948
- 06:36 PM Documentation #56953 (Pending Backport): Daemon colocation documentation incorrect
- 10:01 AM Documentation #56953 (In Progress): Daemon colocation documentation incorrect
- 03:23 PM Bug #57405 (Resolved): cephadm: tuned-profiles with dashes in name are automatically removed.
- cephadm checks the name of the profiles on the host to see if they match what should be there via...
- 03:22 PM Feature #57404 (Resolved): mgr/nfs: Add a sectype field to nfs exports created by nfs mgr module
- The rook team is working on adding LDAP and Kerberos support to the pods running nfs-ganesha. In order to enable "ker...
- 01:19 PM Backport #57398 (Resolved): pacific: orch/cephadm: task/test_cephadm failure due to: ERROR: A clu...
- https://github.com/ceph/ceph/pull/48101
- 01:19 PM Backport #57397 (Resolved): quincy: orch/cephadm: task/test_cephadm failure due to: ERROR: A clus...
- https://github.com/ceph/ceph/pull/47949
- 12:58 PM Bug #57290 (Pending Backport): orch/cephadm: task/test_cephadm failure due to: ERROR: A cluster w...
- 11:25 AM Bug #52279: cephadm tests fail due to: error adding seccomp filter rule for syscall bdflush: requ...
- From the error, it could be a podman issue: https://github.com/containers/podman/issues/11883
- 09:00 AM Bug #57366 (Fix Under Review): prometheus is not re-deployed when service-discovery port changes
- 08:50 AM Bug #57387: Bootstrapping with custom registry should set mgr config keys
- Not sure what would need to be done for the @cephadm@ to correctly login to a container registry for all machines aft...
- 07:08 AM Bug #57387 (New): Bootstrapping with custom registry should set mgr config keys
- Bootstrapping a cluster using a custom registry, with options @--registry-url@ @--registry-username@ @--registry-pass...
- 06:39 AM Bug #57338: Orchestrator not correctly parsing extra_container_args for volumes
- Adam King wrote:
> Hi, as a potential workaround for now, you could maybe split this into multiple lines. I know for... - 02:40 AM Bug #56951: rook/smoke: Updating cephclusters/rook-ceph is forbidden
- In a Quincy run:
https://pulpito.ceph.com/yuriw-2022-09-01_16:26:28-rados-wip-lflores-testing-2-2022-08-26-2240-qu... - 02:39 AM Bug #57270: cephadm: RuntimeError: Failed command: apt-get update: E: The repository 'https://dow...
- Quincy runs:
https://pulpito.ceph.com/yuriw-2022-09-01_16:26:28-rados-wip-lflores-testing-2-2022-08-26-2240-quincy... - 02:39 AM Bug #57303: rados/cephadm: Failed to fetch package version from https://shaman.ceph.com/api/searc...
- Quincy runs:
https://pulpito.ceph.com/yuriw-2022-09-01_16:26:28-rados-wip-lflores-testing-2-2022-08-26-2240-quincy...
09/01/2022
- 06:19 PM Backport #57384 (Resolved): pacific: haproxy check fails for ceph-grafana service
- https://github.com/ceph/ceph/pull/48103
- 06:19 PM Backport #57383 (Resolved): quincy: haproxy check fails for ceph-grafana service
- https://github.com/ceph/ceph/pull/47950
- 06:19 PM Backport #57382 (Resolved): quincy: Cannot bind RGW to loopback address
- https://github.com/ceph/ceph/pull/47951
- 06:17 PM Bug #57304 (Pending Backport): Cannot bind RGW to loopback address
- 06:16 PM Bug #56508 (Pending Backport): haproxy check fails for ceph-grafana service
- 06:07 PM Backport #57379 (Resolved): pacific: cephadm: bootstrap should return non-zero exit code when app...
- https://github.com/ceph/ceph/pull/48102
- 06:07 PM Backport #57378 (Resolved): quincy: cephadm: bootstrap should return non-zero exit code when appl...
- https://github.com/ceph/ceph/pull/47952
- 06:06 PM Backport #57377 (Resolved): quincy: cephadm: don't try to write client/os tuning files to offline...
- https://github.com/ceph/ceph/pull/47953
- 06:00 PM Bug #57173 (Pending Backport): cephadm: bootstrap should return non-zero exit code when applying ...
- 05:58 PM Bug #57175 (Pending Backport): cephadm: don't try to write client/os tuning files to offline hosts
- 05:49 PM Backport #57376 (Resolved): pacific: mgr/dashboard: enable addition custom Prometheus alerts
- https://github.com/ceph/ceph/pull/48099
- 05:49 PM Backport #57375 (Resolved): quincy: mgr/dashboard: enable addition custom Prometheus alerts
- https://github.com/ceph/ceph/pull/47942
- 05:44 PM Feature #57294 (Pending Backport): mgr/dashboard: enable addition custom Prometheus alerts
- 05:28 PM Bug #56573: test_cephadm.sh: KeyError: 'TYPE'
- https://pulpito.ceph.com/adking-2022-08-30_17:06:47-orch:cephadm-wip-adk-testing-2022-08-29-1644-distro-default-smith...
- 05:16 PM Bug #57374 (New): orch/cephadm: nfs-ingress-rgw tests failing with "Command failed on smithi158 w...
- I think this may just be another expression of the issue causing https://tracker.ceph.com/issues/57287, but going to ...
- 05:09 PM Backport #57314 (In Progress): quincy: rados/cephadm: Failed to fetch package version from https:...
- 03:46 PM Bug #57338: Orchestrator not correctly parsing extra_container_args for volumes
- Hi, as a potential workaround for now, you could maybe split this into multiple lines. I know for mounting a certific...
- 03:36 PM Bug #57371 (New): orch/cephadm: cephadm_iscsi test 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/s...
- Not yet sure if this was something caused by a PR in the run or something happening on main. Going to test with just ...
- 12:52 PM Bug #52279: cephadm tests fail due to: error adding seccomp filter rule for syscall bdflush: requ...
- /a/yuriw-2022-08-31_18:06:39-rados-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003285
- 12:28 PM Bug #57369 (Resolved): cephadm: do not use "sudo" when checking host is reachable if user is root
- For https://tracker.ceph.com/issues/55641 we made sure to not use sudo before all of our commands if the user is root...
- 12:25 PM Bug #52321: qa/tasks/rook times out: 'check osd count' reached maximum tries (90) after waiting f...
- /a/yuriw-2022-09-01_00:21:36-rados-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003412
- 12:17 PM Bug #57290: orch/cephadm: task/test_cephadm failure due to: ERROR: A cluster with the same fsid '...
- /a/yuriw-2022-09-01_00:21:36-rados-wip-yuri7-testing-2022-08-31-0841-distro-default-smithi/7003410
- 09:17 AM Bug #57366: prometheus is not re-deployed when service-discovery port changes
- relates to https://tracker.ceph.com/issues/51947 ?
- 08:31 AM Bug #57366 (Pending Backport): prometheus is not re-deployed when service-discovery port changes
- cephadm must redeploy prometheus when mgr/cephadm/service_discovery_port config option value changes.
- 08:29 AM Bug #57334 (Won't Fix): Use the same port for SD and agent
- After some testing I find it hard to use the same port for agent and service-discovery because connection fails while...
08/31/2022
- 12:04 PM Bug #57060 (Fix Under Review): cephadm won't deploy mon service, reports wrongly filtered out
- 10:56 AM Bug #57060 (In Progress): cephadm won't deploy mon service, reports wrongly filtered out
- 11:05 AM Bug #57305: bootstrap mgr timeout is too short
- Redouane Kachach Elhichou wrote:
> Thanks, did you try to use the --timeout / --retry arguments to adapt the timeout... - 09:43 AM Bug #57305: bootstrap mgr timeout is too short
- Thanks, did you try to use the --timeout / --retry arguments to adapt the timeout to your specific case and see if th...
08/30/2022
- 04:06 PM Bug #57341 (New): cephadm: failures from tests comparing output strings are difficult to debug
- When unit tests for the orchestrator/cephadm modules compare strings of things like config files or command output th...
- 11:50 AM Bug #57338 (In Progress): Orchestrator not correctly parsing extra_container_args for volumes
- At our company host certificates are automatically created and updated on the hostmachine. To set the correct certifi...
08/29/2022
- 11:56 PM Bug #57335 (Fix Under Review): cephadm gather-facts reports disk size incorecctly for native 4k s...
- 11:32 PM Bug #57335 (Resolved): cephadm gather-facts reports disk size incorecctly for native 4k sectors
- When the HDD is in native 4K format, the logical and physical logical blocksize is set to 4096 - and since the logica...
- 03:15 PM Bug #57334 (Won't Fix): Use the same port for SD and agent
- After the changes introduced as part of the PR https://github.com/ceph/ceph/pull/46400 cherrypy uses two different po...
- 03:04 PM Bug #57311: rook: ensure CRDs are installed first
- https://kubernetes.io/docs/concepts/security/pod-security-policy/
The PodSecurityPolicy resource type was removed ... - 02:31 PM Bug #57268 (In Progress): rook: The CustomResourceDefinition "installations.operator.tigera.io" i...
- 01:52 PM Bug #57268: rook: The CustomResourceDefinition "installations.operator.tigera.io" is invalid
- Code looks simple enough and there is already a use of 'kubectl create' in the same code block, so switching it to cr...
- 01:43 PM Bug #57268: rook: The CustomResourceDefinition "installations.operator.tigera.io" is invalid
- This error is probably caused by the use of `kubectl apply` in the tests (and the length of the custom resource defin...
- 11:23 AM Feature #57160 (Fix Under Review): Adding RGW multisite support to cephadm
08/26/2022
- 11:34 PM Bug #54071: rados/cephadm/osds: Invalid command: missing required parameter hostname(<string>)
- /a/yuriw-2022-08-24_16:39:47-rados-wip-yuri4-testing-2022-08-24-0707-pacific-distro-default-smithi/6990175
- 11:33 PM Bug #53939: ceph-nfs-upgrade, pacific: Upgrade Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading d...
- /a/yuriw-2022-08-24_16:39:47-rados-wip-yuri4-testing-2022-08-24-0707-pacific-distro-default-smithi/6990258
- 11:13 PM Bug #49287: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope n...
- /a/yuriw-2022-08-24_14:12:57-rados-wip-yuri-testing-2022-08-23-1120-quincy-distro-default-smithi/6989191
- 11:01 PM Bug #57311: rook: ensure CRDs are installed first
- /a/yuriw-2022-08-25_22:59:41-rados-wip-yuri3-testing-2022-08-24-0820-quincy-distro-default-smithi/6994124
- 07:05 PM Bug #57311 (New): rook: ensure CRDs are installed first
- /a/lflores-2022-08-25_17:56:48-rados-wip-yuri11-testing-2022-08-24-0658-distro-default-smithi/6992994...
- 10:55 PM Bug #57269: rook: unable to read URL "https://docs.projectcalico.org/manifests/tigera-operator.yaml"
- /a/yuriw-2022-08-25_22:59:41-rados-wip-yuri3-testing-2022-08-24-0820-quincy-distro-default-smithi/6994045
- 04:04 PM Bug #57269: rook: unable to read URL "https://docs.projectcalico.org/manifests/tigera-operator.yaml"
- /a/yuriw-2022-08-25_17:32:22-rados-tchaikov-wip-pacific-update-fio-5-distro-default-smithi/6992758
- 03:45 PM Bug #57269: rook: unable to read URL "https://docs.projectcalico.org/manifests/tigera-operator.yaml"
- /a/yuriw-2022-08-25_17:32:22-rados-tchaikov-wip-pacific-update-fio-5-distro-default-smithi/6992626
- 10:51 PM Backport #57314 (Resolved): quincy: rados/cephadm: Failed to fetch package version from https://s...
- https://github.com/ceph/ceph/pull/47910
- 10:51 PM Bug #57303 (Pending Backport): rados/cephadm: Failed to fetch package version from https://shaman...
- Several instances on a Quincy run: https://pulpito.ceph.com/yuriw-2022-08-25_22:59:41-rados-wip-yuri3-testing-2022-08...
- 09:24 PM Bug #57303 (Resolved): rados/cephadm: Failed to fetch package version from https://shaman.ceph.co...
- 05:06 PM Bug #57303: rados/cephadm: Failed to fetch package version from https://shaman.ceph.com/api/searc...
- /a/yuriw-2022-08-18_17:36:35-rados-wip-yuri5-testing-2022-08-18-0812-distro-default-smithi/6978841
- 05:09 PM Bug #52321: qa/tasks/rook times out: 'check osd count' reached maximum tries (90) after waiting f...
- /a/yuriw-2022-08-18_17:36:35-rados-wip-yuri5-testing-2022-08-18-0812-distro-default-smithi/6978855
- 12:48 PM Bug #57305: bootstrap mgr timeout is too short
- To be more specific on the machine setup: It is a 4GB rock64 running ubuntu 20.04 off an USB attached SSD.
- 12:43 PM Bug #57305: bootstrap mgr timeout is too short
- You can adjust the timeout (to use a higher value) by providing the --timeout argument (in seconds by default 60s) an...
- 12:04 PM Bug #57305: bootstrap mgr timeout is too short
- ...
- 11:55 AM Bug #57305: bootstrap mgr timeout is too short
- This concerns the bootstrap mgr wait timeout.
- 11:54 AM Bug #57305 (Closed): bootstrap mgr timeout is too short
- While doing a test installation of Ceph Quincy on our rock64 ARM64 machines, I spotted a problem with the timeout for...
- 12:09 PM Bug #57304 (Fix Under Review): Cannot bind RGW to loopback address
- 11:09 AM Bug #57304 (Resolved): Cannot bind RGW to loopback address
Steps de reproduce
1. create RADOS gateway with the following yaml:
---
service_type: rgw
service_id: ceph...- 10:58 AM Bug #56660 (Need More Info): Haproxy error for rgw service with ipv6
- 10:58 AM Bug #56660 (In Progress): Haproxy error for rgw service with ipv6
- 10:34 AM Bug #57032 (Fix Under Review): cephadm: --no-overwrite flag for tuned-profile apply has no effect
- 10:26 AM Feature #57254 (Fix Under Review): RGW deployment should fail early if port number is already in use
08/25/2022
- 11:07 PM Bug #57298 (Resolved): orchestrator: mgr-tox test failure testing orch ps, orch host ls, orch dev...
- tentatively marking this resolved. Should be fixed now on main at least although I'm not certain whether the failure ...
- 04:59 PM Bug #57298 (Resolved): orchestrator: mgr-tox test failure testing orch ps, orch host ls, orch dev...
- ...
- 07:43 PM Bug #49287: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope n...
- /a/yuriw-2022-08-17_19:34:54-rados-wip-yuri7-testing-2022-08-17-0943-quincy-distro-default-smithi/6977626
- 07:28 PM Bug #56951: rook/smoke: Updating cephclusters/rook-ceph is forbidden
- /a/yuriw-2022-08-17_19:34:54-rados-wip-yuri7-testing-2022-08-17-0943-quincy-distro-default-smithi/6977635
- 07:20 PM Bug #57303 (Resolved): rados/cephadm: Failed to fetch package version from https://shaman.ceph.co...
- Several occurrences with cephadm tests on this run, such as:
/a/yuriw-2022-08-17_19:34:54-rados-wip-yuri7-testing-... - 03:52 PM Bug #57287: orch/cephadm: 'mount -t nfs 10.0.31.109:/foouser /mnt/foo' failing in nfs-rgw-ingress...
- This could be related to the issue reported in librados testing, https://tracker.ceph.com/issues/57163
- 03:26 PM Backport #57297 (Resolved): quincy: cephadm: RuntimeError: Failed command: apt-get update: E: The...
- https://github.com/ceph/ceph/pull/47910
- 03:22 PM Bug #57270 (Pending Backport): cephadm: RuntimeError: Failed command: apt-get update: E: The repo...
- 03:19 PM Feature #57294 (Fix Under Review): mgr/dashboard: enable addition custom Prometheus alerts
- 12:46 PM Feature #57294 (Resolved): mgr/dashboard: enable addition custom Prometheus alerts
- Theoretically, the Prometheus configuration file cephadm creates already includes all alerting rules in `/etc/prometh...
- 12:12 PM Bug #57293 (New): cephadm: logrotate conflict between ceph-common and cephadm logrotate configs
- If you install ceph-common and run cephadm commands on the same host in certain distros (was able to recreate on ubun...
08/24/2022
- 07:27 PM Feature #57254 (In Progress): RGW deployment should fail early if port number is already in use
- 07:09 PM Bug #57287: orch/cephadm: 'mount -t nfs 10.0.31.109:/foouser /mnt/foo' failing in nfs-rgw-ingress...
- I see that the Ganesha version is 4.0.8
Looking at the ganesha log, it seems like the ganesha server hits "free():... - 05:19 PM Bug #57287: orch/cephadm: 'mount -t nfs 10.0.31.109:/foouser /mnt/foo' failing in nfs-rgw-ingress...
- in case it's useful, the ganesha.conf for the failed nfs daemon...
- 05:11 PM Bug #57287 (Closed): orch/cephadm: 'mount -t nfs 10.0.31.109:/foouser /mnt/foo' failing in nfs-rg...
- seeing nfs-ingress tests failing with ...
- 07:01 PM Bug #57290 (Resolved): orch/cephadm: task/test_cephadm failure due to: ERROR: A cluster with the ...
- This one I've actually been able to reproduce locally by running the test script. It seems that the shell command the...
- 05:50 PM Bug #57191 (Fix Under Review): [cephadm] os tuned profile setting names are not validated from ce...
- 12:55 PM Bug #57191 (In Progress): [cephadm] os tuned profile setting names are not validated from cephadm...
- 12:49 PM Bug #57255: rados/cephadm/mds_upgrade_sequence, pacific : cephadm [ERR] Upgrade: Paused due to UP...
- It looks like corner case to me where standby mgr somehow closing the connection with mon during mgr upgrade which ca...
- 12:44 PM Bug #57255: rados/cephadm/mds_upgrade_sequence, pacific : cephadm [ERR] Upgrade: Paused due to UP...
- Laura Flores wrote:
> Based on the error message in the mgr log, it looks like there is a problem with the mgr versi... - 12:28 PM Bug #57270 (In Progress): cephadm: RuntimeError: Failed command: apt-get update: E: The repositor...
- 12:00 PM Bug #57192 (Fix Under Review): [cephadm] os tuned profile placement hosts are not validated
Also available in: Atom