Activity
From 10/11/2022 to 11/09/2022
11/09/2022
- 06:23 PM Bug #57999 (Resolved): cephadm: cephadm always reports new or changed devices even if devices are...
- This appears to be an issue with the "created" field changing, which should not affect equality in this case...
- 06:19 PM Bug #57998: cephadm stuck trying to download "mon"
- hmm, can I see what "ceph config dump" spits out (feel free to remove anything sensitive if if necessary)? All the im...
- 10:51 AM Bug #57998 (Resolved): cephadm stuck trying to download "mon"
- Entire cluster cephadm management is stuck and repeatedly tries to download an unqualified "mon" instead of the ceph ...
11/08/2022
- 12:03 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- Adam King wrote:
> this is a painful one. @David at least until we have a fix for this, I will mention that setting ... - 08:39 AM Feature #51971 (New): cephadm/ingress: update keepalived container image
- Reopning to check/address some of the concerns about the current keepalived image
- 01:20 AM Documentation #57991 (New): Migration documentation about osd service
- The documentation doesn't mention how to make the osds in the cluster managed, nor how to add new osds. A new cephadm...
11/05/2022
- 02:21 PM Bug #57954: rook/k8s: nfs cluster creation ends up with no daemons deployment
- *PR*: https://github.com/ceph/ceph/pull/48694
It has been approved.
11/04/2022
- 12:45 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- this is a painful one. @David at least until we have a fix for this, I will mention that setting the iscsi spec to un...
- 12:29 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- In this case I think it would be helpful to see what's the actual content of the deps. To get this information, from ...
11/02/2022
- 12:51 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- Attempts to stop or redeploy the daemon don't work as they seem to invoke a dependency check, which then restarts the...
- 10:48 AM Bug #57960: iscsi - rbd-target-api unkillable on container exit, daemon enters error state
- The systemd service shows the following:...
- 10:20 AM Bug #57960 (New): iscsi - rbd-target-api unkillable on container exit, daemon enters error state
- Hi,
We have seen lots of iscsi container restarts due to https://tracker.ceph.com/issues/57897 and during some of ...
11/01/2022
- 08:22 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- We currently have this situation again after an mgr failover for node maintenance/reboots and managed enabled debug l...
- 06:04 PM Cleanup #57957: cephadm: rename "extra_container_args"
- Additionally, the "args" field specific to Custom Containers. I think that "args" is an attractively named option for...
- 03:32 PM Cleanup #57957 (New): cephadm: rename "extra_container_args"
- we ideally want a different name that makes it more clear that these are arguments for the podman/docker run command ...
- 03:43 AM Bug #57954: rook/k8s: nfs cluster creation ends up with no daemons deployment
- I am working on this issue
- 03:42 AM Bug #57954 (Resolved): rook/k8s: nfs cluster creation ends up with no daemons deployment
- steps to reproduce:
1, with rook deploy Ceph 17.2.5 on k8s
2, run the following to enable rook as orchestrator with...
10/31/2022
- 05:22 PM Feature #57944: add option to allow for setting extra daemon args for containerized services
- We've hit this too.
- 04:07 PM Feature #57948 (Fix Under Review): Adding support for a secure ceph monitoring stack
- 10:05 AM Feature #57948 (Resolved): Adding support for a secure ceph monitoring stack
- Right now the communications between the monitoring components (prometheus, alertmanager, node-exporter, ..) is using...
- 05:04 AM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- And suddenly the upgrade is happening!!!
Today I rebooted ceph02, a node that only had the MDS, and suddenly thing...
10/29/2022
- 05:32 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- I am getting ready to add another node to the cluster. Is there anything you can think of I can check, pre or post?
10/28/2022
- 07:16 PM Feature #57944 (Resolved): add option to allow for setting extra daemon args for containerized se...
- The ceph orchestrator YML specs for service templates has an option for "extra_container_args" which allows the user ...
10/27/2022
- 06:39 AM Bug #57910: ingress: HAProxy fails to start because keepalived IP address not yet available on ne...
- Happens also (sometimes?) after re-provisioning an ingress server. After OS installed and when cephadm configures the...
10/26/2022
- 09:29 PM Bug #57755: task/test_orch_cli: test_cephfs_mirror times out
- /a/yuriw-2022-10-19_18:35:19-rados-wip-yuri10-testing-2022-10-19-0810-distro-default-smithi/7074978
- 12:52 PM Bug #57931 (Fix Under Review): RGW rgw_frontend_type field is not checked correctly during the sp...
- 08:23 AM Bug #57931 (Resolved): RGW rgw_frontend_type field is not checked correctly during the spec parsing
- A spec with the following type for example:...
10/25/2022
- 07:00 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- I rebooted last night, all items report a refreshed time of about 13 hours ago, when I rebooted....
- 12:14 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- this seems to imply the cephadm service loop just isn't running at all. Does the REFRESHED column in `ceph orch devic...
- 05:34 PM Bug #57917: cephadm: duplicate log entry for /var/log/ceph/cephadm.log
- As a workaround, I tried a `prerotate` script:...
- 04:08 AM Bug #57917: cephadm: duplicate log entry for /var/log/ceph/cephadm.log
- this is also problematic for users upgrading from Octopus based clusters to Pacific.
- 04:06 AM Bug #57917 (New): cephadm: duplicate log entry for /var/log/ceph/cephadm.log
- Configuration of logrotate for /var/lib/ceph/cephadm.log was added (and backported to Pacific) via this PR:
https://... - 12:18 PM Cleanup #57921 (Resolved): orchestrator: orch upgrade status help message is wrong
- Currently the `orch upgrade status` help message is just a copy of the `orch upgrade check` help message...
- 04:00 AM Cleanup #50168 (Resolved): cephadm: move bin/cephadm from the git tree to download.ceph.com
- 03:02 AM Backport #57638 (Resolved): pacific: applying osd service spec with size filter fails if there's ...
10/22/2022
- 03:16 AM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- Seems I haven't seen the "host address is empty" error in about 10 days now.... Not sure if that is because of DNS,...
10/21/2022
- 03:55 PM Bug #56951: rook/smoke: Updating cephclusters/rook-ceph is forbidden
- /a/yuriw-2022-10-12_16:24:50-rados-wip-yuri8-testing-2022-10-12-0718-quincy-distro-default-smithi/7063866/
- 03:36 PM Bug #52321: qa/tasks/rook times out: 'check osd count' reached maximum tries (90) after waiting f...
- /a/yuriw-2022-10-12_16:24:50-rados-wip-yuri8-testing-2022-10-12-0718-quincy-distro-default-smithi/7063706/
- 09:53 AM Bug #57910 (New): ingress: HAProxy fails to start because keepalived IP address not yet available...
- After deploying a new cluster _sometimes_ HAProxy fails to start on ingress nodes:...
- 06:03 AM Feature #55490: cephadm: allow passing grafana cert and frontend-api-url in spec
- The OP mentioned @set-grafana-frontend-api-url@ but missed mentioning setting @set-grafana-api-url@ from a spec which...
10/20/2022
- 06:11 PM Feature #57909 (Resolved): cephadm: make logging host refresh data to debug logs configurable
- The amount of data we log in the debug logs when refreshing a host is too verbose, even for debug level. It renders t...
- 03:01 PM Backport #57638: pacific: applying osd service spec with size filter fails if there's tiny (KB-si...
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/48243
merged - 02:58 PM Backport #57639: pacific: cephadm: `ceph orch ps` doesn't list container versions in some cases
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/48210
merged
10/19/2022
- 05:56 PM Bug #57341: cephadm: failures from tests comparing output strings are difficult to debug
- See attached screenshot for a better colorized example.
- 05:53 PM Bug #57341: cephadm: failures from tests comparing output strings are difficult to debug
- I did a few minutes of research and found two packages that may help:
pytest-mock (https://pytest-mock.readthedocs.i... - 12:27 PM Bug #57897 (New): ceph mgr restart causes restart of all iscsi daemons in a loop
- We have observed that since v17.2.4, a restart of the active ceph mgr appears to cause all iSCSI daemons to restart a...
- 10:30 AM Feature #57894 (Fix Under Review): Move prometheus spec check to the service_spec module
- 10:18 AM Feature #57894 (Pending Backport): Move prometheus spec check to the service_spec module
10/18/2022
- 06:04 PM Bug #57891 (Resolved): [Gibba Cluster] HEALTH_ERR: Upgrade: failed due to an unexpected exception
- - Upgrade paused due to one host not being reachable in the cluster.
- Resumed the upgrade with the resume command
... - 03:49 PM Backport #57787 (In Progress): quincy: mgr/nfs: Add a sectype field to nfs exports created by nfs...
- 08:19 AM Bug #57096: osd not restarting after upgrading to quincy due to podman args --cgroups=split
- I manually created the unit.meta, and it seems to work. thanks again.
- 06:28 AM Bug #57096: osd not restarting after upgrading to quincy due to podman args --cgroups=split
- The unit.meta file is not yet present in Octopus. I'll try to figure something out or wait for the PR release.
Tha...
10/17/2022
- 07:29 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- alright, looking back at the original traceback...
- 06:55 PM Bug #57884 (Resolved): cephadm: attempting a daemon redeploy of the active mgr with a specified i...
- If I run something like...
- 10:54 AM Feature #57878 (Resolved): Add typing checks for rgw module
- 09:32 AM Bug #57876 (Fix Under Review): prometheus ERROR failed to collect metrics
- 09:13 AM Bug #57876 (Resolved): prometheus ERROR failed to collect metrics
- ...
10/14/2022
- 06:50 PM Bug #57870 (Resolved): cephadm: --apply-spec is trying to do too much and failing as a result
- --apply-spec is intended to do 2 things:
1) distribute ssh keys to hosts with hosts specs in the applied spec
2) ... - 04:04 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- Oh, by all combinations, I mean I created DNS entries for all hosts, not just ceph02.
- 04:03 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- I add DNS entries for all combinations. So both ceph02.oldname.local and ceph02.domain.local are now valid names but...
- 10:45 AM Bug #57781 (Rejected): Fix prometheus dependencies calculation
- closing as the current behavior is correct. We just need to add some comments to clarify the logic.
- 10:21 AM Bug #57366 (Pending Backport): prometheus is not re-deployed when service-discovery port changes
- 10:20 AM Bug #57816 (Fix Under Review): Add support to configure protocol (http or https) for Grafana url ...
10/13/2022
- 04:08 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- it's odd that the hostname it reports not having an address for isn't even a hostname it has stored "ceph02.domain.lo...
10/11/2022
- 07:55 AM Backport #55991: pacific: Allow setting crush_device_class in OSD service specs
- I just tried to use the feature "crush_device_class" as it's supposed to be available, but it fails (I try to create ...
- 02:16 AM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- So, I did notice that I had set the domain name on one of the nodes to the "oldname.local" (when I was doing the find...
- 01:19 AM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- what does `ceph orch host ls` report for this host? This error should only be raised if we can't find any IP stored f...
- 01:24 AM Documentation #57596: MON Service
- the "networks" parameter inside the service spec is a separate thing from the public/cluster network. The public_netw...
Also available in: Atom