Activity
From 10/19/2022 to 11/17/2022
11/17/2022
- 11:46 PM Bug #57287: orch/cephadm: 'mount -t nfs 10.0.31.109:/foouser /mnt/foo' failing in nfs-rgw-ingress...
- Tracker #57163 was resolved by compiling with c++20. Perhaps that could also help in this case?
- 06:14 PM Bug #58045 (Resolved): orchestrator: incorrect size listed for devices in device ls
- currently when printing out the size in `ceph orch device ls` the orchestrator is calling a function that continually...
11/16/2022
11/14/2022
- 04:43 PM Bug #58021 (Resolved): Promteheus haproxy targets are down
- Using the latest code from main (v18.0) prometheus is not able to scrap the metrics of haproxy. This happens because ...
- 04:18 PM Bug #57998: cephadm stuck trying to download "mon"
- I executed the following:...
- 04:16 PM Bug #57998: cephadm stuck trying to download "mon"
- Here's the dump, there is definitely something fishy here, how do I remove it?...
- 11:04 AM Bug #57998 (Need More Info): cephadm stuck trying to download "mon"
- 03:51 PM Bug #51642: cephadm/rgw : RGW server is not coming up: Initialization timeout, failed to initialize
- I just ran into this issue and would like to propose reopening this.
radosgw should clearly log something when sta... - 12:09 PM Bug #57910: ingress: HAProxy fails to start because keepalived IP address not yet available on ne...
- As of the current design of the ingress service, the keepalived starts before haproxy because the daemon depends on t...
- 11:08 AM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- I tried to reproduce the issue with the same setup but wasn't successful so far. I started from a cluster running v17...
11/10/2022
- 07:09 PM Bug #57311: rook: ensure CRDs are installed first
- /a/yuriw-2022-10-17_17:31:25-rados-wip-yuri7-testing-2022-10-17-0814-distro-default-smithi/7070926
- 05:11 PM Backport #58004 (In Progress): quincy: rook/k8s: nfs cluster creation ends up with no daemons dep...
- 05:00 PM Backport #58004 (Resolved): quincy: rook/k8s: nfs cluster creation ends up with no daemons deploy...
- https://github.com/ceph/ceph/pull/48830
- 04:54 PM Bug #57954 (Pending Backport): rook/k8s: nfs cluster creation ends up with no daemons deployment
- 01:47 PM Bug #58001 (Fix Under Review): haproxy targets are not updated correctly in prometheus.yaml file
- 09:57 AM Bug #58001 (Resolved): haproxy targets are not updated correctly in prometheus.yaml file
- steps to reproduce the issue:
1) Bootstrap a new cluster (with monitoring enabled)
2) Wait until Prometheus is up...
11/09/2022
- 06:23 PM Bug #57999 (Resolved): cephadm: cephadm always reports new or changed devices even if devices are...
- This appears to be an issue with the "created" field changing, which should not affect equality in this case...
- 06:19 PM Bug #57998: cephadm stuck trying to download "mon"
- hmm, can I see what "ceph config dump" spits out (feel free to remove anything sensitive if if necessary)? All the im...
- 10:51 AM Bug #57998 (Resolved): cephadm stuck trying to download "mon"
- Entire cluster cephadm management is stuck and repeatedly tries to download an unqualified "mon" instead of the ceph ...
11/08/2022
- 12:03 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- Adam King wrote:
> this is a painful one. @David at least until we have a fix for this, I will mention that setting ... - 08:39 AM Feature #51971 (New): cephadm/ingress: update keepalived container image
- Reopning to check/address some of the concerns about the current keepalived image
- 01:20 AM Documentation #57991 (New): Migration documentation about osd service
- The documentation doesn't mention how to make the osds in the cluster managed, nor how to add new osds. A new cephadm...
11/05/2022
- 02:21 PM Bug #57954: rook/k8s: nfs cluster creation ends up with no daemons deployment
- *PR*: https://github.com/ceph/ceph/pull/48694
It has been approved.
11/04/2022
- 12:45 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- this is a painful one. @David at least until we have a fix for this, I will mention that setting the iscsi spec to un...
- 12:29 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- In this case I think it would be helpful to see what's the actual content of the deps. To get this information, from ...
11/02/2022
- 12:51 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- Attempts to stop or redeploy the daemon don't work as they seem to invoke a dependency check, which then restarts the...
- 10:48 AM Bug #57960: iscsi - rbd-target-api unkillable on container exit, daemon enters error state
- The systemd service shows the following:...
- 10:20 AM Bug #57960 (New): iscsi - rbd-target-api unkillable on container exit, daemon enters error state
- Hi,
We have seen lots of iscsi container restarts due to https://tracker.ceph.com/issues/57897 and during some of ...
11/01/2022
- 08:22 PM Bug #57897: ceph mgr restart causes restart of all iscsi daemons in a loop
- We currently have this situation again after an mgr failover for node maintenance/reboots and managed enabled debug l...
- 06:04 PM Cleanup #57957: cephadm: rename "extra_container_args"
- Additionally, the "args" field specific to Custom Containers. I think that "args" is an attractively named option for...
- 03:32 PM Cleanup #57957 (New): cephadm: rename "extra_container_args"
- we ideally want a different name that makes it more clear that these are arguments for the podman/docker run command ...
- 03:43 AM Bug #57954: rook/k8s: nfs cluster creation ends up with no daemons deployment
- I am working on this issue
- 03:42 AM Bug #57954 (Resolved): rook/k8s: nfs cluster creation ends up with no daemons deployment
- steps to reproduce:
1, with rook deploy Ceph 17.2.5 on k8s
2, run the following to enable rook as orchestrator with...
10/31/2022
- 05:22 PM Feature #57944: add option to allow for setting extra daemon args for containerized services
- We've hit this too.
- 04:07 PM Feature #57948 (Fix Under Review): Adding support for a secure ceph monitoring stack
- 10:05 AM Feature #57948 (Resolved): Adding support for a secure ceph monitoring stack
- Right now the communications between the monitoring components (prometheus, alertmanager, node-exporter, ..) is using...
- 05:04 AM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- And suddenly the upgrade is happening!!!
Today I rebooted ceph02, a node that only had the MDS, and suddenly thing...
10/29/2022
- 05:32 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- I am getting ready to add another node to the cluster. Is there anything you can think of I can check, pre or post?
10/28/2022
- 07:16 PM Feature #57944 (Resolved): add option to allow for setting extra daemon args for containerized se...
- The ceph orchestrator YML specs for service templates has an option for "extra_container_args" which allows the user ...
10/27/2022
- 06:39 AM Bug #57910: ingress: HAProxy fails to start because keepalived IP address not yet available on ne...
- Happens also (sometimes?) after re-provisioning an ingress server. After OS installed and when cephadm configures the...
10/26/2022
- 09:29 PM Bug #57755: task/test_orch_cli: test_cephfs_mirror times out
- /a/yuriw-2022-10-19_18:35:19-rados-wip-yuri10-testing-2022-10-19-0810-distro-default-smithi/7074978
- 12:52 PM Bug #57931 (Fix Under Review): RGW rgw_frontend_type field is not checked correctly during the sp...
- 08:23 AM Bug #57931 (Resolved): RGW rgw_frontend_type field is not checked correctly during the spec parsing
- A spec with the following type for example:...
10/25/2022
- 07:00 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- I rebooted last night, all items report a refreshed time of about 13 hours ago, when I rebooted....
- 12:14 PM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- this seems to imply the cephadm service loop just isn't running at all. Does the REFRESHED column in `ceph orch devic...
- 05:34 PM Bug #57917: cephadm: duplicate log entry for /var/log/ceph/cephadm.log
- As a workaround, I tried a `prerotate` script:...
- 04:08 AM Bug #57917: cephadm: duplicate log entry for /var/log/ceph/cephadm.log
- this is also problematic for users upgrading from Octopus based clusters to Pacific.
- 04:06 AM Bug #57917 (New): cephadm: duplicate log entry for /var/log/ceph/cephadm.log
- Configuration of logrotate for /var/lib/ceph/cephadm.log was added (and backported to Pacific) via this PR:
https://... - 12:18 PM Cleanup #57921 (Resolved): orchestrator: orch upgrade status help message is wrong
- Currently the `orch upgrade status` help message is just a copy of the `orch upgrade check` help message...
- 04:00 AM Cleanup #50168 (Resolved): cephadm: move bin/cephadm from the git tree to download.ceph.com
- 03:02 AM Backport #57638 (Resolved): pacific: applying osd service spec with size filter fails if there's ...
10/22/2022
- 03:16 AM Bug #57800: ceph orch upgrade does not appear to work with FQNDs.
- Seems I haven't seen the "host address is empty" error in about 10 days now.... Not sure if that is because of DNS,...
10/21/2022
- 03:55 PM Bug #56951: rook/smoke: Updating cephclusters/rook-ceph is forbidden
- /a/yuriw-2022-10-12_16:24:50-rados-wip-yuri8-testing-2022-10-12-0718-quincy-distro-default-smithi/7063866/
- 03:36 PM Bug #52321: qa/tasks/rook times out: 'check osd count' reached maximum tries (90) after waiting f...
- /a/yuriw-2022-10-12_16:24:50-rados-wip-yuri8-testing-2022-10-12-0718-quincy-distro-default-smithi/7063706/
- 09:53 AM Bug #57910 (New): ingress: HAProxy fails to start because keepalived IP address not yet available...
- After deploying a new cluster _sometimes_ HAProxy fails to start on ingress nodes:...
- 06:03 AM Feature #55490: cephadm: allow passing grafana cert and frontend-api-url in spec
- The OP mentioned @set-grafana-frontend-api-url@ but missed mentioning setting @set-grafana-api-url@ from a spec which...
10/20/2022
- 06:11 PM Feature #57909 (Resolved): cephadm: make logging host refresh data to debug logs configurable
- The amount of data we log in the debug logs when refreshing a host is too verbose, even for debug level. It renders t...
- 03:01 PM Backport #57638: pacific: applying osd service spec with size filter fails if there's tiny (KB-si...
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/48243
merged - 02:58 PM Backport #57639: pacific: cephadm: `ceph orch ps` doesn't list container versions in some cases
- Backport Bot wrote:
> https://github.com/ceph/ceph/pull/48210
merged
10/19/2022
- 05:56 PM Bug #57341: cephadm: failures from tests comparing output strings are difficult to debug
- See attached screenshot for a better colorized example.
- 05:53 PM Bug #57341: cephadm: failures from tests comparing output strings are difficult to debug
- I did a few minutes of research and found two packages that may help:
pytest-mock (https://pytest-mock.readthedocs.i... - 12:27 PM Bug #57897 (New): ceph mgr restart causes restart of all iscsi daemons in a loop
- We have observed that since v17.2.4, a restart of the active ceph mgr appears to cause all iSCSI daemons to restart a...
- 10:30 AM Feature #57894 (Fix Under Review): Move prometheus spec check to the service_spec module
- 10:18 AM Feature #57894 (Pending Backport): Move prometheus spec check to the service_spec module
Also available in: Atom