Project

General

Profile

Activity

From 07/14/2021 to 08/12/2021

08/12/2021

06:29 PM Bug #51667 (Fix Under Review): cephadm: host add existing host should be noop
Daniel Pivonka
02:39 PM Bug #51667 (In Progress): cephadm: host add existing host should be noop
Sebastian Wagner
04:56 PM Bug #51027: monmap drops rebooted mon if deployed via label
We can confirm this impacts 16.2.5 clusters. On host failures/reboots, we have to undeploy/redeploy monitors, which i... David Orman
04:01 PM Documentation #46335 (Resolved): Document "Using cephadm to set up rgw-nfs"
https://docs.ceph.com/en/latest/mgr/nfs/#create-rgw-export Sage Weil
02:40 PM Bug #52040 (In Progress): during an apply the host must be online otherwise the apply fails with ...
Sebastian Wagner
01:17 PM Bug #52109 (Won't Fix): test_cephadm.sh: Timeout('Port 8443 not free on 127.0.0.1.',)
test_cephadm.sh deploys two mgrs on the same host first one from bootstrap and the second with cephadm deploy. both m... Daniel Pivonka
09:44 AM Bug #46038 (New): cephadm mon start failure: Failed to reset failed state of unit ceph-9342dcfe-a...
hey Sebastian/orch team! I added cephadm based iscsi tests recently and am observing this failure after rebase, can y... Deepika Upadhyay
05:36 AM Feature #52237 (Closed): use cephadm shell to operate iscsi gateway
Right now a use has to attach to iscsi container in order to access iscsi gateway, the right way should be support gw... Deepika Upadhyay

08/11/2021

05:18 PM Bug #51632 (Pending Backport): cephadm: selinux is not checked against running configuration
Dimitri Savineau
05:17 PM Bug #51973 (Pending Backport): cephadm: global default ingress container images value
Dimitri Savineau
02:26 PM Bug #51590 (Pending Backport): cephadm: iscsi: The first gateway defined must be the local machine
Sebastian Wagner

08/10/2021

09:11 PM Bug #52116: kubeadm task fails with error execution phase wait-control-plane: couldn't initialize...
/a/sseshasa-2021-08-06_04:49:51-rados-wip-sseshasa2-testing-2021-08-04-1847-pacific-distro-basic-smithi/6323276 Neha Ojha
06:11 PM Feature #51947: cephadm: Redeploy services, on property update (was: Ingress for RGW does not app...
Ok, you're right, I did not redeploy, just re-applied the updated ingress yaml. I have tested on my newly upgraded 16... Jim Bartlett

08/09/2021

05:46 PM Bug #52116 (Resolved): kubeadm task fails with error execution phase wait-control-plane: couldn't...
... Neha Ojha
01:58 PM Bug #52109 (Won't Fix): test_cephadm.sh: Timeout('Port 8443 not free on 127.0.0.1.',)
https://sentry.ceph.com/organizations/ceph/issues/1585/?project=2&query=is%3Aunresolved+%22workunit+test+cephadm%22&s... Sebastian Wagner
01:53 PM Bug #51601: mgr/dashboard: server does not bind to all addresses anymore
do we need to do anything on the cephadm side? Sebastian Wagner

08/06/2021

10:22 PM Bug #51620 (Pending Backport): Ceph orch upgrade to 16.2.5 fails
Patrick Donnelly
09:40 AM Bug #52083 (Resolved): cephadm: networks_and_interfaces: duplicated IPs
From: https://c4b83513adcc4a3a9323-03e51d134fc1c044893e5fb53732499a.ssl.cf1.rackcdn.com/778915/68/check/tripleo-ci-ce... Sebastian Wagner

08/05/2021

08:21 PM Bug #51027 (In Progress): monmap drops rebooted mon if deployed via label
Adam King
12:08 PM Feature #51901 (Closed): cephadm: support pulling images from insecure registries
closing this one in favor of #52065 Guillaume Abrioux
11:18 AM Bug #49287 (Resolved): podman: setting cgroup config for procHooks process caused: Unit libpod-$h...
Fixed by https://github.com/opencontainers/runc/pull/2614 Sebastian Wagner
09:56 AM Feature #52065 (Fix Under Review): make cephadm support passing any additional parameter to eithe...
This is a feature request to make cephadm support passing any existing parameters from docker or podman CLI. Guillaume Abrioux
08:52 AM Bug #52064 (In Progress): octopus: cephadm bootstrap --container-init broken in Octopus
Tim Serong
08:46 AM Bug #52064 (Resolved): octopus: cephadm bootstrap --container-init broken in Octopus
In Octopus, when the user provides the "--container-init" option to "cephadm bootstrap", all containerized daemons in... Nathan Cutler

08/04/2021

09:10 PM Bug #51978: podman version check broken on cent7
podman 1.x isn't supported with Pacific
https://docs.ceph.com/en/latest/cephadm/compatibility/#cephadm-compatibili...
Dimitri Savineau
05:04 PM Bug #51978: podman version check broken on cent7
Please try to avoid running cephadm on centos 7: WE had to disable automated QE for it, cause the old kernel wasn't a... Sebastian Wagner
12:56 AM Bug #52042 (Resolved): After deployment the example of cephadm shell invocation is overly complex
If there is only one ceph instance on the host (which is the most likely user scenario), cephadm shell can infer the ... Paul Cuzner
12:52 AM Bug #52041 (New): `orch ps` shows wrong ports for MGR
Only one mgr is active, so any mgr module that has an associated listening port should only be listed against the act... Paul Cuzner
12:46 AM Bug #52040 (Resolved): during an apply the host must be online otherwise the apply fails with a t...
If a host is offline during an apply, the process stops with a traceback instead of continuing to the next host.
...
Paul Cuzner
12:40 AM Bug #52039 (New): cephadm rm-cluster should check whether the given fsid exists
if the fsid provided is not present in /var/lib/ceph a warning should be printed. The return status should be *succes... Paul Cuzner

08/03/2021

04:48 PM Bug #51794 (Pending Backport): mgr/test_orchestrator: remove pool and namespace from nfs service
Varsha Rao

08/02/2021

06:48 PM Bug #51806: cephadm: stopped contains end up in error state
I'm thinking this might not be a cephadm specific issue. For one thing, no matter what version I tested this with (I ... Adam King

07/31/2021

05:10 AM Bug #51961 (Resolved): Stuck progress indicators in ceph status output
Kefu Chai

07/30/2021

10:55 PM Bug #51978 (Closed): podman version check broken on cent7
I tried upgrading a test cluster (built on CentOS 7) from v15.2.13 to v16.2.5 today and ran into this problem:
---...
Bryan Stillwell
07:29 PM Bug #51973 (Fix Under Review): cephadm: global default ingress container images value
Dimitri Savineau
07:22 PM Bug #51973 (Resolved): cephadm: global default ingress container images value
All services (ceph/iscsi/ganesha, prometheus, alertmanager, node-exporter and grafana) have a global default containe... Dimitri Savineau
07:02 PM Feature #51972 (Resolved): cephadm/ingress: support TLS RGW backend
As per the documentation (and the code), the ingress service via haproxy doesn't support RGW backend with TLS. [1][2]... Dimitri Savineau
06:38 PM Feature #51971 (Resolved): cephadm/ingress: update keepalived container image
The default keepalived container image is : arcts/keepalived [1]
There's multiple issues here:
- We don't use a...
Dimitri Savineau
02:44 PM Feature #44414 (Fix Under Review): bubble up errors during 'apply' phase to 'cluster warnings'
Kefu Chai
10:59 AM Bug #51902 (Resolved): cephadm adopt fails on clean_cgroup
Kefu Chai
05:04 AM Bug #51616: Updating node-exporter deployment progress stuck
Thanks, Harry, this woraround worked for me, though I watched some different daemons which stuck during the update pr... Burkhard Obergoeker
01:51 AM Feature #51947: cephadm: Redeploy services, on property update (was: Ingress for RGW does not app...
Ok looks like you didn't redeploy the service after updating the spec file with the intermediate ca certificate right... Dimitri Savineau

07/29/2021

09:51 PM Feature #51947: cephadm: Redeploy services, on property update (was: Ingress for RGW does not app...
I finished to test with v16.2.5 and I counldn't reproduce the issue.... Dimitri Savineau
08:30 PM Feature #51947: cephadm: Redeploy services, on property update (was: Ingress for RGW does not app...
That's weird because the code doesn't do anything special from the ssl_cert value in the spec
https://github.com/c...
Dimitri Savineau
07:06 PM Feature #51901 (Fix Under Review): cephadm: support pulling images from insecure registries
Dimitri Savineau
06:06 PM Bug #51961 (Resolved): Stuck progress indicators in ceph status output
If an exception is thrown while cephadm is attempting to apply a service spec in the serve loop, the progress indicat... Cory Snyder
01:25 PM Bug #51601: mgr/dashboard: server does not bind to all addresses anymore
I think this is related to the change in the URI setting and hostname/IP address handling. Ernesto Puerta

07/28/2021

09:06 PM Bug #51902 (Fix Under Review): cephadm adopt fails on clean_cgroup
Dimitri Savineau
02:06 PM Bug #51902 (Resolved): cephadm adopt fails on clean_cgroup
Until recently, the cephadm adopt command was working perfectly.
Now this ends up with a stack trace...
Dimitri Savineau
07:32 PM Feature #51947 (New): cephadm: Redeploy services, on property update (was: Ingress for RGW does n...
Using v16.2.4, Ubuntu 20.04 hosts for cluster and ingress (haproxy) for RGW instances. Multisite setup with one zone ... Jim Bartlett
04:29 PM Bug #51829 (Resolved): cephadm: deploying cephadm-exporter fails with shutil SameFileError
Kefu Chai
03:01 PM Bug #49633: podman: ERROR (catatonit:2): failed to exec pid1: No such file or directory
... Kefu Chai
01:50 PM Feature #51901 (Closed): cephadm: support pulling images from insecure registries
For convenience, it would be nice if cephadm could support pulling images from insecure registries with a native opti... Guillaume Abrioux
04:48 AM Fix #51721 (Resolved): ingress: Fix for virtual_interface_networks not working
Kefu Chai

07/26/2021

06:56 AM Bug #51736: mgr hung forever when execute multiprocessing.pool.ThreadPool accidentally
Sebastian Wagner wrote:
> you're sure you did not hit #51733 ?
I think that the bug is different from #51733. The...
hongloumeng a

07/25/2021

08:20 PM Bug #51616: Updating node-exporter deployment progress stuck

Workaround (caution: temporarily disruptive), Assuming this is the only reported problem remaining after upgrade o...
Harry Coin
01:43 PM Bug #51298 (Resolved): ceph orch stop mgr should not stop all the mgrs and should give a warning ...
Kefu Chai

07/24/2021

11:51 AM Bug #51796 (Resolved): cephadm: unable to deploy grafana without mgr/dashboard
Kefu Chai

07/23/2021

03:24 PM Bug #51796 (Fix Under Review): cephadm: unable to deploy grafana without mgr/dashboard
Dimitri Savineau
03:03 PM Bug #51796 (In Progress): cephadm: unable to deploy grafana without mgr/dashboard
Dimitri Savineau
02:08 PM Bug #51829 (Resolved): cephadm: deploying cephadm-exporter fails with shutil SameFileError
... Adam King
02:06 PM Bug #51818: "ceph orch host add" presents unhelpful error message if target host is missing cephadm
in any case this is broken. the list (*[]*) should contain the error message. Somehow it got lost, leading to a non-h... Sebastian Wagner
01:24 AM Bug #51818: "ceph orch host add" presents unhelpful error message if target host is missing cephadm
Argh, sorry for the typos there, s/cephadm/ceph orch/ in several places. Lars Kellogg-Stedman
01:23 AM Bug #51818 (Resolved): "ceph orch host add" presents unhelpful error message if target host is mi...
When using "ceph orch host add", if the remote host is missing cephadm
and its dependencies then "ceph orch host add...
Lars Kellogg-Stedman
11:10 AM Documentation #47637: mgr/cephadm: document how to configure custom TLS certificate for Grafana
Reconfigure can be done easier with... Kai Stian Olstad
09:56 AM Bug #51794 (Fix Under Review): mgr/test_orchestrator: remove pool and namespace from nfs service
Varsha Rao
12:10 AM Bug #51817 (Resolved): FAILED tests/test_cephadm.py::TestShell::test_fsid - AttributeError: 'Fake...
... Sebastian Wagner

07/22/2021

04:27 PM Bug #51806: cephadm: stopped contains end up in error state
Adding ... Adam King
03:26 PM Bug #51806 (Need More Info): cephadm: stopped contains end up in error state
... Sebastian Wagner
03:53 PM Bug #51111: Pacific: CEPHADM_STRAY_DAEMON after deploying iSCSI gateway with cephadm due to tcmu-...
ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable) Tobias Fischer
03:53 PM Bug #51111: Pacific: CEPHADM_STRAY_DAEMON after deploying iSCSI gateway with cephadm due to tcmu-...
same here as well:... Tobias Fischer
12:04 PM Bug #51796 (Resolved): cephadm: unable to deploy grafana without mgr/dashboard
... Sebastian Wagner
11:08 AM Bug #51794 (Resolved): mgr/test_orchestrator: remove pool and namespace from nfs service
... Varsha Rao
09:20 AM Feature #51793 (Closed): cephadm: Grafana: Add switch to enable the Gafana admin account
Right now, users need to replace the Jinja2 template in order to enable the admin account. This has a few downsides. ... Sebastian Wagner
12:56 AM Bug #51355 (Resolved): ingress service /var/lib/haproxy/haproxy.cfg
Kefu Chai

07/21/2021

06:57 PM Feature #50815 (Fix Under Review): cephadm: Removing an offline host
Daniel Pivonka
02:22 PM Bug #51298 (In Progress): ceph orch stop mgr should not stop all the mgrs and should give a warni...
Adam King
12:36 PM Bug #51733: offline host hangs serve loop for 15 mins
only is happening is host is not gracefully shutdown Daniel Pivonka
12:05 PM Bug #51761 (Closed): journald logs are broken up again
... Sebastian Wagner
11:46 AM Bug #51311: Failed to apply ingress.rgw: IndexError: list index out of range
# ceph orch ls
NAME PORTS RUNNING REFRESHED AGE PLACEMENT
alertmanager ...
Sigurd Brinch
08:50 AM Bug #51311 (Fix Under Review): Failed to apply ingress.rgw: IndexError: list index out of range
Sebastian Wagner
08:15 AM Bug #51713 (Duplicate): Cephadm: Timeout waiting for ingress.nfs.foo to start
Sebastian Wagner
02:46 AM Support #51737: How to restore data after I reinstall host opera system
Sebastian Wagner wrote:
> I hope you still have a few MONs and MGRs left. Cause then, you can follow https://docs.ce...
The fool

07/20/2021

03:23 PM Bug #51713: Cephadm: Timeout waiting for ingress.nfs.foo to start
Seems to be failing consistently
rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingres...
Neha Ojha
02:13 PM Bug #51713: Cephadm: Timeout waiting for ingress.nfs.foo to start
... Sebastian Wagner
02:11 PM Bug #51355 (Fix Under Review): ingress service /var/lib/haproxy/haproxy.cfg
Sebastian Wagner
01:38 PM Bug #51736: mgr hung forever when execute multiprocessing.pool.ThreadPool accidentally
you're sure you did not hit #51733 ? Sebastian Wagner
02:50 AM Bug #51736 (Resolved): mgr hung forever when execute multiprocessing.pool.ThreadPool accidentally
Envrionment:
We have 30+ hosts cluster ceph. 3 mons, 3 mgrs, 330 osds.
Description:
After running one day approx...
hongloumeng a
12:52 PM Support #51737: How to restore data after I reinstall host opera system
I hope you still have a few MONs and MGRs left. Cause then, you can follow https://docs.ceph.com/en/latest/cephadm/os... Sebastian Wagner
02:51 AM Support #51737 (Resolved): How to restore data after I reinstall host opera system
I use cephadm bootstrap ceph cluster(2 host, 1 mon, 2 mgr, 6 osd, 2 mds, 1 cephfs).
For some reason, I need reinstal...
The fool

07/19/2021

08:43 PM Bug #51733 (Resolved): offline host hangs serve loop for 15 mins
when a host in your cluster goes offline the next time the serve loop starts _refresh_hosts_and_daemons() will be cal... Daniel Pivonka
06:04 PM Bug #51546 (Pending Backport): cephadm: remove iscsi service fails when the dashboard isn't deployed
Adam King
07:29 AM Documentation #47637: mgr/cephadm: document how to configure custom TLS certificate for Grafana
This is how I did it
Since @cephadm shell ceph config-key set mgr/cephadm/grafana_crt -i <cert-file>@ can't read f...
Kai Stian Olstad

07/18/2021

03:57 PM Bug #51355: ingress service /var/lib/haproxy/haproxy.cfg
The 2.3 haproxy version is pinned in 16.2.5, it works for me, please close this.
Asbjørn Sannes
03:51 PM Fix #51721 (Fix Under Review): ingress: Fix for virtual_interface_networks not working
Kefu Chai
03:43 PM Fix #51721: ingress: Fix for virtual_interface_networks not working
PR: https://github.com/ceph/ceph/pull/42389 Asbjørn Sannes
03:39 PM Fix #51721 (Resolved): ingress: Fix for virtual_interface_networks not working
If you follow the documentation and try to specify the interface by specificing subnets in the spec file, it does not... Asbjørn Sannes
09:21 AM Bug #51311: Failed to apply ingress.rgw: IndexError: list index out of range
What does ... Asbjørn Sannes

07/17/2021

10:53 AM Bug #51616: Updating node-exporter deployment progress stuck
I have exactly the same issue. In addition the dashboard is not working anymore. mgr is listenning on port 8443 but ... Enrico Kern

07/16/2021

04:17 PM Bug #51713 (Duplicate): Cephadm: Timeout waiting for ingress.nfs.foo to start
Test Description:
rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/nfs-ingress2 3-final}
L...
Sridhar Seshasayee
01:12 PM Bug #51665: document unforunate interactions between cephadm and restrictive sshd_config?
Let's set aside my earlier mention of ceph-salt for a moment, and focus only on the use of @cephadm bootstrap --ssh-u... Tim Serong

07/15/2021

01:48 PM Bug #51027: monmap drops rebooted mon if deployed via label
Still a problem in Pacific 16.2.5. Pretty much makes the 'assignment of mons by label' useless since the mon is lost... Harry Coin
01:45 PM Bug #51027: monmap drops rebooted mon if deployed via label
I think it's a mistake to put this in the 'orchestrator' problem list, because I think the logic that decides whether... Harry Coin

07/14/2021

03:59 PM Feature #47774: orch,cephadm: host search with filters
Paul Cuzner wrote:
> Do we really need this? In most enterprise environments I;ve worked in this type of thing gets ...
Ernesto Puerta
02:19 PM Bug #51642 (Resolved): cephadm/rgw : RGW server is not coming up: Initialization timeout, failed ...
Jiffin Tony Thottan
02:19 PM Bug #51642: cephadm/rgw : RGW server is not coming up: Initialization timeout, failed to initialize
Dimitri Savineau wrote:
> Answering to myself...
>
> [...]
>
> So I think we can close this issue.
I was ab...
Jiffin Tony Thottan
11:53 AM Bug #51668: cephadm shell repeats WARNING: The same type, major and minor should not be used for ...
also appears in https://tracker.ceph.com/issues/48261 Sebastian Wagner
09:47 AM Bug #51668 (Closed): cephadm shell repeats WARNING: The same type, major and minor should not be ...
Launching cephadm shell is quite noisy on our nodes running OSDs (48 OSDs, 96 copies of the warning).
It's probably ...
Dan van der Ster
10:22 AM Bug #51671 (Resolved): cephadm rm-cluster stuck: No indication that /run/cephadm/<fsid>.lock was ...
rm-cluster, it seemed to hang forever until I removed /run/cephadm/<fsid>.lock (and the cephadm.log was quickly flood... Sebastian Wagner
09:39 AM Bug #51667 (Resolved): cephadm: host add existing host should be noop
I ran `host add` from an _admin/mon host and it reset the addr to 127.0.1.1 and removed the labels.
I think this sho...
Dan van der Ster
09:12 AM Bug #51632 (Fix Under Review): cephadm: selinux is not checked against running configuration
Sebastian Wagner
08:41 AM Bug #51665 (Resolved): document unforunate interactions between cephadm and restrictive sshd_config?
This one is a little obscure, so please bear with me.
If you deploy ceph using ceph-salt, it will invoke @cephadm ...
Tim Serong
01:02 AM Bug #51620 (Resolved): Ceph orch upgrade to 16.2.5 fails
Kefu Chai
 

Also available in: Atom