Project

General

Profile

Activity

From 10/13/2020 to 11/11/2020

11/11/2020

10:23 PM Bug #48205 (Fix Under Review): cephadm: last local ceph image tag can be null
Michael Fritch
10:19 PM Bug #48205: cephadm: last local ceph image tag can be null
Filtering this out to the list of image names seems more reasonable:... Michael Fritch
10:18 PM Bug #48205: cephadm: last local ceph image tag can be null
`--filter dangling=false` does not appear to trim the list when the image tag is null... Michael Fritch
10:16 PM Bug #48205 (Resolved): cephadm: last local ceph image tag can be null
... Michael Fritch
08:29 PM Bug #45808: cephadm/test_adoption.sh: Error parsing image configuration: Invalid status code retu...
This is likely docker rate limiting as per https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH... Brad Hubbard
07:38 PM Bug #45808: cephadm/test_adoption.sh: Error parsing image configuration: Invalid status code retu...
http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-05_20:17:33-rados-wip-yuri2-testing-2020-11-05-1029-octopus-distro-... Deepika Upadhyay
07:08 PM Bug #48162: octopus: all mgr daemons do not support module 'cephadm'
https://pulpito.ceph.com/yuriw-2020-11-10_20:43:58-rados-octopus-distro-basic-smithi/... Neha Ojha
05:06 PM Bug #48158: cephadm bootstrap fails with custom ssh port
Still no luck... Removed all ceph containers, removed /var/lib/ceph and /etc/ceph, then:... Thilo-Alexander Ginkel
04:02 AM Bug #48158: cephadm bootstrap fails with custom ssh port
maybe not entirely ideal, but I think this will work:
https://github.com/ceph/ceph/commit/193a1b3fc2faee50ccc87f78e4...
Michael Fritch
02:17 AM Bug #48158: cephadm bootstrap fails with custom ssh port
eh sorry, `ceph orch restart mgr` happens async, so issuing a `host add` immediately after won't work without some ki... Michael Fritch
04:14 PM Bug #47234 (Resolved): by default, cephadm creates 4 MONs
Adam King
01:56 PM Cleanup #48113 (Resolved): doc/mgr/orchestrator: Add hints related to custom containers to the docs
Nathan Cutler

11/10/2020

08:52 PM Bug #48158: cephadm bootstrap fails with custom ssh port
I tried including the restart in @cephadm@ after setting the ssh config, but that also does not seem to have any effe... Thilo-Alexander Ginkel
08:23 PM Bug #48158: cephadm bootstrap fails with custom ssh port
Thanks for your reply! Unfortunately, the workaround does not seem to work:... Thilo-Alexander Ginkel
07:58 PM Bug #48158 (Need More Info): cephadm bootstrap fails with custom ssh port
These are set using the generic ceph key/value store (ceph config-key), which would require a restart of the mgr. It ... Michael Fritch
01:37 PM Bug #48158: cephadm bootstrap fails with custom ssh port
Manually attempting to apply the troubleshooting instructions does indeed work, so the root cause is unclear to me:
...
Thilo-Alexander Ginkel
08:12 PM Bug #48171: catatonit not available on CentOS
https://pulpito.ceph.com/mgfritch-2020-11-10_01:16:20-rados:cephadm-wip-mgfritch-testing-2020-11-09-1644-distro-basic... Michael Fritch
08:11 PM Bug #48171 (Resolved): catatonit not available on CentOS
https://pulpito.ceph.com/mgfritch-2020-11-10_01:16:20-rados:cephadm-wip-mgfritch-testing-2020-11-09-1644-distro-basic... Michael Fritch
05:29 PM Bug #48166 (Fix Under Review): cephadm should be run as root
Michael Fritch
05:25 PM Bug #48166 (Resolved): cephadm should be run as root
... Michael Fritch
11:27 AM Bug #48164 (Resolved): Orchestrator: failed deployments leave orphaned auth entries
During upgrade tests to cephadm I had troubles deploying mds nodes. In the end I managed to deploy containerized mds ... Eugen Block
09:06 AM Bug #48162 (Resolved): octopus: all mgr daemons do not support module 'cephadm'
... Deepika Upadhyay

11/09/2020

10:59 PM Bug #48158 (Resolved): cephadm bootstrap fails with custom ssh port
Attempting to bootstrap a Ceph cluster using @cephadm@ fails if the host is using a non-standard SSH port instead of ... Thilo-Alexander Ginkel
10:50 PM Bug #48157: test_cephadm.sh failure You have reached your pull rate limit. You may increase the l...
/a/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605208 Neha Ojha
08:28 PM Bug #48157 (Resolved): test_cephadm.sh failure You have reached your pull rate limit. You may inc...
http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-09_17:43:09-rados-wip-yuri8-testing-2020-11-09-0807-octopus-distro-... Deepika Upadhyay
10:22 PM Bug #48144: rados/cephadm/upgrade: ceph_mons times out
I think this is a duplicate?
See: https://tracker.ceph.com/issues/48142#note-3
Michael Fritch
10:18 PM Bug #48144: rados/cephadm/upgrade: ceph_mons times out
/a/teuthology-2020-11-09_07:01:01-rados-master-distro-basic-smithi/5605118 Neha Ojha

11/06/2020

09:55 PM Bug #48107 (New): cephadm fails to deploy iscsi gateway when selinux is enabled
Nathan Cutler
05:33 PM Bug #48107: cephadm fails to deploy iscsi gateway when selinux is enabled
Nathan Cutler wrote:
> How did you deploy your iscsi gateway, if not using cephadm?
iSCSI gateway was deployed usi...
David Rivera
08:36 AM Bug #48107: cephadm fails to deploy iscsi gateway when selinux is enabled
> After a closer look, it looks like iSCSI gateway deployment doesn't use ceph-daemon
cephadm is not called "ceph-...
Nathan Cutler
07:39 PM Bug #48144 (Duplicate): rados/cephadm/upgrade: ceph_mons times out
... Neha Ojha
04:05 PM Cleanup #48140: cephadm: provide dashboard URL + credentials in an friendly way
Also somewhat related:
https://github.com/ceph/ceph/pull/37712#issuecomment-722631095
bin/cephadm needs to provid...
Michael Fritch
11:52 AM Cleanup #48140 (Duplicate): cephadm: provide dashboard URL + credentials in an friendly way
Right now after bootstrap stage, cephadm returns dashboard URL and credentials within the output of the whole command... Ernesto Puerta
03:45 PM Bug #48142: rados:cephadm/upgrade/mon_election tests are failing: CapAdd and privileged are mutua...
Fixed by this PR:
https://github.com/ceph/ceph/pull/37133
But that would require us to move the upgrade start poi...
Michael Fritch
03:44 PM Bug #48142: rados:cephadm/upgrade/mon_election tests are failing: CapAdd and privileged are mutua...
It's also appearing in the nightly Octopus test runs:
https://pulpito.ceph.com/teuthology-2020-11-01_02:30:03-rados-...
Michael Fritch
03:43 PM Bug #48142: rados:cephadm/upgrade/mon_election tests are failing: CapAdd and privileged are mutua...
A few more examples of this failure:
https://pulpito.ceph.com/kchang-2020-11-04_06:38:14-rados:cephadm-wip-kiefer-te...
Michael Fritch
03:30 PM Bug #48142 (Resolved): rados:cephadm/upgrade/mon_election tests are failing: CapAdd and privilege...
https://pulpito.ceph.com/mgfritch-2020-11-04_22:57:20-rados:cephadm-wip-mgfritch-testing-2020-11-04-1200-distro-basic... Michael Fritch

11/05/2020

09:20 PM Bug #48107: cephadm fails to deploy iscsi gateway when selinux is enabled
Nathan Cutler wrote:
> This looks like a mistake. https://github.com/ceph/ceph/pull/31321 contains a single commit 0...
David Rivera
10:15 AM Cleanup #48113: doc/mgr/orchestrator: Add hints related to custom containers to the docs
Backport PR for Octopus is https://github.com/ceph/ceph/pull/37962 Volker Theile
09:59 AM Cleanup #48113 (Pending Backport): doc/mgr/orchestrator: Add hints related to custom containers t...
Lenz Grimmer

11/04/2020

06:52 PM Bug #48120 (Fix Under Review): JSONDecodeErrors unclear during cephadm upgrade
Michael Fritch
06:42 PM Bug #48120 (Resolved): JSONDecodeErrors unclear during cephadm upgrade
a/teuthology/mgfritch-2020-11-03_14:22:58-rados:cephadm-wip-mgfritch-testing-2020-11-02-1045-distro-basic-smithi/5586... Michael Fritch
06:40 PM Bug #48119 (Fix Under Review): JSONDecodeErrors break OSD deploy
Michael Fritch
06:24 PM Bug #48119: JSONDecodeErrors break OSD deploy
a/teuthology/mgfritch-2020-11-03_14:22:58-rados:cephadm-wip-mgfritch-testing-2020-11-02-1045-distro-basic-smithi/5586... Michael Fritch
06:23 PM Bug #48119 (Resolved): JSONDecodeErrors break OSD deploy
a/teuthology/mgfritch-2020-11-03_14:22:58-rados:cephadm-wip-mgfritch-testing-2020-11-02-1045-distro-basic-smithi/5586... Michael Fritch
06:23 PM Feature #48074 (Resolved): cephadm logs needs a -f (follow) option
Ahh thanks! That works fine, and since it's documented in later versions of cephadm, we can probably close this. Jeff Layton
06:18 PM Bug #48118 (Fix Under Review): JSONDecodeErrors break the server loop
Michael Fritch
06:16 PM Bug #48118 (Resolved): JSONDecodeErrors break the server loop
a/mgfritch-2020-11-03_14:22:58-rados:cephadm-wip-mgfritch-testing-2020-11-02-1045-distro-basic-smithi/5586920/teuthol... Michael Fritch
01:52 PM Feature #48114 (Duplicate): Cephadm to support Adding multiple instances of RGW in same node for ...
Cephadm to support Adding multiple instances of RGW in same node for 5.0 Preethi Nataraj
01:41 PM Cleanup #48113 (Fix Under Review): doc/mgr/orchestrator: Add hints related to custom containers t...
Volker Theile
01:38 PM Cleanup #48113 (Resolved): doc/mgr/orchestrator: Add hints related to custom containers to the docs
The documentation how to deploy custom containers need some cleanup and additional information how to handle paths. Volker Theile
10:22 AM Bug #47924 (Closed): rook: 'ceph orch daemon add nfs' fails due to invalid field value
Fixed by https://tracker.ceph.com/issues/47923 Varsha Rao
10:17 AM Bug #48105: cephadm.py: failure on interactive on error for archive file handling
to reproduce: on teuthology: ... Deepika Upadhyay
09:20 AM Bug #48107 (Resolved): cephadm fails to deploy iscsi gateway when selinux is enabled
This looks like a mistake. https://github.com/ceph/ceph/pull/31321 contains a single commit 0444025aaf559a662882abc49... Nathan Cutler
07:38 AM Bug #47922 (Closed): rook: Failed to load ceph-mgr modules: cephadm, dashboard
This issue no longer occurs with latest master branch image. Varsha Rao
12:23 AM Bug #47923 (Pending Backport): rook: 'ceph orch apply nfs' throws error if no ganesha daemons are...
Patrick Donnelly

11/03/2020

10:46 PM Feature #48074: cephadm logs needs a -f (follow) option
arbitrary args to be can be passed to journalctl:... Michael Fritch
10:46 PM Bug #48107 (Can't reproduce): cephadm fails to deploy iscsi gateway when selinux is enabled
With Ceph 15.2.5 iSCSI Gateway containers will still fail start.
Applying the changes from the following pull requ...
David Rivera
06:17 PM Bug #48105 (Can't reproduce): cephadm.py: failure on interactive on error for archive file handling

when running on interactive on error mode,iirc, observed we might not be handling archive path generation:...
Deepika Upadhyay
11:30 AM Feature #48102 (New): cephadm: configure HA (cluster flags) for Alertmanager
While HA in metrics (Grafana) is less relevant (manual switchover is the basic workaround), alerting should always pe... Ernesto Puerta
09:32 AM Bug #48068 (Fix Under Review): cephadm: Various properties like 'last_refresh' do not contain tim...
Volker Theile

11/02/2020

09:56 PM Bug #47107: device-health-metrics unavailable because image ceph/ceph:latest has smartmontools 6.6
Dimitri temporarily added the Copr repository to the container images in https://github.com/ceph/ceph-container/pull/... Ken Dreyer
06:36 PM Bug #46038: cephadm mon start failure: Failed to reset failed state of unit ceph-9342dcfe-afd5-11...
observed in octopus:
http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-30_15:36:14-rados-wip-yuri-testing-2020-10-2...
Deepika Upadhyay
05:35 PM Feature #48074 (Resolved): cephadm logs needs a -f (follow) option
It would be nice to be able to follow logs as they are being printed from cephadm. Basically, be able to tell it to s... Jeff Layton
03:57 PM Bug #48072 (Fix Under Review): ppa:projectatomic is no longer maintained
Michael Fritch
03:54 PM Bug #48072: ppa:projectatomic is no longer maintained
ubuntu bionic (18.04) installs podman via ppa:projectatomic... Michael Fritch
03:52 PM Bug #48072 (Resolved): ppa:projectatomic is no longer maintained
a/mgfritch-2020-10-29_02:49:56-rados:cephadm-wip-mgfritch-testing-2020-10-28-1744-distro-basic-smithi/5569611/
<pr...
Michael Fritch
03:51 PM Bug #48071 (Resolved): rook: 'ceph orch ls' does not list nfs-ganesha daemons
... Varsha Rao
10:04 AM Bug #48068 (In Progress): cephadm: Various properties like 'last_refresh' do not contain timezone
Volker Theile
08:19 AM Bug #48068 (Resolved): cephadm: Various properties like 'last_refresh' do not contain timezone
The property 'last_refresh', 'created', 'started', 'last_configured' or 'last_deployed' in 'ServiceDescription' and '... Volker Theile

10/31/2020

10:48 AM Bug #48031 (Fix Under Review): Cephadm: Needs to pass cluster.listen-address to alertmanager
Nathan Cutler

10/30/2020

11:08 AM Bug #48041: mgr/cephadm: Allow customizing mgr/cephadm/lsmcli_blink_lights_cmd per host
Volker Theile wrote:
...
> The problem is that the template to build the command line to enable/disable the LEDs is...
Juan Miguel Olmo Martínez
08:22 AM Bug #48041 (Fix Under Review): mgr/cephadm: Allow customizing mgr/cephadm/lsmcli_blink_lights_cmd...
Volker Theile
07:11 AM Bug #48041: mgr/cephadm: Allow customizing mgr/cephadm/lsmcli_blink_lights_cmd per host
Juan Miguel Olmo Martínez wrote:
> Could you mind to explain better the problem?
>
> The blinking light feature i...
Volker Theile

10/29/2020

04:35 PM Bug #46764 (Can't reproduce): cephadm (ceph orch apply) sometimes gets "stuck" and cannot deploy ...
no longer reproducible Nathan Cutler
04:13 PM Bug #48041: mgr/cephadm: Allow customizing mgr/cephadm/lsmcli_blink_lights_cmd per host

Could you mind to explain better the problem?
The blinking light feature is to use with individual storage devic...
Juan Miguel Olmo Martínez
03:59 PM Bug #48041 (Resolved): mgr/cephadm: Allow customizing mgr/cephadm/lsmcli_blink_lights_cmd per host
PR https://github.com/ceph/ceph/pull/36911 introduced a feature to customize the command that is internally used to s... Volker Theile
03:06 PM Bug #47360 (Resolved): cephadm: osd unit.run creates /var/run/ceph/$FSID too late, so OSD may not...
backport to octopus via https://github.com/ceph/ceph/pull/37436 Nathan Cutler
01:57 PM Feature #46182 (Resolved): cephadm should use the same image reference across the cluster
backported to octopus via https://github.com/ceph/ceph/pull/37436 Nathan Cutler
01:56 PM Bug #46814 (Resolved): cephadm: Deploying alertmanager image is broken
backported to octopus via https://github.com/ceph/ceph/pull/36450 Nathan Cutler
01:06 PM Bug #46665 (Pending Backport): cephadm plugin: Failure to start service stops service loop; no ot...
Nathan Cutler

10/28/2020

05:49 PM Bug #48031: Cephadm: Needs to pass cluster.listen-address to alertmanager
I've submitted a pull request.
https://github.com/ceph/ceph/pull/37883
Dan Williams
05:12 PM Bug #48031 (Resolved): Cephadm: Needs to pass cluster.listen-address to alertmanager
When using public IP with the ceph dashboard/monitoring, alert manager will not start with the following error messag... Dan Williams
03:41 PM Bug #47923 (Fix Under Review): rook: 'ceph orch apply nfs' throws error if no ganesha daemons are...
Varsha Rao

10/27/2020

04:07 PM Bug #48019 (Can't reproduce): cephadm: `ceph daemon <daemon-name> ...` is broken
... Nathan Cutler
04:06 PM Documentation #45564: cephadm: document workaround for accessing the admin socket by entering run...
I just noticed this ticket is in the Documentation tracker. I opened a new ticket #48019 to track the actual bug (it ... Nathan Cutler

10/26/2020

09:47 PM Bug #47107: device-health-metrics unavailable because image ceph/ceph:latest has smartmontools 6.6
RHEL 8.3 is going to ship smartmontools 7 (https://bugzilla.redhat.com/show_bug.cgi?id=1671154).
In the meantime, ...
Ken Dreyer
11:14 AM Bug #45628: cephadm qa: smoke should verify daemons are actually running
The teuthology project is for tracking issues in teuthology itself, not for tracking missing test cases.
According...
Nathan Cutler

10/24/2020

10:06 AM Bug #47387 (Resolved): rook: 'ceph orch ps' does not list daemons correctly
The backport of this issue is done in https://github.com/ceph/ceph/pull/37436 Kiefer Chang

10/23/2020

10:29 AM Feature #47970 (New): cephadm: enable user to retrieve configuration templates for monitoring com...
Due to the necessity to migrate configuration files of monitoring components manually, the user should be able to con... Patrick Seidensal
10:20 AM Bug #47969 (New): cephadm: output migration of alertmanager is confusing
Though the migration process runs through successfully, the displayed output is probably confusing:... Patrick Seidensal
10:05 AM Bug #47924 (Fix Under Review): rook: 'ceph orch daemon add nfs' fails due to invalid field value
Varsha Rao
09:56 AM Bug #47923: rook: 'ceph orch apply nfs' throws error if no ganesha daemons are deployed
Currently, it works only if nfs-ganesha daemons are already deployed. Otherwise too, it should work. Since 'orch appl... Varsha Rao
09:48 AM Bug #47968 (Resolved): rook: 'ceph orch rm' throws type error
... Varsha Rao
08:10 AM Bug #47501 (Resolved): cephadm: Error bootstraping with '--container-init' option
Ricardo Marques

10/22/2020

11:42 AM Bug #44990 (New): cephadm: exec: "/usr/bin/ceph-mon": stat /usr/bin/ceph-mon: no such file or dir...
seems like this issue still exists as i see the fix PR was backported to octopus, seen this in:
/a/yuriw-2020-10-...
Deepika Upadhyay

10/21/2020

03:42 PM Bug #47924 (In Progress): rook: 'ceph orch daemon add nfs' fails due to invalid field value
Varsha Rao
08:44 AM Bug #47924 (Closed): rook: 'ceph orch daemon add nfs' fails due to invalid field value
... Varsha Rao
10:55 AM Bug #46031 (Resolved): Exception: Failed to validate Drive Group: block_wal_size must be of type int
Jan Fajerski
08:39 AM Bug #47923 (Resolved): rook: 'ceph orch apply nfs' throws error if no ganesha daemons are deployed
... Varsha Rao
08:03 AM Bug #47921: Bad auth caps for orchestrated mds daemon
mds created by "ceph orch apply mds 1" get auth caps of
mds.test_fs.******.gpqtol
key: ***************==
caps: [...
Yanshuo Li
08:01 AM Bug #47921 (Can't reproduce): Bad auth caps for orchestrated mds daemon
mds created by "ceph orch apply mds 1" get auth caps of... Yanshuo Li
08:02 AM Bug #47922 (Closed): rook: Failed to load ceph-mgr modules: cephadm, dashboard
Mgr log... Varsha Rao
07:23 AM Bug #47862 (Pending Backport): cepham no longer requires apparmor-abstractions on SUSE
Kefu Chai

10/20/2020

07:15 PM Bug #47916: podman containers running in a detached state do not output logs to journald
Configuring journald as the log driver allows for the conmon logs to show the actual output from the failed daemon co... Michael Fritch
07:11 PM Bug #47916 (Resolved): podman containers running in a detached state do not output logs to journald
When a service has failed, it can be difficult to determine the actual cause:... Michael Fritch

10/19/2020

07:00 PM Bug #47905 (Resolved): cephadm: cephadm bootstrap is missing structured output. (was: logging to...
cephadm CLI is currently using stderr for logging instead of stdout for info/debug statements.... Dimitri Savineau
08:10 AM Feature #47885 (New): Add networking checks
The networking checks could be added to the orchestrator, given its access to each of the nodes.
It could e.g.
1...
Vikhyat Umrao

10/15/2020

06:40 PM Bug #47873 (Resolved): /usr/lib/sysctl.d/90-ceph-osd.conf getting installed in container, renderi...
The file /usr/lib/sysctl.d/90-ceph-osd.conf has the following contents:... Nathan Cutler
04:21 PM Bug #47872 (Resolved): cephadm: ceph orch add osd does not show error
Trying to use:
# ceph orch daemon osd add hots1:/dev/sdc
No error presented and "hots1" does not exist in the clu...
Juan Miguel Olmo Martínez
10:17 AM Bug #47525 (Resolved): cephadm prepare-host time sync service list missing ntpsec
Kefu Chai

10/14/2020

02:50 PM Bug #47862 (Fix Under Review): cepham no longer requires apparmor-abstractions on SUSE
Nathan Cutler
02:37 PM Bug #47862 (Resolved): cepham no longer requires apparmor-abstractions on SUSE
We are currently carrying a commit - 070e5c3e35ea476815ff9fa4f71aed147fe1ea79 - which adds the following lines to cep... Nathan Cutler

10/13/2020

04:36 PM Bug #47796 (Can't reproduce): octopus: not possible to schedule "--suite rados/cephadm" teutholog...
Octopus centos 7 builds suddenly started to appear on Shaman, so the bug is presumably no longer reproducible. Nathan Cutler
10:59 AM Bug #45909 (New): already existing cluster deployed: cephadm bootstrap failure
Deepika Upadhyay
10:58 AM Bug #45909: already existing cluster deployed: cephadm bootstrap failure
Hey Sebastian,
I see this failure still, in conditions when there is an already existing cluster deployed: verifie...
Deepika Upadhyay
04:00 AM Bug #47841 (Fix Under Review): `ceph orch device ls` assumes lsm data is present
Nathan Cutler
01:01 AM Bug #47841 (Resolved): `ceph orch device ls` assumes lsm data is present
Found via the rook toolbox in a k8s environment:... Michael Fritch
 

Also available in: Atom