Project

General

Profile

Activity

From 02/22/2021 to 03/23/2021

03/23/2021

07:52 AM Support #49497: Cephadm fails to upgrade from 15.2.8 to 15.2.9
The error is still here with 15.2.10
Stuck on 15.2.8
Illya S.
04:09 AM Tasks #49871: cephadm bootstrap: print the podman version
Can I take this issue? Shreya Sharma
04:08 AM Bug #49737: cephadm bootstrap --skip-ssh skips too much
I think I've found and fixed the bug but I'm not able to reproduce the problem. How can I test it? Shreya Sharma
01:58 AM Bug #49013 (Pending Backport): cephadm: Service definition causes some container startups to fail
Sage Weil
01:57 AM Bug #49870 (Resolved): When 'ceph mgr dump' returns invalid JSON during the middle of spec applic...
Sage Weil
01:56 AM Bug #49909 (Resolved): CNI network "podman" not found
Sage Weil
01:56 AM Bug #46497 (Resolved): cephadm: prevent colon character for service_ids.
Sage Weil
01:56 AM Bug #49638 (Resolved): qa/workunits/cephadm/create_iscsi_disks.sh: The script only supports CentOS
Sage Weil
01:56 AM Feature #49235 (Resolved): cephadm: Log number of already upgraded daemons during upgrade process
Sage Weil

03/22/2021

10:05 PM Bug #49884 (Fix Under Review): cephadm bootstrp: verify major version of the image matches major ...
Sage Weil
09:21 PM Bug #49916 (Resolved): cephadm/test_dashboard_e2e.sh: api/rgw/daemon: 500 Internal Server Error
Sage Weil
06:31 AM Bug #49916: cephadm/test_dashboard_e2e.sh: api/rgw/daemon: 500 Internal Server Error
I think this fix from Alfonso will take care of that error: https://github.com/ceph/ceph/pull/40005 Nizamudeen A
06:25 AM Bug #49916 (Resolved): cephadm/test_dashboard_e2e.sh: api/rgw/daemon: 500 Internal Server Error
orchestrator/01-hosts.e2e-spec.ts/Hosts page -- should not add an exsiting host -- before each hook
in teuthology....
Kefu Chai
09:19 PM Bug #45327 (Fix Under Review): cephadm: Orch daemon add is not idempotent
we can't rely on 'orch apply mon ...' in octopus, at least not with the current scheduler, since it can't handle mult... Sage Weil
08:54 PM Bug #49870 (Pending Backport): When 'ceph mgr dump' returns invalid JSON during the middle of spe...
Sage Weil
07:53 PM Bug #49638 (Pending Backport): qa/workunits/cephadm/create_iscsi_disks.sh: The script only suppor...
Sage Weil
02:08 PM Bug #49909 (Pending Backport): CNI network "podman" not found
Sage Weil
07:05 AM Bug #49909 (Fix Under Review): CNI network "podman" not found
Kefu Chai
06:27 AM Bug #49909: CNI network "podman" not found
/a/kchai-2021-03-22_02:52:16-rados-wip-kefu2-testing-2021-03-21-2353-distro-basic-smithi/5986450 Kefu Chai
01:19 PM Bug #47333 (Pending Backport): repo_digest: fix `orch ps`
Adam King

03/21/2021

07:22 AM Bug #49449 (Fix Under Review): cephadm: synchronize container timezone with host
Kefu Chai

03/20/2021

11:58 PM Bug #46497 (Pending Backport): cephadm: prevent colon character for service_ids.
Sage Weil
07:33 PM Bug #49910 (Can't reproduce): cephadm | Creating initial admin user... | Please specify the file ...
I got this issue when trying to *bootstrap* the *cephadm* ... not sure if this is the right place for this bug so if ... Vermaden Nedamrev
06:04 PM Bug #49909: CNI network "podman" not found
so far always 20.04 and kubic podman... Sage Weil
06:03 PM Bug #49909: CNI network "podman" not found
/a/sage-2021-03-19_15:19:16-rados:cephadm-wip-sage-testing-2021-03-19-0956-distro-basic-smithi/5981022
Sage Weil
05:49 PM Bug #49909 (Resolved): CNI network "podman" not found
... Sage Weil
05:47 PM Bug #49674 (Resolved): monitoring unit.run files don't remove container first
this is a matter of redeploying to regenerate unit.run files Sage Weil
01:16 PM Bug #49805 (Pending Backport): unmanaged OSDs return to be managed OSDs after a cephadm module re...
Sage Weil

03/19/2021

06:24 PM Bug #49366 (Resolved): 'cephadm version' will show a trace back if image comes from a authenticat...
Backported to pacific in https://github.com/ceph/ceph/pull/39807 Ken Dreyer
06:21 PM Bug #49659 (Resolved): Exception found on "ceph orch osd rm stop" command
Backported to pacific in https://github.com/ceph/ceph/pull/40135 Ken Dreyer
01:56 PM Bug #49638 (Fix Under Review): qa/workunits/cephadm/create_iscsi_disks.sh: The script only suppor...
Sage Weil
01:53 PM Bug #49638: qa/workunits/cephadm/create_iscsi_disks.sh: The script only supports CentOS
on an ubuntu 20.04 host,... Sage Weil
12:31 PM Bug #49890 (Pending Backport): podman makes socket.getfqdn() return container name instead of hos...
Sage Weil
10:42 AM Bug #46745: cephadm does not set systemd dependencies when using docker
For the record, the Octopus backport is at https://github.com/ceph/ceph/pull/39804 Loïc Dachary
10:41 AM Bug #46745 (Resolved): cephadm does not set systemd dependencies when using docker
Loïc Dachary
10:41 AM Bug #46745 (Pending Backport): cephadm does not set systemd dependencies when using docker
Loïc Dachary
09:26 AM Bug #49737: cephadm bootstrap --skip-ssh skips too much
Can you point me to the relevant code/files if possible? Shreya Sharma

03/18/2021

06:27 PM Bug #49890 (Fix Under Review): podman makes socket.getfqdn() return container name instead of hos...
Sage Weil
06:26 PM Bug #49890 (Resolved): podman makes socket.getfqdn() return container name instead of hostname
podman adds a line like... Sage Weil
06:23 PM Bug #47333 (Fix Under Review): repo_digest: fix `orch ps`
Considering removing the image name field which technically fixes the image name issue in orch ps Adam King
06:09 PM Bug #49889 (Can't reproduce): mgr/orchestrator/_interface.py: ZeroDivisionError
... Neha Ojha
05:11 PM Feature #49235 (Pending Backport): cephadm: Log number of already upgraded daemons during upgrade...
Adam King
02:52 PM Bug #49884 (Resolved): cephadm bootstrp: verify major version of the image matches major version ...
... Sebastian Wagner

03/17/2021

10:11 PM Bug #49870: When 'ceph mgr dump' returns invalid JSON during the middle of spec application the s...
Here's a potential fix: https://github.com/ceph/ceph/pull/40203
First patch to cephadm. Happy to update as needed....
John Fulton
05:58 PM Bug #49870: When 'ceph mgr dump' returns invalid JSON during the middle of spec application the s...
Sorry still getting used to tracker for formatting. I can send a PR.... John Fulton
05:55 PM Bug #49870: When 'ceph mgr dump' returns invalid JSON during the middle of spec application the s...
I made the modification below and I am not having the issue any more from repeated testing. My logs show the followin... John Fulton
05:54 PM Bug #49870: When 'ceph mgr dump' returns invalid JSON during the middle of spec application the s...
[ceph-admin@oc0-controller-0 ~]$ podman --version
podman version 3.0.0-dev
[ceph-admin@oc0-controller-0 ~]$
John Fulton
04:36 PM Bug #49870: When 'ceph mgr dump' returns invalid JSON during the middle of spec application the s...
let me guess: podman 2.2.1 ? Sebastian Wagner
04:35 PM Bug #49870 (Resolved): When 'ceph mgr dump' returns invalid JSON during the middle of spec applic...
When using cephadm-15.2.9-2.el8.noarch with the command below to apply the attached spec:... John Fulton
09:55 PM Fix #49336 (Resolved): re-enable coredumps for cephadm
Sage Weil
04:56 PM Bug #49872 (Resolved): cephadm: Don't remove the daemon keyring, if redeploy failes
This code block is also executed when redeploying a daemon:
https://github.com/ceph/ceph/blob/28b5137da73c3fa74e1...
Sebastian Wagner
04:39 PM Tasks #49871 (Resolved): cephadm bootstrap: print the podman version
Bootstrap looks like so:... Sebastian Wagner
03:56 PM Bug #49013: cephadm: Service definition causes some container startups to fail
Workaround
When upgrading from a previous cephadm release, please redeploy iSCSI, NFS and the monitoring stack. Pl...
Sebastian Wagner
10:29 AM Bug #49860 (Can't reproduce): cephadm adopt - Report conf file missing - now it says could not de...
version - cephadm-16.1.0-603.el8cp.noarch
cmd:...
Vasishta Shastry
10:11 AM Bug #49856 (Fix Under Review): mgr/cephadm: prometheus default alerts not provisioned
Patrick Seidensal
09:11 AM Bug #49856 (Resolved): mgr/cephadm: prometheus default alerts not provisioned
When deploying the prometheus service through cephadm, the `ceph_default_alerts.yml` file is passed as configuration,... Patrick Seidensal
06:07 AM Bug #46582: cephadm: NFS services should not share the same namespace in a pool
I was thinking about this issue and wondering a few things. If we make a class variable e.g. `namespace_set` in the N... Melissa Li
04:45 AM Bug #49449: cephadm: synchronize container timezone with host
Hi! can I work on this? Melissa Li

03/16/2021

10:57 PM Documentation #49849 (Resolved): doc/RBD: ceph-immutable-object-cache daemon enable command needs...
Document for rbd-persistent-read-only-cache show how to manage ceph-immutable-object-cache daemon using systemd.
co...
Rachana Patel
08:16 PM Bug #49626: cephadm: remove duplicate labels when adding a host
pacific backport merged in https://github.com/ceph/ceph/pull/40135 Sage Weil
08:16 PM Bug #49462 (Resolved): cephadm: add iscsi and nfs to upgrade
pacific backport merged in https://github.com/ceph/ceph/pull/40135 Sage Weil
08:16 PM Feature #47261 (Resolved): cephadm integration for cephfs-mirror daemon
pacific backport merged in https://github.com/ceph/ceph/pull/40135 Sage Weil
08:56 AM Feature #47261 (Pending Backport): cephadm integration for cephfs-mirror daemon
Sebastian Wagner
08:16 PM Bug #49675: ceph daemon 'reconfig' populates daemon cache with 'starting' state
pacific backport merged in https://github.com/ceph/ceph/pull/40135 Sage Weil
08:15 PM Feature #49159: "cephadm ceph-volume activate" does not support cephadm
pacific backport merged in https://github.com/ceph/ceph/pull/40135 Sage Weil
08:14 PM Bug #49573 (Resolved): cephadm: rgw-nfs: stray daemons(s) not managed by cephadm
Sage Weil
06:21 PM Bug #49757 (Fix Under Review): orch: --format flag name not included in help for 'orch ps' and 'o...
new attempt, this time only affecting the --format flag Adam King
05:24 PM Bug #49838 (Closed): RFE: Support for cephadm daemon logs redirection to non default files and al...
We need to support cephadm daemon logs redirection to non default files other than fixed files and locations ie non ... Preethi Nataraj
05:11 PM Bug #49293: podman 3.0 on ubuntu 18.04: failed to mount overlay for metacopy check with "nodev,me...
for SEO: the new error message is:... Sebastian Wagner
05:09 PM Bug #49293: podman 3.0 on ubuntu 18.04: failed to mount overlay for metacopy check with "nodev,me...
deepika: https://github.com/ceph/ceph/pull/39949 Sebastian Wagner
01:44 PM Bug #49674 (In Progress): monitoring unit.run files don't remove container first
hmm, this is something we should probably deal with on upgrade (which is where I ran into it).... Sage Weil
01:43 PM Bug #49674 (Rejected): monitoring unit.run files don't remove container first
yep, that fixed it! Sage Weil
08:57 AM Bug #49674 (Need More Info): monitoring unit.run files don't remove container first
Sebastian Wagner
01:32 PM Bug #47358: "ceph orch apply osd" chokes on valid service_spec.yml
sure! Sebastian Wagner
01:31 PM Documentation #48806: documentation trobleshooting: cephadm; how do i start all containers?
sure! Sebastian Wagner
09:22 AM Bug #46497 (Fix Under Review): cephadm: prevent colon character for service_ids.
Sebastian Wagner
09:10 AM Feature #48368 (Need More Info): cephadm check-host should verify fsid of ceph.conf
Sebastian Wagner
09:03 AM Feature #47286: cephadm: Local registry setup
I don't think this requires any code changes. this issue is about figuring out how to call the cephadm binary to make... Sebastian Wagner
09:01 AM Feature #45768 (Rejected): cephadm: remove daemons should check HEALTH
Sebastian Wagner
08:24 AM Bug #49827 (Duplicate): cephadm driven upgrade test takes 12 hours and still running
... Kefu Chai

03/15/2021

10:12 PM Bug #47358 (In Progress): "ceph orch apply osd" chokes on valid service_spec.yml
Sebastian Wagner
06:47 PM Bug #47358: "ceph orch apply osd" chokes on valid service_spec.yml
I would like to work on this issue. Rafay Ghafoor
06:49 PM Documentation #48806: documentation trobleshooting: cephadm; how do i start all containers?
I would like to take this issue. Rafay Ghafoor
02:53 PM Bug #49293: podman 3.0 on ubuntu 18.04: failed to mount overlay for metacopy check with "nodev,me...
@Sebastian should we use `--docker` instead of podman just for ubuntu
18.04, as a workaround?
Deepika Upadhyay
01:41 PM Bug #49737 (In Progress): cephadm bootstrap --skip-ssh skips too much
sure! Sebastian Wagner
01:28 PM Bug #49737: cephadm bootstrap --skip-ssh skips too much
Can I take this issue? Shreya Sharma
01:30 PM Documentation #49806 (Resolved): minor problems in cephadm docs
The cephadm docs don't currently list python3 as a prerequisite, but it most certainly is. Also, don't enshrine "octo... Jeff Layton
01:09 PM Bug #49805 (Resolved): unmanaged OSDs return to be managed OSDs after a cephadm module restart
Juan Miguel Olmo Martínez
01:06 PM Bug #49757 (New): orch: --format flag name not included in help for 'orch ps' and 'orch ls'
initially suggested change is being reverted https://github.com/ceph/ceph/pull/40111 Adam King
09:07 AM Bug #49757 (Resolved): orch: --format flag name not included in help for 'orch ps' and 'orch ls'
Kefu Chai

03/14/2021

12:27 PM Bug #49654: iSCSI stops working after Upgrade 15.2.4 -> 15.2.9
Inside the iscsi-Container the wrong hostname is reported (CentOS 8 + podman):... Frank Holtz

03/12/2021

06:39 PM Bug #48142 (Pending Backport): rados:cephadm/upgrade/mon_election tests are failing: CapAdd and p...
needs octopus backport too, we can get back to it after 15.0.10 Deepika Upadhyay
05:46 PM Bug #49626 (Pending Backport): cephadm: remove duplicate labels when adding a host
Adam King
11:29 AM Bug #49633: podman: ERROR (catatonit:2): failed to exec pid1: No such file or directory
https://pulpito.ceph.com/swagner-2021-03-12_11:27:39-rados:cephadm:smoke-wip-swagner-testing-2021-03-11-1320-distro-b... Sebastian Wagner
12:47 AM Bug #49436: cephadm bootstrap fails to create /etc/ceph directory
Okay. I've followed the instructions here and I still can get only 15.2.8:
https://docs.ceph.com/en/latest/install...
Zac Dover

03/11/2021

10:58 PM Bug #49436: cephadm bootstrap fails to create /etc/ceph directory
Stand by while I learn how to install cephadm 15.2.9. Zac Dover
10:54 PM Bug #49436: cephadm bootstrap fails to create /etc/ceph directory
zdover@zdover-Standard-PC-i440FX-PIIX-1996:~$ sudo dpkg -l cephadm
Desired=Unknown/Install/Remove/Purge/Hold
| Stat...
Zac Dover
10:51 PM Bug #49436: cephadm bootstrap fails to create /etc/ceph directory
zdover@zdover-Standard-PC-i440FX-PIIX-1996:~$ apt show cephadm
Package: cephadm
Version: 15.2.8-0ubuntu0.20.04.1
P...
Zac Dover
09:26 PM Bug #49436: cephadm bootstrap fails to create /etc/ceph directory
No dice, guys.
I ran it again, and I get the same error.
Here's the full log of the install, done on Ubuntu 20....
Zac Dover
06:55 PM Bug #49757 (Resolved): orch: --format flag name not included in help for 'orch ps' and 'orch ls'
the help description for 'ceph orch ps' is... Adam King
06:45 PM Bug #49755 (Can't reproduce): OSD service is not found
If you create OSDs using "ceph orch daemon add osd ..." you can see a "osd.None" service when the user list services... Juan Miguel Olmo Martínez
05:49 PM Bug #49467: cephadm bootstrap process fails in open_ports on octopus branch: TypeError: __init__(...
Is there a workaround that can be used for this issue until 15.2.10 is released ?
My situation is that I installe...
Robert Toole
05:22 PM Bug #49749 (Resolved): cephadm: migrate_0_1 doesn't handle multiple daemons per host
/a/sage-2021-03-11_14:50:20-rados:cephadm:upgrade-master-distro-basic-smithi/5956079
- cephadm.py (weridly) sets m...
Sage Weil
03:19 PM Bug #49740: cephadm: error looking up supplemental groups for container ca2...23: Unable to find ...
no help from google this time: https://www.google.com/search?q=podman+%22Unable+to+find+group+disk%22 Sebastian Wagner
02:45 PM Bug #49740 (Rejected): cephadm: error looking up supplemental groups for container ca2...23: Unab...
... Sebastian Wagner
03:08 PM Bug #49742 (Can't reproduce): Mirror was added, but still "toomanyrequests: You have reached your...
https://pulpito.ceph.com/sage-2021-03-04_03:32:45-upgrade:octopus-x-wip-sage-testing-2021-03-03-1623-distro-basic-smi... Sebastian Wagner
02:29 PM Bug #49739 (Can't reproduce): `ceph` not found in $PATH: No such file or directory: OCI not found
https://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952020/... Sebastian Wagner
02:12 PM Bug #49633: podman: ERROR (catatonit:2): failed to exec pid1: No such file or directory
https://sentry.ceph.com/organizations/ceph/issues/5359/?project=2 Sebastian Wagner
01:55 PM Support #49497: Cephadm fails to upgrade from 15.2.8 to 15.2.9
Sebastian Wagner wrote:
> > Error processing tar file(exit status 1): potentially insufficient UIDs or GIDs availabl...
Illya S.
01:46 PM Support #49497: Cephadm fails to upgrade from 15.2.8 to 15.2.9
> Error processing tar file(exit status 1): potentially insufficient UIDs or GIDs available in user namespace
you...
Sebastian Wagner
01:08 PM Bug #49737 (Resolved): cephadm bootstrap --skip-ssh skips too much
--skip-ssh should only disable the SSH configs. It should still enable the cephadm mgr module.
This is a usabilit...
Sebastian Wagner
11:58 AM Feature #49735 (New): cephadm: allow applying RGW multisite YAML objects
See Also:
* https://rook.io/docs/rook/v1.5/ceph-object-multisite-crd.html We should avoid diverging from Rook here...
Sebastian Wagner
12:24 AM Bug #49462 (Pending Backport): cephadm: add iscsi and nfs to upgrade
Sage Weil

03/10/2021

11:09 PM Bug #49462 (Fix Under Review): cephadm: add iscsi and nfs to upgrade
Sage Weil
11:08 PM Bug #49462 (Pending Backport): cephadm: add iscsi and nfs to upgrade
Sage Weil
11:08 PM Bug #49724 (Fix Under Review): fsid is not validated during accessing the shell through cli
Daniel Pivonka
11:07 PM Bug #49724 (Resolved): fsid is not validated during accessing the shell through cli
... Daniel Pivonka
08:28 PM Bug #46745 (Resolved): cephadm does not set systemd dependencies when using docker
Sage Weil
08:28 PM Cleanup #46219 (Resolved): cephadm: remove DaemonDescription.service_id()
Sage Weil
02:17 PM Cleanup #46219 (Pending Backport): cephadm: remove DaemonDescription.service_id()
Sebastian Wagner
08:28 PM Bug #49348 (Resolved): cephadm: giving nonexistent service for service action command should retu...
Sage Weil
05:22 PM Bug #49436: cephadm bootstrap fails to create /etc/ceph directory
I will run this test later today, after I am finished with my meetings.
I didn't see that this tracker had been up...
Zac Dover
04:06 PM Feature #43707 (Rejected): mgr/rook: OSD create for non-trivial drive groups
rook is removing drive group support Sebastian Wagner
03:59 PM Feature #47774: orch,cephadm: host search with filters
actually I'd like to go the other way around and enable remote hosts to join the cluster by themselves. Similar to ku... Sebastian Wagner
03:58 PM Bug #47921 (Can't reproduce): Bad auth caps for orchestrated mds daemon
Sebastian Wagner
03:57 PM Documentation #48974 (Rejected): document repo_digest
it's enabled by default for pacific Sebastian Wagner
03:30 PM Cleanup #44676: cephadm: Replace execnet (and remoto)
Outreachy: https://www.outreachy.org/outreachy-may-2021-internship-round/communities/ceph/#ceph-orchestrators-integra... Sebastian Wagner
03:28 PM Bug #44990 (Can't reproduce): cephadm: exec: "/usr/bin/ceph-mon": stat /usr/bin/ceph-mon: no such...
Sebastian Wagner
03:21 PM Bug #48510 (Can't reproduce): CEPHADM_REFRESH_FAILED: detail item 0 not a [unicode] string
Sebastian Wagner
03:21 PM Feature #49235 (In Progress): cephadm: Log number of already upgraded daemons during upgrade process
Sebastian Wagner
03:19 PM Bug #47916: podman containers running in a detached state do not output logs to journald
how can we fix this for octopus? Sebastian Wagner
03:18 PM Documentation #46082 (Can't reproduce): cephadm: deleting (mds) service doesn't work?
Sebastian Wagner
03:18 PM Documentation #49214 (Resolved): Docs: howto Restore MON quorum
Sebastian Wagner
03:16 PM Documentation #45833 (Resolved): cephadm: properly document labels
Sebastian Wagner
03:16 PM Documentation #45767 (Resolved): documentation: disable the scheduler: unmanaged=True + ceph orch...
Sebastian Wagner
03:08 PM Bug #49339 (Pending Backport): cephadm/osd: OSD draining: don't mark OSDs out
Sebastian Wagner
03:07 PM Bug #49239 (Resolved): cephadm cannot deploy OSDs with selinux-policy-minimum
Sebastian Wagner
03:06 PM Feature #49407 (Pending Backport): Enable the ability of cephadm to trigger libstoragemgmt info f...
Sebastian Wagner
03:06 PM Feature #49159 (Pending Backport): "cephadm ceph-volume activate" does not support cephadm
Sebastian Wagner
03:05 PM Feature #47711 (Pending Backport): mgr/cephadm: add a feature to examine the host facts to look f...
Sebastian Wagner
03:03 PM Documentation #49488 (Resolved): Document service specs for iSCSI deployment
Sebastian Wagner
03:02 PM Support #49499 (Resolved): new osds created by orchestrator running different image version
This is getting fixed by https://github.com/ceph/ceph/pull/39058 Sebastian Wagner
02:59 PM Bug #49590 (Pending Backport): Error: error parsing host port: invalid port number: strconv.Atoi:...
Sebastian Wagner
02:58 PM Bug #49603 (Need More Info): cephadm/podman: 3 stray daemon(s) not managed by cephadm","count":3}
Sebastian Wagner
02:58 PM Bug #49603: cephadm/podman: 3 stray daemon(s) not managed by cephadm","count":3}
guess I need ceph health detail to find this Sebastian Wagner
02:54 PM Bug #49223 (Fix Under Review): unrecognized arguments: --container-init
Sebastian Wagner
02:54 PM Support #49497: Cephadm fails to upgrade from 15.2.8 to 15.2.9
podman 2.2.1 is really a bad release for cephadm.
See https://docs.ceph.com/en/latest/cephadm/compatibility/
Sebastian Wagner
02:53 PM Bug #49659 (Pending Backport): Exception found on "ceph orch osd rm stop" command
Sebastian Wagner
02:52 PM Bug #48469 (Can't reproduce): upgrade:octopus-x-master: "Failed to start Ceph mon.smithi116": Fai...
lots of upgrade fixes in the meantime Sebastian Wagner
02:51 PM Bug #46558 (Pending Backport): cephadm: paths attribute ignored for db_devices/wal_devices via OS...
Sebastian Wagner
02:49 PM Bug #49041 (Resolved): cephadm: update container image tag for pacific
Sebastian Wagner
02:48 PM Bug #48597: pybind/mgr/cephadm: mds_join_fs not cleaned up
backport: https://github.com/ceph/ceph/pull/39649 Sebastian Wagner
02:48 PM Bug #49276 (Duplicate): Create multiple RGW instances in the same realm , same zone fails using c...
fixed by https://github.com/ceph/ceph/pull/39877 Sebastian Wagner
02:47 PM Bug #46606 (Fix Under Review): cephadm: post-bootstrap monitoring deployment only works if the co...
Sebastian Wagner
02:45 PM Bug #49293 (Rejected): podman 3.0 on ubuntu 18.04: failed to mount overlay for metacopy check wit...
Podman dropped support for ubuntu 18.04.
Nothing we can do about this
Sebastian Wagner
02:44 PM Bug #49680 (Duplicate): reconfig fails when cephx key changes
Sebastian Wagner
02:43 PM Bug #48142 (Resolved): rados:cephadm/upgrade/mon_election tests are failing: CapAdd and privilege...
Sebastian Wagner
02:42 PM Bug #48754 (Resolved): "failed xx 'sudo systemctl start ceph-None@rgw.client.1'" in upgrade:octop...
Sebastian Wagner
02:29 PM Bug #49435 (Closed): cephadm: rgw not getting deployed due to HEALTH_WARN
Sebastian Wagner
02:29 PM Bug #49435: cephadm: rgw not getting deployed due to HEALTH_WARN
in the meantime fixed by https://github.com/ceph/ceph/pull/39877 Sebastian Wagner
02:26 PM Bug #49674: monitoring unit.run files don't remove container first
when was the node exporter deployed?... Sebastian Wagner
02:18 PM Bug #49522 (Resolved): cephadm: ValueError: not enough values to unpack (expected 2, got 1)
Sebastian Wagner
02:16 PM Feature #48822 (Fix Under Review): Add proper port management to mgr/cephadm
Sebastian Wagner
02:15 PM Feature #47145 (Fix Under Review): cephadm: Multiple daemons of the same service on single host
Sebastian Wagner
02:14 PM Bug #44910 (Rejected): cephadm: PlacementSpec host1:192.168.0.2,host1:192.168.0.2
Sebastian Wagner
02:13 PM Tasks #46551 (Resolved): cephadm: Add better a better hint how to add a host
Sebastian Wagner
11:05 AM Bug #49633: podman: ERROR (catatonit:2): failed to exec pid1: No such file or directory
https://pulpito.ceph.com/swagner-2021-03-09_14:01:08-rados:cephadm-wip-swagner3-testing-2021-03-09-1022-distro-basic-... Sebastian Wagner

03/09/2021

10:32 PM Bug #49675 (Pending Backport): ceph daemon 'reconfig' populates daemon cache with 'starting' state
Sage Weil
06:15 PM Bug #49675 (Fix Under Review): ceph daemon 'reconfig' populates daemon cache with 'starting' state
Sage Weil
05:26 PM Bug #49675 (Resolved): ceph daemon 'reconfig' populates daemon cache with 'starting' state
A ceph daemon reconfig doesn't have to restart the daemon, but cephadm is refreshing the cache state with a bogus 'st... Sage Weil
10:30 PM Bug #49638: qa/workunits/cephadm/create_iscsi_disks.sh: The script only supports CentOS
/a/yuriw-2021-03-08_21:03:18-rados-wip-yuri5-testing-2021-03-08-1049-pacific-distro-basic-smithi/5947134 Neha Ojha
10:28 PM Bug #49680: reconfig fails when cephx key changes
https://github.com/ceph/ceph/pull/39677 fixes this Sage Weil
07:28 PM Bug #49680 (Fix Under Review): reconfig fails when cephx key changes
Sage Weil
06:57 PM Bug #49680 (Duplicate): reconfig fails when cephx key changes
... Sage Weil
05:23 PM Bug #49674 (Resolved): monitoring unit.run files don't remove container first
the ceph daemon unit.run files look like... Sage Weil
03:48 PM Feature #48340: cephadm/rgw: Add rgw_zonegroup to RGWSpec
blocked for now. Sebastian Wagner

03/08/2021

07:10 PM Bug #49659 (Fix Under Review): Exception found on "ceph orch osd rm stop" command
Daniel Pivonka
07:10 PM Bug #49659 (Resolved): Exception found on "ceph orch osd rm stop" command
Exception found using "ceph orch osd rm stop" command
>>>[ceph: root@ceph-suniladm-1612441365162-node1-monmgrins...
Daniel Pivonka
03:59 PM Support #49497: Cephadm fails to upgrade from 15.2.8 to 15.2.9
I have the same issue on hosts running CentOS 8.3 with podman 2.2.1, only difference is that I run cephadm as root. Jimmy Spets
03:05 PM Bug #49654 (Resolved): iSCSI stops working after Upgrade 15.2.4 -> 15.2.9
We have four iSCSI-Gateways deployed with "ceph orch". two gateways each form an IQN sharing one /23 network.
In U...
Frank Holtz
01:40 PM Bug #49484 (Resolved): rados/upgrade/pacific-x/parallel fails due to more than 1 version shown af...
Kefu Chai
10:53 AM Bug #49633: podman: ERROR (catatonit:2): failed to exec pid1: No such file or directory
https://github.com/containers/podman/issues/9660 Sebastian Wagner
10:50 AM Bug #49633: podman: ERROR (catatonit:2): failed to exec pid1: No such file or directory
https://pulpito.ceph.com/swagner-2021-03-05_12:04:33-rados:cephadm-wip-swagner2-testing-2021-03-05-1040-pacific-distr... Sebastian Wagner

03/07/2021

10:30 AM Bug #49638 (Resolved): qa/workunits/cephadm/create_iscsi_disks.sh: The script only supports CentOS
... Kefu Chai

03/05/2021

08:44 PM Bug #49633: podman: ERROR (catatonit:2): failed to exec pid1: No such file or directory
/a/sage-2021-03-05_17:57:02-rados:cephadm-wip-sage-testing-2021-03-05-0948-distro-basic-gibba/5939780
distro/ubunt...
Sage Weil
08:43 PM Bug #49633 (Can't reproduce): podman: ERROR (catatonit:2): failed to exec pid1: No such file or d...
... Sage Weil
06:05 PM Bug #49348 (Pending Backport): cephadm: giving nonexistent service for service action command sho...
Adam King
06:03 PM Bug #49348 (Duplicate): cephadm: giving nonexistent service for service action command should ret...
Adam King
06:03 PM Feature #49246 (Duplicate): cephadm: Display error message when given service name is wrong
Adam King
04:37 PM Bug #49435 (Fix Under Review): cephadm: rgw not getting deployed due to HEALTH_WARN
Sage Weil
03:18 PM Bug #49626 (Fix Under Review): cephadm: remove duplicate labels when adding a host
Adam King
03:10 PM Bug #49626 (Resolved): cephadm: remove duplicate labels when adding a host
right now, the "ceph orch host label add" command with cephadm will only add a label if it is not already attached to... Adam King
02:57 PM Bug #48373 (Resolved): cephadm iscsi: required file missing from config-json: iscsi-gateway.cfg
Adam King
12:01 PM Bug #49622: cephad orchestrator allows to delete hosts with ceph daemons running
https://github.com/ceph/ceph/pull/39850 Juan Miguel Olmo Martínez
11:49 AM Bug #49622 (Resolved): cephad orchestrator allows to delete hosts with ceph daemons running
This can drive the user to a difficult situation Juan Miguel Olmo Martínez

03/04/2021

06:39 PM Bug #49467 (Resolved): cephadm bootstrap process fails in open_ports on octopus branch: TypeError...
Nathan Cutler
04:17 PM Bug #49573: cephadm: rgw-nfs: stray daemons(s) not managed by cephadm
nfs-ganesha is deployed in such a way that it can host both cephfs and rgw exports from a single daemon.
rgw appea...
Michael Fritch
04:09 PM Bug #49522: cephadm: ValueError: not enough values to unpack (expected 2, got 1)
https://github.com/ceph/ceph/pull/39715 merged Yuri Weinstein
02:29 PM Bug #49603 (Can't reproduce): cephadm/podman: 3 stray daemon(s) not managed by cephadm","count":3}
... Deepika Upadhyay
02:01 PM Bug #45327: cephadm: Orch daemon add is not idempotent
... Deepika Upadhyay
10:35 AM Bug #49411 (Resolved): Rook: "ceph orch ls" command fails with KeyError: 'crashcollector'
Juan Miguel Olmo Martínez
10:28 AM Feature #47145: cephadm: Multiple daemons of the same service on single host
Kubernetes:
> The below yaml snippet of the webserver deployment has podAntiAffinity and podAffinity configured. T...
Sebastian Wagner

03/03/2021

11:18 PM Bug #49573 (Fix Under Review): cephadm: rgw-nfs: stray daemons(s) not managed by cephadm
during the an nfs mount of an rgw bucket, librgw will register a daemon with type `rgw-nfs`:
https://github.com/ceph...
Michael Fritch
08:51 PM Bug #49590: Error: error parsing host port: invalid port number: strconv.Atoi: parsing " 9093": i...
introduced by usage of shlex in https://github.com/ceph/ceph/pull/39730
quoted args are passed to podman:...
Michael Fritch
08:18 PM Bug #49590 (Fix Under Review): Error: error parsing host port: invalid port number: strconv.Atoi:...
Michael Fritch
08:15 PM Bug #49590 (Resolved): Error: error parsing host port: invalid port number: strconv.Atoi: parsing...
a/mgfritch-2021-03-02_23:06:05-rados:cephadm-wip-mgfritch-testing-2021-03-02-1408-distro-basic-smithi/5928333/
a/mgf...
Michael Fritch
08:07 PM Bug #49277 (Can't reproduce): cephadm bootstrap --apply-spec <cluster.yaml> hangs
tested on 15.2.8 and 15.2.9 cant reproduce Daniel Pivonka
02:27 PM Bug #49277: cephadm bootstrap --apply-spec <cluster.yaml> hangs
... Sebastian Wagner
03:10 PM Bug #48924 (Resolved): cephadm: upgrade process failed to pull target image: not enough values to...
Sage Weil
03:09 PM Bug #48924: cephadm: upgrade process failed to pull target image: not enough values to unpack (ex...
upstream issue: https://github.com/containers/podman/issues/8882 Sage Weil
02:49 PM Bug #49483 (Can't reproduce): CommandFailedError: Command failed on smithi104 with status 1: 'sud...
Sebastian Wagner
02:49 PM Bug #49483: CommandFailedError: Command failed on smithi104 with status 1: 'sudo /home/ubuntu/cep...
caused by ... Sebastian Wagner
02:49 PM Documentation #48267 (New): orchestrator docs should at least mention keyrings
Sebastian Wagner
02:49 PM Documentation #48267 (Can't reproduce): orchestrator docs should at least mention keyrings
Sebastian Wagner
09:52 AM Bug #46745 (Pending Backport): cephadm does not set systemd dependencies when using docker
Sebastian Wagner
09:48 AM Bug #49456: cephadm dashboard test: failed to connect to the server
https://pulpito.ceph.com/swagner-2021-03-02_17:23:47-rados:cephadm-wip-swagner3-testing-2021-03-02-1313-distro-basic-... Sebastian Wagner
09:40 AM Bug #49506 (Pending Backport): cephadm: `cephadm ls` broken for SUSE's downstream alertmanager co...
Octopus Backport PR: https://github.com/ceph/ceph/pull/39802/ Patrick Seidensal

03/02/2021

11:56 PM Bug #49348 (Pending Backport): cephadm: giving nonexistent service for service action command sho...
Ken Dreyer
11:52 PM Bug #49366 (Pending Backport): 'cephadm version' will show a trace back if image comes from a aut...
Ken Dreyer
11:41 PM Bug #49056 (Resolved): faulty behaviour running ceph orch apply mds with missing fsname
Merged to pacific as a part of https://github.com/ceph/ceph/pull/39623 Ken Dreyer
11:41 PM Bug #49056 (Pending Backport): faulty behaviour running ceph orch apply mds with missing fsname
Ken Dreyer
07:25 PM Bug #49522: cephadm: ValueError: not enough values to unpack (expected 2, got 1)
workaround by not testing on centos/rhel for now: https://github.com/ceph/ceph/pull/39791
Sage Weil
05:21 PM Bug #49287: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope n...
when running tests on gibba, it's always 20.04, and podman 3.0.1-2. and it seems pretty consistent.
error is some...
Sage Weil
04:59 PM Bug #49573 (Resolved): cephadm: rgw-nfs: stray daemons(s) not managed by cephadm
... Sebastian Wagner
04:33 PM Fix #49336 (Pending Backport): re-enable coredumps for cephadm
Sage Weil
04:23 PM Bug #49571 (Resolved): cephadm: same OSD one two host + daemon_id not unique
OSD.1 on both node06 and node01. The node01 is not managing a drive and is not working. Any idea on how to delete thi... Sebastian Wagner
04:19 PM Bug #49570 (Can't reproduce): cephadm: UnicodeDecodeError when reading sysctl
cephadm throws an UnicodeDecodeError when reading systctl data which contains unreadable errors.... Patrick Seidensal
10:37 AM Bug #49293: podman 3.0 on ubuntu 18.04: failed to mount overlay for metacopy check with "nodev,me...
Sebastian Wagner wrote:
> Deepika Upadhyay wrote:
> > /ceph/teuthology-archive/yuriw-2021-02-22_20:19:50-rados-wip-...
Sebastian Wagner
09:11 AM Bug #49456: cephadm dashboard test: failed to connect to the server
How often this one happens? We rarely see that in the none-cephadm dashboard e2e tests... It might be due to the diff... Ernesto Puerta

03/01/2021

10:42 PM Bug #46745 (Fix Under Review): cephadm does not set systemd dependencies when using docker
Sage Weil
09:17 PM Bug #49287: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope n...
/a/sage-2021-03-01_20:25:17-rados-wip-sage4-testing-2021-03-01-1042-distro-basic-gibba/5924180
description: rados/...
Sage Weil
07:16 PM Bug #49293: podman 3.0 on ubuntu 18.04: failed to mount overlay for metacopy check with "nodev,me...
Deepika Upadhyay wrote:
> /ceph/teuthology-archive/yuriw-2021-02-22_20:19:50-rados-wip-yuri-testing-2021-02-22-0812-...
Sebastian Wagner
06:19 PM Bug #49293: podman 3.0 on ubuntu 18.04: failed to mount overlay for metacopy check with "nodev,me...
/ceph/teuthology-archive/yuriw-2021-02-22_20:19:50-rados-wip-yuri-testing-2021-02-22-0812-octopus-distro-basic-smithi... Deepika Upadhyay
04:50 PM Bug #49539 (Resolved): test_cephadm.sh failure: container.alertmanager.a does'nt start
the problem was that the container image was being pulled from docker.io and was a day old and didn't have the needed... Sage Weil
04:49 PM Bug #49539: test_cephadm.sh failure: container.alertmanager.a does'nt start
Sage Weil wrote:
> [...]
> /a/sage-2021-02-28_18:35:15-rados-wip-sage-testing-2021-02-28-1217-distro-basic-smithi/5...
Sebastian Wagner
11:38 AM Bug #49551: cephadm journald logs are mangled
I think use std::clog instead of std::cerr to write the log can mitigate this issue. Because clog buffers content but... 玮文 胡
11:13 AM Bug #49551 (Resolved): cephadm journald logs are mangled
Regression introduced by https://github.com/ceph/ceph/pull/37729
to fix a regression introduced by https://github....
Sebastian Wagner
11:23 AM Fix #49336 (Fix Under Review): re-enable coredumps for cephadm
Sebastian Wagner

02/28/2021

09:23 PM Bug #49539 (Resolved): test_cephadm.sh failure: container.alertmanager.a does'nt start
... Sage Weil

02/26/2021

10:07 PM Bug #49522 (Resolved): cephadm: ValueError: not enough values to unpack (expected 2, got 1)
... Sage Weil
04:43 PM Bug #49506 (Fix Under Review): cephadm: `cephadm ls` broken for SUSE's downstream alertmanager co...
Patrick Seidensal
04:33 PM Bug #49506 (Resolved): cephadm: `cephadm ls` broken for SUSE's downstream alertmanager container
... Patrick Seidensal
11:01 AM Support #49499: new osds created by orchestrator running different image version
Already solved with help from mailing list, sorry for the noise.
The fix (thanks to Tobias Fisher):
Hi Kenneth,
...
Kenneth Waegeman

02/25/2021

07:01 PM Bug #49287: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope n...
... Sage Weil
04:21 PM Support #49499 (Resolved): new osds created by orchestrator running different image version
Hi,
I installed new host for OSDS today, they were automatically created using drivegroups service specs (https://do...
Kenneth Waegeman
03:16 PM Support #49497 (Resolved): Cephadm fails to upgrade from 15.2.8 to 15.2.9
I'm trying to upgrade cluster from 15.2.8 to 15.2.9 by running... Illya S.
11:24 AM Feature #49492 (Resolved): cepham: Spine-Leaf network architecture
https://access.redhat.com/webassets/avalon/d/Red_Hat_OpenStack_Platform-13-Spine_Leaf_Networking-en-US/images/0bd8baa... Sebastian Wagner
10:46 AM Documentation #49488: Document service specs for iSCSI deployment
fixed by https://github.com/ceph/ceph/pull/39551
https://ceph--39551.org.readthedocs.build/en/39551/cephadm/iscsi/
Sebastian Wagner
08:58 AM Documentation #49488 (Resolved): Document service specs for iSCSI deployment
There's currently no documentation on how to deploy iSCSI gateways (or, if there is, I can't find it beyond what's li... Tim Serong
10:34 AM Tasks #49490: cephadm additions/changes to support everything rgw.py needs
config key/value: https://github.com/ceph/ceph/pull/39648 Sebastian Wagner
10:32 AM Tasks #49490 (Resolved): cephadm additions/changes to support everything rgw.py needs
From: https://pad.ceph.com/p/rgw-cephadm
- adopt realm.zone.id naming for tests
- make sure PlacementSpec nam...
Sebastian Wagner
10:25 AM Bug #49467 (Fix Under Review): cephadm bootstrap process fails in open_ports on octopus branch: T...
Sebastian Wagner
01:29 AM Bug #49467 (Resolved): cephadm bootstrap process fails in open_ports on octopus branch: TypeError...
There is no problem until v15.2.8, but an error occurs during bootstrap process in open_ports of the latest octopus b... Donggyu Park
08:07 AM Bug #49456: cephadm dashboard test: failed to connect to the server
qa/workunits/cephadm/test_dashboard_e2e.sh (for SEO) Kefu Chai
06:36 AM Bug #49484 (Resolved): rados/upgrade/pacific-x/parallel fails due to more than 1 version shown af...
... Kefu Chai
06:33 AM Bug #49483 (Can't reproduce): CommandFailedError: Command failed on smithi104 with status 1: 'sud...
https://sentry.ceph.com/organizations/ceph/issues/4720/... Sentry Bot
03:40 AM Bug #49436 (In Progress): cephadm bootstrap fails to create /etc/ceph directory
the creation of the missing dir is there in the src for octopus and pacific. In both examples provided, the source is... Paul Cuzner

02/24/2021

10:50 PM Bug #49462 (Fix Under Review): cephadm: add iscsi and nfs to upgrade
Adam King
09:44 PM Bug #49462 (Resolved): cephadm: add iscsi and nfs to upgrade
these daemons are not upgraded during the upgrade process but they should be since they use the Ceph image. Adam King
05:19 PM Bug #49191 (Duplicate): cephadm: service_type: osd: Failed to apply: ''NoneType'' object has no a...
already fixed Sebastian Wagner
02:35 PM Bug #49456: cephadm dashboard test: failed to connect to the server
/a/kchai-2021-02-24_13:00:59-rados-wip-kefu-testing-2021-02-24-1742-distro-basic-smithi/5911838/ Kefu Chai
02:28 PM Bug #49456 (Can't reproduce): cephadm dashboard test: failed to connect to the server
https://pulpito.ceph.com/swagner-2021-02-22_13:53:31-rados:cephadm-wip-swagner3-testing-2021-02-22-1135-distro-basic-... Sebastian Wagner
12:42 PM Bug #49280 (Duplicate): mds/orch: bare/short hostname as a number is not supported
will be fixed by #46219 Sebastian Wagner
11:44 AM Bug #49449 (Won't Fix): cephadm: synchronize container timezone with host
Right now, the timezone within the container differs from the host. Timestamps in the future (or past) will hinder tr... Sebastian Wagner
04:06 AM Feature #47711 (Fix Under Review): mgr/cephadm: add a feature to examine the host facts to look f...
Paul Cuzner

02/23/2021

11:25 PM Bug #48870: cephadm: Several services in error status after upgrade to 15.2.8: unrecognized argum...
Sebastian, I am seeing something similar in pacific upgrade tests, want me create a new tracker issue?
rados/cepha...
Neha Ojha
09:26 PM Bug #49439: logrotate should clean up container logs
is this caused by cephadm? Sebastian Wagner
06:37 PM Bug #49439: logrotate should clean up container logs
See also https://bugzilla.redhat.com/show_bug.cgi?id=1892170
https://access.redhat.com/solutions/5434641
David Galloway
06:35 PM Bug #49439 (Resolved): logrotate should clean up container logs
... David Galloway
05:19 PM Bug #48598 (Can't reproduce): "ceph orch daemon redeploy" fails with [errno 13] RADOS permission ...
these tests pass now. there have been a ton of changes/fixes in hte last 2 months Sage Weil
04:18 PM Bug #49436 (Can't reproduce): cephadm bootstrap fails to create /etc/ceph directory
In trials of Octopus and Pacific, cephadm fails to create /etc/ceph during the bootstrapping process.
These two et...
Zac Dover
04:16 PM Feature #47145: cephadm: Multiple daemons of the same service on single host
... Sebastian Wagner
04:10 PM Fix #49336: re-enable coredumps for cephadm
two issues:
1. messanger v2 bug
2. "wait for snap complete" hangs
Sebastian Wagner
04:09 PM Fix #49336: re-enable coredumps for cephadm
sage: sending signals seemed to work find. Sebastian Wagner
04:09 PM Fix #49336: re-enable coredumps for cephadm
https://github.com/ceph/ceph/pull/39530 Sebastian Wagner
03:43 PM Bug #49435 (Closed): cephadm: rgw not getting deployed due to HEALTH_WARN
We should provide a way for users to deploy RGW anyway and at the same time prevent radosgw-admin to block indefinite... Sebastian Wagner
03:16 PM Bug #49411 (Fix Under Review): Rook: "ceph orch ls" command fails with KeyError: 'crashcollector'
Sebastian Wagner
03:16 PM Feature #47261 (Fix Under Review): cephadm integration for cephfs-mirror daemon
Sebastian Wagner
11:25 AM Feature #49159 (Fix Under Review): "cephadm ceph-volume activate" does not support cephadm
Sebastian Wagner

02/22/2021

02:33 PM Bug #49126 (Pending Backport): rook: 'ceph orch ls' throws type error
Varsha Rao
11:19 AM Bug #49411 (Resolved): Rook: "ceph orch ls" command fails with KeyError: 'crashcollector'
... Juan Miguel Olmo Martínez
09:50 AM Feature #49269: cephadm: upgrade stuck in repeating sleep when a host is offline
Gunther Heinrich wrote:
> There might be some cases where either the host is offline for a longer amount of time or ...
Sebastian Wagner
08:15 AM Feature #49269: cephadm: upgrade stuck in repeating sleep when a host is offline
Sebastian Wagner wrote:
> Did you verify that the upgrade continues, if the host is online again?
Yes, the upgrade...
Gunther Heinrich
01:43 AM Feature #49407 (Fix Under Review): Enable the ability of cephadm to trigger libstoragemgmt info f...
When this information is gathered, cephadm configuration checks will be able to;
- raise a healthcheck for any dis...
Paul Cuzner
01:41 AM Feature #49407 (Resolved): Enable the ability of cephadm to trigger libstoragemgmt info from ceph...
The default in ceph-volume inventory runs without libstoragemgmt integration, so by default this enhanced information... Paul Cuzner
 

Also available in: Atom