Project

General

Profile

Activity

From 03/30/2020 to 04/28/2020

04/28/2020

08:30 PM Bug #45293 (Fix Under Review): cephadm: service_id can contain a '.' char (mds, nfs, iscsi)
Michael Fritch
08:30 PM Bug #45294 (Fix Under Review): cephdam: rgw realm/zone could contain 'hostname'
Michael Fritch
08:23 PM Bug #45093: cephadm: mgrs transiently getting co-located (one node gets two when only one was ask...
Note: this is not a matter of "I asked for 4 MGRs and got 4, only two were unexpectedly colocated."
What is happen...
Nathan Cutler
08:10 PM Bug #45093 (New): cephadm: mgrs transiently getting co-located (one node gets two when only one w...
It happened again. Here is the output of the commands you asked for:
https://paste2.org/CGsgjJWy
NOTE: this tim...
Nathan Cutler
05:48 PM Bug #45037 (In Progress): octopus: cephadm: non-ceph units put wrong uid:gid in systemd unit file
Nathan Cutler
01:20 PM Feature #45091: cephadm: CephX disabled: bad_method + failed to fetch mon config
To update, I was able to restart all services and move to using cephx and the two MDS come online. Ashley Merrick
12:35 AM Bug #45296 (Duplicate): cephadm: daemon add mon failure: orchestrator._interface.OrchestratorVali...
/a/teuthology-2020-04-26_07:01:02-rados-master-distro-basic-smithi/4985864/... Brad Hubbard

04/27/2020

09:55 PM Bug #44990: cephadm: exec: "/usr/bin/ceph-mon": stat /usr/bin/ceph-mon: no such file or directory
/a/yuriw-2020-04-25_15:46:30-rados-wip-yuri4-testing-2020-04-25-0009-master-distro-basic-smithi/4984285 Neha Ojha
07:41 PM Bug #45294 (Resolved): cephdam: rgw realm/zone could contain 'hostname'
A 'hostname' like sub-string could be provided as a realm/zone :... Michael Fritch
07:40 PM Bug #45293 (Resolved): cephadm: service_id can contain a '.' char (mds, nfs, iscsi)
Create a cephfs name that contains a '.' char:... Michael Fritch
01:57 PM Bug #45284 (In Progress): cephadm: Access host files on "cephadm shell"
Ricardo Marques
10:13 AM Bug #45284 (Resolved): cephadm: Access host files on "cephadm shell"
I have a file on my host, that I would like to use to set a "config-key":... Ricardo Marques
10:50 AM Bug #44792: cephadm: make `cephadm shell` independent from /etc/ceph/ceph.conf
Sebastian Wagner wrote:
> This is a usability bug:
>
> Workaround might be to infer the ceph.conf as well?
>
>...
Ricardo Marques
10:33 AM Bug #45286 (Closed): cephadm: Adding hosts to the cluster fails
hi,
using centos8 can't add an host to the cluster via cephadm.
Following the docs i was able to boostrap a new clu...
max liccardo
08:32 AM Bug #45279 (Can't reproduce): cephadm bootstrap: monmaptool --create: error writing to '/tmp/monm...
Hi,
using cpehadm in order to install octopus on a ubuntu 18.04 fails asap I've tried to install first monitor.
I f...
max liccardo

04/24/2020

02:23 PM Feature #45263 (Resolved): osdspec/drivegroup: not enough filters to define layout
Considering this layout:... Joshua Schmid
02:09 PM Bug #45167 (New): cephadm: mons are not properly deployed
hm. this needs more investigation Sebastian Wagner
01:40 PM Bug #44825: cephadm: bootstrap is not idempotent
ceph-salt as well: https://github.com/ceph/ceph-salt/issues/173 Sebastian Wagner
11:59 AM Bug #45258 (Duplicate): cephadm: iSCSIServiceSpec: user/password should be mandatory (or autogene...
Some arguments in iSCSIServiceSpec should be mandatory, like user/password/port or at least cephadm should generate d... Sebastian Wagner
10:08 AM Bug #44792 (Fix Under Review): cephadm: make `cephadm shell` independent from /etc/ceph/ceph.conf
Ricardo Marques
08:46 AM Bug #45249: cephadm: fail to apply a iSCSI ServiceSpec
Ricardo Marques wrote:
> @Kiefer isn't this PR already fixing the issue? https://github.com/ceph/ceph/pull/34663
...
Kiefer Chang
08:37 AM Bug #45249: cephadm: fail to apply a iSCSI ServiceSpec
@Kiefer isn't this PR already fixing the issue? https://github.com/ceph/ceph/pull/34663 Ricardo Marques
07:25 AM Bug #45249 (Resolved): cephadm: fail to apply a iSCSI ServiceSpec
How to reproduce:
* Create a spec file...
Kiefer Chang
08:17 AM Bug #45252 (Resolved): cephadm: fail to insert modules when creating iSCSI targets
How to reproduce:
* Enable cephadm, create a pool and enable rbd application on it.
* Create an iSCSI container w...
Kiefer Chang
06:30 AM Bug #45196 (In Progress): cephadm: remove 'fqdn_enabled' parameter from iSCSI service spec
Attached a PR that removes the option. Matthew Oliver
05:39 AM Bug #45198 (In Progress): cephadm: unable to add iSCSI daemon from service spec yaml file
I've pushed a PR to fix this. And with this PR managed to deploy using the follow json:... Matthew Oliver
04:17 AM Bug #45245 (Resolved): cephadm: print iscsi container's log to stdout/stderr
rbd-target-api's log lives in /var/log/rbd-target-api/rbd-target-api.log inside container.
We should print the log t...
Kiefer Chang

04/23/2020

09:17 PM Bug #45152 (Rejected): cephadm: data structure doesn't work for multiple CephFS
turns out, everything is fine - as long as you attach standby mds to a particular FS. which is the case. yay! Sebastian Wagner
11:32 AM Bug #45152: cephadm: data structure doesn't work for multiple CephFS
I am unable to follow. Which data structure are you referring to, and how does it need to be corrected? Ramana Raja
03:07 PM Bug #45235 (Can't reproduce): cephadm: mons are not properly undeployed
... Sebastian Wagner
12:33 PM Feature #45203 (Resolved): OSD Spec: allow filtering via explicit hosts and labels
How to reproduce:
1. bootstrap a single-node cluster on a machine with 4 free disks, and then run "ceph versions" ...
Nathan Cutler
12:24 PM Bug #45167 (In Progress): cephadm: mons are not properly deployed
can confirm:... Sebastian Wagner
09:41 AM Bug #45197 (Duplicate): cephadm: rgw: failed to bind address 0.0.0.0:80
close. duplicate. Sebastian Wagner
09:26 AM Bug #45197: cephadm: rgw: failed to bind address 0.0.0.0:80
... Sebastian Wagner
09:01 AM Bug #45197 (Duplicate): cephadm: rgw: failed to bind address 0.0.0.0:80
Despite running as root, RGW still cannot bind to port 80.... Sebastian Wagner
09:17 AM Bug #44792: cephadm: make `cephadm shell` independent from /etc/ceph/ceph.conf
This is a usability bug:
Workaround might be to infer the ceph.conf as well?...
Sebastian Wagner
09:08 AM Bug #45198 (Closed): cephadm: unable to add iSCSI daemon from service spec yaml file
Looking into the docs [1], I see that we can use the `add` command in two different ways:
1) *ceph orch daemon add...
Ricardo Marques
08:49 AM Bug #45196 (Resolved): cephadm: remove 'fqdn_enabled' parameter from iSCSI service spec
The 'fqdn_enabled' parameter was never merged into ceph-iscsi master branch.
That setting was introduced on https:...
Ricardo Marques
08:27 AM Bug #45174: cephadm: missing parameters on 'orch daemon add iscsi'
Can we access ceph-iscsi API if we don't specify an `api_user` and `api_pass`? Ricardo Marques
07:26 AM Bug #45129 (Fix Under Review): simple (ceph-disk) style OSDs adopted by cephadm don't start after...
Tim Serong
01:32 AM Bug #45161: cephadm: iscsi should validate the existence of the given pool
I've added a pool check to iscsci and nfs (which has the same issue): https://github.com/ceph/ceph/pull/34698 Matthew Oliver

04/22/2020

11:27 PM Bug #45174: cephadm: missing parameters on 'orch daemon add iscsi'
Isn't that normal. Others do that too, look at _add_rgw above it. if you want to set the non-standard options you are... Matthew Oliver
11:19 AM Bug #45174 (Triaged): cephadm: missing parameters on 'orch daemon add iscsi'
Sebastian Wagner
09:23 AM Bug #45174 (Resolved): cephadm: missing parameters on 'orch daemon add iscsi'
`orch daemon add iscsi` is missing some parameters when compared to iSCSI service spec:
add command parameter: htt...
Ricardo Marques
07:41 PM Bug #45162 (Fix Under Review): cephadm: iscsi should use the correct container image
Michael Fritch
02:59 PM Bug #45087 (Triaged): cephadm: add-repo: cephadm uses the container image ID as Debian repo base
Sebastian Wagner
02:59 PM Bug #45087: cephadm: add-repo: cephadm uses the container image ID as Debian repo base
Right, That doesn't make sense. Sebastian Wagner
02:55 PM Feature #44869 (Need More Info): cephadm: automatic auth key rotation
need info Sebastian Wagner
02:55 PM Bug #45120 (Fix Under Review): cephadm: adopt prometheus doesn't work
Sebastian Wagner
02:17 PM Feature #43690: cephadm: service resource limits
[16:13:08] <jlayton> need to lower the daemon memory limits to try and reproduce a problem
[16:13:27] <jlayton> (plu...
Sebastian Wagner
02:11 PM Bug #44832 (Fix Under Review): cephadm: `ceph cephadm generate-key` fails with No such file or di...
Sebastian Wagner
02:00 PM Bug #44826 (Fix Under Review): cephadm: "Deploying daemon crash.li221-238... ERROR: no keyring pr...
Sebastian Wagner
01:49 PM Documentation #44828 (Fix Under Review): cephadm: clarify "Failed to infer CIDR network for mon ip"
Sebastian Wagner
01:49 PM Documentation #44905 (Pending Backport): cephadm troubleshooting SSH errors
Sebastian Wagner
01:20 PM Bug #45095 (Pending Backport): cephadm adopt can't handle offline OSDs
Sebastian Wagner
01:20 PM Bug #45108 (Pending Backport): test_orchestrator: service ls doesn't work
Sebastian Wagner
01:19 PM Bug #44609 (Resolved): cephadm: grafana: cert problem prevents dashbaord integration
Sebastian Wagner
01:18 PM Bug #45081 (Pending Backport): cephadm: `upgrade check 15.2.1` : OrchestratorError: Failed to pul...
Sebastian Wagner
12:53 PM Bug #45129: simple (ceph-disk) style OSDs adopted by cephadm don't start after reboot
Sebastian Wagner wrote:
> Hm, we're already injecting this lvm activate into the unit file:
>
> * https://github....
Tim Serong
09:16 AM Documentation #44971 (Fix Under Review): cephadm: document the cephadm binary
Sebastian Wagner
09:01 AM Bug #45172 (Resolved): bin/cephadm: logs: Traceback: not enough values to unpack (expected 2, got 1)
query logs for a daemon that doesn't exist results in a uncaught traceback.... Joshua Schmid

04/21/2020

09:07 PM Bug #45167 (Can't reproduce): cephadm: mons are not properly deployed
... Sebastian Wagner
06:47 PM Backport #44893: octopus: racey concurrent ceph-volume callKeyError: 'ceph.type'
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/34423
m...
Nathan Cutler
06:05 PM Documentation #45165 (Can't reproduce): cephadm troubleshooting: recover from broken daemons
... Sebastian Wagner
05:41 PM Bug #45162: cephadm: iscsi should use the correct container image
docker.io/ceph/ceph:v15 is the default cephadm container image so if you're using a different container image via the... Dimitri Savineau
02:24 PM Bug #45162 (Resolved): cephadm: iscsi should use the correct container image
I've used "registry/ceph/ceph:latest" to bootstrap my cluster, but when I add an iSCSI gateway I see that "docker.io/... Ricardo Marques
03:59 PM Bug #45155: mgr/dashboard: Error listing orchestrator NFS daemons
sorry for the noise, mike Sebastian Wagner
10:46 AM Bug #45155: mgr/dashboard: Error listing orchestrator NFS daemons
the traceback is:... Sebastian Wagner
10:18 AM Bug #45155 (Closed): mgr/dashboard: Error listing orchestrator NFS daemons
I've used orchestrator to add an NFS gateway:... Ricardo Marques
03:06 PM Documentation #45128 (Resolved): cephadm: document: `orch device zap`
https://github.com/ceph/ceph/pull/34668
This PR addresses this issue.
Zac Dover
02:54 PM Feature #45163 (Resolved): cephadm: iscsi: read and write config-key for the dashboard
Make use of https://github.com/ceph/ceph/blob/master/src/pybind/mgr/dashboard/services/iscsi_config.py#L46 to set isc... Sebastian Wagner
02:04 PM Bug #45161 (Resolved): cephadm: iscsi should validate the existence of the given pool
Let's create an iscsi gw, without having the "rbd" pool:... Sebastian Wagner

04/20/2020

04:46 PM Bug #45152 (Rejected): cephadm: data structure doesn't work for multiple CephFS
It is possible to move an MDS from one FS to another:... Sebastian Wagner
12:37 PM Bug #45120: cephadm: adopt prometheus doesn't work
So we should have something to address issue 2/ since the prometheus data directory depends on the OS.
I'll update...
Dimitri Savineau

04/19/2020

09:33 PM Feature #44919 (New): cephadm MONSpec: special dir for the mon store?
Sebastian Wagner
09:27 PM Tasks #45143 (Closed): cephadm: scheduler improvements
h3. Prio = high
* Removal: make sure, enough daemons joined the maps
* Removal: priorize standby daemons
* docum...
Sebastian Wagner

04/18/2020

08:52 AM Feature #45091: cephadm: CephX disabled: bad_method + failed to fetch mon config
It seems this isn't just a bug related to new MDS, I also hit the exact same erorr trying to add a new OSD/MON via ce... Ashley Merrick

04/17/2020

09:46 PM Bug #45120: cephadm: adopt prometheus doesn't work
This path appears to be platform and/or config dependent based the '--storage.tsdb.path' argument.
Debian uses a d...
Michael Fritch
09:44 PM Feature #45138 (Closed): cephadm: remove legacy daemons
rm-daemon doesn't support removing those daemons:... Sebastian Wagner
09:26 PM Bug #45129: simple (ceph-disk) style OSDs adopted by cephadm don't start after reboot
Hm, we're already injecting this lvm activate into the unit file:
* https://github.com/ceph/ceph/blob/138018eddc8a...
Sebastian Wagner
12:44 PM Bug #45129: simple (ceph-disk) style OSDs adopted by cephadm don't start after reboot
OK, here's what's going on: outside the container world, simple OSDs have a unit enabled named something like ceph-vo... Tim Serong
11:33 AM Bug #45129 (Resolved): simple (ceph-disk) style OSDs adopted by cephadm don't start after reboot
When running @cephadm adopt@ against a simple (ceph-disk) style OSD, the adopt runs fine, and the OSD starts, but lat... Tim Serong
09:09 PM Backport #44845 (Resolved): octopus: cephadm: Unable to use IPv6 on "cephadm bootstrap"
Sebastian Wagner
09:09 PM Backport #44893 (Resolved): octopus: racey concurrent ceph-volume callKeyError: 'ceph.type'
Sebastian Wagner
09:08 PM Backport #45061 (Resolved): octopus: cephadm: iscsi
Sebastian Wagner
10:31 AM Documentation #45128 (Resolved): cephadm: document: `orch device zap`
There is no mention of `orch device zap` in the docs: https://docs.ceph.com/docs/master/search/?q=orch+device+zap
...
Sebastian Wagner
03:46 AM Bug #44769 (Pending Backport): cephadm doesn't reuse osd_id of 'destroyed' osds
Kiefer Chang

04/16/2020

08:28 PM Bug #45120 (Resolved): cephadm: adopt prometheus doesn't work
The cephadm adopt prometheus command has two major problems:
1/ the etc/prometheus directory in the destination di...
Dimitri Savineau
06:43 PM Cleanup #45118 (Closed): orch (pacific): cleanup CLI
use ... Sebastian Wagner
06:30 PM Feature #44556 (Pending Backport): cephadm: preview drivegroups
Sebastian Wagner
07:46 AM Feature #44556 (Resolved): cephadm: preview drivegroups
Joshua Schmid
06:29 PM Feature #43689 (Resolved): cephadm: iscsi
Sebastian Wagner
06:28 PM Bug #44602 (Resolved): cephadm: `orch ls` shows daemons as online, despite host is down
Sebastian Wagner
06:27 PM Bug #44934 (Resolved): cephadm RGW: scary remove-deploy loop
Sebastian Wagner
06:25 PM Feature #43839 (Resolved): enhance `host ls`
Sebastian Wagner
03:51 PM Subtask #45116 (Resolved): cephadm: RGW Load balancer using HAproxy
The Ceph Object Gateway allows you to assign many instances of the object gateway to a single zone so that you can sc... Juan Miguel Olmo Martínez
03:27 PM Feature #45115 (New): cephadm: Deploy Ceph Dashboard behind a HAProxy instance
A very common scenario is putting Ceph Dashboard behind a proxy server, for load balancing and security purposes. Thi... Lenz Grimmer
01:22 PM Documentation #44828: cephadm: clarify "Failed to infer CIDR network for mon ip"
See
https://github.com/ceph/ceph/pull/34589
This PR addresses this issue.
Zac Dover
10:51 AM Documentation #44828: cephadm: clarify "Failed to infer CIDR network for mon ip"
https://docs.ceph.com/docs/master/cephadm/install/?highlight=public_network#deploy-additional-monitors-optional
Li...
Zac Dover
10:50 AM Documentation #44828: cephadm: clarify "Failed to infer CIDR network for mon ip"
https://ceph.readthedocs.io/en/latest/cephadm/install/#deploy-additional-monitors-optional Sebastian Wagner
12:52 PM Bug #44577: cephadm: reconfigure Prometheus on MGR failover
How can we make sure, we're not missing any MgrMap updates, as we have to deal with a mgr/cephadm failover simultaneo... Sebastian Wagner
10:21 AM Feature #45111 (Rejected): cephadm: choose distribution specific images based on etc/os-releaes
Would be great to autoamticllay download the leap images, if cephadm was started on leap. Sebastian Wagner
09:44 AM Bug #45108 (Fix Under Review): test_orchestrator: service ls doesn't work
Sebastian Wagner
07:51 AM Bug #45108 (Resolved): test_orchestrator: service ls doesn't work
*How to reproduce*
- vstart a cluster.
- Enable test_orchestrator and set it as the backend.
- listing services ra...
Kiefer Chang
09:04 AM Bug #45086 (Resolved): cephadm: upgrade from v15 to v15.2.1 not working
Sebastian Wagner
08:22 AM Bug #45093 (Can't reproduce): cephadm: mgrs transiently getting co-located (one node gets two whe...
It is not 100% reproducible. Nathan Cutler
07:46 AM Bug #44769 (Fix Under Review): cephadm doesn't reuse osd_id of 'destroyed' osds
Joshua Schmid

04/15/2020

01:58 PM Bug #43838 (In Progress): cephadm: Forcefully Remove Services (unresponsive hosts)
Sebastian Wagner
01:48 PM Bug #45086: cephadm: upgrade from v15 to v15.2.1 not working
yes - thank you!
ceph orch upgrade start --ceph-version 15.2.1
Initiating upgrade to docker.io/ceph/ceph:v15.2.1
Tobias Fischer
01:44 PM Bug #45086 (Need More Info): cephadm: upgrade from v15 to v15.2.1 not working
Sebastian Wagner
01:43 PM Bug #45086: cephadm: upgrade from v15 to v15.2.1 not working
Is this fixed by https://github.com/ceph/ceph/pull/34556 ? Sebastian Wagner
01:36 PM Bug #45097 (Resolved): cephadm: UX: Traceback, if `orch host add mon1` fails.
This should not show a Traceback: ... Sebastian Wagner
01:31 PM Bug #45093 (Need More Info): cephadm: mgrs transiently getting co-located (one node gets two when...
Sebastian Wagner
09:22 AM Bug #45093: cephadm: mgrs transiently getting co-located (one node gets two when only one was ask...
could you attach ... Sebastian Wagner
07:54 AM Bug #45093 (Resolved): cephadm: mgrs transiently getting co-located (one node gets two when only ...
h3. After "ceph orch apply mgr node1,node2,node3", cluster has four MGRs
This started happening in master very rec...
Nathan Cutler
01:26 PM Bug #45081 (Fix Under Review): cephadm: `upgrade check 15.2.1` : OrchestratorError: Failed to pul...
Sebastian Wagner
01:14 PM Documentation #44905: cephadm troubleshooting SSH errors
<SebastianW> 1. ceph cephadm get-ssh-config > config
<SebastianW> 2. ceph config-key get mgr/cephadm/ssh_identity_ke...
Zac Dover
12:43 PM Bug #43816 (New): cephadm: Unable to use IPv6 on "cephadm bootstrap"
This covers PR 34180.
Sebastian Wagner
12:40 PM Bug #44820 (Resolved): racey concurrent ceph-volume callKeyError: 'ceph.type'
Sebastian Wagner
12:40 PM Bug #44609 (Pending Backport): cephadm: grafana: cert problem prevents dashbaord integration
Sebastian Wagner
12:39 PM Bug #44602 (Pending Backport): cephadm: `orch ls` shows daemons as online, despite host is down
Sebastian Wagner
11:37 AM Bug #44950 (Duplicate): OSDSpec: Reserving storage on db_devices
Sebastian Wagner
11:28 AM Bug #45029 (Pending Backport): cephadm: add-repo fails (silently) when no arguments are given
Sebastian Wagner
11:27 AM Backport #45061 (In Progress): octopus: cephadm: iscsi
Sebastian Wagner
11:25 AM Bug #45065 (Pending Backport): cephadm: Config option warn_on_stray_daemons does not work as expe...
Sebastian Wagner
11:24 AM Bug #44934 (Pending Backport): cephadm RGW: scary remove-deploy loop
Sebastian Wagner
09:44 AM Bug #45095 (Fix Under Review): cephadm adopt can't handle offline OSDs
Tim Serong
09:17 AM Bug #45095 (Resolved): cephadm adopt can't handle offline OSDs
@cephadm adopt@ for OSDs relies on the OSD actually being up and running (it checks /var/lib/ceph/osd/ceph-$ID/{fsid,... Tim Serong
09:12 AM Bug #45092 (Duplicate): granfana api url - cephadm
Thanks for reporting this! (duplicates #44877) Sebastian Wagner
05:41 AM Bug #45092 (Duplicate): granfana api url - cephadm
Upon creating a cephadm grafana using 'ceph orch apply grafana 1'
The api url is automatically set to the internal...
Ashley Merrick
05:36 AM Feature #45091 (Closed): cephadm: CephX disabled: bad_method + failed to fetch mon config
Upon trying to migrate an existing cluster to cephadm the new MDS via cephadm fail to start.
Cluster is running wi...
Ashley Merrick

04/14/2020

05:21 PM Bug #45016: mgr: `ceph tell mgr mgr_status` hangs
Quick check in vstart suggests the mgr works fine (current octopus).
Guess a next step could be to run this with d...
Jan Fajerski
04:17 PM Bug #45065 (Fix Under Review): cephadm: Config option warn_on_stray_daemons does not work as expe...
Sebastian Wagner
01:52 PM Bug #45065: cephadm: Config option warn_on_stray_daemons does not work as expected
As far as I can see, the problem is line 1050 in mgr/cephadm/module.py. The line states
if self.warn_on_stray_ho...
Andreas Haase
02:53 PM Bug #45086: cephadm: upgrade from v15 to v15.2.1 not working
I tried both - v15.2.1 and 15.2.1 (as stated in documentation) - same result Tobias Fischer
02:47 PM Bug #45086: cephadm: upgrade from v15 to v15.2.1 not working
have you tried without the v prefix?... Sebastian Wagner
01:17 PM Bug #45086 (Resolved): cephadm: upgrade from v15 to v15.2.1 not working
start updgrade:... Tobias Fischer
02:43 PM Feature #45089 (New): cephadm: mgr thrasher
Add a mgr thrasher
And make sure, *all things* are idempotent everywhere.
Sebastian Wagner
01:27 PM Bug #45087 (Closed): cephadm: add-repo: cephadm uses the container image ID as Debian repo base
installed cephadm last week according to docu and added repo via cephadm:... Tobias Fischer
10:33 AM Bug #45081 (Resolved): cephadm: `upgrade check 15.2.1` : OrchestratorError: Failed to pull 15.2.1...
... Sebastian Wagner

04/13/2020

10:47 AM Bug #45065: cephadm: Config option warn_on_stray_daemons does not work as expected
Debian 10, CEPH v15.2.1. The same problem. Abatolii Balaban
10:44 AM Bug #45065: cephadm: Config option warn_on_stray_daemons does not work as expected
On Octopus cluster we've installed tcmu-runner, ceph-iscsi as stated in Manual Installation for iSCSI Gateways. We've... Fedor Ivanov

04/11/2020

06:47 PM Bug #45065 (Resolved): cephadm: Config option warn_on_stray_daemons does not work as expected
On a Octopus cluster I configured tcmu-runner to export storage via iscsi. As the tcmu-runner isn't configured by cep... Andreas Haase
09:41 AM Backport #45061 (Resolved): octopus: cephadm: iscsi
https://github.com/ceph/ceph/pull/34554 Nathan Cutler
09:36 AM Bug #45037 (Resolved): octopus: cephadm: non-ceph units put wrong uid:gid in systemd unit file
https://github.com/ceph/ceph/pull/34438 Nathan Cutler

04/10/2020

09:00 PM Bug #45029 (In Progress): cephadm: add-repo fails (silently) when no arguments are given
> Would you be open for a PR that either prints out an error when no arguments are given or that assumes some default... Sebastian Wagner
12:58 PM Bug #45029 (Resolved): cephadm: add-repo fails (silently) when no arguments are given
I've been looking around to see if there are any low-level things that were broken for me during the installation of ... Maran H
08:54 PM Bug #45032 (Resolved): cephadm: Not recovering from `OSError: cannot send (already closed?)`
Workaround for this was:... Sebastian Wagner

04/09/2020

01:15 PM Bug #43803 (Resolved): ceph orchestrator rgw rm: no valid command found
Sebastian Wagner
01:11 PM Bug #45016 (Resolved): mgr: `ceph tell mgr mgr_status` hangs
cephadm bootstrap hangs:... Sebastian Wagner
12:32 PM Bug #44825: cephadm: bootstrap is not idempotent
Making cephadm bootstrap truly idempotent will not be trivial. As there are going to be some special cases, like: wha... Sebastian Wagner
12:09 PM Feature #45015 (Closed): cephadm: bind mount `ceph` from a container into the host system?
"snaps" can actually bind mount the binaries from their containers into the host OS environment, rather than needing ... Sebastian Wagner
11:43 AM Bug #45010 (Fix Under Review): cephadm: /etc/ceph/ceph.conf directory /etc/ceph does not exist
Sebastian Wagner
08:01 AM Bug #45010 (Can't reproduce): cephadm: /etc/ceph/ceph.conf directory /etc/ceph does not exist
... Sebastian Wagner
11:42 AM Bug #44909 (Can't reproduce): cephadm on Debian Buster: journald logs are empty
... Sebastian Wagner
09:42 AM Backport #43995 (Resolved): nautilus: ceph orchestrator rgw rm: no valid command found
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33160
m...
Nathan Cutler
07:48 AM Bug #44972 (New): cephadm: add-repo on ubuntu broken
Sebastian Wagner
07:36 AM Bug #44972: cephadm: add-repo on ubuntu broken
Turns out apt-key is unusable by default:... Sebastian Wagner
06:29 AM Bug #44950: OSDSpec: Reserving storage on db_devices
Jan Fajerski wrote:
> Which version are you running? There was a bug recently where the slots arguments were ignored...
Maran H

04/08/2020

04:33 PM Bug #44934: cephadm RGW: scary remove-deploy loop
The GitHub PR states "turns out users put dot into their RGW service names" - all the dots you can see in the log ste... Hurz Hurz
02:43 PM Bug #44972 (In Progress): cephadm: add-repo on ubuntu broken
Sebastian Wagner
01:29 PM Bug #44313 (Resolved): ceph-volume prepare is not idempotent and may get called twice
this particular issue was resolved. Sebastian Wagner
01:29 PM Bug #44824: cephadm: adding osd device is not idempotent
See https://github.com/ceph/ceph/pull/33755/files#r405524847 Sebastian Wagner
01:15 PM Bug #44965 (Resolved): cephadm: git archive from ci failes
Fixed by Kefu. Big Thanks! Sebastian Wagner
11:45 AM Feature #44993 (New): cephadm: Resource-aware daemons placement
Use resource limits (cpu, memory) to allow to schedule properly the deploy of the different daemons in the best suite... Juan Miguel Olmo Martínez
09:34 AM Bug #44990 (Can't reproduce): cephadm: exec: "/usr/bin/ceph-mon": stat /usr/bin/ceph-mon: no such...
http://pulpito.ceph.com/yuriw-2020-04-07_17:39:28-rados-wip-octopus-rgw-msg-fixes-distro-basic-smithi/4931485/
<pr...
Sebastian Wagner
08:11 AM Bug #44950: OSDSpec: Reserving storage on db_devices
Maran H wrote:
> I've read this as, 'it's not implement in batch' therefor I assumed it would be implemented in crea...
Jan Fajerski
08:03 AM Bug #44950: OSDSpec: Reserving storage on db_devices
Maran H wrote:
> Joshua Schmid wrote:
> > This can be achieved using the `slots` option of ceph-volume.
>
> I've...
Joshua Schmid
01:57 AM Bug #44968: cehpadm: another "RuntimeError: Set changed size during iteration"
The issue was reported by an IRC user.
Basically he tried to select 6 OSDs for deleting from Dashboard, requests are...
Kiefer Chang
01:36 AM Feature #43689 (Pending Backport): cephadm: iscsi
Kiefer Chang

04/07/2020

10:46 PM Bug #44965 (In Progress): cephadm: git archive from ci failes
Sebastian Wagner
10:46 PM Bug #44965: cephadm: git archive from ci failes
turns out, the tag is missing in cpeh/ceph-ci Sebastian Wagner
05:49 PM Backport #43995: nautilus: ceph orchestrator rgw rm: no valid command found
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/33160
merged
Yuri Weinstein
03:50 PM Bug #44950: OSDSpec: Reserving storage on db_devices
Joshua Schmid wrote:
> This can be achieved using the `slots` option of ceph-volume.
I've read this as, 'it's not...
Maran H
01:07 PM Bug #44972 (Closed): cephadm: add-repo on ubuntu broken
Right now this fails:... Sebastian Wagner
12:46 PM Bug #44720 (Need More Info): rook: rgw: allow realm != zone
Sebastian Wagner
12:46 PM Bug #44720: rook: rgw: allow realm != zone
Relates to https://github.com/ceph/ceph/pull/34042 but I cannot really tell, how exactly. Sebastian Wagner
12:39 PM Bug #44758 (Resolved): Drive Groups: limit:1 does not imply all:true
Sebastian Wagner
12:37 PM Documentation #44716 (Resolved): orchestrator/cephadm: document ceph orch apply -i -
Sebastian Wagner
12:35 PM Documentation #44971 (Resolved): cephadm: document the cephadm binary
Right now (without any docs), this is totally confusing.
Topics to cover:
h2. Man page
h2. overview
...
Sebastian Wagner
11:36 AM Feature #43687: cephadm: haproxy (or lb)
Retrieving detailed requirements.
If only monitoring we will need at least the parameters needed to launch the conta...
Juan Miguel Olmo Martínez
11:27 AM Feature #43687: cephadm: haproxy (or lb)
Maybe something like this???... Sebastian Wagner
11:25 AM Feature #43687: cephadm: haproxy (or lb)
also: haproxy prometheus exporter! Sebastian Wagner
10:05 AM Bug #44968 (Can't reproduce): cehpadm: another "RuntimeError: Set changed size during iteration"
... Sebastian Wagner

04/06/2020

11:18 PM Bug #44965 (Resolved): cephadm: git archive from ci failes
http://qa-proxy.ceph.com/teuthology/mgfritch-2020-04-06_21:21:01-rados-wip-mgfritch-testing-2020-04-06-1246-distro-ba... Sebastian Wagner
03:06 PM Backport #44893 (In Progress): octopus: racey concurrent ceph-volume callKeyError: 'ceph.type'
Nathan Cutler
11:18 AM Bug #44950: OSDSpec: Reserving storage on db_devices
This can be achieved using the `slots` option of ceph-volume.
Unfortunately the slots option for wal/db (taken fro...
Joshua Schmid
10:37 AM Bug #44950 (Duplicate): OSDSpec: Reserving storage on db_devices
I'm trying to setup a new Ceph cluster using cephadm.
To save costs I've gotten four OSD servers with only a hand...
Maran H
10:38 AM Backport #44710: octopus: doc/cephadm: replace `osd create` with `apply osd`
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/34355
m...
Nathan Cutler
10:28 AM Bug #44934 (Fix Under Review): cephadm RGW: scary remove-deploy loop
Sebastian Wagner

04/04/2020

06:22 AM Bug #44823 (Won't Fix): cephadm: tries to parse arguments command passed to shell
Sebastian Wagner wrote:
> right. should be
>
> [...]
Ah, that is right. Thanks!
Patrick Donnelly

04/03/2020

07:16 PM Bug #44894 (Pending Backport): cephadm: non-ceph units put wrong uid:gid in systemd unit file
Sage Weil
03:59 PM Bug #44934: cephadm RGW: scary remove-deploy loop
Caught the intermittent container (at the very bottom):... Hurz Hurz
03:19 PM Bug #44934 (Resolved): cephadm RGW: scary remove-deploy loop
... Sebastian Wagner
11:40 AM Bug #44926: dashboard: creating a new bucket causes InvalidLocationConstraint
Commands used to create the object gateway:... Andreas Haase
11:26 AM Bug #44926 (Resolved): dashboard: creating a new bucket causes InvalidLocationConstraint
In Octopus I created an object gateway as mentioned in https://ceph.io/ceph-management/introducing-cephadm/ chapter "... Andreas Haase
10:51 AM Bug #44692 (Resolved): doc/cephadm: replace `osd create` with `apply osd`
Sebastian Wagner
10:51 AM Backport #44710 (Resolved): octopus: doc/cephadm: replace `osd create` with `apply osd`
Sebastian Wagner
10:47 AM Feature #44925 (In Progress): Please give cephadm a --version option
Figuring out which version of cephadm a given environment is running seems needlessly difficult:... Nathan Cutler
09:17 AM Feature #43690: cephadm: service resource limits
Rook actually recommends to *not* set resource limits for Ceph daemons, as all daemons are critical for the cluster.... Sebastian Wagner
09:10 AM Feature #44919 (Resolved): cephadm MONSpec: special dir for the mon store?
Rook supports a dataDirHostPath to set the data dir for the mons. Do we need this as well? Is it worth?
e.g for p...
Sebastian Wagner
04:02 AM Backport #44845: octopus: cephadm: Unable to use IPv6 on "cephadm bootstrap"
https://github.com/ceph/ceph/pull/34350 Nathan Cutler
04:02 AM Backport #44845 (Need More Info): octopus: cephadm: Unable to use IPv6 on "cephadm bootstrap"
Nathan Cutler

04/02/2020

11:37 PM Bug #44894 (Fix Under Review): cephadm: non-ceph units put wrong uid:gid in systemd unit file
Sage Weil
06:01 PM Bug #44894: cephadm: non-ceph units put wrong uid:gid in systemd unit file
When a node-export deploy runs, the generated systemd unit file puts 65534:65534 for /var/run/ceph/$fsid
Sage Weil
02:31 PM Bug #44598 (Resolved): cephadm: Traceback, if Python 3 is not installed on remote host
Daniel Pivonka
02:18 PM Bug #44609 (Fix Under Review): cephadm: grafana: cert problem prevents dashbaord integration
Sebastian Wagner
11:04 AM Bug #44910 (Rejected): cephadm: PlacementSpec host1:192.168.0.2,host1:192.168.0.2
Make sure... Sebastian Wagner
10:58 AM Bug #44909 (Can't reproduce): cephadm on Debian Buster: journald logs are empty
* Debian Buster
* docker...
Sebastian Wagner
10:07 AM Documentation #44905 (Resolved): cephadm troubleshooting SSH errors
... Sebastian Wagner
10:02 AM Documentation #43834 (Can't reproduce): cephadm: some command only support `hosts`. make sure use...
close for now. Sebastian Wagner
09:58 AM Feature #43709: mgr/rook: remove OSDs
Design discussion:
https://github.com/rook/rook/pull/3954
Juan Miguel Olmo Martínez
09:39 AM Bug #44720: rook: rgw: allow realm != zone
It seems sensible to wait for changes explained in the RGW multisite design:
https://github.com/rook/rook/pull/4520
Juan Miguel Olmo Martínez

04/01/2020

08:30 PM Bug #44673: cephadm: `orch apply` and `orch daemon add` use completely different code path
Sebastian Wagner wrote:
> prerequisite: https://github.com/ceph/ceph/pull/34091
This one has been merged.
Nathan Cutler
08:27 PM Backport #44710 (In Progress): octopus: doc/cephadm: replace `osd create` with `apply osd`
Nathan Cutler
06:50 PM Bug #44894 (Resolved): cephadm: non-ceph units put wrong uid:gid in systemd unit file
... Sage Weil
06:42 PM Bug #44832: cephadm: `ceph cephadm generate-key` fails with No such file or directory: '/tmp/...
Here is the Debug Log:... Mario Ohnewald
05:04 PM Backport #44893 (Resolved): octopus: racey concurrent ceph-volume callKeyError: 'ceph.type'
https://github.com/ceph/ceph/pull/34423 Nathan Cutler
03:59 PM Bug #44820 (Pending Backport): racey concurrent ceph-volume callKeyError: 'ceph.type'
Sage Weil
02:36 PM Bug #44887 (Fix Under Review): cephadm: Simplify mounting of host dirs into prom/node-exporter
Volker Theile
02:10 PM Bug #44887 (Rejected): cephadm: Simplify mounting of host dirs into prom/node-exporter
With https://github.com/ceph/ceph/pull/32340 the following host directories are mounted into the prom/node-exporter c... Volker Theile
02:11 PM Bug #44888 (Resolved): Drivegroup's :limit: isn't working correctly
Each iteration of an osd deployment deploys OSDs up to a set :limit:
Since we're deploying every $sleep_interval sec...
Joshua Schmid
02:10 PM Feature #44886: cephadm: allow use of authenticated registry
and then the next request will be to support untrusted registries... and so on Sebastian Wagner
01:49 PM Feature #44886 (Resolved): cephadm: allow use of authenticated registry
Users may need to use an authenticated registry, e.g. in air-gapped deployments.
We could punt and require that th...
Sage Weil
02:06 PM Feature #44556 (Fix Under Review): cephadm: preview drivegroups
Joshua Schmid
10:15 AM Bug #44777 (Resolved): podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to ...
Sebastian Wagner
10:04 AM Bug #44876 (New): mgr/rook: track minor upgrades
... Sebastian Wagner
09:59 AM Feature #44875 (Resolved): mgr/rook: PlacementSpec to K8s POD scheduling conversion
https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.18/#affinity-v1-core
orch -> k8s...
Sebastian Wagner
09:53 AM Feature #41239: mgr/rook: support creating OSDs on Persistent Volumes
Some thoughts:
* OSDSpec specifies an existing StorageClass, num OSDs per node, ...?
* mgr/rook triggers osd crea...
Sebastian Wagner
09:50 AM Feature #44874 (Rejected): cephadm: add Filestore support
If someone wants to work on it:
* Has to mount the filesystem. ceph-ansible uses a complex bind-mount for it.
* c...
Sebastian Wagner
09:46 AM Feature #44873 (Resolved): cephadm bootstrap: add --apply-spec <cluster.yaml>
to have truly a single command when setting up a cluster for Day 1
Requirements:
h3. Adding hosts
* YAML spe...
Sebastian Wagner
08:28 AM Bug #44769 (In Progress): cephadm doesn't reuse osd_id of 'destroyed' osds
Joshua Schmid

03/31/2020

07:58 PM Feature #43687: cephadm: haproxy (or lb)
Deploy and configure haproxy with cephadm; configure a service/lb with kubernetes/rook. Can we generalize these into... Sage Weil
07:54 PM Feature #44869 (Resolved): cephadm: automatic auth key rotation
This is about periodically deploying new keys for daemons and clients. This is a bit more involved at we need to make... Sage Weil
04:21 PM Documentation #44867 (Rejected): cephadm: document "package" mode
... Sebastian Wagner
04:07 PM Feature #44866 (Resolved): cephadm root mode: support non-root users + sudo
Let's say, someone does:... Sebastian Wagner
03:45 PM Feature #44864 (New): cephadm: garbage collect old container images
cephadm: garbage collect old container images Sebastian Wagner
01:39 PM Bug #44820: racey concurrent ceph-volume callKeyError: 'ceph.type'
Copying to fix in c-v as well. Jan Fajerski
01:18 PM Bug #44820 (Fix Under Review): racey concurrent ceph-volume callKeyError: 'ceph.type'
Sage Weil
10:00 AM Backport #44845 (Resolved): octopus: cephadm: Unable to use IPv6 on "cephadm bootstrap"
Nathan Cutler
09:54 AM Bug #44823 (Triaged): cephadm: tries to parse arguments command passed to shell
Sebastian Wagner
09:54 AM Bug #44823: cephadm: tries to parse arguments command passed to shell
right. should be ... Sebastian Wagner
12:32 AM Bug #44823 (Won't Fix): cephadm: tries to parse arguments command passed to shell
... Patrick Donnelly
09:49 AM Bug #44832 (Resolved): cephadm: `ceph cephadm generate-key` fails with No such file or directory:...
... Sebastian Wagner
09:43 AM Bug #44810 (Won't Fix): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
according to kai , this was a false alarm Sebastian Wagner
09:42 AM Bug #44830 (Duplicate): cpehadm bootstrap: improve error message, if `host add` fails
... Sebastian Wagner
09:07 AM Documentation #44828 (Resolved): cephadm: clarify "Failed to infer CIDR network for mon ip"
... Sebastian Wagner
03:41 AM Bug #44826 (Resolved): cephadm: "Deploying daemon crash.li221-238... ERROR: no keyring provided"
... Patrick Donnelly
12:36 AM Bug #44825 (Rejected): cephadm: bootstrap is not idempotent
It would be helpful if this command did nothing if the cluster is already bootstrapped. This would simplify ansible r... Patrick Donnelly
12:35 AM Bug #44824 (Resolved): cephadm: adding osd device is not idempotent
... Patrick Donnelly

03/30/2020

11:28 PM Bug #44820: racey concurrent ceph-volume callKeyError: 'ceph.type'
the problem seems to be a racing invocation of inventory and prepare:... Sage Weil
08:29 PM Bug #44820 (Resolved): racey concurrent ceph-volume callKeyError: 'ceph.type'
... Sage Weil
09:01 PM Bug #44810 (Fix Under Review): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
Michael Fritch
05:28 PM Bug #44810 (Need More Info): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
Sebastian Wagner
11:09 AM Bug #44810 (Won't Fix): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
cephadm bootstrap creates @/etc/ceph/ceph.pub@ with a wrong permissions Sebastian Wagner
08:23 PM Bug #44669 (Resolved): cephadm: rm-cluster should clean up /etc/ceph
Sage Weil
06:08 PM Feature #44305 (Resolved): mgr/cephadm: Add support for removing MONs
Sage Weil
06:08 PM Bug #44039 (Rejected): bin/cephadm: Remove --allow-fqdn-hostname
seems that this might be a valid config! Sebastian Wagner
06:07 PM Feature #44287: cephadm: Graceful Shutdown of the Whole Ceph Cluster
open Q: how do we shutdown the mons, after we already did shut down all mgrs? Sebastian Wagner
05:53 PM Bug #44758 (Fix Under Review): Drive Groups: limit:1 does not imply all:true
Sebastian Wagner
05:35 PM Feature #43708 (Resolved): mgr/rook: Blink enclosure LED
Sebastian Wagner
05:35 PM Feature #43696: cephadm: check that units start
low, until someone complains. Sebastian Wagner
05:33 PM Bug #44739 (Need More Info): ceph.conf parameters set via "cephadm bootstrap -c" are not persiste...
Interesting. the code there is rather old: https://github.com/ceph/ceph/blame/master/src/cephadm/cephadm#L2115-L2124
...
Sebastian Wagner
05:29 PM Documentation #44716 (Fix Under Review): orchestrator/cephadm: document ceph orch apply -i -
Sebastian Wagner
01:01 PM Feature #44556: cephadm: preview drivegroups
Shortened this discussion with a f2t talk with Sebastian. Here are the results
Keep the old syntax but expand with...
Joshua Schmid
10:45 AM Feature #44556: cephadm: preview drivegroups
> I guess we want to have the following features:
>
> 1) preview a service if the spec is already applied (useful ...
Sebastian Wagner
08:31 AM Feature #44556: cephadm: preview drivegroups
I guess we want to have the following features:
1) preview a service if the spec is already applied (useful when h...
Joshua Schmid
10:37 AM Bug #44777: podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to remove cont...
Not yet understsand, why https://github.com/ceph/ceph/pull/34260 fixes this issue. Sebastian Wagner
10:21 AM Bug #44777: podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to remove cont...
... Sebastian Wagner
09:16 AM Bug #44777 (Fix Under Review): podman: stat /usr/bin/ceph-mon: no such file or directory, then un...
Sebastian Wagner
10:33 AM Bug #44642: cephadm: mgr dump might be too huge
Backported to octopus by https://github.com/ceph/ceph/pull/34258 Nathan Cutler
 

Also available in: Atom