Project

General

Profile

Activity

From 03/11/2020 to 04/09/2020

04/09/2020

01:15 PM Bug #43803 (Resolved): ceph orchestrator rgw rm: no valid command found
Sebastian Wagner
01:11 PM Bug #45016 (Resolved): mgr: `ceph tell mgr mgr_status` hangs
cephadm bootstrap hangs:... Sebastian Wagner
12:32 PM Bug #44825: cephadm: bootstrap is not idempotent
Making cephadm bootstrap truly idempotent will not be trivial. As there are going to be some special cases, like: wha... Sebastian Wagner
12:09 PM Feature #45015 (Closed): cephadm: bind mount `ceph` from a container into the host system?
"snaps" can actually bind mount the binaries from their containers into the host OS environment, rather than needing ... Sebastian Wagner
11:43 AM Bug #45010 (Fix Under Review): cephadm: /etc/ceph/ceph.conf directory /etc/ceph does not exist
Sebastian Wagner
08:01 AM Bug #45010 (Can't reproduce): cephadm: /etc/ceph/ceph.conf directory /etc/ceph does not exist
... Sebastian Wagner
11:42 AM Bug #44909 (Can't reproduce): cephadm on Debian Buster: journald logs are empty
... Sebastian Wagner
09:42 AM Backport #43995 (Resolved): nautilus: ceph orchestrator rgw rm: no valid command found
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/33160
m...
Nathan Cutler
07:48 AM Bug #44972 (New): cephadm: add-repo on ubuntu broken
Sebastian Wagner
07:36 AM Bug #44972: cephadm: add-repo on ubuntu broken
Turns out apt-key is unusable by default:... Sebastian Wagner
06:29 AM Bug #44950: OSDSpec: Reserving storage on db_devices
Jan Fajerski wrote:
> Which version are you running? There was a bug recently where the slots arguments were ignored...
Maran H

04/08/2020

04:33 PM Bug #44934: cephadm RGW: scary remove-deploy loop
The GitHub PR states "turns out users put dot into their RGW service names" - all the dots you can see in the log ste... Hurz Hurz
02:43 PM Bug #44972 (In Progress): cephadm: add-repo on ubuntu broken
Sebastian Wagner
01:29 PM Bug #44313 (Resolved): ceph-volume prepare is not idempotent and may get called twice
this particular issue was resolved. Sebastian Wagner
01:29 PM Bug #44824: cephadm: adding osd device is not idempotent
See https://github.com/ceph/ceph/pull/33755/files#r405524847 Sebastian Wagner
01:15 PM Bug #44965 (Resolved): cephadm: git archive from ci failes
Fixed by Kefu. Big Thanks! Sebastian Wagner
11:45 AM Feature #44993 (New): cephadm: Resource-aware daemons placement
Use resource limits (cpu, memory) to allow to schedule properly the deploy of the different daemons in the best suite... Juan Miguel Olmo Martínez
09:34 AM Bug #44990 (Can't reproduce): cephadm: exec: "/usr/bin/ceph-mon": stat /usr/bin/ceph-mon: no such...
http://pulpito.ceph.com/yuriw-2020-04-07_17:39:28-rados-wip-octopus-rgw-msg-fixes-distro-basic-smithi/4931485/
<pr...
Sebastian Wagner
08:11 AM Bug #44950: OSDSpec: Reserving storage on db_devices
Maran H wrote:
> I've read this as, 'it's not implement in batch' therefor I assumed it would be implemented in crea...
Jan Fajerski
08:03 AM Bug #44950: OSDSpec: Reserving storage on db_devices
Maran H wrote:
> Joshua Schmid wrote:
> > This can be achieved using the `slots` option of ceph-volume.
>
> I've...
Joshua Schmid
01:57 AM Bug #44968: cehpadm: another "RuntimeError: Set changed size during iteration"
The issue was reported by an IRC user.
Basically he tried to select 6 OSDs for deleting from Dashboard, requests are...
Kiefer Chang
01:36 AM Feature #43689 (Pending Backport): cephadm: iscsi
Kiefer Chang

04/07/2020

10:46 PM Bug #44965 (In Progress): cephadm: git archive from ci failes
Sebastian Wagner
10:46 PM Bug #44965: cephadm: git archive from ci failes
turns out, the tag is missing in cpeh/ceph-ci Sebastian Wagner
05:49 PM Backport #43995: nautilus: ceph orchestrator rgw rm: no valid command found
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/33160
merged
Yuri Weinstein
03:50 PM Bug #44950: OSDSpec: Reserving storage on db_devices
Joshua Schmid wrote:
> This can be achieved using the `slots` option of ceph-volume.
I've read this as, 'it's not...
Maran H
01:07 PM Bug #44972 (Closed): cephadm: add-repo on ubuntu broken
Right now this fails:... Sebastian Wagner
12:46 PM Bug #44720 (Need More Info): rook: rgw: allow realm != zone
Sebastian Wagner
12:46 PM Bug #44720: rook: rgw: allow realm != zone
Relates to https://github.com/ceph/ceph/pull/34042 but I cannot really tell, how exactly. Sebastian Wagner
12:39 PM Bug #44758 (Resolved): Drive Groups: limit:1 does not imply all:true
Sebastian Wagner
12:37 PM Documentation #44716 (Resolved): orchestrator/cephadm: document ceph orch apply -i -
Sebastian Wagner
12:35 PM Documentation #44971 (Resolved): cephadm: document the cephadm binary
Right now (without any docs), this is totally confusing.
Topics to cover:
h2. Man page
h2. overview
...
Sebastian Wagner
11:36 AM Feature #43687: cephadm: haproxy (or lb)
Retrieving detailed requirements.
If only monitoring we will need at least the parameters needed to launch the conta...
Juan Miguel Olmo Martínez
11:27 AM Feature #43687: cephadm: haproxy (or lb)
Maybe something like this???... Sebastian Wagner
11:25 AM Feature #43687: cephadm: haproxy (or lb)
also: haproxy prometheus exporter! Sebastian Wagner
10:05 AM Bug #44968 (Can't reproduce): cehpadm: another "RuntimeError: Set changed size during iteration"
... Sebastian Wagner

04/06/2020

11:18 PM Bug #44965 (Resolved): cephadm: git archive from ci failes
http://qa-proxy.ceph.com/teuthology/mgfritch-2020-04-06_21:21:01-rados-wip-mgfritch-testing-2020-04-06-1246-distro-ba... Sebastian Wagner
03:06 PM Backport #44893 (In Progress): octopus: racey concurrent ceph-volume callKeyError: 'ceph.type'
Nathan Cutler
11:18 AM Bug #44950: OSDSpec: Reserving storage on db_devices
This can be achieved using the `slots` option of ceph-volume.
Unfortunately the slots option for wal/db (taken fro...
Joshua Schmid
10:37 AM Bug #44950 (Duplicate): OSDSpec: Reserving storage on db_devices
I'm trying to setup a new Ceph cluster using cephadm.
To save costs I've gotten four OSD servers with only a hand...
Maran H
10:38 AM Backport #44710: octopus: doc/cephadm: replace `osd create` with `apply osd`
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/34355
m...
Nathan Cutler
10:28 AM Bug #44934 (Fix Under Review): cephadm RGW: scary remove-deploy loop
Sebastian Wagner

04/04/2020

06:22 AM Bug #44823 (Won't Fix): cephadm: tries to parse arguments command passed to shell
Sebastian Wagner wrote:
> right. should be
>
> [...]
Ah, that is right. Thanks!
Patrick Donnelly

04/03/2020

07:16 PM Bug #44894 (Pending Backport): cephadm: non-ceph units put wrong uid:gid in systemd unit file
Sage Weil
03:59 PM Bug #44934: cephadm RGW: scary remove-deploy loop
Caught the intermittent container (at the very bottom):... Hurz Hurz
03:19 PM Bug #44934 (Resolved): cephadm RGW: scary remove-deploy loop
... Sebastian Wagner
11:40 AM Bug #44926: dashboard: creating a new bucket causes InvalidLocationConstraint
Commands used to create the object gateway:... Andreas Haase
11:26 AM Bug #44926 (Resolved): dashboard: creating a new bucket causes InvalidLocationConstraint
In Octopus I created an object gateway as mentioned in https://ceph.io/ceph-management/introducing-cephadm/ chapter "... Andreas Haase
10:51 AM Bug #44692 (Resolved): doc/cephadm: replace `osd create` with `apply osd`
Sebastian Wagner
10:51 AM Backport #44710 (Resolved): octopus: doc/cephadm: replace `osd create` with `apply osd`
Sebastian Wagner
10:47 AM Feature #44925 (In Progress): Please give cephadm a --version option
Figuring out which version of cephadm a given environment is running seems needlessly difficult:... Nathan Cutler
09:17 AM Feature #43690: cephadm: service resource limits
Rook actually recommends to *not* set resource limits for Ceph daemons, as all daemons are critical for the cluster.... Sebastian Wagner
09:10 AM Feature #44919 (Resolved): cephadm MONSpec: special dir for the mon store?
Rook supports a dataDirHostPath to set the data dir for the mons. Do we need this as well? Is it worth?
e.g for p...
Sebastian Wagner
04:02 AM Backport #44845: octopus: cephadm: Unable to use IPv6 on "cephadm bootstrap"
https://github.com/ceph/ceph/pull/34350 Nathan Cutler
04:02 AM Backport #44845 (Need More Info): octopus: cephadm: Unable to use IPv6 on "cephadm bootstrap"
Nathan Cutler

04/02/2020

11:37 PM Bug #44894 (Fix Under Review): cephadm: non-ceph units put wrong uid:gid in systemd unit file
Sage Weil
06:01 PM Bug #44894: cephadm: non-ceph units put wrong uid:gid in systemd unit file
When a node-export deploy runs, the generated systemd unit file puts 65534:65534 for /var/run/ceph/$fsid
Sage Weil
02:31 PM Bug #44598 (Resolved): cephadm: Traceback, if Python 3 is not installed on remote host
Daniel Pivonka
02:18 PM Bug #44609 (Fix Under Review): cephadm: grafana: cert problem prevents dashbaord integration
Sebastian Wagner
11:04 AM Bug #44910 (Rejected): cephadm: PlacementSpec host1:192.168.0.2,host1:192.168.0.2
Make sure... Sebastian Wagner
10:58 AM Bug #44909 (Can't reproduce): cephadm on Debian Buster: journald logs are empty
* Debian Buster
* docker...
Sebastian Wagner
10:07 AM Documentation #44905 (Resolved): cephadm troubleshooting SSH errors
... Sebastian Wagner
10:02 AM Documentation #43834 (Can't reproduce): cephadm: some command only support `hosts`. make sure use...
close for now. Sebastian Wagner
09:58 AM Feature #43709: mgr/rook: remove OSDs
Design discussion:
https://github.com/rook/rook/pull/3954
Juan Miguel Olmo Martínez
09:39 AM Bug #44720: rook: rgw: allow realm != zone
It seems sensible to wait for changes explained in the RGW multisite design:
https://github.com/rook/rook/pull/4520
Juan Miguel Olmo Martínez

04/01/2020

08:30 PM Bug #44673: cephadm: `orch apply` and `orch daemon add` use completely different code path
Sebastian Wagner wrote:
> prerequisite: https://github.com/ceph/ceph/pull/34091
This one has been merged.
Nathan Cutler
08:27 PM Backport #44710 (In Progress): octopus: doc/cephadm: replace `osd create` with `apply osd`
Nathan Cutler
06:50 PM Bug #44894 (Resolved): cephadm: non-ceph units put wrong uid:gid in systemd unit file
... Sage Weil
06:42 PM Bug #44832: cephadm: `ceph cephadm generate-key` fails with No such file or directory: '/tmp/...
Here is the Debug Log:... Mario Ohnewald
05:04 PM Backport #44893 (Resolved): octopus: racey concurrent ceph-volume callKeyError: 'ceph.type'
https://github.com/ceph/ceph/pull/34423 Nathan Cutler
03:59 PM Bug #44820 (Pending Backport): racey concurrent ceph-volume callKeyError: 'ceph.type'
Sage Weil
02:36 PM Bug #44887 (Fix Under Review): cephadm: Simplify mounting of host dirs into prom/node-exporter
Volker Theile
02:10 PM Bug #44887 (Rejected): cephadm: Simplify mounting of host dirs into prom/node-exporter
With https://github.com/ceph/ceph/pull/32340 the following host directories are mounted into the prom/node-exporter c... Volker Theile
02:11 PM Bug #44888 (Resolved): Drivegroup's :limit: isn't working correctly
Each iteration of an osd deployment deploys OSDs up to a set :limit:
Since we're deploying every $sleep_interval sec...
Joshua Schmid
02:10 PM Feature #44886: cephadm: allow use of authenticated registry
and then the next request will be to support untrusted registries... and so on Sebastian Wagner
01:49 PM Feature #44886 (Resolved): cephadm: allow use of authenticated registry
Users may need to use an authenticated registry, e.g. in air-gapped deployments.
We could punt and require that th...
Sage Weil
02:06 PM Feature #44556 (Fix Under Review): cephadm: preview drivegroups
Joshua Schmid
10:15 AM Bug #44777 (Resolved): podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to ...
Sebastian Wagner
10:04 AM Bug #44876 (New): mgr/rook: track minor upgrades
... Sebastian Wagner
09:59 AM Feature #44875 (Resolved): mgr/rook: PlacementSpec to K8s POD scheduling conversion
https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.18/#affinity-v1-core
orch -> k8s...
Sebastian Wagner
09:53 AM Feature #41239: mgr/rook: support creating OSDs on Persistent Volumes
Some thoughts:
* OSDSpec specifies an existing StorageClass, num OSDs per node, ...?
* mgr/rook triggers osd crea...
Sebastian Wagner
09:50 AM Feature #44874 (Rejected): cephadm: add Filestore support
If someone wants to work on it:
* Has to mount the filesystem. ceph-ansible uses a complex bind-mount for it.
* c...
Sebastian Wagner
09:46 AM Feature #44873 (Resolved): cephadm bootstrap: add --apply-spec <cluster.yaml>
to have truly a single command when setting up a cluster for Day 1
Requirements:
h3. Adding hosts
* YAML spe...
Sebastian Wagner
08:28 AM Bug #44769 (In Progress): cephadm doesn't reuse osd_id of 'destroyed' osds
Joshua Schmid

03/31/2020

07:58 PM Feature #43687: cephadm: haproxy (or lb)
Deploy and configure haproxy with cephadm; configure a service/lb with kubernetes/rook. Can we generalize these into... Sage Weil
07:54 PM Feature #44869 (Resolved): cephadm: automatic auth key rotation
This is about periodically deploying new keys for daemons and clients. This is a bit more involved at we need to make... Sage Weil
04:21 PM Documentation #44867 (Rejected): cephadm: document "package" mode
... Sebastian Wagner
04:07 PM Feature #44866 (Resolved): cephadm root mode: support non-root users + sudo
Let's say, someone does:... Sebastian Wagner
03:45 PM Feature #44864 (New): cephadm: garbage collect old container images
cephadm: garbage collect old container images Sebastian Wagner
01:39 PM Bug #44820: racey concurrent ceph-volume callKeyError: 'ceph.type'
Copying to fix in c-v as well. Jan Fajerski
01:18 PM Bug #44820 (Fix Under Review): racey concurrent ceph-volume callKeyError: 'ceph.type'
Sage Weil
10:00 AM Backport #44845 (Resolved): octopus: cephadm: Unable to use IPv6 on "cephadm bootstrap"
Nathan Cutler
09:54 AM Bug #44823 (Triaged): cephadm: tries to parse arguments command passed to shell
Sebastian Wagner
09:54 AM Bug #44823: cephadm: tries to parse arguments command passed to shell
right. should be ... Sebastian Wagner
12:32 AM Bug #44823 (Won't Fix): cephadm: tries to parse arguments command passed to shell
... Patrick Donnelly
09:49 AM Bug #44832 (Resolved): cephadm: `ceph cephadm generate-key` fails with No such file or directory:...
... Sebastian Wagner
09:43 AM Bug #44810 (Won't Fix): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
according to kai , this was a false alarm Sebastian Wagner
09:42 AM Bug #44830 (Duplicate): cpehadm bootstrap: improve error message, if `host add` fails
... Sebastian Wagner
09:07 AM Documentation #44828 (Resolved): cephadm: clarify "Failed to infer CIDR network for mon ip"
... Sebastian Wagner
03:41 AM Bug #44826 (Resolved): cephadm: "Deploying daemon crash.li221-238... ERROR: no keyring provided"
... Patrick Donnelly
12:36 AM Bug #44825 (Rejected): cephadm: bootstrap is not idempotent
It would be helpful if this command did nothing if the cluster is already bootstrapped. This would simplify ansible r... Patrick Donnelly
12:35 AM Bug #44824 (Resolved): cephadm: adding osd device is not idempotent
... Patrick Donnelly

03/30/2020

11:28 PM Bug #44820: racey concurrent ceph-volume callKeyError: 'ceph.type'
the problem seems to be a racing invocation of inventory and prepare:... Sage Weil
08:29 PM Bug #44820 (Resolved): racey concurrent ceph-volume callKeyError: 'ceph.type'
... Sage Weil
09:01 PM Bug #44810 (Fix Under Review): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
Michael Fritch
05:28 PM Bug #44810 (Need More Info): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
Sebastian Wagner
11:09 AM Bug #44810 (Won't Fix): cephadm: chmod /etc/ceph/ceph.pub should be set to 0600
cephadm bootstrap creates @/etc/ceph/ceph.pub@ with a wrong permissions Sebastian Wagner
08:23 PM Bug #44669 (Resolved): cephadm: rm-cluster should clean up /etc/ceph
Sage Weil
06:08 PM Feature #44305 (Resolved): mgr/cephadm: Add support for removing MONs
Sage Weil
06:08 PM Bug #44039 (Rejected): bin/cephadm: Remove --allow-fqdn-hostname
seems that this might be a valid config! Sebastian Wagner
06:07 PM Feature #44287: cephadm: Graceful Shutdown of the Whole Ceph Cluster
open Q: how do we shutdown the mons, after we already did shut down all mgrs? Sebastian Wagner
05:53 PM Bug #44758 (Fix Under Review): Drive Groups: limit:1 does not imply all:true
Sebastian Wagner
05:35 PM Feature #43708 (Resolved): mgr/rook: Blink enclosure LED
Sebastian Wagner
05:35 PM Feature #43696: cephadm: check that units start
low, until someone complains. Sebastian Wagner
05:33 PM Bug #44739 (Need More Info): ceph.conf parameters set via "cephadm bootstrap -c" are not persiste...
Interesting. the code there is rather old: https://github.com/ceph/ceph/blame/master/src/cephadm/cephadm#L2115-L2124
...
Sebastian Wagner
05:29 PM Documentation #44716 (Fix Under Review): orchestrator/cephadm: document ceph orch apply -i -
Sebastian Wagner
01:01 PM Feature #44556: cephadm: preview drivegroups
Shortened this discussion with a f2t talk with Sebastian. Here are the results
Keep the old syntax but expand with...
Joshua Schmid
10:45 AM Feature #44556: cephadm: preview drivegroups
> I guess we want to have the following features:
>
> 1) preview a service if the spec is already applied (useful ...
Sebastian Wagner
08:31 AM Feature #44556: cephadm: preview drivegroups
I guess we want to have the following features:
1) preview a service if the spec is already applied (useful when h...
Joshua Schmid
10:37 AM Bug #44777: podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to remove cont...
Not yet understsand, why https://github.com/ceph/ceph/pull/34260 fixes this issue. Sebastian Wagner
10:21 AM Bug #44777: podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to remove cont...
... Sebastian Wagner
09:16 AM Bug #44777 (Fix Under Review): podman: stat /usr/bin/ceph-mon: no such file or directory, then un...
Sebastian Wagner
10:33 AM Bug #44642: cephadm: mgr dump might be too huge
Backported to octopus by https://github.com/ceph/ceph/pull/34258 Nathan Cutler

03/29/2020

10:38 PM Bug #44642 (Resolved): cephadm: mgr dump might be too huge
Sage Weil
12:17 PM Bug #44642 (Pending Backport): cephadm: mgr dump might be too huge
Sage Weil

03/28/2020

04:24 PM Feature #44599 (Resolved): cephadm: check-host: Returns only a single problem
Daniel Pivonka
09:59 AM Bug #44777: podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to remove cont...
Fascinating! Sebastian Wagner
12:53 AM Bug #44777: podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to remove cont...
not sure why, but I'm pretty sure that https://github.com/ceph/ceph/pull/34091 is responsible for the regression.
...
Sage Weil

03/27/2020

10:10 PM Bug #44792 (Resolved): cephadm: make `cephadm shell` independent from /etc/ceph/ceph.conf
/etc/ceph/ceph.conf is often use by tools in the ceph ecosystem. We should provide a mechanism to keep this up to dat... Sebastian Wagner
08:58 PM Bug #44598 (Fix Under Review): cephadm: Traceback, if Python 3 is not installed on remote host
Daniel Pivonka
06:47 PM Bug #44598 (In Progress): cephadm: Traceback, if Python 3 is not installed on remote host
Daniel Pivonka
02:53 PM Feature #44556: cephadm: preview drivegroups
When we want to have preview functionality for other components aswell, we should generalize the CLI a bit more.
...
Joshua Schmid
12:37 PM Bug #44781 (Fix Under Review): cephadm: monitoring: root volume alert doesn't work in container
Patrick Seidensal
10:19 AM Bug #44781 (Resolved): cephadm: monitoring: root volume alert doesn't work in container
This is due the the root filesystem being mapped inside the container as `/rootfs` but the Prometheus alert checking ... Patrick Seidensal
03:58 AM Bug #44642: cephadm: mgr dump might be too huge
Same, @cephadm shell -- ceph mgr dump@ seems perfectly happy for me too. So it's only a problem during bootstrap some... Tim Serong

03/26/2020

10:56 PM Bug #44777 (Resolved): podman: stat /usr/bin/ceph-mon: no such file or directory, then unable to ...
the mon.b unit:... Sage Weil
08:43 PM Feature #43677 (Resolved): monitoring: create rpm for alerts rules also for centos
Sage Weil
08:42 PM Documentation #43672 (Resolved): doc: point release upgrades
Sebastian Wagner
08:37 PM Bug #44559 (Need More Info): cephadm logs an invalid stat command
Sebastian Wagner
08:36 PM Feature #43708 (Pending Backport): mgr/rook: Blink enclosure LED
backport https://github.com/ceph/ceph/pull/34199 Sebastian Wagner
08:35 PM Bug #44603: cephadm: `ls --refresh` shows Tracebacks in the log
prio low, till someone complains Sebastian Wagner
08:32 PM Bug #44699: cephadm: removing services leaves configs behind
which config? things in the mon store? Sebastian Wagner
08:27 PM Bug #44609 (In Progress): cephadm: grafana: cert problem prevents dashbaord integration
Sebastian Wagner
08:27 PM Bug #44513 (Resolved): mgr/cephadm: `orch ps --refresh` returns no results
Sebastian Wagner
02:17 AM Bug #44513 (Pending Backport): mgr/cephadm: `orch ps --refresh` returns no results
https://github.com/ceph/ceph/pull/34190 Sage Weil
08:26 PM Bug #44608 (Resolved): cephadm: grafana: bound to 127.0.0.1
Sebastian Wagner
02:18 AM Bug #44608 (Pending Backport): cephadm: grafana: bound to 127.0.0.1
backport https://github.com/ceph/ceph/pull/34191 Sage Weil
08:26 PM Bug #43890 (Resolved): cephadm: default hardcoded to non-ceph dockerhub
Sebastian Wagner
08:25 PM Feature #44775 (Resolved): cephadm: NFS stage 2
* Teuthology integration
* cephadm adopt
* make container upgrades work
Sebastian Wagner
08:22 PM Feature #44718 (Resolved): NFS ganesha (mgr/cephadm)
Sebastian Wagner
03:24 PM Bug #44642: cephadm: mgr dump might be too huge
... Sebastian Wagner
02:47 PM Bug #44642: cephadm: mgr dump might be too huge
... Sebastian Wagner
11:33 AM Bug #44642: cephadm: mgr dump might be too huge
Just ran another loop of ten with https://github.com/ceph/ceph/raw/octopus/src/cephadm/cephadm and docker.io/ceph/cep... Tim Serong
11:24 AM Bug #44642: cephadm: mgr dump might be too huge
Ten runs using cephadm from https://github.com/ceph/ceph/raw/octopus/src/cephadm/cephadm (so the container image is d... Tim Serong
11:01 AM Bug #44642: cephadm: mgr dump might be too huge
To try to obtain some further clarity, I ran this:
@for n in $(seq 1 10); do sleep 5; systemctl stop ceph.target ;...
Tim Serong
08:15 AM Bug #44642: cephadm: mgr dump might be too huge
OK, I've now seen it work at least once without that patch applied, and I've also seen it fail at least once without ... Tim Serong
03:35 AM Bug #44642: cephadm: mgr dump might be too huge
Sebastian Wagner wrote:
> interesting. does it work when using https://github.com/ceph/ceph/pull/34031 ?
Yeah, it...
Tim Serong
01:32 PM Bug #44602 (Fix Under Review): cephadm: `orch ls` shows daemons as online, despite host is down
Sebastian Wagner
12:57 PM Feature #44556: cephadm: preview drivegroups
This is the output of:... Joshua Schmid
10:16 AM Feature #44556 (In Progress): cephadm: preview drivegroups
Joshua Schmid
10:53 AM Bug #43816: cephadm: Unable to use IPv6 on "cephadm bootstrap"
https://github.com/ceph/ceph/compare/master...sebastian-philipp:cephadm-add-ipv6-routes?expand=1 Sebastian Wagner
10:15 AM Bug #44769 (Resolved): cephadm doesn't reuse osd_id of 'destroyed' osds
The replacement operation is supposed to work like this:... Joshua Schmid
09:27 AM Documentation #44768 (Rejected): cephadm: document allow_ptrace true
... Sebastian Wagner
09:18 AM Bug #44729: cephadm enter using docker is broken
hm. Jan, close as "Can't reproduce"? Sebastian Wagner

03/25/2020

11:57 PM Backport #43994 (Rejected): luminous: ceph orchestrator rgw rm: no valid command found
Nathan Cutler
11:57 PM Backport #43993 (Rejected): mimic: ceph orchestrator rgw rm: no valid command found
Nathan Cutler
09:42 PM Bug #43816 (Pending Backport): cephadm: Unable to use IPv6 on "cephadm bootstrap"
Sage Weil
03:16 PM Bug #43816: cephadm: Unable to use IPv6 on "cephadm bootstrap"
> This command produced the following error:
> ...
Ricardo Marques
05:34 PM Bug #44758 (Resolved): Drive Groups: limit:1 does not imply all:true
This drive group:... Sebastian Wagner
05:29 PM Bug #44673: cephadm: `orch apply` and `orch daemon add` use completely different code path
prerequisite: https://github.com/ceph/ceph/pull/34091 Sebastian Wagner
05:28 PM Bug #44673: cephadm: `orch apply` and `orch daemon add` use completely different code path
I'm already getting bug reports, like... Sebastian Wagner
04:23 PM Bug #44642: cephadm: mgr dump might be too huge
interesting. does it work when using https://github.com/ceph/ceph/pull/34031 ? Sebastian Wagner
08:26 AM Bug #44642: cephadm: mgr dump might be too huge
I can't help but think this is somehow related to the hangs we're getting after ~100k output when podman is run via s... Tim Serong
04:12 PM Bug #44513: mgr/cephadm: `orch ps --refresh` returns no results
Confirmed PR 34182 fixes this.
Saw a similar thing with 3 hosts and only the last host was shown during refersh:
...
Michael Fritch
03:41 PM Bug #44513: mgr/cephadm: `orch ps --refresh` returns no results
(pretty sure i'm fixing the same bug... it would happen if you had 2 hosts in your test cluster above and the last on... Sage Weil
03:40 PM Bug #44513 (Fix Under Review): mgr/cephadm: `orch ps --refresh` returns no results
Sage Weil
03:44 PM Bug #44729 (Need More Info): cephadm enter using docker is broken
It works for me...... Sage Weil
03:35 PM Bug #44608 (Fix Under Review): cephadm: grafana: bound to 127.0.0.1
Sage Weil
03:21 PM Bug #44756 (Resolved): drivegroups: replacement op will ignore existing wal/dbs
Since the db/wal is considered "locked/non-avialable" by ceph-volume after the first deployment, the DriveGroup algor... Joshua Schmid
12:11 PM Bug #44747: orch: `ceph orch ls --service_type` is broken
This looks actually random. In the same session:... Sebastian Wagner
12:07 PM Bug #44747 (Can't reproduce): orch: `ceph orch ls --service_type` is broken
... Sebastian Wagner
11:52 AM Bug #44746 (Closed): cephadm: vstart.sh --cephadm: don't deploy crash by default
as it's not part of the normal cluster, it's getting left behind and stays running. ... Sebastian Wagner
09:34 AM Bug #44739 (Can't reproduce): ceph.conf parameters set via "cephadm bootstrap -c" are not persist...
Now, when I set e.g. "osd crush chooseleaf type = 0" via "cephadm bootstrap -c", the initial CRUSH map has failure do... Nathan Cutler
09:32 AM Bug #44738: drivegroups/cephadm: db_devices don't get applied correctly when using "paths"
-It seems that db_devices are ignored whenever "paths" is used in the "data_devices" section.-
Ignore that.
Joshua Schmid
09:15 AM Bug #44738 (Won't Fix): drivegroups/cephadm: db_devices don't get applied correctly when using "p...
... Joshua Schmid

03/24/2020

10:05 PM Bug #44642: cephadm: mgr dump might be too huge
> Do you know why the line "j = json.loads(out)" is choking on the integer value sent by "ceph mgr dump"?
Now I se...
Nathan Cutler
07:38 PM Bug #44669 (Fix Under Review): cephadm: rm-cluster should clean up /etc/ceph
Daniel Pivonka
02:35 PM Bug #44669 (In Progress): cephadm: rm-cluster should clean up /etc/ceph
Daniel Pivonka
02:57 PM Bug #44729: cephadm enter using docker is broken
ls works though... Jan Fajerski
02:56 PM Bug #44729 (Can't reproduce): cephadm enter using docker is broken
... Sebastian Wagner

03/23/2020

04:16 PM Bug #44720 (Need More Info): rook: rgw: allow realm != zone
Sage Weil
04:16 PM Bug #44719 (New): rook: align rgw client names with orch and cephadm
client.rgw.$realm.$zone[.$id] Sage Weil
04:11 PM Feature #44718 (Fix Under Review): NFS ganesha (mgr/cephadm)
Sebastian Wagner
04:10 PM Feature #44718 (Resolved): NFS ganesha (mgr/cephadm)
mgr/cephadm Sebastian Wagner
04:10 PM Feature #43688 (Resolved): NFS ganesha
Sebastian Wagner
02:36 PM Bug #44701 (Resolved): ganesha selinux denial
Sebastian Wagner
01:56 PM Documentation #44716 (Resolved): orchestrator/cephadm: document ceph orch apply -i -
... Sebastian Wagner
12:16 PM Backport #44710 (Resolved): octopus: doc/cephadm: replace `osd create` with `apply osd`
https://github.com/ceph/ceph/pull/34355 Nathan Cutler
08:33 AM Bug #44642 (Fix Under Review): cephadm: mgr dump might be too huge
Sebastian Wagner
08:31 AM Bug #44642: cephadm: mgr dump might be too huge
I don't know what caused this. Might actually be an artifact of our podman hang. prio=low for now.
edit: oh, you c...
Sebastian Wagner

03/20/2020

10:45 PM Bug #44642: cephadm: mgr dump might be too huge
Now, with both cephadm and container at 15.1.1-168-g06ecd31e39 I am seeing "cephadm bootstrap" fail on "ceph mgr dump... Nathan Cutler
06:48 PM Bug #44701 (Resolved): ganesha selinux denial
... Sage Weil
06:28 PM Feature #44628: cephadm: Add initial firewall management to cephadm
yeah, I also don't like to create a new dependency from the dashboard to cephadm Sebastian Wagner
05:08 PM Feature #44628: cephadm: Add initial firewall management to cephadm
I'm inclined to just open both, because the dashboard might move between ssl and not ssl. otherwise we need to make t... Sage Weil
05:10 PM Feature #44576 (Resolved): cephadm: Restart Prometheus, if a new node_exporter or alertmanager is...
This already works. Sage Weil
05:05 PM Bug #44669: cephadm: rm-cluster should clean up /etc/ceph
What should the behavior here be? Check if the /etc/ceph config has the same fsid, and if so, remove it + the keyrin... Sage Weil
05:04 PM Bug #44699 (Closed): cephadm: removing services leaves configs behind
Some of the configs are created by cephadm itself. The user might have created some too, but the config history will... Sage Weil
05:02 PM Bug #44698 (Duplicate): cephadm: removing daemons leaves auth keys behind
Sage Weil
02:19 PM Feature #43839 (Fix Under Review): enhance `host ls`
Sebastian Wagner
01:39 PM Feature #43839 (In Progress): enhance `host ls`
Sebastian Wagner
12:13 PM Bug #44692 (Pending Backport): doc/cephadm: replace `osd create` with `apply osd`
Sebastian Wagner
11:38 AM Bug #44692 (Fix Under Review): doc/cephadm: replace `osd create` with `apply osd`
Sebastian Wagner
11:33 AM Bug #44692 (Resolved): doc/cephadm: replace `osd create` with `apply osd`
Sebastian Wagner
12:06 PM Feature #43689 (Fix Under Review): cephadm: iscsi
Sebastian Wagner
11:43 AM Bug #43890 (Fix Under Review): cephadm: default hardcoded to non-ceph dockerhub
Sebastian Wagner

03/19/2020

07:19 PM Bug #44615 (Resolved): cephadm: reconfig of removed daemon
Sage Weil
02:47 PM Feature #44599 (Fix Under Review): cephadm: check-host: Returns only a single problem
Daniel Pivonka
09:28 AM Cleanup #44676 (Resolved): cephadm: Replace execnet (and remoto)
[[https://github.com/pytest-dev/execnet]] is in maintenance mode. ... Sebastian Wagner

03/18/2020

11:55 PM Bug #44673 (Rejected): cephadm: `orch apply` and `orch daemon add` use completely different code ...
... which is not obvious to users and they will use this interchangeably. Which is not really a good idea.
We sho...
Sebastian Wagner
10:43 PM Feature #44622 (Resolved): orch daemon add -i spec.yaml
Sage Weil
03:16 PM Bug #44642 (In Progress): cephadm: mgr dump might be too huge
Sebastian Wagner
02:05 PM Bug #44642 (New): cephadm: mgr dump might be too huge
Sebastian Wagner
01:48 PM Bug #44669 (Resolved): cephadm: rm-cluster should clean up /etc/ceph
... Sebastian Wagner
01:14 PM Bug #44401 (Resolved): cephadm: check host performed every time through serve loop
Sage Weil
01:14 PM Bug #44607 (Resolved): cephadm: apply(): Traceback, if host doesn't exist
Sage Weil

03/17/2020

04:12 PM Bug #44642 (Rejected): cephadm: mgr dump might be too huge
seems to be a downstream issue. Sebastian Wagner
02:51 PM Bug #44642 (Resolved): cephadm: mgr dump might be too huge
... Sebastian Wagner
04:11 PM Feature #44599 (In Progress): cephadm: check-host: Returns only a single problem
Sebastian Wagner
04:08 PM Feature #44599 (Rejected): cephadm: check-host: Returns only a single problem
Sebastian Wagner
03:30 PM Bug #44644 (Closed): cephadm: RGW: updating the spec doesn't update the mon store
when creating RGW running... Sebastian Wagner
03:20 PM Backport #43993: mimic: ceph orchestrator rgw rm: no valid command found
As `ceph orchestrator rgw rm` doesn't exist for mimic, what about just close this? Sebastian Wagner
02:25 PM Bug #44607 (Fix Under Review): cephadm: apply(): Traceback, if host doesn't exist
Sebastian Wagner
12:46 PM Feature #44622 (Fix Under Review): orch daemon add -i spec.yaml
Sebastian Wagner
10:21 AM Feature #44622 (In Progress): orch daemon add -i spec.yaml
Sebastian Wagner

03/16/2020

05:43 PM Bug #44629 (Can't reproduce): cephadm: prometheus: graph queries are not working correctly
graph queries are not working correctly. The use of instance and
exported_instance needs some investigation. On the ...
Sebastian Wagner
05:41 PM Feature #44628 (Resolved): cephadm: Add initial firewall management to cephadm
we open both 8080 and 8443 for dashboard even when the default is
https. We should probably do one or the other, not...
Sebastian Wagner
05:30 PM Documentation #44600 (Resolved): cephadm: use ssh-copy-id
Sebastian Wagner
04:08 PM Bug #44597 (Resolved): cephadm: Traceback, if ssh key is not on the remote host
Sage Weil
02:26 PM Feature #44625 (Resolved): cephadm: test dmcrypt
we need to verify it. Sebastian Wagner
01:18 PM Feature #44622 (Resolved): orch daemon add -i spec.yaml
Sage Weil

03/14/2020

03:14 PM Bug #44615 (Resolved): cephadm: reconfig of removed daemon
... Sage Weil

03/13/2020

05:00 PM Bug #44609 (Resolved): cephadm: grafana: cert problem prevents dashbaord integration
SSL cert problem prevents embedding out of the box.
Is the problem that ssl_verify is true by default? or that we...
Sebastian Wagner
04:59 PM Bug #44608 (Resolved): cephadm: grafana: bound to 127.0.0.1
after deploying I noticed that it was bound to 127.0.0.1, which blocks
client access from other machines. Should thi...
Sebastian Wagner
04:56 PM Bug #44607 (Resolved): cephadm: apply(): Traceback, if host doesn't exist
when deploying a daemon, with a host for placement - if the host doesn't
exist you get a trackback. This scenario sh...
Sebastian Wagner
04:55 PM Feature #44606 (Resolved): cephadm: RGW firewall + static port
how is the firewall being handled? AFAIK, the port is a parameter on
the rgw_frontend setting, so it could be un...
Sebastian Wagner
04:29 PM Bug #44604 (Can't reproduce): cephadm: RGW: missing spec / mon store validation
should the deployment of rgw first check the presence of a minimum set
of parms defined in the config store - if no...
Sebastian Wagner
04:25 PM Bug #44603 (Rejected): cephadm: `ls --refresh` shows Tracebacks in the log
With a host down that had daemons deployed, a --refresh shows trackbacks in the mgr log from the failed connect attem... Sebastian Wagner
04:23 PM Bug #44602 (Resolved): cephadm: `orch ls` shows daemons as online, despite host is down
With a host down that had daemons deployed:
ceph orch ls didn't show services as affected even after a --refresh i...
Sebastian Wagner
04:20 PM Feature #44601 (New): cephadm: Mix of hosts: with and without firewall
We allow a mix of hosts that either have firewall or not. I think this
should be part of the checks - either all hos...
Sebastian Wagner
04:14 PM Documentation #44600 (Resolved): cephadm: use ssh-copy-id
adding a new host:
Passing the ceph.pub key to new hosts could use the...
Sebastian Wagner
04:13 PM Feature #44599 (Resolved): cephadm: check-host: Returns only a single problem
Adding a host:
If checks fail, they show one at a time, forcing the admin to repeat
the command to get passed eac...
Sebastian Wagner
04:11 PM Bug #44598 (Resolved): cephadm: Traceback, if Python 3 is not installed on remote host
Adding a host:
if python3 isn't on the target, you get a traceback with OSError:
cannot send(already closed?) err...
Sebastian Wagner
04:10 PM Bug #44597 (Resolved): cephadm: Traceback, if ssh key is not on the remote host
Adding a host:
if the ssh key isn't on the new target you hit a trackback - which doesn't inspire confidence.
Sebastian Wagner
03:58 PM Feature #44402 (Resolved): cephadm: more complete smoke test that can be run with vstart
Sage Weil
03:56 PM Feature #44581 (Resolved): cephadm pause and cephadm resume
Sebastian Wagner
03:55 PM Bug #44569 (Resolved): NotImplementedError not caught
Sebastian Wagner
03:23 PM Cleanup #44379 (Won't Fix): orchestrator: {to,from}_json inconsistent
not worth the effort right now. Sebastian Wagner
02:53 PM Documentation #44284: cephadm: provide a way to modify the initial crushmap
Per our discussion today, using `cephadm bootstrap -c /root/ceph.conf` is the correct way to set initial crushmap or ... Ricardo Marques
02:55 AM Bug #44587 (New): failed to write <pid> to cgroup.procs:
... Sage Weil

03/12/2020

05:28 PM Bug #44440 (Resolved): cephadm should be able to infer running container
Sage Weil
02:44 PM Feature #44581 (Resolved): cephadm pause and cephadm resume
if the serve() thread is in a loop breaking all your daemons, people will want to pause it. Sebastian Wagner
12:52 PM Feature #44578 (Rejected): cephadm: verify Grafana works with Prometheus HA
Is Grafana correctly configured when a Prometheus instance is added, for example:
* Is HA working in the Grafana d...
Sebastian Wagner
12:51 PM Bug #44577 (Closed): cephadm: reconfigure Prometheus on MGR failover
we have to make sure, Prometheus knows the new prometheus exporter endpoint:
* Generate a new prometheus config po...
Sebastian Wagner
12:44 PM Feature #44576 (Resolved): cephadm: Restart Prometheus, if a new node_exporter or alertmanager is...
P needs to know the new targets / configuration Sebastian Wagner
12:37 PM Bug #37514 (Can't reproduce): mgr CLI commands block one another (indefinitely if the orchestrato...
CLI commands should now respond swiftly. (cephadm and rook) Sebastian Wagner
12:36 PM Feature #39093 (Rejected): mgr/orchestrator: add `ceph orchestrator wait`
out of scope for now. Sebastian Wagner
12:33 PM Feature #43705: cephadm: on config change, restart appropriate daemons
partially: https://github.com/ceph/ceph/pull/33855 Sebastian Wagner
12:28 PM Feature #43839 (New): enhance `host ls`
Sebastian Wagner
12:19 PM Bug #44270: Under certain circumstances, "ceph orch apply" returns success even when no OSDs are ...
Which means, we have to track which nodes are scanned and bail out, if we don't have the inventory yet? Sebastian Wagner
12:15 PM Bug #44270: Under certain circumstances, "ceph orch apply" returns success even when no OSDs are ...
new workaround: https://github.com/ceph/ceph-salt/pull/109 Sebastian Wagner
12:10 PM Bug #44559: cephadm logs an invalid stat command
just to clarify, ... Sebastian Wagner
12:07 PM Bug #44569 (Fix Under Review): NotImplementedError not caught
Sebastian Wagner

03/11/2020

08:21 PM Bug #44569 (Resolved): NotImplementedError not caught
with cephadm for example,... Sage Weil
08:21 PM Feature #43694 (Resolved): cephadm: flag dashboard user to change password
Daniel Pivonka
02:57 PM Bug #44559 (New): cephadm logs an invalid stat command
Nathan Cutler
02:30 PM Bug #44559: cephadm logs an invalid stat command
Thanks Kris - updated the bug description. Nathan Cutler
12:06 PM Bug #44559: cephadm logs an invalid stat command
Shouldn't that be... Kristoffer Gronlund
11:50 AM Bug #44559 (Fix Under Review): cephadm logs an invalid stat command
Nathan Cutler
11:46 AM Bug #44559 (Can't reproduce): cephadm logs an invalid stat command
When I run "cephadm bootstrap", I see the following in the log:... Nathan Cutler
02:52 PM Bug #44272 (Resolved): on SUSE, crash daemon starts but then always stops a couple minutes later
Sage Weil
11:17 AM Bug #44557 (Resolved): cephadm: error on run-tox-cephadm test
Kefu Chai
09:14 AM Bug #44557 (Fix Under Review): cephadm: error on run-tox-cephadm test
Kiefer Chang
08:19 AM Bug #44557 (Resolved): cephadm: error on run-tox-cephadm test
run-tox-cephadm test fails with:... Kiefer Chang
09:56 AM Backport #43994 (Need More Info): luminous: ceph orchestrator rgw rm: no valid command found
mimic backport attempt was closed. presuming non-trivial Nathan Cutler
08:05 AM Feature #44556 (Resolved): cephadm: preview drivegroups
The osd deployment in cephadm happens async in the background.
When using drivegroups, it may be not always clear...
Joshua Schmid
 

Also available in: Atom