Activity
From 09/05/2020 to 10/04/2020
10/04/2020
- 05:44 AM Bug #47726 (Pending Backport): disk selector should pass all devices to ceph-volume (available an...
10/03/2020
- 01:46 AM Bug #47580 (Pending Backport): cephadm: "Error ENOENT: Module not found": TypeError: type object ...
10/02/2020
- 09:45 AM Bug #47726 (Fix Under Review): disk selector should pass all devices to ceph-volume (available an...
- 09:39 AM Bug #47726 (Resolved): disk selector should pass all devices to ceph-volume (available and unavai...
- With the lvm batch refactor merged (https://github.com/ceph/ceph/pull/34740) we need to pass available and unavailabl...
- 06:42 AM Bug #47366: Mgr keeps dispatching `osd crush reweight` after OSD removal process is done
- I've just tested this on version 15.2.5 and can confirm this is fixed. You can close this :-)
- 06:41 AM Bug #47107: device-health-metrics unavailable because image ceph/ceph:latest has smartmontools 6.6
- Unfortunately ceph/ceph:15.2.5 still comes with smartmontools version 6.6. device-health-metrics rely on smartmontool...
09/30/2020
- 11:00 PM Feature #47711 (Resolved): mgr/cephadm: add a feature to examine the host facts to look for confi...
- Once the host facts are part of the mgr/cephadm cache, he idea is to periodically check the host cache to look for an...
- 07:30 PM Bug #47694: downgrading via ceph orch upgrade start results in partial application and mixed state
- After a while the status and versions are as expected. We should probably still put a validation against downgrades i...
- 09:10 AM Bug #47694 (Won't Fix): downgrading via ceph orch upgrade start results in partial application an...
- Following https://docs.ceph.com/en/latest/cephadm/upgrade/#using-customized-container-images I attempted to _downgrad...
- 07:29 PM Bug #47702: upgrading via ceph orch upgrade start results in partial application and mixed state
- Seems like its a reporting issue. After a while the status and versions are as expected.
- 03:12 PM Bug #47702 (Can't reproduce): upgrading via ceph orch upgrade start results in partial applicatio...
- Following https://docs.ceph.com/en/latest/cephadm/upgrade/#using-customized-container-images I attempted to upgrade m...
- 06:34 PM Bug #47709 (Duplicate): orchestrator._interface.OrchestratorValidationError: name mon.c already i...
- ...
- 03:58 PM Bug #47501 (Fix Under Review): cephadm: Error bootstraping with '--container-init' option
- 03:29 PM Bug #47501 (In Progress): cephadm: Error bootstraping with '--container-init' option
- 02:48 PM Bug #47700 (Fix Under Review): during OSD deletion: Module 'cephadm' has failed: Set changed size...
- 02:44 PM Bug #47700 (Resolved): during OSD deletion: Module 'cephadm' has failed: Set changed size during ...
- ...
- 11:48 AM Bug #47639 (Resolved): cephadm: rbd-mirror daemons automatically marked as stray
- 10:01 AM Bug #46764: cephadm (ceph orch apply) sometimes gets "stuck" and cannot deploy any OSDs
- Could you include the mgr log the next time you see this issue?
09/29/2020
- 05:44 PM Bug #45421: cephadm: MaxWhileTries: Waiting for 3 mons in monmap: "unable to remove container c3e...
- seeing this in recent octopus branch with related issue fix:
http://qa-proxy.ceph.com/teuthology/yuriw-2020-09-28_1... - 02:04 PM Bug #47381: "ceph orch apply --dry-run" reports empty osdspec even though OSDs will be deployed
- > But AFAICT we are not requiring users to issue a "ceph orch device ls --refresh" before running "ceph orch apply --...
- 11:03 AM Bug #47580 (Fix Under Review): cephadm: "Error ENOENT: Module not found": TypeError: type object ...
- 11:02 AM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- moved to https://tracker.ceph.com/issues/47684
- 10:49 AM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- Attached.
Thanks - 08:47 AM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- do you have a chance to upload new MGR logs?
- 04:13 AM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- The above two commands worked and allowed the upgrade to start, it progressed to 2% (Upgraded the MON and a few OSD's...
- 11:01 AM Bug #47684 (Resolved): cephadm: auth get failed: failed to find osd.27 in keyring retval: -2
- ...
09/28/2020
- 01:56 PM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- workaround should be something like ...
09/27/2020
- 08:41 AM Bug #45093 (Pending Backport): cephadm: mgrs transiently getting co-located (one node gets two wh...
09/25/2020
- 04:20 PM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- ...
- 05:11 AM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- I tried running "ceph orch status" and then checked the last few lines of the log and see the following, not sure if ...
- 12:58 PM Documentation #47651 (Resolved): mgr/cephadm: document custom configuration templates
- Is it now possible to store custom templates that will be used instead of the ones which are already used internally ...
- 12:10 PM Bug #47648 (Fix Under Review): mgr/cephadm: Rendering custom template HTML escapes wrongly
- 12:02 PM Bug #47648 (Resolved): mgr/cephadm: Rendering custom template HTML escapes wrongly
- When setting a custom template for prometheus, the result is rendered HTML escaped and therefore faulty....
09/24/2020
- 11:58 PM Bug #46529: cephadm: error removing storage for container "...-mon": remove /var/lib/containers/s...
- Yuri Weinstein wrote:
> https://github.com/ceph/ceph/pull/36931 - octopus PR
merged - 04:08 PM Bug #47639 (Resolved): cephadm: rbd-mirror daemons automatically marked as stray
- The _list_servers_ function used in __check_for_strays_ finds the rbd-mirror service id rather than the daemon id and...
- 03:13 PM Bug #45421: cephadm: MaxWhileTries: Waiting for 3 mons in monmap: "unable to remove container c3e...
- seen this in recent run on octopus:
/a/yuriw-2020-09-23_15:16:58-rados-wip-yuri-testing-2020-09-22-1332-octopus-di... - 12:41 PM Documentation #47637 (Resolved): mgr/cephadm: document how to configure custom TLS certificate fo...
- The documentation is missing the description of the configuration options necessary to set a custom TLS certificate f...
09/23/2020
- 08:19 AM Bug #47598 (Rejected): cephadm bootstrap fails
- Bug is somewhere else.
- 08:13 AM Bug #47598 (Rejected): cephadm bootstrap fails
- cephadm is called liks so:...
09/22/2020
- 10:19 PM Bug #45421: cephadm: MaxWhileTries: Waiting for 3 mons in monmap: "unable to remove container c3e...
- Sebastian, Can you confirm whether you still think this duplicates Bug #44990 ?
- 10:13 PM Bug #45421: cephadm: MaxWhileTries: Waiting for 3 mons in monmap: "unable to remove container c3e...
- http://qa-proxy.ceph.com/teuthology/yuriw-2020-09-16_23:57:37-rados-wip-yuri8-testing-2020-09-16-2220-octopus-distro-...
- 10:17 PM Bug #45701: rados/cephadm/smoke-roleless fails due to CEPHADM_REFRESH_FAILED health check
- Deepika, https://tracker.ceph.com/issues/45701#note-4 is actually https://tracker.ceph.com/issues/45421
- 02:00 PM Bug #45701: rados/cephadm/smoke-roleless fails due to CEPHADM_REFRESH_FAILED health check
- http://qa-proxy.ceph.com/teuthology/yuriw-2020-09-16_23:57:37-rados-wip-yuri8-testing-2020-09-16-2220-octopus-distro-...
- 03:33 PM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- I have restarted the mgr server itself just to make sure the docker did fully reload, and tried to re-run the upgrade...
- 03:14 PM Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** m...
- hm. according to ...
- 11:15 AM Bug #47580 (Resolved): cephadm: "Error ENOENT: Module not found": TypeError: type object argument...
- Currently running a 15.2.4 cluster, trying to upgrade to 15.2.5 but was hit by the bug https://tracker.ceph.com/issue...
- 03:16 PM Feature #45091: cephadm: CephX disabled: bad_method + failed to fetch mon config
- Deepika, this is something different:...
- 02:09 PM Feature #45091: cephadm: CephX disabled: bad_method + failed to fetch mon config
- /a/yuriw-2020-09-16_23:57:37-rados-wip-yuri8-testing-2020-09-16-2220-octopus-distro-basic-smithi/5441511/teuthology.l...
09/21/2020
- 04:48 PM Bug #47511 (Pending Backport): rook: 'ceph orch status' returns 403 error
- 12:37 PM Feature #47507: qa: add testing for Rook
- Patrick Donnelly wrote:
> teuthology currently has no support for verifying Ceph's rook functionality (through the o...
09/18/2020
- 12:42 PM Bug #47234 (Fix Under Review): by default, cephadm creates 4 MONs
- 09:09 AM Bug #47384 (Pending Backport): cephadm: Remove assignment to member variable in ServiceSpecs
- 09:09 AM Feature #47533 (Rejected): Scan for dangling ceph auth entries
- If we have have old/dangling ceph auth entries, i.e. OSD creation will fail.
This requires manual intervention fro... - 08:59 AM Feature #46666 (Pending Backport): cephadm: Introduce 'container' specification to deploy custom ...
09/17/2020
- 10:24 PM Bug #47525 (Resolved): cephadm prepare-host time sync service list missing ntpsec
- When time sync package ntpsec is installed, nevertheless
cephadm prepare-host
complains with
WARNING:cephadm:No... - 09:03 PM Bug #46922 (Resolved): cephadm: IPv6 syntax inconsistency
- 04:34 PM Bug #47438 (Resolved): OSD.__init__ failes: the JSON object must be str, bytes or bytearray, not ...
- 10:55 AM Bug #47513 (Resolved): rook: 'ceph orch ps' does not show image and container id correctly
- ...
- 08:41 AM Bug #47511 (Fix Under Review): rook: 'ceph orch status' returns 403 error
- 07:10 AM Bug #47511 (Resolved): rook: 'ceph orch status' returns 403 error
- ...
- 05:07 AM Bug #47337 (Closed): rook: 'ceph orch ls' fails
- Not a bug in rook orchestrator module. Rather it was an issue in rook itself. This PR[1] fixes it.
[1] https://githu... - 04:06 AM Bug #47387 (Fix Under Review): rook: 'ceph orch ps' does not list daemons correctly
09/16/2020
- 10:58 PM Feature #47370: cephadm to support configuration of rbd mirroring daemon
- As I don't see any config options for the rbd mirror daemon, ...
- 12:14 PM Feature #47370: cephadm to support configuration of rbd mirroring daemon
- Sebastian Wagner wrote:
> what *exactly* do you need?
https://docs.ceph.com/docs/master/rbd/rbd-mirroring/#rbd-mi... - 04:48 PM Feature #47507 (Resolved): qa: add testing for Rook
- teuthology currently has no support for verifying Ceph's rook functionality (through the orchestrator) works. We shou...
- 02:31 PM Bug #47501 (Resolved): cephadm: Error bootstraping with '--container-init' option
- When I try to bootstrap a new cluster using the '--container-init' option, I get the following error:...
- 02:26 PM Bug #47500: Feature <encryption> is not supported" with having it set it to "False"
- The config option is actually called `encrypted`
- 02:13 PM Bug #47500 (Won't Fix): Feature <encryption> is not supported" with having it set it to "False"
- ceph orch apply osd -i /data/config/drive_groups.yaml --dry-run
with this drive_groups.yaml:... - 09:48 AM Bug #47495 (Resolved): rook: 'ceph orch device ls' does not list devices
- ...
- 07:58 AM Feature #46666 (Fix Under Review): cephadm: Introduce 'container' specification to deploy custom ...
09/15/2020
- 07:29 PM Bug #47480 (Resolved): cephadm: tcmu-runner container is logging inside the container
- The tcmu-runner container uses the same bind mounts than rbd-target-api container....
- 04:55 PM Bug #44926: dashboard: creating a new bucket causes InvalidLocationConstraint
- Similar issue is reported in rook upstream https://github.com/rook/rook/issues/6210, I tried in mydev enviroment and ...
- 02:35 PM Bug #47340: _list_devices: 'NoneType' object has no attribute 'get'
- My docker cluster dev environment shows this error now too.
09/14/2020
- 01:46 PM Bug #47438 (Fix Under Review): OSD.__init__ failes: the JSON object must be str, bytes or bytearr...
- 01:46 PM Bug #47438 (In Progress): OSD.__init__ failes: the JSON object must be str, bytes or bytearray, n...
- 12:48 PM Bug #47438 (Resolved): OSD.__init__ failes: the JSON object must be str, bytes or bytearray, not ...
- ...
- 12:38 PM Bug #45465 (Fix Under Review): cephadm: `ceph orch restart osd` has the potential to break your c...
- 10:20 AM Bug #45093 (Fix Under Review): cephadm: mgrs transiently getting co-located (one node gets two wh...
- 07:41 AM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- Take a look at https://github.com/ceph/ceph/pull/37130
It needs a rebase, but the basics are there in terms of the... - 06:18 AM Bug #47360 (Pending Backport): cephadm: osd unit.run creates /var/run/ceph/$FSID too late, so OSD...
09/11/2020
- 03:04 PM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- -Could you push the code to a branch, please?- What sebastian said :)
Also, what about finding a suitable timeslot... - 03:01 PM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- Paul, can you make a WIP Pr with your current code?
- 05:24 AM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- quick demo of the work so far
https://gist.githubusercontent.com/pcuzner/574113c5976e05a78a6334901eba6319/raw/ae2f... - 02:28 PM Feature #47335 (Fix Under Review): cephadm: Make the Monitoring templates super flexible
- 02:27 PM Support #47233 (Resolved): cephadm: orch apply mon "label:osd" crashes cluster
- 12:09 PM Bug #46429: cephadm fails bootstrap with new Podman Versions 2.0.1 and 2.0.2
- Tested
dev-box-1:/var/lib/ceph/662190fd-30cc-4f4f-945d-dd429e32b0c0 # podman --version
podman version 2.0.6
a... - 11:32 AM Bug #46558: cephadm: paths attribute ignored for db_devices/wal_devices via OSD spec
- DriveGroups are supposed to `describe` a state/layout without explicitly pointing to disk identifiers.
If there is... - 10:35 AM Bug #47381: "ceph orch apply --dry-run" reports empty osdspec even though OSDs will be deployed
- Joshua Schmid wrote:
> This is most likely a known timing issue of the `--dry-run` command.
Could you provide a ... - 09:35 AM Cleanup #47402 (New): CLI: orch osd rm: Replace svc_id with osd_id
- https://ceph.readthedocs.io/en/latest/mgr/orchestrator/#remove-an-osd
and section below refer to svc_id. Should be... - 09:28 AM Bug #47401 (Resolved): improve drive group validation
- ...
09/10/2020
- 11:10 PM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- cephadm ls in 0.5 secs...on what system :) the current ls code takes 10secs per host in my physical lab!
Like I sa... - 08:20 AM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- Actually this change is really impactful, as this introduces a fundamental change in the architecture of cephadm.
... - 05:33 AM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- I'll push the code tomorrow as a draft for people to poke at.
At this point deployment from cephadm looks like
c... - 06:03 PM Bug #47291 (Resolved): cephadm: invalid unit.run file generated for iSCSI
- 03:12 PM Bug #47078 (In Progress): cephadm: ForwardToSyslog=yes (aka really huge syslog)
- 02:09 PM Bug #47387: rook: 'ceph orch ps' does not list daemons correctly
- Sebastian Wagner wrote:
> but `ceph orch ls` or `ceph orch status` works?
'ceph orch ls' doesn't work: https://tr... - 01:40 PM Bug #47387: rook: 'ceph orch ps' does not list daemons correctly
- but `ceph orch ls` or `ceph orch status` works?
- 11:49 AM Bug #47387 (Resolved): rook: 'ceph orch ps' does not list daemons correctly
- Daemons are deployed successfully...
09/09/2020
- 10:49 PM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- This work has a simple goal - provide the data that mgr/cephadm needs faster to make the data more current and the Ui...
- 02:55 PM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- Juan Miguel Olmo Martínez wrote:
> Sebastian Wagner wrote:
>
> >
> > * What's the point in establishing SSH con... - 02:26 PM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- Sebastian Wagner wrote:
>
> * What's the point in establishing SSH connections from the MGR, if we already have ... - 11:20 AM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- Juan Miguel Olmo Martínez wrote:
> I think that the target here is to provide a way to collect information of the ho... - 08:54 AM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- I think that the target here is to provide a way to collect information of the hosts and daemons running in each host...
- 08:24 AM Feature #47368: Provide a daemon mode for cephadm to handle host/daemon state requests
- This has the potential to screw up cephadm pretty badly for all eternity, if we design the architecture wrong. We hav...
- 04:07 PM Bug #47384 (Fix Under Review): cephadm: Remove assignment to member variable in ServiceSpecs
- 04:07 PM Bug #47384 (Resolved): cephadm: Remove assignment to member variable in ServiceSpecs
- Remove unnecessary assignment to member variable 'preview_only', this is done in the constructor of the derived Servi...
- 03:02 PM Bug #47381: "ceph orch apply --dry-run" reports empty osdspec even though OSDs will be deployed
- This is most likely a known timing issue of the `--dry-run` command.
You may verify this by running the provided ... - 02:01 PM Bug #47381 (Can't reproduce): "ceph orch apply --dry-run" reports empty osdspec even though OSDs ...
- If I precede "ceph orch apply --dry-run" with "ceph orch device ls --refresh", everything is fine.
But AFAICT we a... - 01:55 PM Bug #47358: "ceph orch apply osd" chokes on valid service_spec.yml
- ...
- 11:14 AM Tasks #47369: Ceph scales to 100's of hosts, 1000's of OSDs....can orchestrator?
- A single Prometheus instance can, on a properly sized host, handle 1000 nodes. As an OSD is usually accompanied by ot...
- 07:47 AM Tasks #47369 (Resolved): Ceph scales to 100's of hosts, 1000's of OSDs....can orchestrator?
- This bug is intended to help us identify areas in mgr/orchestrator, mgr/cephadm, cephadm, mgr/prometheus and mgr/rook...
- 08:10 AM Feature #47370: cephadm to support configuration of rbd mirroring daemon
- what *exactly* do you need?
- 07:58 AM Feature #47370 (Resolved): cephadm to support configuration of rbd mirroring daemon
- This is an Request for enhancement for cephadm to support configuration of rbd mirroring daemon.
09/08/2020
- 09:51 PM Feature #47368 (Resolved): Provide a daemon mode for cephadm to handle host/daemon state requests
- Scaling the current methods for list_daemons and gather_facts to 100+ hosts represents problems in mgr multi-threadin...
- 05:24 PM Bug #47366 (Closed): Mgr keeps dispatching `osd crush reweight` after OSD removal process is done
- hello,
First of all, I am not certain that his may have already been fixed by the PR of this resolved issue, if ... - 02:37 PM Bug #47078: cephadm: ForwardToSyslog=yes (aka really huge syslog)
- https://docs.ceph.com/docs/master/cephadm/operations/#logging-to-files
- 02:36 PM Bug #47078: cephadm: ForwardToSyslog=yes (aka really huge syslog)
- https://github.com/systemd/systemd/pull/7198
- 12:29 PM Bug #47360 (Fix Under Review): cephadm: osd unit.run creates /var/run/ceph/$FSID too late, so OSD...
- If you've got a node runing OSDs and no other services, this is trivially reproducible by first running @ceph orch rm...
- 10:44 AM Bug #47360 (Resolved): cephadm: osd unit.run creates /var/run/ceph/$FSID too late, so OSD may not...
- The OSD unit.run file currently has the following form:...
- 11:39 AM Bug #45093: cephadm: mgrs transiently getting co-located (one node gets two when only one was ask...
- https://github.com/ceph/ceph/pull/36766 is probably going to help finding this.
- 11:35 AM Bug #44644: cephadm: RGW: updating the spec doesn't update the mon store
- Deleting realms, zones and RGW users is something we need to *carefully* think about. Under all circumstances we have...
- 10:32 AM Bug #47358 (Resolved): "ceph orch apply osd" chokes on valid service_spec.yml
- The following service_spec.yml works fine for "ceph orch apply", but produces an error with "ceph orch apply osd"
... - 03:44 AM Bug #47340: _list_devices: 'NoneType' object has no attribute 'get'
- Doesn't this require https://tracker.ceph.com/issues/47146 first to backport in ceph-volume, and then orch device ls ...
09/07/2020
- 04:01 PM Bug #47340 (Duplicate): _list_devices: 'NoneType' object has no attribute 'get'
- https://pulpito.ceph.com/swagner-2020-09-07_12:17:11-rados:cephadm-wip-swagner2-testing-2020-09-07-1101-distro-basic-...
- 11:22 AM Bug #47337 (Closed): rook: 'ceph orch ls' fails
- ...
- 11:14 AM Bug #47336: `orch device ls`: Unexpected argument '--wide'
- interesting: `master` actually has --wide!...
- 11:04 AM Bug #47336 (Can't reproduce): `orch device ls`: Unexpected argument '--wide'
- https://pulpito.ceph.com/teuthology-2020-09-03_07:01:02-rados-master-distro-basic-smithi/...
- 11:01 AM Bug #47109 (Resolved): while doing an upgrade: Module 'osd_support' has failed: Not found or unlo...
- 11:00 AM Feature #47335 (Resolved): cephadm: Make the Monitoring templates super flexible
- The idea is to allow power-users to modify the templates, if they really want to.
- 10:26 AM Bug #47333 (Resolved): repo_digest: fix `orch ps`
- https://github.com/ceph/ceph/pull/36432#issuecomment-682414409
According to systemctl status, my podman is execute... - 09:57 AM Bug #47332 (Resolved): repo_digest: Follow up's
- ...
- 08:48 AM Bug #47305 (Pending Backport): cephadm: podman not optional on SUSE
09/06/2020
- 10:32 AM Documentation #47142: docs: explain the difference between services and daemons
- While the previous comment has a technical definition of various terms, it doesn't make clear the difference between ...
09/05/2020
Also available in: Atom