Ceph : Issueshttps://tracker.ceph.com/https://tracker.ceph.com/favicon.ico2022-03-29T06:05:33ZCeph
Redmine Dashboard - Bug #55096 (Triaged): mgr/dashboard: Grafana dashboard: "matching labels must be uniq...https://tracker.ceph.com/issues/550962022-03-29T06:05:33Zbrent s.
<a name="Description-of-problem"></a>
<h3 >Description of problem<a href="#Description-of-problem" class="wiki-anchor">¶</a></h3>
<p>When:</p>
<ul>
<li>using an external/remote Prometheus scraper</li>
<li>the radosgw-overview.json (<a class="external" href="https://github.com/ceph/ceph/blob/master/monitoring/ceph-mixin/dashboards_out/radosgw-overview.json">https://github.com/ceph/ceph/blob/master/monitoring/ceph-mixin/dashboards_out/radosgw-overview.json</a>) dashboard in Grafana</li>
<li>with more than one RGW in the cluster</li>
</ul>
<p>The following graphs:</p>
<ul>
<li><strong>Average GET/PUT Latencies</strong></li>
<li><strong>Total Requests/sec by RGW Instance</strong></li>
<li><strong>GET Latencies by RGW Instance</strong></li>
<li><strong>Bandwidth by RGW Instance</strong></li>
<li><strong>PUT Latencies by RGW Instance</strong></li>
</ul>
<p>all fail to render data with the following error:</p>
<pre><code class="text syntaxhl"><span class="CodeRay">execution: found duplicate series for the match group {} on the right hand-side of the operation: [{__name__="ceph_rgw_metadata", ceph_daemon="rgw.182475", ceph_version="ceph version 16.2.7 (dd0603118f56ab514f133c8d2e3adfc983942503) pacific (stable)", hostname="cephstor001.DOMAIN.TLD", instance="cephmon002.DOMAIN.TLD:9283", job="ceph"}, {__name__="ceph_rgw_metadata", ceph_daemon="rgw.123843", ceph_version="ceph version 16.2.7 (dd0603118f56ab514f133c8d2e3adfc983942503) pacific (stable)", hostname="cephstor002.DOMAIN.TLD", instance="cephmon002.DOMAIN.TLD:9283", job="ceph"}];many-to-many matching not allowed: matching labels must be unique on one side
</span></code></pre>
<p>This seems to be similar to <a class="external" href="https://tracker.ceph.com/issues/49433">https://tracker.ceph.com/issues/49433</a> and <a class="external" href="https://tracker.ceph.com/issues/47334">https://tracker.ceph.com/issues/47334</a> and likely just needs the query adjusted.</p>
<a name="Environment"></a>
<h3 >Environment<a href="#Environment" class="wiki-anchor">¶</a></h3>
<ul>
<li><code>ceph version</code> string: ceph version 16.2.7 (dd0603118f56ab514f133c8d2e3adfc983942503) pacific (stable)</li>
<li>Platform (OS/distro/release): AlmaLinux 8.5</li>
<li>Cluster details (nodes, monitors, OSDs): 6 nodes total (3 combined MON/MGR, 3 combined OSD host/RGW/MDS)</li>
<li>Did it happen on a stable environment or after a migration/upgrade?: stable</li>
<li>Browser used (e.g.: <code>Version 86.0.4240.198 (Official Build) (64-bit)</code>): Firefox 97.0.1 (64-bit) (but reproducible on all browsers)</li>
</ul>
<a name="How-reproducible"></a>
<h3 >How reproducible<a href="#How-reproducible" class="wiki-anchor">¶</a></h3>
<p>Steps:</p>
<p>See description.</p>
<a name="Actual-results"></a>
<h3 >Actual results<a href="#Actual-results" class="wiki-anchor">¶</a></h3>
<p>See above.</p>
<a name="Expected-results"></a>
<h3 >Expected results<a href="#Expected-results" class="wiki-anchor">¶</a></h3>
<p>Metrics are displayed.</p>
<a name="Additional-info"></a>
<h3 >Additional info<a href="#Additional-info" class="wiki-anchor">¶</a></h3>
<p>N/A</p> Dashboard - Bug #50684 (Resolved): mgr/dashboard: fix base-href: revert it to previous approachhttps://tracker.ceph.com/issues/506842021-05-07T09:18:09ZAvan Thakkar
<p>Currently the dashboard with a url_prefix is broken as base href is not generated correctly in this case. For now the sugeestion is to just revert it back to document.write() approach.</p> Dashboard - Bug #50519 (Resolved): "ceph dashboard set-ssl-certificate{,-key} -i" is trying to de...https://tracker.ceph.com/issues/505192021-04-26T08:28:25ZPascal Briehl
<p>We are using 16.2.1 on Debian buster directly from <a class="external" href="https://download.ceph.com/debian-pacific/">https://download.ceph.com/debian-pacific/</a> .</p>
<p>We just enabled the dashboard on our test installation to validate.<br />When we tried to enable ssl the cli failed to store the file content after trying to decode an already decoded string.</p>
<ol>
<li>ceph dashboard set-ssl-certificate -i fullchain.crt<br />Error EINVAL: Traceback (most recent call last):<br /> File "/usr/share/ceph/mgr/mgr_module.py", line 1337, in _handle_command<br /> return CLICommand.COMMANDS[cmd['prefix']].call(self, cmd, inbuf)<br /> File "/usr/share/ceph/mgr/mgr_module.py", line 389, in call<br /> return self.func(mgr, **kwargs)<br /> File "/usr/share/ceph/mgr/dashboard/module.py", line 372, in set_ssl_certificate<br /> self.set_store('crt', inbuf.decode())<br />AttributeError: 'str' object has no attribute 'decode'</li>
</ol>
<ol>
<li>ceph dashboard set-ssl-certificate-key -i privatekey.key <br />Error EINVAL: Traceback (most recent call last):<br /> File "/usr/share/ceph/mgr/mgr_module.py", line 1337, in _handle_command<br /> return CLICommand.COMMANDS[cmd['prefix']].call(self, cmd, inbuf)<br /> File "/usr/share/ceph/mgr/mgr_module.py", line 389, in call<br /> return self.func(mgr, **kwargs)<br /> File "/usr/share/ceph/mgr/dashboard/module.py", line 385, in set_ssl_certificate_key<br /> self.set_store('key', inbuf.decode())<br />AttributeError: 'str' object has no attribute 'decode'</li>
</ol>
<p>Modifing "inbuf.decode()" to "inbuf" in the regarding lines allowed us then to load the certifikate & key and activate ssl.</p> Dashboard - Bug #49925 (Resolved): mgr/dashboard: adapt Dashboard to work with NFSv4https://tracker.ceph.com/issues/499252021-03-22T16:47:40ZErnesto Puerta
<a name="Description-of-problem"></a>
<h3 >Description of problem<a href="#Description-of-problem" class="wiki-anchor">¶</a></h3>
After the following PRs:
<ul>
<li><a class="external" href="https://github.com/ceph/ceph/pull/32297">https://github.com/ceph/ceph/pull/32297</a> (volume mgr module, on CephFS-NFS exports + NFSv4 only)</li>
<li><a class="external" href="https://github.com/ceph/ceph/pull/34249">https://github.com/ceph/ceph/pull/34249</a> (cephadm support for volume mgr module)</li>
<li><a class="external" href="https://github.com/ceph/ceph/pull/37600">https://github.com/ceph/ceph/pull/37600</a> (RGW-NFS exports)</li>
<li><a class="external" href="https://github.com/ceph/ceph/pull/38510">https://github.com/ceph/ceph/pull/38510</a> (mgr/volumes/nfs: remove 'ganesha-' prefix from cluster id)</li>
</ul>
<p>The support in Dashboard for managing NFS got broken (it can still work if the <code>ganesha.conf</code> is manually created, but not with cephadm/volume mgr module).</p>
<a name="Fixes-required"></a>
<h3 >Fixes required<a href="#Fixes-required" class="wiki-anchor">¶</a></h3>
<p>Prior to all these changes, the Dashboard needed to manually read <code>ganesha.conf</code> (stored in a RADOS pool) and each of the nfs exports (also stored in the same RADOS pool).</p>
<p>After this change, the dashboard shouldn't require to take care of those and it'd just need to interact with the volume mgr module API</p>
<a name="Pending-NFSv3-support"></a>
<h3 >Pending NFSv3 support<a href="#Pending-NFSv3-support" class="wiki-anchor">¶</a></h3>
<p>See <a class="external" href="https://github.com/ceph/ceph/pull/39918/files">https://github.com/ceph/ceph/pull/39918/files</a> for details</p> Dashboard - Bug #49869 (Resolved): mgr/dashboard: feature toggles CLI is brokenhttps://tracker.ceph.com/issues/498692021-03-17T16:00:51ZErnesto Puerta
<pre>
]# ceph dashboard feature disable rbd
2021-03-17T15:59:22.893+0000 7f9cf81e3700 -1 WARNING: all dangerous and experimental features are enabled.
2021-03-17T15:59:22.902+0000 7f9cf81e3700 -1 WARNING: all dangerous and experimental features are enabled.
Error EINVAL: Traceback (most recent call last):
File "/ceph/src/pybind/mgr/mgr_module.py", line 1337, in _handle_command
return CLICommand.COMMANDS[cmd['prefix']].call(self, cmd, inbuf)
File "/ceph/src/pybind/mgr/mgr_module.py", line 389, in call
return self.func(mgr, **kwargs)
File "/ceph/src/pybind/mgr/dashboard/plugins/feature_toggles.py", line 105, in cmd
enabled = mgr.get_module_option(self.OPTION_FMT.format(feature))
File "/ceph/src/pybind/mgr/mgr_module.py", line 1403, in get_module_option
self._validate_module_option(key)
File "/ceph/src/pybind/mgr/mgr_module.py", line 1386, in _validate_module_option
format(key, self.__class__.__name__))
RuntimeError: Config option 'FEATURE_TOGGLE_Features.RBD' is not in Module.MODULE_OPTIONS
</pre> Dashboard - Bug #45981 (Can't reproduce): mgr/dashboard: Nautilus: Missing blanks in modal titles...https://tracker.ceph.com/issues/459812020-06-11T19:01:44ZLenz Grimmer
<p>This issue seems to be specific to the "nautilus" branch, I did not observe this on octopus or master: there's a blank missing in the modal title and action buttons across the application, e.g. "CreateUser" instead of "Create User" or "CreatePool" instead of "Create Pool". This only affects the English version; in localized variants the blank between object and action is visible. See screen shots for some examples.</p>
<p><img src="https://tracker.ceph.com/attachments/download/4909/Screenshot%20from%202020-06-11%2020-59-58.png" alt="" /><br /><img src="https://tracker.ceph.com/attachments/download/4910/Screenshot%20from%202020-06-11%2020-59-43.png" alt="" /><br /><img src="https://tracker.ceph.com/attachments/download/4911/Screenshot%20from%202020-06-11%2020-59-28.png" alt="" /></p> Dashboard - Bug #45968 (Resolved): mgr/dashboard: Tooltips missing from progress barshttps://tracker.ceph.com/issues/459682020-06-10T13:31:13ZLenz Grimmer
<p>This is likely a regression introduced by <a class="issue tracker-2 status-3 priority-4 priority-default closed child" title="Feature: mgr/dashboard: Use ng-bootstrap for Tooltip (Resolved)" href="https://tracker.ceph.com/issues/45754">#45754</a> - tooltips on progress bars are no longer displayed. This was discovered while reviewing <a href="https://github.com/ceph/ceph/pull/34606" class="external">PR#34606</a> (issue <a class="issue tracker-2 status-3 priority-4 priority-default closed child" title="Feature: mgr/dashboard: Display users current bucket quota usage (Resolved)" href="https://tracker.ceph.com/issues/45011">#45011</a>).</p>
<p><img src="https://tracker.ceph.com/attachments/download/4908/Peek-2020-06-10-14-24.gif" alt="" /></p> Dashboard - Bug #45877 (Resolved): mgr/dashboard: CephFS browser not visiblehttps://tracker.ceph.com/issues/458772020-06-04T10:27:52ZLenz Grimmer
<p>This is likely related to <a class="issue tracker-1 status-3 priority-5 priority-high3 closed" title="Bug: mgr/dashboard: OSD page is slow at loading all the inline pages and tabs (Resolved)" href="https://tracker.ceph.com/issues/45017">#45017</a> - the CephFS browser disappeared (see screenshot):</p>
<p><img src="https://tracker.ceph.com/attachments/download/4905/Screenshot_2020-06-04%20Ceph.png" alt="" /></p> Dashboard - Bug #44784 (Resolved): mgr/dashboard: Some Grafana panels in Host overview, Host deta...https://tracker.ceph.com/issues/447842020-03-27T11:32:04ZKristoffer Gronlund
<p>Some Grafana dashboards are broken due to mismatches between FQDN and hostname in instance labels between the node exporter and the ceph exporter.<br />Others seem to have broken when devices can be created on LVM and not just raw devices.</p> Dashboard - Bug #43647 (Can't reproduce): mgr/dashboard: logout is not working properlyhttps://tracker.ceph.com/issues/436472020-01-17T09:34:06ZTatjana Dehler
<p>I created a vstart cluster and logged in with the default user. I logged out and the window looked like this:</p>
<p><img src="https://tracker.ceph.com/attachments/download/4669/Screenshot_2020-01-17_10-25-50.png" alt="" /></p> Dashboard - Bug #39579 (Resolved): mgr/dashboard: Fix run-tox script to accept cli arguments againhttps://tracker.ceph.com/issues/395792019-05-03T10:30:12ZStephan Müller
<p>A regression was introduced by <a href="https://github.com/ceph/ceph/commit/9426f1f2045d0ae0f319530c3dc3a9240d838d07#diff-cc2ee9d8e56f3a2cd98b8148935d3829L37" class="external">this change</a> , causing the script to not accept command line arguments. Therefore command described in the hacking.rst to only run a single tox test ("WITH_PYTHON2=OFF ./run-tox.sh pytest tests/test_rgw_client.py::RgwClientTest::test_ssl_verify") did not work anymore and caused tox to <a href="https://paste.opensuse.org/view//64659695" class="external">fail</a> .</p>
<pre>
Traceback (most recent call last):
File "/usr/bin/tox", line 11, in <module>
load_entry_point('tox==3.7.0', 'console_scripts', 'tox')()
File "/usr/lib/python3.7/site-packages/tox/session.py", line 47, in cmdline
main(args)
File "/usr/lib/python3.7/site-packages/tox/session.py", line 54, in main
retcode = build_session(config).runcommand()
File "/usr/lib/python3.7/site-packages/tox/session.py", line 467, in runcommand
return self.subcommand_test()
File "/usr/lib/python3.7/site-packages/tox/session.py", line 590, in subcommand_test
self.run_sequential()
File "/usr/lib/python3.7/site-packages/tox/session.py", line 609, in run_sequential
self.runtestenv(venv)
File "/usr/lib/python3.7/site-packages/tox/session.py", line 728, in runtestenv
self.hook.tox_runtest(venv=venv, redirect=redirect)
File "/usr/lib/python3.7/site-packages/pluggy/hooks.py", line 289, in __call__
return self._hookexec(self, self.get_hookimpls(), kwargs)
File "/usr/lib/python3.7/site-packages/pluggy/manager.py", line 68, in _hookexec
return self._inner_hookexec(hook, methods, kwargs)
File "/usr/lib/python3.7/site-packages/pluggy/manager.py", line 62, in <lambda>
firstresult=hook.spec.opts.get("firstresult") if hook.spec else False,
File "/usr/lib/python3.7/site-packages/pluggy/callers.py", line 208, in _multicall
return outcome.get_result()
File "/usr/lib/python3.7/site-packages/pluggy/callers.py", line 80, in get_result
raise ex[1].with_traceback(ex[2])
File "/usr/lib/python3.7/site-packages/pluggy/callers.py", line 187, in _multicall
res = hook_impl.function(*args)
File "/usr/lib/python3.7/site-packages/tox/venv.py", line 597, in tox_runtest
venv.test(redirect=redirect)
File "/usr/lib/python3.7/site-packages/tox/venv.py", line 468, in test
if argv[0].startswith("-"):
IndexError: list index out of range
</pre>