Ceph : Issues
https://tracker.ceph.com/
https://tracker.ceph.com/favicon.ico
2018-12-19T19:41:42Z
Ceph
Redmine
Dashboard - Bug #37717 (Resolved): Teuthology error in tasks.mgr.dashboard.test_health.HealthTest
https://tracker.ceph.com/issues/37717
2018-12-19T19:41:42Z
Sebastian Wagner
<p>We're getting</p>
<pre>
FAIL: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu2-testing-2018-12-19-1703/qa/tasks/mgr/dashboard/test_health.py", line 239, in test_full_health
self.assertSchema(data, schema)
File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu2-testing-2018-12-19-1703/qa/tasks/mgr/dashboard/helper.py", line 337, in assertSchema
self.assertEqual(data, str(e))
AssertionError: {...<<see out.json>>...} != "In `input['df']`: unknown keys: set([u'stats_by_class'])"
</pre><br /><pre>
ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks
manager.__enter__()
File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
return self.gen.next()
File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu2-testing-2018-12-19-1703/qa/tasks/cephfs_test_runner.py", line 207, in task
raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests)))
RuntimeError: Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)
</pre><br /><pre>
Saw exception from nested tasks
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 32, in nested
yield vars
File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu2-testing-2018-12-19-1703/qa/tasks/rgw.py", line 313, in task
yield
File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks
manager.__enter__()
File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
return self.gen.next()
File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu2-testing-2018-12-19-1703/qa/tasks/cephfs_test_runner.py", line 207, in task
raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests)))
RuntimeError: Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)
</pre>
sepia - Support #37709 (Resolved): Sepia Lab Access Request
https://tracker.ceph.com/issues/37709
2018-12-19T11:48:25Z
Sebastian Wagner
<p>1) Do you just need VPN access or will you also be running teuthology jobs?</p>
<p>I'm going to need access to Teuthology and to the lab's k8s cluster.</p>
<p>2) Desired Username:</p>
<p>swagner</p>
<p>3) Alternate e-mail address(es) we can reach you at:</p>
<p><a class="email" href="mailto:cephth@spawnhost.de">cephth@spawnhost.de</a></p>
<p>4) If you don't already have an established history of code contributions to Ceph, is there an existing community or core developer you've worked with who has reviewed your work and can vouch for your access request?</p>
<p><a class="external" href="https://github.com/ceph/ceph/commit/e0eb2dbd98d930eb0bd5b29b051f3639fc805c40#diff-5e08bfe65cc656745656d8042a5fd8b8">https://github.com/ceph/ceph/commit/e0eb2dbd98d930eb0bd5b29b051f3639fc805c40#diff-5e08bfe65cc656745656d8042a5fd8b8</a></p>
<p style="padding-left:2em;">If you answered "No" to # 4, please answer the following (paste directly below the question to keep indentation):</p>
<p style="padding-left:2em;">4a) Paste a link to a Blueprint or planning doc of yours that was reviewed at a Ceph Developer Monthly.</p>
<p style="padding-left:2em;">4b) Paste a link to an accepted pull request for a major patch or feature.</p>
<p style="padding-left:2em;">4c) If applicable, include a link to the current project (planning doc, dev branch, or pull request) that you are looking to test.</p>
<p>5) Paste your SSH public key(s) between the <code>pre</code> tags<br /><pre>ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com</pre></p>
<p>6) Paste your hashed VPN credentials between the <code>pre</code> tags (Format: <code>user@hostname 22CharacterSalt 65CharacterHashedPassword</code>)<br /><pre>swagner@ubuntu HKUxZQFMdbrCq3VhYt+jDQ d0ad7e9f21a90d2c51fee2ef5e87ce9b13b13c2fa81dbaf3361c827ebb9b045a</pre></p>
Dashboard - Bug #37651 (Can't reproduce): Container, Mimic: Unable to open CherryPy port
https://tracker.ceph.com/issues/37651
2018-12-13T18:47:12Z
Sebastian Wagner
<pre>
2018-12-10 16:46:27.962 7ff665c5e700 -1 Traceback (most recent call last):
File "/usr/lib64/ceph/mgr/prometheus/module.py", line 711, in serve
cherrypy.engine.start()
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
raise e_info
ChannelFailures: IOError("Port 9283 not bound on '::'",)
</pre>
<p>and it also affects mgr/prometheus</p>
<pre>
2018-12-10 16:46:27.962 7ff665c5e700 -1 Traceback (most recent call last):
File "/usr/lib64/ceph/mgr/prometheus/module.py", line 711, in serve
cherrypy.engine.start()
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
raise e_info
ChannelFailures: IOError("Port 9283 not bound on '::'",)
[10/Dec/2018:16:46:27] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7ff66b728590>>
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
output.append(listener(*args, **kwargs))
File "/usr/lib/python2.7/site-packages/cherrypy/_cpserver.py", line 151, in start
ServerAdapter.start(self)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 174, in start
self.wait()
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 214, in wait
wait_for_occupied_port(host, port)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 427, in wait_for_occupied_port
raise IOError("Port %r not bound on %r" % (port, host))
IOError: Port 8443 not bound on '::'
[10/Dec/2018:16:46:27] ENGINE Shutting down due to error in start listener:
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 235, in start
self.publish('start')
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 215, in publish
raise exc
ChannelFailures: IOError("Port 8443 not bound on '::'",)
</pre>
<p>and</p>
<pre>
2018-12-10 16:46:27.982 7ff666c60700 -1 Traceback (most recent call last):
File "/usr/lib64/ceph/mgr/dashboard/module.py", line 288, in serve
cherrypy.engine.start()
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
raise e_info
ChannelFailures: IOError("Port 8443 not bound on '::'",)
</pre>
<p>and</p>
<pre>
::ffff:10.244.3.31 - - [10/Dec/2018:16:46:25] "GET /metrics HTTP/1.1" 200 49184 "" "Prometheus/2.5.0"
2018-12-10 16:46:25.882 7ff677dbc700 0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91786600 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/summary HTTP/1.0" 200 215 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/dashboard/health HTTP/1.0" 200 27036 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET / HTTP/1.0" 200 1094 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/summary HTTP/1.0" 200 215 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/dashboard/health HTTP/1.0" 200 27023 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
2018-12-10 16:46:26.882 7ff6775bb700 0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91786c00 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
2018-12-10 16:46:27.454 7ff6705ad700 1 mgr send_beacon active
2018-12-10 16:46:27.882 7ff6775bb700 0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91787200 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
[10/Dec/2018:16:46:27] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7ff66a836710>>
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
output.append(listener(*args, **kwargs))
File "/usr/lib/python2.7/site-packages/cherrypy/_cpserver.py", line 151, in start
ServerAdapter.start(self)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 174, in start
self.wait()
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 214, in wait
wait_for_occupied_port(host, port)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 427, in wait_for_occupied_port
raise IOError("Port %r not bound on %r" % (port, host))
IOError: Port 9283 not bound on '::'
</pre>
<p>Downstream issue [[<a class="external" href="https://github.com/rook/rook/issues/2335">https://github.com/rook/rook/issues/2335</a>]]</p>
ceph-volume - Bug #37390 (Resolved): c-v inventory returns invalid JSON
https://tracker.ceph.com/issues/37390
2018-11-26T13:16:39Z
Sebastian Wagner
<p>print() uses single-quotes by default, which is invalid JSON.</p>
Ceph - Bug #37373 (New): Interactive mode CLI with Python 3: Traceback when pressing ^D
https://tracker.ceph.com/issues/37373
2018-11-22T15:06:43Z
Sebastian Wagner
<p>Hey,</p>
<p>calling ^d in the repl of the ceph command using Python 3 shows a Traceback:</p>
<pre>
$ ceph
ceph>
ceph>
ceph> Traceback (most recent call last):
File "/home/sebastian/Repos/ceph/build/bin/ceph", line 1250, in <module>
retval = main()
File "/home/sebastian/Repos/ceph/build/bin/ceph", line 1229, in main
raw_write(outbuf)
File "/home/sebastian/Repos/ceph/build/bin/ceph", line 172, in raw_write
raw_stdout.write(buf)
TypeError: a bytes-like object is required, not 'str'
</pre>
<p>Is there anyone that uses this mode? Relates to</p>
<p><a class="external" href="https://marc.info/?i=CALe9h7c5kJudfsQ6Vf_vczUG0CeoN8=dxznC=92RamBvxD9u0w%20()%20mail%20!%20gmail%20!%20com">https://marc.info/?i=CALe9h7c5kJudfsQ6Vf_vczUG0CeoN8=dxznC=92RamBvxD9u0w%20()%20mail%20!%20gmail%20!%20com</a></p>
Dashboard - Feature #36596 (New): Integrate the Orchestrator interface into the dashboard
https://tracker.ceph.com/issues/36596
2018-10-25T12:34:30Z
Sebastian Wagner
<p>Integrate the Orchestrator interface into the dashboard</p>
<p>Things to consider:</p>
<ul>
<li>Either integrate the Orchestrator similar to the CLI or, use the CLI</li>
<li>use inter-module calls</li>
<li>expose the REST API similar to the API [[<a class="external" href="https://docs.google.com/document/d/17DIs_NCMBsTG3jbrhsG0Ot5y40TC9ADDZgEhmtF6Yks/edit?ts=5bd0ce16">https://docs.google.com/document/d/17DIs_NCMBsTG3jbrhsG0Ot5y40TC9ADDZgEhmtF6Yks/edit?ts=5bd0ce16</a>#]] or build our own API? </li>
<li>How to integrate NFS?</li>
</ul>
Dashboard - Bug #36373 (Resolved): build failes, if there is no system-wide NPM installation: `ng...
https://tracker.ceph.com/issues/36373
2018-10-10T09:07:35Z
Sebastian Wagner
<a name="Running-make-fails"></a>
<h3 >Running make fails<a href="#Running-make-fails" class="wiki-anchor">¶</a></h3>
<pre>
634effb2f216:/ceph/build/src/pybind/mgr/dashboard # make
[ 0%] Built target mgr-dashboard-nodeenv
[ 0%] dashboard frontend dependencies are being installed
/ceph/build/src/pybind/mgr/dashboard/node-env/bin/npm -> /ceph/build/src/pybind/mgr/dashboard/node-env/lib/node_modules/npm/bin/npm-cli.js
/ceph/build/src/pybind/mgr/dashboard/node-env/bin/npx -> /ceph/build/src/pybind/mgr/dashboard/node-env/lib/node_modules/npm/bin/npx-cli.js
+ npm@6.2.0
added 282 packages, removed 363 packages and updated 41 packages in 5.401s
npm ERR! code ENOGIT
npm ERR! Error while executing:
npm ERR! undefined ls-remote -h -t ssh://git@github.com/zzakir/ng2-toastr.git
npm ERR!
npm ERR! undefined
npm ERR! No git binary found in $PATH
npm ERR!
npm ERR! Failed using git.
npm ERR! Please check if you have git installed and in your PATH.
npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2018-10-10T08_51_15_951Z-debug.log
make[2]: *** [src/pybind/mgr/dashboard/CMakeFiles/mgr-dashboard-frontend-deps.dir/build.make:61: ../src/pybind/mgr/dashboard/frontend/node_modules] Error 1
make[1]: *** [CMakeFiles/Makefile2:5054: src/pybind/mgr/dashboard/CMakeFiles/mgr-dashboard-frontend-deps.dir/all] Error 2
make: *** [Makefile:141: all] Error 2
</pre>
<p>I can reproduce it:</p>
<pre>
634effb2f216:/ceph/src/pybind/mgr/dashboard/frontend # . /ceph/build/src/pybind/mgr/dashboard/node-env/bin/activate
(node-env) 634effb2f216:/ceph/src/pybind/mgr/dashboard/frontend # /ceph/build/src/pybind/mgr/dashboard/node-env/bin/npm run build
> ceph-dashboard@0.0.0 build /ceph/src/pybind/mgr/dashboard/frontend
> ng build
sh: ng: command not found
npm ERR! file sh
npm ERR! code ELIFECYCLE
npm ERR! errno ENOENT
npm ERR! syscall spawn
npm ERR! ceph-dashboard@0.0.0 build: `ng build`
npm ERR! spawn ENOENT
npm ERR!
npm ERR! Failed at the ceph-dashboard@0.0.0 build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.
npm ERR! A complete log of this run can be found in:
npm ERR! /root/.npm/_logs/2018-10-10T08_58_26_555Z-debug.log
</pre>
<p>Looks like npm calls ng which is not installed correctly in on of these dirs:<br /><pre>
/ceph/build/src/pybind/mgr/dashboard/node-env/lib/node_modules/.bin
/ceph/build/src/pybind/mgr/dashboard/node-env/bin
</pre></p>
<p>Right! it's not installed:</p>
<pre>
(node-env) 634effb2f216:/ceph/build/src/pybind/mgr/dashboard/node-env/lib/node_modules # find * -name ng | wc -l
0
</pre>
<p>Deleting the `node_modules` folder doesn't help.</p>
<a name="Environemnt"></a>
<h3 >Environemnt<a href="#Environemnt" class="wiki-anchor">¶</a></h3>
<ul>
<li>Current git master</li>
<li>openSUSE LEap 15 docker container</li>
</ul>
Dashboard - Documentation #24755 (New): mgr/dashboard: Add Documentation about accessing the Dash...
https://tracker.ceph.com/issues/24755
2018-07-03T10:47:21Z
Sebastian Wagner
<p>Add Documentation about accessing the Dashboard's API documentation.</p>
Ceph - Bug #23854 (Can't reproduce): Linking libceph_zstd.so sometimes fails
https://tracker.ceph.com/issues/23854
2018-04-25T13:00:23Z
Sebastian Wagner
<p>I get this error from time to time (since a few months) when building from source:<br /><pre>
[ 20%] Linking CXX shared library ../../../lib/libceph_zstd.so
/usr/bin/ld: libzstd/lib/libzstd.a(error_private.c.o): relocation R_X86_64_PC32 against symbol `ERR_getErrorString' can not be used when making a shared object; recompile with -fPIC
/usr/bin/ld: final link failed: Bad value
collect2: error: ld returned 1 exit status
src/compressor/zstd/CMakeFiles/ceph_zstd.dir/build.make:95: die Regel für Ziel „lib/libceph_zstd.so.2.0.0“ scheiterte
make[2]: *** [lib/libceph_zstd.so.2.0.0] Fehler 1
CMakeFiles/Makefile2:20785: die Regel für Ziel „src/compressor/zstd/CMakeFiles/ceph_zstd.dir/all“ scheiterte
make[1]: *** [src/compressor/zstd/CMakeFiles/ceph_zstd.dir/all] Fehler 2
make[1]: *** Auf noch nicht beendete Prozesse wird gewartet …
</pre></p>
<p>This happens mostly after calling <code>make</code> multiple times without a full rebuild for a longer period of time.</p>
<p>Removing the build files helps as a workaround:<br /><pre>
rm -r build/src/compressor/zstd
</pre></p>
<p>Environment:</p>
<ul>
<li>Ubuntu 17.10</li>
<li>GNU ld (GNU Binutils for Ubuntu) 2.29.1</li>
<li>g++ (Ubuntu 7.2.0-8ubuntu3) 7.2.0</li>
<li>cmake version 3.9.1</li>
<li>git on master for the last few months.</li>
</ul>
Dashboard - Bug #23823 (Closed): Dashboard: redefinition of group name 'path' as group 2; was gro...
https://tracker.ceph.com/issues/23823
2018-04-23T12:01:04Z
Sebastian Wagner
<p>When starting a new vstart.sh cluster, ceph mgr dump shows:</p>
<pre>
Error EIO: Module 'dashboard' has experienced an error and cannot handle commands: error("redefinition of group name 'path' as group 2; was group 1",)
</pre>
<p>for the dashboard module.</p>
<p>Ceph version: <code>ceph version 13.0.2-1544-g67da525353</code><br />python-Routes: <code>2.4.1-1</code><br />Cherrypy: <code>3.5.0</code></p>
RADOS - Bug #23360 (Duplicate): call to 'ceph osd erasure-code-profile set' asserts the monitors
https://tracker.ceph.com/issues/23360
2018-03-14T14:37:14Z
Sebastian Wagner
<p>I've attached `thread apply all bt` mixed with `thread apply all py-bt`</p>
<p>Threads 38 35 34 32 and 31 are waiting for futex 0x55a285204640</p>
<p>Thread 37 waits in<br />File "/src/pybind/mgr/mgr_module.py", line 71, in wait<br /> self.ev.wait()</p>
<p>AFAICT, all other threads are not part of this deadlock.</p>
mgr - Bug #23286 (Resolved): mgr: ActivePyModules::list_servers_python() returns mgr with empty h...
https://tracker.ceph.com/issues/23286
2018-03-09T10:50:36Z
Sebastian Wagner
<p>When running a vstart.sh cluster on master at cf52fc5a, <code>list_servers_python()</code> returns:<br /><pre>
[
{
"services": [
{
"type": "mgr",
"id": "x"
}
],
"hostname": "",
"ceph_version": ""
},
{
"services": [
{
"type": "mds",
"id": "a"
},
{
"type": "mds",
"id": "b"
},
{
"type": "mds",
"id": "c"
},
{
"type": "mon",
"id": "a"
},
{
"type": "mon",
"id": "b"
},
{
"type": "mon",
"id": "c"
},
{
"type": "osd",
"id": "0"
},
{
"type": "osd",
"id": "1"
},
{
"type": "osd",
"id": "2"
},
{
"type": "rgw",
"id": "rgw"
}
],
"hostname": "ubuntu",
"ceph_version": "ceph version 13.0.1-2832 .. mimic (dev)"
}
]
</pre></p>
<p>This breaks the dashboard_v2 Host tab: <br /><img src="https://user-images.githubusercontent.com/2574405/37150468-113b26b8-22d2-11e8-867e-804cab4936ca.png" alt="" /></p>
<p>This is <code>ceph mgr dump</code>:<br /><pre>
$ ceph mgr dump | jq .
2018-03-09 11:48:27.125 7fe28a849700 -1 WARNING: all dangerous and experimental features are enabled.
2018-03-09 11:48:27.177 7fe28a849700 -1 WARNING: all dangerous and experimental features are enabled.
{
"epoch": 8,
"active_gid": 4137,
"active_name": "x",
"active_addr": "192.168.178.29:6800/9933",
"available": true,
"standbys": [],
"modules": [
"balancer",
"dashboard",
"dashboard_v2",
"restful",
"status"
],
"available_modules": [
{
"name": "balancer",
"can_run": true,
"error_string": ""
},
{
"name": "dashboard",
"can_run": true,
"error_string": ""
},
{
"name": "dashboard_v2",
"can_run": true,
"error_string": ""
},
{
"name": "influx",
"can_run": false,
"error_string": "influxdb python module not found"
},
{
"name": "localpool",
"can_run": true,
"error_string": ""
},
{
"name": "prometheus",
"can_run": true,
"error_string": ""
},
{
"name": "restful",
"can_run": true,
"error_string": ""
},
{
"name": "selftest",
"can_run": true,
"error_string": ""
},
{
"name": "smart",
"can_run": true,
"error_string": ""
},
{
"name": "status",
"can_run": true,
"error_string": ""
},
{
"name": "zabbix",
"can_run": true,
"error_string": ""
}
],
"services": {
"dashboard": "http://ubuntu:41116/",
"dashboard_v2": "http://ubuntu:43116/",
"restful": "https://ubuntu:42116/"
}
}
</pre></p>
rbd - Bug #22253 (Can't reproduce): "rbd info" crashed: stack smashing detected
https://tracker.ceph.com/issues/22253
2017-11-27T14:37:58Z
Sebastian Wagner
<p>Environment: quite small vstart cluster.</p>
<p>This is the stack trace:<br /><pre>
#3 0x00007fffed44711c in __GI___fortify_fail (msg=<optimized out>, msg@entry=0x7fffed4bd441 "stack smashing detected") at fortify_fail.c:37
#4 0x00007fffed4470c0 in __stack_chk_fail () at stack_chk_fail.c:28
#5 0x00007ffff78f0beb in librbd::ImageCtx::perf_start (this=this@entry=0x555555b7bf70, name="librbd-8c39e2ae8944a-rbd-huge2") at /home/sebastian/Repos/ceph/src/librbd/ImageCtx.cc:397
#6 0x00007ffff78f3cb4 in librbd::ImageCtx::init (this=0x555555b7bf70) at /home/sebastian/Repos/ceph/src/librbd/ImageCtx.cc:275
#7 0x00007ffff799dacd in librbd::image::OpenRequest<librbd::ImageCtx>::send_register_watch (this=this@entry=0x555555b7fe60) at /home/sebastian/Repos/ceph/src/librbd/image/OpenRequest.cc:477
#8 0x00007ffff79a3102 in librbd::image::OpenRequest<librbd::ImageCtx>::handle_v2_apply_metadata (this=this@entry=0x555555b7fe60, result=result@entry=0x7fffb77fa374) at /home/sebastian/Repos/ceph/src/librbd/image/OpenRequest.cc:471
#9 0x00007ffff79a351f in librbd::util::detail::rados_state_callback<librbd::image::OpenRequest<librbd::ImageCtx>, &librbd::image::OpenRequest<librbd::ImageCtx>::handle_v2_apply_metadata, true> (c=<optimized out>, arg=0x555555b7fe60) at /home/sebastian/Repos/ceph/src/librbd/Utils.h:39
#10 0x00007ffff75d678d in librados::C_AioComplete::finish (this=0x7fffd0001b60, r=<optimized out>) at /home/sebastian/Repos/ceph/src/librados/AioCompletionImpl.h:169
#11 0x0000555555613949 in Context::complete (this=0x7fffd0001b60, r=<optimized out>) at /home/sebastian/Repos/ceph/src/include/Context.h:70
#12 0x00007fffeeab6010 in Finisher::finisher_thread_entry (this=0x555555acb3e8) at /home/sebastian/Repos/ceph/src/common/Finisher.cc:72
#13 0x00007fffee3a86ba in start_thread (arg=0x7fffb77fe700) at pthread_create.c:333
#14 0x00007fffed4353dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
</pre></p>
Ceph - Bug #20619 (Closed): MgrClient.cc: 43: FAILED assert(msgr != nullptr)
https://tracker.ceph.com/issues/20619
2017-07-13T16:17:29Z
Sebastian Wagner
<p>I got this after creating a replicated Pool with very few PGs.</p>
Environment:
<ul>
<li>Git revision: 7e12840db34f8a0fb</li>
<li>vstart.sh -X -l</li>
</ul>
<pre>
/ceph/src/mgr/MgrClient.cc: In function 'void MgrClient::init()' thread 7f34b5310700 time 2017-07-13 17:51:39.314068
/ceph/src/mgr/MgrClient.cc: 43: FAILED assert(msgr != nullptr)
ceph version 12.1.0-761-g3ad4123 (3ad4123c83b42bfd49dc3594c96a0c7539bd6511) luminous (rc)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f34a9f847d2]
2: (MgrClient::init()+0x5d) [0x7f34a9fe4bed]
3: (librados::RadosClient::connect()+0x90e) [0x7f34b29cde0e]
4: (rados_connect()+0x1f) [0x7f34b298199f]
5: (()+0x5f6dc) [0x7f34b2ce16dc]
6: (PyEval_EvalFrameEx()+0x68a) [0x4c468a]
7: (PyEval_EvalFrameEx()+0x5d8f) [0x4c9d8f]
8: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
9: ../env/bin/python() [0x4de6fe]
10: (PyObject_Call()+0x43) [0x4b0cb3]
11: ../env/bin/python() [0x4f492e]
12: (PyObject_Call()+0x43) [0x4b0cb3]
13: ../env/bin/python() [0x4f46a7]
14: ../env/bin/python() [0x4b670c]
15: (PyObject_Call()+0x43) [0x4b0cb3]
16: (PyEval_EvalFrameEx()+0x5faf) [0x4c9faf]
17: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
18: ../env/bin/python() [0x4de6fe]
19: (PyObject_Call()+0x43) [0x4b0cb3]
20: ../env/bin/python() [0x4f492e]
21: (PyObject_Call()+0x43) [0x4b0cb3]
22: ../env/bin/python() [0x569a48]
23: (PyEval_EvalFrameEx()+0x6345) [0x4ca345]
24: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
25: (PyEval_EvalFrameEx()+0x6099) [0x4ca099]
26: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
27: (PyEval_EvalFrameEx()+0x6099) [0x4ca099]
28: (PyEval_EvalFrameEx()+0x5d8f) [0x4c9d8f]
29: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
30: (PyEval_EvalFrameEx()+0x68d1) [0x4ca8d1]
31: (PyEval_EvalFrameEx()+0x5d8f) [0x4c9d8f]
32: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
33: (PyEval_EvalFrameEx()+0x68d1) [0x4ca8d1]
34: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
35: ../env/bin/python() [0x4de6fe]
36: (PyObject_Call()+0x43) [0x4b0cb3]
37: (PyObject_CallFunctionObjArgs()+0x16a) [0x4b97fa]
38: (_PyObject_GenericGetAttrWithDict()+0x17c) [0x4b00dc]
39: (PyEval_EvalFrameEx()+0x4c1) [0x4c44c1]
40: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
41: ../env/bin/python() [0x4de6fe]
42: (PyObject_Call()+0x43) [0x4b0cb3]
43: ../env/bin/python() [0x4f492e]
44: (PyObject_Call()+0x43) [0x4b0cb3]
45: ../env/bin/python() [0x569a48]
46: ../env/bin/python() [0x589fb1]
47: ../env/bin/python() [0x50157c]
48: (PyEval_EvalFrameEx()+0x615e) [0x4ca15e]
49: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
50: ../env/bin/python() [0x4de8b8]
51: (PyObject_Call()+0x43) [0x4b0cb3]
52: (PyEval_EvalFrameEx()+0x2ad1) [0x4c6ad1]
53: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
54: (PyEval_EvalFrameEx()+0x68d1) [0x4ca8d1]
55: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
56: ../env/bin/python() [0x4de8b8]
57: (PyObject_Call()+0x43) [0x4b0cb3]
58: (PyEval_EvalFrameEx()+0x2ad1) [0x4c6ad1]
59: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
60: ../env/bin/python() [0x4de8b8]
61: (PyObject_Call()+0x43) [0x4b0cb3]
62: (PyEval_EvalFrameEx()+0x2ad1) [0x4c6ad1]
63: (PyEval_EvalFrameEx()+0x5d8f) [0x4c9d8f]
64: (PyEval_EvalFrameEx()+0x5d8f) [0x4c9d8f]
65: (PyEval_EvalFrameEx()+0x5d8f) [0x4c9d8f]
66: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
67: ../env/bin/python() [0x4de6fe]
68: (PyObject_Call()+0x43) [0x4b0cb3]
69: ../env/bin/python() [0x4f492e]
70: (PyObject_Call()+0x43) [0x4b0cb3]
71: (PyEval_CallObjectWithKeywords()+0x30) [0x4ce5d0]
72: (_pyglib_handler_marshal()+0x39) [0x7f348a002759]
73: (()+0x4aab3) [0x7f348a24fab3]
74: (g_main_context_dispatch()+0x15a) [0x7f348a24f04a]
75: (()+0x4a3f0) [0x7f348a24f3f0]
76: (g_main_loop_run()+0xc2) [0x7f348a24f712]
77: (()+0xa534) [0x7f348a520534]
78: (PyEval_EvalFrameEx()+0x5780) [0x4c9780]
79: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
80: ../env/bin/python() [0x4de8b8]
81: (PyObject_Call()+0x43) [0x4b0cb3]
82: (PyEval_EvalFrameEx()+0x2ad1) [0x4c6ad1]
83: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
84: ../env/bin/python() [0x4de8b8]
85: (PyObject_Call()+0x43) [0x4b0cb3]
86: (PyEval_EvalFrameEx()+0x2ad1) [0x4c6ad1]
87: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
88: (PyEval_EvalFrameEx()+0x68d1) [0x4ca8d1]
89: (PyEval_EvalFrameEx()+0x5d8f) [0x4c9d8f]
90: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
91: (PyEval_EvalFrameEx()+0x6099) [0x4ca099]
92: (PyEval_EvalCodeEx()+0x255) [0x4c2765]
93: (PyEval_EvalCode()+0x19) [0x4c2509]
94: ../env/bin/python() [0x4f1def]
95: (PyRun_FileExFlags()+0x82) [0x4ec652]
96: (PyRun_SimpleFileExFlags()+0x191) [0x4eae31]
97: (Py_Main()+0x68a) [0x49e14a]
98: (__libc_start_main()+0xf0) [0x7f34b4b58830]
99: (_start()+0x29) [0x49d9d9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
[1] 17661 abort (core dumped)
</pre>
rbd - Bug #20223 (Resolved): rbd.ImageNotFound: __init__() takes exactly 3 positional arguments, ...
https://tracker.ceph.com/issues/20223
2017-06-08T11:46:01Z
Sebastian Wagner
<p>While investigating <a class="external" href="https://tracker.openattic.org/browse/OP-2311">https://tracker.openattic.org/browse/OP-2311</a>, I came across this lines:</p>
<pre>
File "rbd.pyx", line 390, in rbd.OSError.__init__ (ceph-12.0.3+git.1495798013.23dd2b67dc/build/src/pybind/rbd/pyrex/rbd.c:2257)
TypeError: ('__init__() takes exactly 3 positional arguments (1 given)', <class 'rbd.ImageNotFound'>, ())
</pre>
<p>This looks as if `rbd.ImageNotFound` is called with too few arguments.</p>