Ceph » mgr » Dashboard

TI have a minikube VM running (v0.34.1), and attempted to deploy a bootstrap rook/ceph cluster on it (starting only a single mon and a single mgr), and a toolbox container. I'm using nautilus images and a fairly bleeding-edge rook image. Once it all came up, I exec'ed a shell in the toolbox and did a ceph status:

# ceph status
  cluster:
    id:     065b0695-9293-4153-831e-a11919a4fe96
    health: HEALTH_ERR
            Module 'dashboard' has failed: IOError("Port 8443 not bound on '::'",)

  services:
    mon: 1 daemons, quorum a (age 40m)
    mgr: a(active, since 8s)
    osd: 0 osds: 0 up, 0 in

  data:
    pools:   0 pools, 0 pgs
    objects: 0 objects, 0 B
    usage:   0 B used, 0 B / 0 B avail
    pgs:     

Looking at the mgr logs, I see some backtraces in cherrypy code:

debug 2019-02-20 18:10:33.391 7fb4e4f07700  0 log_channel(cluster) log [DBG] : pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail
debug 2019-02-20 18:10:35.392 7fb4e4f07700  0 log_channel(cluster) log [DBG] : pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail
[20/Feb/2019:18:10:35] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7fb4ed547ed0>>
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
    output.append(listener(*args, **kwargs))
  File "/usr/lib/python2.7/site-packages/cherrypy/_cpserver.py", line 151, in start
    ServerAdapter.start(self)
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 174, in start
    self.wait()
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 214, in wait
    wait_for_occupied_port(host, port)
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 427, in wait_for_occupied_port
    raise IOError("Port %r not bound on %r" % (port, host))
IOError: Port 8443 not bound on '::'

[20/Feb/2019:18:10:35] ENGINE Shutting down due to error in start listener:
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 235, in start
    self.publish('start')
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 215, in publish
    raise exc
ChannelFailures: IOError("Port 8443 not bound on '::'",)

[20/Feb/2019:18:10:35] ENGINE Bus STOPPING
[20/Feb/2019:18:10:35] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 8443)) already shut down
[20/Feb/2019:18:10:35] ENGINE Stopped thread '_TimeoutMonitor'.
[20/Feb/2019:18:10:35] ENGINE Bus STOPPED
[20/Feb/2019:18:10:35] ENGINE Bus EXITING
[20/Feb/2019:18:10:35] ENGINE Bus EXITED
debug 2019-02-20 18:10:35.833 7fb4e3704700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'dashboard' while running on mgr.a: IOError("Port 8443 not bound on '::'",)
debug 2019-02-20 18:10:35.833 7fb4e3704700 -1 dashboard.serve:
debug 2019-02-20 18:10:35.833 7fb4e3704700 -1 Traceback (most recent call last):
  File "/usr/share/ceph/mgr/dashboard/module.py", line 327, in serve
    cherrypy.engine.start()
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
    raise e_info
ChannelFailures: IOError("Port 8443 not bound on '::'",)

debug 2019-02-20 18:10:37.392 7fb4e4f07700  0 log_channel(cluster) log [DBG] : pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail
debug 2019-02-20 18:10:39.393 7fb4e4f07700  0 log_channel(cluster) log [DBG] : pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail

This all works on my other single-node, non-minikube cluster, so it may be due to some quirk of the networking under minikube. Still, the dashboard should handle such errors more gracefully in that case.