Bug #37651
Updated by Sebastian Wagner over 5 years ago
<pre>
2018-12-10 16:46:27.962 7ff665c5e700 -1 Traceback (most recent call last):
File "/usr/lib64/ceph/mgr/prometheus/module.py", line 711, in serve
cherrypy.engine.start()
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
raise e_info
ChannelFailures: IOError("Port 9283 not bound on '::'",)
</pre>
and it also affects mgr/prometheus
<pre>
2018-12-10 16:46:27.962 7ff665c5e700 -1 Traceback (most recent call last):
File "/usr/lib64/ceph/mgr/prometheus/module.py", line 711, in serve
cherrypy.engine.start()
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
raise e_info
ChannelFailures: IOError("Port 9283 not bound on '::'",)
[10/Dec/2018:16:46:27] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7ff66b728590>>
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
output.append(listener(*args, **kwargs))
File "/usr/lib/python2.7/site-packages/cherrypy/_cpserver.py", line 151, in start
ServerAdapter.start(self)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 174, in start
self.wait()
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 214, in wait
wait_for_occupied_port(host, port)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 427, in wait_for_occupied_port
raise IOError("Port %r not bound on %r" % (port, host))
IOError: Port 8443 not bound on '::'
[10/Dec/2018:16:46:27] ENGINE Shutting down due to error in start listener:
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 235, in start
self.publish('start')
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 215, in publish
raise exc
ChannelFailures: IOError("Port 8443 not bound on '::'",)
</pre>
and
<pre>
2018-12-10 16:46:27.982 7ff666c60700 -1 Traceback (most recent call last):
File "/usr/lib64/ceph/mgr/dashboard/module.py", line 288, in serve
cherrypy.engine.start()
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
raise e_info
ChannelFailures: IOError("Port 8443 not bound on '::'",)
</pre>
and
<pre>
::ffff:10.244.3.31 - - [10/Dec/2018:16:46:25] "GET /metrics HTTP/1.1" 200 49184 "" "Prometheus/2.5.0"
2018-12-10 16:46:25.882 7ff677dbc700 0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91786600 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/summary HTTP/1.0" 200 215 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/dashboard/health HTTP/1.0" 200 27036 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET / HTTP/1.0" 200 1094 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/summary HTTP/1.0" 200 215 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/dashboard/health HTTP/1.0" 200 27023 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15"
2018-12-10 16:46:26.882 7ff6775bb700 0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91786c00 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
2018-12-10 16:46:27.454 7ff6705ad700 1 mgr send_beacon active
2018-12-10 16:46:27.882 7ff6775bb700 0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91787200 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
[10/Dec/2018:16:46:27] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7ff66a836710>>
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
output.append(listener(*args, **kwargs))
File "/usr/lib/python2.7/site-packages/cherrypy/_cpserver.py", line 151, in start
ServerAdapter.start(self)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 174, in start
self.wait()
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 214, in wait
wait_for_occupied_port(host, port)
File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 427, in wait_for_occupied_port
raise IOError("Port %r not bound on %r" % (port, host))
IOError: Port 9283 not bound on '::'
</pre>
Downstream issue [[https://github.com/rook/rook/issues/2335]]