Project

General

Profile

Bug #37651

Container, Mimic: Unable to open CherryPy port

Added by Sebastian Wagner almost 2 years ago. Updated over 1 year ago.

Status:
Can't reproduce
Priority:
Normal
Assignee:
-
Category:
dashboard/backend
Target version:
-
% Done:

100%

Source:
Community (dev)
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

2018-12-10 16:46:27.962 7ff665c5e700 -1 Traceback (most recent call last):
  File "/usr/lib64/ceph/mgr/prometheus/module.py", line 711, in serve
    cherrypy.engine.start()
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
    raise e_info
ChannelFailures: IOError("Port 9283 not bound on '::'",)

and it also affects mgr/prometheus

2018-12-10 16:46:27.962 7ff665c5e700 -1 Traceback (most recent call last):
  File "/usr/lib64/ceph/mgr/prometheus/module.py", line 711, in serve
    cherrypy.engine.start()
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
    raise e_info
ChannelFailures: IOError("Port 9283 not bound on '::'",)

[10/Dec/2018:16:46:27] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7ff66b728590>>
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
    output.append(listener(*args, **kwargs))
  File "/usr/lib/python2.7/site-packages/cherrypy/_cpserver.py", line 151, in start
    ServerAdapter.start(self)
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 174, in start
    self.wait()
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 214, in wait
    wait_for_occupied_port(host, port)
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 427, in wait_for_occupied_port
    raise IOError("Port %r not bound on %r" % (port, host))
IOError: Port 8443 not bound on '::'

[10/Dec/2018:16:46:27] ENGINE Shutting down due to error in start listener:
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 235, in start
    self.publish('start')
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 215, in publish
    raise exc
ChannelFailures: IOError("Port 8443 not bound on '::'",)

and

2018-12-10 16:46:27.982 7ff666c60700 -1 Traceback (most recent call last):
  File "/usr/lib64/ceph/mgr/dashboard/module.py", line 288, in serve
    cherrypy.engine.start()
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 250, in start
    raise e_info
ChannelFailures: IOError("Port 8443 not bound on '::'",)

and

::ffff:10.244.3.31 - - [10/Dec/2018:16:46:25] "GET /metrics HTTP/1.1" 200 49184 "" "Prometheus/2.5.0" 
2018-12-10 16:46:25.882 7ff677dbc700  0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91786600 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/summary HTTP/1.0" 200 215 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15" 
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/dashboard/health HTTP/1.0" 200 27036 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15" 
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET / HTTP/1.0" 200 1094 "" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15" 
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/summary HTTP/1.0" 200 215 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15" 
::ffff:10.244.0.0 - - [10/Dec/2018:16:46:26] "GET /api/dashboard/health HTTP/1.0" 200 27023 "https://krs-m.s3.ua/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.1 Safari/605.1.15" 
2018-12-10 16:46:26.882 7ff6775bb700  0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91786c00 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
2018-12-10 16:46:27.454 7ff6705ad700  1 mgr send_beacon active
2018-12-10 16:46:27.882 7ff6775bb700  0 -- 10.244.2.31:6800/1 >> 10.244.2.31:0/3852671633 conn(0x563d91787200 :6800 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=1).handle_connect_msg: challenging authorizer
[10/Dec/2018:16:46:27] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7ff66a836710>>
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/cherrypy/process/wspbus.py", line 197, in publish
    output.append(listener(*args, **kwargs))
  File "/usr/lib/python2.7/site-packages/cherrypy/_cpserver.py", line 151, in start
    ServerAdapter.start(self)
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 174, in start
    self.wait()
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 214, in wait
    wait_for_occupied_port(host, port)
  File "/usr/lib/python2.7/site-packages/cherrypy/process/servers.py", line 427, in wait_for_occupied_port
    raise IOError("Port %r not bound on %r" % (port, host))
IOError: Port 9283 not bound on '::'

Downstream issue [[https://github.com/rook/rook/issues/2335]]


Related issues

Duplicated by mgr - Bug #38411: Under rook+minikube: HEALTH_ERR: Module 'dashboard' has failed: IOError("Port 8443 not bound on '::'",) Can't reproduce

History

#1 Updated by Sebastian Wagner almost 2 years ago

  • Description updated (diff)

#2 Updated by Lenz Grimmer almost 2 years ago

  • Status changed from New to Can't reproduce

Resolving as "Can't reproduce" per our discussion during the bug scrub.

#3 Updated by Jeff Layton over 1 year ago

  • Duplicated by Bug #38411: Under rook+minikube: HEALTH_ERR: Module 'dashboard' has failed: IOError("Port 8443 not bound on '::'",) added

Also available in: Atom PDF