Bug #23483: "ENGINE Error in 'start' listener <bound " in rados - Ceph - Ceph

Actions

Copy link

Bug #23483

closed

"ENGINE Error in 'start' listener <bound " in rados

Added by Yuri Weinstein about 6 years ago. Updated about 6 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Category:

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

luminous

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

rados

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Run: http://pulpito.ceph.com/yuriw-2018-03-28_00:06:52-rados-wip-yuri5-testing-2018-03-27-1535-luminous-distro-basic-smithi/

Job: 2328902

Logs: http://qa-proxy.ceph.com/teuthology/yuriw-2018-03-28_00:06:52-rados-wip-yuri5-testing-2018-03-27-1535-luminous-distro-basic-smithi/2328902/teuthology.log

2018-03-28T00:18:24.338 INFO:teuthology.orchestra.run.smithi182:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json-pretty'
2018-03-28T00:18:24.433 INFO:tasks.ceph.mgr.y.smithi043.stderr:[28/Mar/2018:00:18:24] ENGINE Error in 'start' listener <bound method Server.start of <cherrypy._cpserver.Server object at 0x7fc0d42be310>>
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:Traceback (most recent call last):
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:  File "/usr/lib/python2.7/dist-packages/cherrypy/process/wspbus.py", line 205, in publish
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:    output.append(listener(*args, **kwargs))
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:  File "/usr/lib/python2.7/dist-packages/cherrypy/_cpserver.py", line 168, in start
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:    ServerAdapter.start(self)
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:  File "/usr/lib/python2.7/dist-packages/cherrypy/process/servers.py", line 170, in start
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:    wait_for_free_port(*self.bind_addr)
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:  File "/usr/lib/python2.7/dist-packages/cherrypy/process/servers.py", line 438, in wait_for_free_port
2018-03-28T00:18:24.434 INFO:tasks.ceph.mgr.y.smithi043.stderr:    raise IOError("Port %r not free on %r" % (port, host))
2018-03-28T00:18:24.435 INFO:tasks.ceph.mgr.y.smithi043.stderr:IOError: Port 9283 not free on '::'
2018-03-28T00:18:24.435 INFO:tasks.ceph.mgr.y.smithi043.stderr:
2018-03-28T00:18:24.435 INFO:tasks.ceph.mgr.y.smithi043.stderr:[28/Mar/2018:00:18:24] ENGINE Shutting down due to error in start listener:

Related issues 2 (0 open — 2 closed)

Actions

Copy link

Updated by Yuri Weinstein about 6 years ago

Related to Bug #20216: mgr: dashboard failure to bind to port 7000 (or whatever) makes mgr exit/fail added

Actions

Copy link

Updated by Yuri Weinstein about 6 years ago

maybe backport missing? see https://github.com/ceph/ceph/pull/15588

Actions

Copy link

Updated by Abhishek Lekshmanan about 6 years ago

The pr https://github.com/ceph/ceph/pull/15588 was included in https://github.com/ceph/ceph/pull/18675 as 728e1e4e136aab5b4d185c738de8df7bcdce18ee which is merged, so we may be seeing a new issue

Actions

Copy link

Updated by Yuri Weinstein about 6 years ago

suspect regression introduced by https://github.com/ceph/ceph/pull/21016

Actions

Copy link

Updated by Jan Fajerski about 6 years ago

Iiuc the test case ran on two machines, so one machine runs (at least) two mgr daemons? By default (i.e. if not otherwise configured) the prometheus module and its standby will try to bind to port 9283. So maybe just the test case needs fixing?

Actions

Copy link