Project

General

Profile

Actions
Copy link

Bug #23300

closed

ceph-mgr returns internal error

Added by Nico Schottelius about 6 years ago. Updated about 6 years ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
prometheus module
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
Ceph - v12.2.4
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Hello,

after some weeks of running a new ceph cluster, we get the following answer from the mgr:

black3.place6:~# curl http://[2a0a:e5c0:2:1:20d:b9ff:fe48:3bb8]:9283/metrics
<!DOCTYPE html PUBLIC
"-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
<title>500 Internal Server Error</title>
<style type="text/css">
#powered_by {
margin-top: 20px;
border-top: 2px solid black;
font-style: italic;
}

#traceback {
        color: red;
    }
    &lt;/style&gt;
&lt;/head&gt;
    &lt;body&gt;
        &lt;h2&gt;500 Internal Server Error&lt;/h2&gt;
        &lt;p&gt;The server encountered an unexpected condition which prevented it from fulfilling the request.&lt;/p&gt;
        
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/cherrypy/_cprequest.py", line 670, in respond
    response.body = self.handler()
  File "/usr/lib/python2.7/dist-packages/cherrypy/lib/encoding.py", line 217, in __call__
    self.body = self.oldhandler(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/cherrypy/_cpdispatch.py", line 61, in __call__
    return self.callable(*self.args, **self.kwargs)
  File "/usr/lib/ceph/mgr/prometheus/module.py", line 414, in metrics
    metrics = global_instance().collect()
  File "/usr/lib/ceph/mgr/prometheus/module.py", line 351, in collect
    self.get_metadata_and_osd_status()
  File "/usr/lib/ceph/mgr/prometheus/module.py", line 310, in get_metadata_and_osd_status
    dev_class['class'],
KeyError: 'class'


    &lt;div id=&quot;powered_by&quot;&gt;
      &lt;span&gt;
        Powered by &lt;a href=&quot;http://www.cherrypy.org&amp;quot;&amp;gt;CherryPy 3.5.0&lt;/a&gt;
      &lt;/span&gt;
    &lt;/div&gt;
    &lt;/body&gt;
&lt;/html&gt;

Changing / starting another mgr does not fix this problem.
Using 12.2.4-1~bpo90+1 on Devuan Ascii

Files

t.png (88.9 KB) t.png Nico Schottelius, 03/11/2018 07:19 PM
Actions
Copy link

Also available in: Atom PDF