Project

General

Profile

Actions

Bug #55142

closed

[ERR] : Unhandled exception from module 'devicehealth' while running on mgr.gibba002.nzpbzu: disk I/O error

Added by Vikhyat Umrao about 2 years ago. Updated about 1 year ago.

Status:
Duplicate
Priority:
Normal
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
pacific, quincy
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

022-03-31T00:15:17.829+0000 7fcf56511700  0 [balancer INFO root] ceph osd pg-upmap-items 204.c4d mappings [{'from': 878, 'to': 191}]
2022-03-31T00:15:18.419+0000 7fcf49cf8700 -1 client.1735696: SimpleRADOSStriper: lock: main.db:  lock failed: (108) Cannot send after transport endpoint shutdown
2022-03-31T00:15:18.419+0000 7fcf49cf8700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'devicehealth' while running on mgr.gibba002.nzpbzu: disk I/O er
ror
2022-03-31T00:15:18.419+0000 7fcf49cf8700 -1 devicehealth.serve:
2022-03-31T00:15:18.419+0000 7fcf49cf8700 -1 Traceback (most recent call last):
  File "/usr/share/ceph/mgr/devicehealth/module.py", line 373, in serve
    self.scrape_all()
  File "/usr/share/ceph/mgr/devicehealth/module.py", line 425, in scrape_all
    self.put_device_metrics(device, data)
  File "/usr/share/ceph/mgr/devicehealth/module.py", line 500, in put_device_metrics
    self._create_device(devid)
  File "/usr/share/ceph/mgr/devicehealth/module.py", line 487, in _create_device
    cursor = self.db.execute(SQL, (devid,))
sqlite3.OperationalError: disk I/O error

2022-03-31T00:15:18.568+0000 7fcff717d700 -1 mgr handle_mgr_map I was active but no longer am
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  e: '/usr/bin/ceph-mgr'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  0: '/usr/bin/ceph-mgr'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  1: '-n'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  2: 'mgr.gibba002.nzpbzu'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  3: '-f'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  4: '--setuser'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  5: 'ceph'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  6: '--setgroup'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  7: 'ceph'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  8: '--default-log-to-file=false'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  9: '--default-log-to-journald=true'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  10: '--default-log-to-stderr=false'
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn respawning with exe /usr/bin/ceph-mgr
2022-03-31T00:15:18.568+0000 7fcff717d700  1 mgr respawn  exe_path /proc/self/exe
2022-03-31T00:15:19.967+0000 7f2c2da44000  0 ceph version 17.1.0-138-g723fda64 (723fda64a662bb79871e590698268007049bcf7f) quincy (stable), process ceph-mgr, pid 8
2022-03-31T00:15:19.967+0000 7f2c2da44000  0 pidfile_write: ignore empty --pid-file
2022-03-31T00:15:21.569+0000 7f2c2da44000  1 mgr[py] Loading python module 'mirroring'
2022-03-31T00:15:22.569+0000 7f2c2da44000  1 mgr[py] Loading python module 'stats'

Related issues 1 (0 open1 closed)

Is duplicate of cephsqlite - Bug #55606: [ERR] Unhandled exception from module ''devicehealth'' while running on mgr.y: unknownResolvedPatrick Donnelly

Actions
Actions

Also available in: Atom PDF