Project

General

Profile

Actions

Bug #21415

closed

OSD can't start

Added by Yi-AN Li over 6 years ago. Updated almost 3 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
leveldb
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

We use ceph version 0.80.9 (b5a67f0e1d15385bc0d60a6da6e7fc810bde6047) in production machine.

About machine information as following:

# cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=14.04
DISTRIB_CODENAME=trusty
DISTRIB_DESCRIPTION="Ubuntu 14.04.3 LTS" 

# uname -a
Linux node-5 3.13.0-65-generic #106-Ubuntu SMP Fri Oct 2 22:08:27 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

When I start osd.14, it start failed.

start ceph-osd id=14

Error messages as following:

...
2017-09-16 05:05:01.022849 7f6627dad800  0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-14) detect_feature: extsize is disabled by conf
2017-09-16 05:05:01.023877 7f6627dad800 -1 filestore(/var/lib/ceph/osd/ceph-14) Error initializing leveldb: Corruption: bad record length

2017-09-16 05:05:01.023904 7f6627dad800 -1  ** ERROR: error converting store /var/lib/ceph/osd/ceph-14: (1) Operation not permitted


About osd.14 information as following:
The folder for osd.14

The joural path for osd.14

I have execute some commands, but osd.14 still can't start.

# umount /var/lib/ceph/osd/ceph-14

# xfs_repair -L /dev/sdb2

I check other osd which it is in same machine.
osd.5 log:

Does osd.14 journal broken? Is this any risky process if I change osd.14 joural?

Any suggestion?

Thanks!


Files

error.png (15.7 KB) error.png Yi-AN Li, 09/16/2017 08:17 AM
info-2.png (2.62 KB) info-2.png Yi-AN Li, 09/16/2017 08:21 AM
info-1.png (9.43 KB) info-1.png Yi-AN Li, 09/16/2017 08:21 AM
info-3.png (17.1 KB) info-3.png Yi-AN Li, 09/16/2017 08:21 AM
osd.5_log.png (26.5 KB) osd.5_log.png Yi-AN Li, 09/16/2017 08:29 AM
Actions #1

Updated by Sage Weil almost 3 years ago

  • Status changed from New to Closed
Actions

Also available in: Atom PDF