Actions
Bug #8445
closedosd not starting anymore
Status:
Won't Fix
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
other
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Beside #8439 we seem to have another issue on some on our OSDs.
I'm attaching the full log of this session ( Duration : 8 seconds ) and the ceph-osd binary.
We have this issue on several OSDs.
-45> 2014-05-27 09:43:08.253660 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.16( v 11939'109606 (7408'106573,11939'109606] local-les=11938 n=953 ec=31 les/c 11938/11932 11937/11937/9963) [9,20,6] r=2 lpr=0 pi=7900-11936/144 crt=11936'109605 lcod 0'0 inactive NOTIFY] exit Initial 0.028802 0 0.000000
-44> 2014-05-27 09:43:08.253687 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.16( v 11939'109606 (7408'106573,11939'109606] local-les=11938 n=953 ec=31 les/c 11938/11932 11937/11937/9963) [9,20,6] r=2 lpr=0 pi=7900-11936/144 crt=11936'109605 lcod 0'0 inactive NOTIFY] enter Reset
-43> 2014-05-27 09:43:08.253960 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.18(unlocked)] enter Initial
-42> 2014-05-27 09:43:08.301312 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.18( v 11939'127157 lc 11902'127148 (7408'123880,11939'127157] local-les=11939 n=973 ec=31 les/c 11939/11508 11937/11938/7643) [21,6,4]/[21,6] r=1 lpr=0 pi=7466-11937/374 crt=11918'127150 lcod 0'0 inactive NOTIFY m=1] exit Initial 0.047351 0 0.000000
-41> 2014-05-27 09:43:08.301354 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.18( v 11939'127157 lc 11902'127148 (7408'123880,11939'127157] local-les=11939 n=973 ec=31 les/c 11939/11508 11937/11938/7643) [21,6,4]/[21,6] r=1 lpr=0 pi=7466-11937/374 crt=11918'127150 lcod 0'0 inactive NOTIFY m=1] enter Reset
-40> 2014-05-27 09:43:08.301594 7f53c5533780 5 osd.6 pg_epoch: 11938 pg[3.1b(unlocked)] enter Initial
-39> 2014-05-27 09:43:08.338508 7f53c5533780 5 osd.6 pg_epoch: 11938 pg[3.1b( v 11936'136889 lc 11901'136878 (7408'133559,11936'136889] local-les=11938 n=956 ec=31 les/c 11938/11903 11937/11937/11937) [6,20,4] r=0 lpr=0 pi=11900-11936/6 crt=11936'136889 lcod 0'0 mlcod 0'0 inactive m=4] exit Initial 0.036914 0 0.000000
-38> 2014-05-27 09:43:08.338539 7f53c5533780 5 osd.6 pg_epoch: 11938 pg[3.1b( v 11936'136889 lc 11901'136878 (7408'133559,11936'136889] local-les=11938 n=956 ec=31 les/c 11938/11903 11937/11937/11937) [6,20,4] r=0 lpr=0 pi=11900-11936/6 crt=11936'136889 lcod 0'0 mlcod 0'0 inactive m=4] enter Reset
-37> 2014-05-27 09:43:08.338816 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.1d(unlocked)] enter Initial
-36> 2014-05-27 09:43:08.367754 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.1d( v 11939'139049 (7849'136048,11939'139049] local-les=11938 n=1044 ec=31 les/c 11938/11939 11937/11937/9532) [11,6,21] r=1 lpr=0 pi=6272-11936/409 crt=11935'139044 lcod 0'0 inactive NOTIFY] exit Initial 0.028938 0 0.000000
-35> 2014-05-27 09:43:08.367785 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.1d( v 11939'139049 (7849'136048,11939'139049] local-les=11938 n=1044 ec=31 les/c 11938/11939 11937/11937/9532) [11,6,21] r=1 lpr=0 pi=6272-11936/409 crt=11935'139044 lcod 0'0 inactive NOTIFY] enter Reset
-34> 2014-05-27 09:43:08.368169 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.1e(unlocked)] enter Initial
-33> 2014-05-27 09:43:08.404123 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.1e( v 11928'97355 (7408'94121,11928'97355] local-les=11938 n=668 ec=31 les/c 11938/10841 11937/11937/7619) [20,6,11]/[20,6] r=1 lpr=0 pi=7466-11936/270 crt=11928'97355 lcod 0'0 inactive NOTIFY] exit Initial 0.035954 0 0.000000
-32> 2014-05-27 09:43:08.404150 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.1e( v 11928'97355 (7408'94121,11928'97355] local-les=11938 n=668 ec=31 les/c 11938/10841 11937/11937/7619) [20,6,11]/[20,6] r=1 lpr=0 pi=7466-11936/270 crt=11928'97355 lcod 0'0 inactive NOTIFY] enter Reset
-31> 2014-05-27 09:43:08.404402 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.20(unlocked)] enter Initial
-30> 2014-05-27 09:43:08.441841 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.20( v 11934'17455 (7447'14442,11934'17455] local-les=11938 n=37 ec=31 les/c 11938/11939 11937/11937/11937) [6,9,20] r=0 lpr=0 crt=11934'17455 lcod 0'0 mlcod 0'0 inactive] exit Initial 0.037440 0 0.000000
-29> 2014-05-27 09:43:08.441869 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.20( v 11934'17455 (7447'14442,11934'17455] local-les=11938 n=37 ec=31 les/c 11938/11939 11937/11937/11937) [6,9,20] r=0 lpr=0 crt=11934'17455 lcod 0'0 mlcod 0'0 inactive] enter Reset
-28> 2014-05-27 09:43:08.442178 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.2c(unlocked)] enter Initial
-27> 2014-05-27 09:43:08.477411 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.2c( v 11917'80146 lc 11874'80145 (7408'76448,11917'80146] lb 94d797ac/rbd_data.2992641f122bd.00000000000002f3/head//3 local-les=0 n=743 ec=31 les/c 11920/9840 11937/11937/7900) [20,6,9]/[20,1] r=-1 lpr=0 pi=7900-11936/626 crt=11917'80146 lcod 0'0 inactive NOTIFY m=1] exit Initial 0.035234 0 0.000000
-26> 2014-05-27 09:43:08.477444 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.2c( v 11917'80146 lc 11874'80145 (7408'76448,11917'80146] lb 94d797ac/rbd_data.2992641f122bd.00000000000002f3/head//3 local-les=0 n=743 ec=31 les/c 11920/9840 11937/11937/7900) [20,6,9]/[20,1] r=-1 lpr=0 pi=7900-11936/626 crt=11917'80146 lcod 0'0 inactive NOTIFY m=1] enter Reset
-25> 2014-05-27 09:43:08.477721 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.2e(unlocked)] enter Initial
-24> 2014-05-27 09:43:08.507672 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.2e( v 11920'87288 (6609'84090,11920'87288] lb c69a572e/rbd_data.2d106b8b4567.00000000000019c0/head//3 local-les=0 n=214 ec=31 les/c 11920/11916 11937/11937/11840) [6,11,21]/[11,21,2] r=-1 lpr=0 pi=10755-11936/153 crt=11920'87288 lcod 0'0 inactive NOTIFY] exit Initial 0.029952 0 0.000000
-23> 2014-05-27 09:43:08.507700 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.2e( v 11920'87288 (6609'84090,11920'87288] lb c69a572e/rbd_data.2d106b8b4567.00000000000019c0/head//3 local-les=0 n=214 ec=31 les/c 11920/11916 11937/11937/11840) [6,11,21]/[11,21,2] r=-1 lpr=0 pi=10755-11936/153 crt=11920'87288 lcod 0'0 inactive NOTIFY] enter Reset
-22> 2014-05-27 09:43:08.507905 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.2f(unlocked)] enter Initial
-21> 2014-05-27 09:43:08.537073 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.2f( v 11934'16316 lc 11934'16314 (7408'13260,11934'16316] local-les=11938 n=44 ec=31 les/c 11938/11932 11937/11937/11937) [6,16,21] r=0 lpr=0 pi=11919-11936/2 crt=11934'16316 lcod 0'0 mlcod 0'0 inactive m=2] exit Initial 0.029168 0 0.000000
-20> 2014-05-27 09:43:08.537104 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.2f( v 11934'16316 lc 11934'16314 (7408'13260,11934'16316] local-les=11938 n=44 ec=31 les/c 11938/11932 11937/11937/11937) [6,16,21] r=0 lpr=0 pi=11919-11936/2 crt=11934'16316 lcod 0'0 mlcod 0'0 inactive m=2] enter Reset
-19> 2014-05-27 09:43:08.537482 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.32(unlocked)] enter Initial
-18> 2014-05-27 09:43:08.582160 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.32( v 11936'183099 lc 11936'183098 (7408'180090,11936'183099] local-les=11938 n=977 ec=31 les/c 11938/11902 11937/11937/7617) [20,6,4] r=1 lpr=0 pi=7466-11936/461 crt=11936'183099 lcod 0'0 inactive NOTIFY m=1] exit Initial 0.044678 0 0.000000
-17> 2014-05-27 09:43:08.582190 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.32( v 11936'183099 lc 11936'183098 (7408'180090,11936'183099] local-les=11938 n=977 ec=31 les/c 11938/11902 11937/11937/7617) [20,6,4] r=1 lpr=0 pi=7466-11936/461 crt=11936'183099 lcod 0'0 inactive NOTIFY m=1] enter Reset
-16> 2014-05-27 09:43:08.582509 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.34(unlocked)] enter Initial
-15> 2014-05-27 09:43:08.617487 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.34( v 11918'18620 (7408'14955,11918'18620] lb 1c879334/rbd_data.22f76b8b4567.00000000000192c0/head//3 local-les=0 n=118 ec=31 les/c 11920/7943 11937/11937/8396) [9,6,20]/[11,1] r=-1 lpr=0 pi=6321-11936/651 crt=11918'18620 lcod 0'0 inactive NOTIFY] exit Initial 0.034978 0 0.000000
-14> 2014-05-27 09:43:08.617518 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.34( v 11918'18620 (7408'14955,11918'18620] lb 1c879334/rbd_data.22f76b8b4567.00000000000192c0/head//3 local-les=0 n=118 ec=31 les/c 11920/7943 11937/11937/8396) [9,6,20]/[11,1] r=-1 lpr=0 pi=6321-11936/651 crt=11918'18620 lcod 0'0 inactive NOTIFY] enter Reset
-13> 2014-05-27 09:43:08.617884 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.38(unlocked)] enter Initial
-12> 2014-05-27 09:43:08.652226 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.38( v 11918'166016 (7408'162390,11918'166016] lb b46f2338/rbd_data.2d625629f9720.000000000000014d/head//3 local-les=0 n=101 ec=31 les/c 11920/10013 11937/11937/10092) [6,16,20]/[20,2] r=-1 lpr=0 pi=10012-11936/210 crt=11918'166016 lcod 0'0 inactive NOTIFY] exit Initial 0.034343 0 0.000000
-11> 2014-05-27 09:43:08.652254 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.38( v 11918'166016 (7408'162390,11918'166016] lb b46f2338/rbd_data.2d625629f9720.000000000000014d/head//3 local-les=0 n=101 ec=31 les/c 11920/10013 11937/11937/10092) [6,16,20]/[20,2] r=-1 lpr=0 pi=10012-11936/210 crt=11918'166016 lcod 0'0 inactive NOTIFY] enter Reset
-10> 2014-05-27 09:43:08.652523 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.39(unlocked)] enter Initial
-9> 2014-05-27 09:43:08.691619 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.39( v 11818'40046 lc 11628'40012 (7408'36006,11818'40046] lb 4204ab9/rbd_data.331a857391c2a.00000000000000df/head//3 local-les=0 n=815 ec=31 les/c 11879/7956 11937/11937/11933) [4,6,11]/[2] r=-1 lpr=0 pi=7955-11936/625 crt=11818'40046 lcod 0'0 inactive NOTIFY m=6] exit Initial 0.039096 0 0.000000
-8> 2014-05-27 09:43:08.691648 7f53c5533780 5 osd.6 pg_epoch: 11937 pg[3.39( v 11818'40046 lc 11628'40012 (7408'36006,11818'40046] lb 4204ab9/rbd_data.331a857391c2a.00000000000000df/head//3 local-les=0 n=815 ec=31 les/c 11879/7956 11937/11937/11933) [4,6,11]/[2] r=-1 lpr=0 pi=7955-11936/625 crt=11818'40046 lcod 0'0 inactive NOTIFY m=6] enter Reset
-7> 2014-05-27 09:43:08.691879 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.3b(unlocked)] enter Initial
-6> 2014-05-27 09:43:08.723569 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.3b( v 11934'251826 lc 11932'251822 (7447'248790,11934'251826] local-les=11938 n=955 ec=31 les/c 11938/11932 11937/11937/11937) [6,21,9] r=0 lpr=0 pi=11919-11936/2 crt=11934'251826 lcod 0'0 mlcod 0'0 inactive m=4] exit Initial 0.031689 0 0.000000
-5> 2014-05-27 09:43:08.723597 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.3b( v 11934'251826 lc 11932'251822 (7447'248790,11934'251826] local-les=11938 n=955 ec=31 les/c 11938/11932 11937/11937/11937) [6,21,9] r=0 lpr=0 pi=11919-11936/2 crt=11934'251826 lcod 0'0 mlcod 0'0 inactive m=4] enter Reset
-4> 2014-05-27 09:43:08.723862 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.3e(unlocked)] enter Initial
-3> 2014-05-27 09:43:08.766302 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.3e( v 11939'209893 lc 11932'209889 (7408'206568,11939'209893] local-les=11938 n=977 ec=31 les/c 11938/10840 11937/11937/11937) [6,21,16]/[6,21] r=0 lpr=0 pi=10839-11936/78 crt=11933'209892 lcod 0'0 mlcod 0'0 inactive m=3] exit Initial 0.042441 0 0.000000
-2> 2014-05-27 09:43:08.766339 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.3e( v 11939'209893 lc 11932'209889 (7408'206568,11939'209893] local-les=11938 n=977 ec=31 les/c 11938/10840 11937/11937/11937) [6,21,16]/[6,21] r=0 lpr=0 pi=10839-11936/78 crt=11933'209892 lcod 0'0 mlcod 0'0 inactive m=3] enter Reset
-1> 2014-05-27 09:43:08.766631 7f53c5533780 5 osd.6 pg_epoch: 11939 pg[3.41(unlocked)] enter Initial
0> 2014-05-27 09:43:08.806967 7f53c5533780 -1 osd/PGLog.cc: In function 'static bool PGLog::read_log(ObjectStore*, coll_t, hobject_t, const pg_info_t&, std::map<eversion_t, hobject_t>&, PGLog::IndexedLog&, pg_missing_t&, std::ostringstream&, std::set<std::basic_string<char> >*)' thread 7f53c5533780 time 2014-05-27 09:43:08.805110
osd/PGLog.cc: 808: FAILED assert(last_e.version.version < e.version.version)
ceph version 0.78 (f6c746c314d7b87b8419b6e584c94bfe4511dbd4)
1: (PGLog::read_log(ObjectStore*, coll_t, hobject_t, pg_info_t const&, std::map<eversion_t, hobject_t, std::less<eversion_t>, std::allocator<std::pair<eversion_t const, hobject_t> > >&, PGLog::IndexedLog&, pg_missing_t&, std::basic_ostringstream<char, std::char_traits<char>, std::allocator<char> >&, std::set<std::string, std::less<std::string>, std::allocator<std::string> >*)+0x1867) [0x94c4a7]
2: (PGLog::read_log(ObjectStore*, coll_t, hobject_t, pg_info_t const&, std::basic_ostringstream<char, std::char_traits<char>, std::allocator<char> >&)+0xa1) [0x91cd21]
3: (PG::read_state(ObjectStore*, ceph::buffer::list&)+0x103) [0x909a73]
4: (OSD::load_pgs()+0x782) [0x773762]
5: (OSD::init()+0x15e9) [0x777d99]
6: (main()+0x2360) [0x7214a0]
7: (__libc_start_main()+0xf5) [0x7f53c3186bf5]
8: ceph-osd() [0x7250d9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 keyvaluestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
max_recent 10000
max_new 1000
log_file /var/log/ceph/ceph-osd.6.log
--- end dump of recent events ---
2014-05-27 09:43:08.825673 7f53c5533780 -1 *** Caught signal (Aborted) **
in thread 7f53c5533780
ceph version 0.78 (f6c746c314d7b87b8419b6e584c94bfe4511dbd4)
1: ceph-osd() [0xa884dd]
2: (()+0x10b10) [0x7f53c4d18b10]
3: (gsignal()+0x35) [0x7f53c319a535]
4: (abort()+0x148) [0x7f53c319b9b8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f53c3a8696d]
6: (()+0x63a66) [0x7f53c3a84a66]
7: (()+0x63a93) [0x7f53c3a84a93]
8: (()+0x63cbe) [0x7f53c3a84cbe]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x42a) [0xb5d13a]
10: (PGLog::read_log(ObjectStore*, coll_t, hobject_t, pg_info_t const&, std::map<eversion_t, hobject_t, std::less<eversion_t>, std::allocator<std::pair<eversion_t const, hobject_t> > >&, PGLog::IndexedLog&, pg_missing_t&, std::basic_ostringstream<char, std::char_traits<char>, std::allocator<char> >&, std::set<std::string, std::less<std::string>, std::allocator<std::string> >*)+0x1867) [0x94c4a7]
11: (PGLog::read_log(ObjectStore*, coll_t, hobject_t, pg_info_t const&, std::basic_ostringstream<char, std::char_traits<char>, std::allocator<char> >&)+0xa1) [0x91cd21]
12: (PG::read_state(ObjectStore*, ceph::buffer::list&)+0x103) [0x909a73]
13: (OSD::load_pgs()+0x782) [0x773762]
14: (OSD::init()+0x15e9) [0x777d99]
15: (main()+0x2360) [0x7214a0]
16: (__libc_start_main()+0xf5) [0x7f53c3186bf5]
17: ceph-osd() [0x7250d9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- begin dump of recent events ---
0> 2014-05-27 09:43:08.825673 7f53c5533780 -1 *** Caught signal (Aborted) **
in thread 7f53c5533780
ceph version 0.78 (f6c746c314d7b87b8419b6e584c94bfe4511dbd4)
1: ceph-osd() [0xa884dd]
2: (()+0x10b10) [0x7f53c4d18b10]
3: (gsignal()+0x35) [0x7f53c319a535]
4: (abort()+0x148) [0x7f53c319b9b8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f53c3a8696d]
6: (()+0x63a66) [0x7f53c3a84a66]
7: (()+0x63a93) [0x7f53c3a84a93]
8: (()+0x63cbe) [0x7f53c3a84cbe]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x42a) [0xb5d13a]
10: (PGLog::read_log(ObjectStore*, coll_t, hobject_t, pg_info_t const&, std::map<eversion_t, hobject_t, std::less<eversion_t>, std::allocator<std::pair<eversion_t const, hobject_t> > >&, PGLog::IndexedLog&, pg_missing_t&, std::basic_ostringstream<char, std::char_traits<char>, std::allocator<char> >&, std::set<std::string, std::less<std::string>, std::allocator<std::string> >*)+0x1867) [0x94c4a7]
11: (PGLog::read_log(ObjectStore*, coll_t, hobject_t, pg_info_t const&, std::basic_ostringstream<char, std::char_traits<char>, std::allocator<char> >&)+0xa1) [0x91cd21]
12: (PG::read_state(ObjectStore*, ceph::buffer::list&)+0x103) [0x909a73]
13: (OSD::load_pgs()+0x782) [0x773762]
14: (OSD::init()+0x15e9) [0x777d99]
15: (main()+0x2360) [0x7214a0]
16: (__libc_start_main()+0xf5) [0x7f53c3186bf5]
17: ceph-osd() [0x7250d9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 keyvaluestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
max_recent 10000
max_new 1000
log_file /var/log/ceph/ceph-osd.6.log
--- end dump of recent events ---
Files
Updated by Sage Weil almost 10 years ago
- Status changed from New to 4
This looks like a bug we fixed in firefly. If you don't need these OSDs to recover, I suggest upgrading and replacing them. If you do, there is a patch that just skips this assert and usually works.
Updated by Pierre Grandin almost 10 years ago
Thank you Sage.
Tyler pointed me to this patch, we are testing it.
Updated by Sage Weil over 9 years ago
- Project changed from rbd to Ceph
- Status changed from 4 to Won't Fix
0.78 had lots of issues; see 0.80.x
Actions