Project

General

Profile

Actions
Copy link

Bug #23875

closed

Removal of snapshot with corrupt replica crashes osd

Added by David Zafman almost 6 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
22476
Crash signature (v1):
Crash signature (v2):

Description

This may be a completely legitimate crash due to the curruption.

See pending test case TEST_scrub_snaps_replica in osd-scrub-snaps.sh:

2018-04-25 14:50:14.797 7f06b8852700 20 osd.0 op_wq(0) _process OpQueueItem(1.0 PGOpItem(op=osd_repop(osd.1.0:0 1.0 e26/23) v2) prio 127 cost 1041 e26) queued
2018-04-25 14:50:14.797 7f06b8852700 20 osd.0 op_wq(0) _process 1.0 to_process <OpQueueItem(1.0 PGOpItem(op=osd_repop(osd.1.0:0 1.0 e26/23) v2) prio 127 cost 1041 e26)> waiting <> waiting_peering {26=<OpQueueItem(1.0 PGPeeringEvent(epoch_sent: 26 epoch_requested: 26 MInfoRec from 1 info: 1.0( v 19'53 (0'0,19'53] local-lis/les=23/24 n=34 ec=10/10 lis/c 23/23 les/c/f 24/24/0 23/23/23)) prio 255 cost 10 e26)>}
2018-04-25 14:50:14.797 7f06b8852700 20 osd.0 op_wq(0) _process OpQueueItem(1.0 PGOpItem(op=osd_repop(osd.1.0:0 1.0 e26/23) v2) prio 127 cost 1041 e26) pg 0x557a76acd400
2018-04-25 14:50:14.797 7f06b8852700 10 osd.0 25 dequeue_op 0x557a77272a80 prio 127 cost 1041 latency 0.000145 osd_repop(osd.1.0:0 1.0 e26/23) v2 pg pg[1.0( v 19'53 (0'0,19'53] local-lis/les=23/24 n=34 ec=10/10 lis/c 23/23 les/c/f 24/24/0 23/23/23) [1,0] r=1 lpr=23 luod=0'0 crt=19'53 lcod 0'0 active mbc={}]
2018-04-25 14:50:14.797 7f06b8852700 20 osd.0 25 share_map osd.1 127.0.0.1:6806/570 26
2018-04-25 14:50:14.797 7f06b8852700 20 osd.0 25 should_share_map osd.1 127.0.0.1:6806/570 26
2018-04-25 14:50:14.797 7f06b8852700 10 osd.0 pg_epoch: 25 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=23/24 n=34 ec=10/10 lis/c 23/23 les/c/f 24/24/0 23/23/23) [1,0] r=1 lpr=23 luod=0'0 crt=19'53 lcod 0'0 active mbc={}] _handle_message: 0x557a77272a80
2018-04-25 14:50:14.797 7f06b8852700 10 osd.0 pg_epoch: 25 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=23/24 n=34 ec=10/10 lis/c 23/23 les/c/f 24/24/0 23/23/23) [1,0] r=1 lpr=23 luod=0'0 crt=19'53 lcod 0'0 active mbc={}] do_repop 1:ee9ae150:::obj4:7 v 26'55 (transaction) 328
2018-04-25 14:50:14.797 7f06b8852700 20 snap_mapper.update_snaps 1:ee9ae150:::obj4:7 3,4,5,6,7 was
2018-04-25 14:50:14.797 7f06b8852700 20 snap_mapper.get_snaps 1:ee9ae150:::obj4:7 got.empty()
2018-04-25 14:50:14.797 7f06b8852700 -1 /home/dzafman/ceph/src/osd/PG.cc: In function 'void PG::update_snap_map(const std::vector<pg_log_entry_t>&, ObjectStore::Transaction&)' thread 7f06b8852700 time 2018-04-25 14:50:14.800145
/home/dzafman/ceph/src/osd/PG.cc: 3851: FAILED assert(r == 0)

#0  0x00007f2b59bfa269 in raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/pt-raise.c:35
#1  0x000055c638a3db1e in reraise_fatal (signum=6) at /home/dzafman/ceph/src/global/signal_handler.cc:74
#2  handle_fatal_signal (signum=6) at /home/dzafman/ceph/src/global/signal_handler.cc:138
#3  <signal handler called>
#4  0x00007f2b58da9428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#5  0x00007f2b58dab02a in __GI_abort () at abort.c:89
#6  0x00007f2b5b0fae2b in ceph::__ceph_assert_fail (assertion=<optimized out>, file=<optimized out>, line=<optimized out>, func=<optimized out>)
    at /home/dzafman/ceph/src/common/assert.cc:66
#7  0x00007f2b5b0fae97 in ceph::__ceph_assert_fail (ctx=...) at /home/dzafman/ceph/src/common/assert.cc:71
#8  0x000055c63859e33b in PG::update_snap_map (this=0x55c63ae75400, log_entries=std::vector of length 2, capacity 2 = {...}, t=...) at /home/dzafman/ceph/src/osd/PG.cc:3851
#9  0x000055c6385c4b71 in PG::append_log (this=0x55c63ae75400, logv=std::vector of length 2, capacity 2 = {...}, trim_to=..., roll_forward_to=..., t=..., transaction_applied=true)
    at /home/dzafman/ceph/src/osd/PG.cc:3604
#10 0x000055c6386b7403 in non-virtual thunk to PrimaryLogPG::log_operation(std::vector<pg_log_entry_t, std::allocator<pg_log_entry_t> > const&, boost::optional<pg_hit_set_history_t> const&, eversion_t const&, eversion_t const&, bool, ObjectStore::Transaction&) ()
#11 0x000055c6387d4a79 in ReplicatedBackend::do_repop (this=this@entry=0x55c63a99f680, op=...) at /home/dzafman/ceph/src/osd/ReplicatedBackend.cc:1065
#12 0x000055c6387d7327 in ReplicatedBackend::_handle_message (this=0x55c63a99f680, op=...) at /home/dzafman/ceph/src/osd/ReplicatedBackend.cc:203
#13 0x000055c6386ebf87 in PGBackend::handle_message (this=<optimized out>, op=...) at /home/dzafman/ceph/src/osd/PGBackend.cc:114
#14 0x000055c63869b8ed in PrimaryLogPG::do_request (this=0x55c63ae75400, op=..., handle=...) at /home/dzafman/ceph/src/osd/PrimaryLogPG.cc:1794
#15 0x000055c6384fef08 in OSD::dequeue_op (this=this@entry=0x55c63ae72000, pg=..., op=..., handle=...) at /home/dzafman/ceph/src/osd/OSD.cc:8905
#16 0x000055c63876fc22 in PGOpItem::run (this=<optimized out>, osd=0x55c63ae72000, sdata=<optimized out>, pg=..., handle=...) at /home/dzafman/ceph/src/osd/OpQueueItem.cc:24
#17 0x000055c63851c2a4 in OpQueueItem::run (handle=..., pg=..., sdata=<optimized out>, osd=<optimized out>, this=0x7f2b3afa80e0) at /home/dzafman/ceph/src/osd/OpQueueItem.h:134
#18 OSD::ShardedOpWQ::_process (this=<optimized out>, thread_index=<optimized out>, hb=<optimized out>) at /home/dzafman/ceph/src/osd/OSD.cc:9909
#19 0x00007f2b5b0ffc7e in ShardedThreadPool::shardedthreadpool_worker (this=0x55c63ae729c8, thread_index=0) at /home/dzafman/ceph/src/common/WorkQueue.cc:339
#20 0x00007f2b5b101d00 in ShardedThreadPool::WorkThreadSharded::entry (this=<optimized out>) at /home/dzafman/ceph/src/common/WorkQueue.h:690
#21 0x00007f2b59bf06ba in start_thread (arg=0x7f2b3afad700) at pthread_create.c:333
#22 0x00007f2b58e7a82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109

Related issues 1 (0 open — 1 closed)

Related to Ceph - Bug #24396: osd crashes in on_local_recover due to stray cloneResolved06/04/2018

Actions
Actions
Copy link
 #1

Updated by David Zafman almost 6 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by David Zafman almost 6 years ago

  • Related to Bug #24396: osd crashes in on_local_recover due to stray clone added
Actions
Copy link
 #3

Updated by David Zafman almost 6 years ago

If update_snap_map() ignores the error from remove_oid() we still crash because an op from the primary related to the missing clone fails. To reproduce this I modify qa/standalone/scrub/osd-scrub-snaps.sh:

diff --git a/qa/standalone/scrub/osd-scrub-snaps.sh b/qa/standalone/scrub/osd-scrub-snaps.sh
index fe22681..ac2d207 100755
--- a/qa/standalone/scrub/osd-scrub-snaps.sh
+++ b/qa/standalone/scrub/osd-scrub-snaps.sh
@@ -1118,15 +1118,10 @@ fi
         pids+="$(cat $pidfile) " 
     done

-    # When removing snapshots with a corrupt replica, it crashes.
-    # See http://tracker.ceph.com/issues/23875
-    if [ $which = "primary" ];
-    then
-        for i in `seq 1 7`
-        do
-            rados -p $poolname rmsnap snap$i
-        done
-    fi
+    for i in `seq 1 7`
+    do
+        rados -p $poolname rmsnap snap$i
+    done

     ERRORS=0

diff --git a/src/osd/PG.cc b/src/osd/PG.cc
index 97564c3..de9e02c 100644
--- a/src/osd/PG.cc
+++ b/src/osd/PG.cc
@@ -3831,7 +3831,8 @@ void PG::update_snap_map(
        int r = snap_mapper.remove_oid(
          i->soid,
          &_t);
-       assert(r == 0);
+       if (r != 0)
+         derr << __func__ << " remove_oid " << i->soid << " failed with " << r << dendl;
       } else if (i->is_update()) {
        assert(i->snaps.length() > 0);
        vector<snapid_t> snaps;

2018-06-04 18:52:32.723 7f1c8ecce700 -1 filestore(td/osd-scrub-snaps/0)  error (2) No such file or directory not handled on operation 0x55f16a17e2d9 (91.1.0, or op 0, counting from 0)
2018-06-04 18:52:32.723 7f1c8ecce700  0 filestore(td/osd-scrub-snaps/0) unexpected error code

2018-06-04 18:52:32.723 7f1c8ecce700  0 filestore(td/osd-scrub-snaps/0)  transaction dump:
{
    "ops": [
        {
            "op_num": 0,
            "op_name": "setattrs",
            "collection": "1.0_head",
            "oid": "#1:0ee9ae15:::obj4:7#",
            "attr_lens": {
                "_": 236
            }
        },
        {
            "op_num": 1,
            "op_name": "setattrs",
            "collection": "1.0_head",
            "oid": "#1:0ee9ae15:::obj4:head#",
            "attr_lens": {
                "_": 259,
                "snapset": 179
            }
        }
    ]
}

2018-06-04 18:52:32.723 7f1c8ecce700 -1 /home/dzafman/ceph/src/os/filestore/FileStore.cc: In function 'void FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int, ThreadPool::TPHandle*, const char*)' thread 7f1c8ecce700 time 2018-06-04 18:52:32.725050
/home/dzafman/ceph/src/os/filestore/FileStore.cc: 3236: FAILED assert(0 == "unexpected error")

 ceph version 14.0.0-238-ga799ae4 (a799ae45e6df97cb1a8f0150c6395b18006625a5) nautilus (dev)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f1ca0458d82]
 2: (()+0x29af57) [0x7f1ca0458f57]
 3: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int, ThreadPool::TPHandle*, char const*)+0xc45) [0x55f166b2c245]
 4: (FileStore::_do_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, unsigned long, ThreadPool::TPHandle*, char const*)+0x48) [0x55f166b32298]
 5: (FileStore::_do_op(FileStore::OpSequencer*, ThreadPool::TPHandle&)+0x145) [0x55f166b32415]
 6: (ThreadPool::worker(ThreadPool::WorkThread*)+0x8f7) [0x7f1ca045eeb7]
 7: (ThreadPool::WorkThread::entry()+0x10) [0x7f1ca045fde0]
 8: (()+0x76ba) [0x7f1c9eb2b6ba]
 9: (clone()+0x6d) [0x7f1c9db9b82d]

The primary was doing a snap trim:

2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] SnapTrimmer state<Trimming/AwaitAsyncWork>: AwaitAsyncWork react trimming 1:ee9ae150:::obj4:7
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] get_object_context: obc NOT found in cache: 1:ee9ae150:::obj4:7
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] populate_obc_watchers 1:ee9ae150:::obj4:7
2018-06-04 18:52:32.719 7fb510558700 20 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] PrimaryLogPG::check_blacklisted_obc_watchers for obc 1:ee9ae150:::obj4:7
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] get_object_context: 0x55951a003c80 1:ee9ae150:::obj4:7 rwstate(none n=0 w=0) oi: 1:ee9ae150:::obj4:7(19'50 client.4164.0:1 dirty|data_digest s 1032 uv 4 dd ded3dc99 alloc_hint [0 0 0]) exists: 1 ssc: 0x55951a3f3700 snapset: 7=[7,6,5,4,3,2,1]:{7=[7,6,5,4,3,2,1]}
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] get_object_context: obc NOT found in cache: 1:ee9ae150:::obj4:head
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] populate_obc_watchers 1:ee9ae150:::obj4:head
2018-06-04 18:52:32.719 7fb510558700 20 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] PrimaryLogPG::check_blacklisted_obc_watchers for obc 1:ee9ae150:::obj4:head
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] get_object_context: 0x55951a40d080 1:ee9ae150:::obj4:head rwstate(none n=0 w=0) oi: 1:ee9ae150:::obj4:head(19'51 client.4278.0:1 whiteout|dirty s 0 uv 51 alloc_hint [0 0 0]) exists: 1 ssc: 0x55951a3f3700 snapset: 7=[7,6,5,4,3,2,1]:{7=[7,6,5,4,3,2,1]}
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] 1:ee9ae150:::obj4:7 old_snaps 1,2,3,4,5,6,7 old snapset 7=[7,6,5,4,3,2,1]:{7=[7,6,5,4,3,2,1]}
2018-06-04 18:52:32.719 7fb510558700 20 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] simple_opc_create 1:ee9ae150:::obj4:7
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] 1:ee9ae150:::obj4:7 snaps 1,2,3,4,5,6,7 -> 2,3,4,5,6,7
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] 1:ee9ae150:::obj4:7 new snapset 7=[7,6,5,4,3,2,1]:{7=[7,6,5,4,3,2]} on 1:ee9ae150:::obj4:head(19'51 client.4278.0:1 whiteout|dirty s 0 uv 51 alloc_hint [0 0 0])
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] 1:ee9ae150:::obj4:7 filtering snapset on 1:ee9ae150:::obj4:head
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] 1:ee9ae150:::obj4:7 writing updated snapset on 1:ee9ae150:::obj4:head, snapset is 7=[7,6,5,4,3,2]:{7=[7,6,5,4,3,2]}
2018-06-04 18:52:32.719 7fb510558700  7 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] issue_repop rep_tid 0 o 1:ee9ae150:::obj4:7
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 19'53 (0'0,19'53] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] append_log log((0'0,19'53], crt=19'53) [26'54 (19'50) modify   1:ee9ae150:::obj4:7 by unknown.0.0:0 2018-06-04 18:52:32.722708 0 snaps [2,3,4,5,6,7],26'55 (19'51) modify   1:ee9ae150:::obj4:head by unknown.0.0:0 2018-06-04 18:52:32.722708 0]
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 26'54 (0'0,26'54] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 luod=19'53 lua=19'53 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] add_log_entry 26'54 (19'50) modify   1:ee9ae150:::obj4:7 by unknown.0.0:0 2018-06-04 18:52:32.722708 0 snaps [2,3,4,5,6,7]
2018-06-04 18:52:32.719 7fb510558700 10 osd.1 pg_epoch: 26 pg[1.0( v 26'55 (0'0,26'55] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 luod=19'53 lua=19'53 crt=19'53 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] add_log_entry 26'55 (19'51) modify   1:ee9ae150:::obj4:head by unknown.0.0:0 2018-06-04 18:52:32.722708 0
2018-06-04 18:52:32.719 7fb510558700 20 osd.1 pg_epoch: 26 pg[1.0( v 26'55 (0'0,26'55] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 luod=19'53 lua=19'53 crt=26'55 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] rollforward: entry=26'54 (19'50) modify   1:ee9ae150:::obj4:7 by unknown.0.0:0 2018-06-04 18:52:32.722708 0 snaps [2,3,4,5,6,7]
2018-06-04 18:52:32.719 7fb510558700 20 osd.1 pg_epoch: 26 pg[1.0( v 26'55 (0'0,26'55] local-lis/les=24/25 n=34 ec=10/10 lis/c 24/24 les/c/f 25/25/0 24/24/24) [1,0] r=0 lpr=24 luod=19'53 lua=19'53 crt=26'55 lcod 0'0 mlcod 0'0 active+clean+inconsistent+snaptrim trimq=[1~1]] rollforward: entry=26'55 (19'51) modify   1:ee9ae150:::obj4:head by unknown.0.0:0 2018-06-04 18:52:32.722708 0
Actions
Copy link
 #4

Updated by David Zafman almost 6 years ago

  • Status changed from 12 to In Progress

Tentative pull request https://github.com/ceph/ceph/pull/22476 is an improvement but doesn't address comment 3

Actions
Copy link
 #5

Updated by David Zafman about 5 years ago

  • Status changed from In Progress to Need More Info
Actions
Copy link
 #6

Updated by David Zafman over 3 years ago

  • Status changed from Need More Info to Resolved
  • Pull request ID set to 22476

Marking resolved since no issue has been seen since the supposed partial fix was added.

Actions
Copy link

Also available in: Atom PDF