https://tracker.ceph.com/
https://tracker.ceph.com/favicon.ico
2015-03-18T22:58:46Z
Ceph
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=49479
2015-03-18T22:58:46Z
Samuel Just
sjust@redhat.com
<ul></ul><p>Scrub got there first. The promote is a result of a read which of course is not blocked behind the scrubber. bother.</p>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=49608
2015-03-20T18:43:37Z
Samuel Just
sjust@redhat.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>12</i></li></ul>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=49792
2015-03-24T19:16:23Z
Sage Weil
sage@newdream.net
<ul><li><strong>Status</strong> changed from <i>12</i> to <i>Pending Backport</i></li><li><strong>Source</strong> changed from <i>other</i> to <i>Q/A</i></li><li><strong>Backport</strong> set to <i>firefly</i></li></ul>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=49864
2015-03-25T18:58:00Z
Loïc Dachary
loic@dachary.org
<ul></ul><p><a class="external" href="http://pulpito.ceph.com/loic-2015-03-25_17:37:52-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-vps/820686/">http://pulpito.ceph.com/loic-2015-03-25_17:37:52-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-vps/820686/</a></p>
<pre>
Core was generated by `ceph-osd -f -i 11'.
Program terminated with signal SIGABRT, Aborted.
#0 0x00007f5b4e76e20b in raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/pt-raise.c:37
37 ../nptl/sysdeps/unix/sysv/linux/pt-raise.c: No such file or directory.
(gdb) bt
#0 0x00007f5b4e76e20b in raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/pt-raise.c:37
#1 0x000000000098302a in reraise_fatal (signum=6) at global/signal_handler.cc:59
#2 handle_fatal_signal (signum=6) at global/signal_handler.cc:105
#3 <signal handler called>
#4 0x00007f5b4ce15cc9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#5 0x00007f5b4ce190d8 in __GI_abort () at abort.c:89
#6 0x00007f5b4d7206b5 in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7 0x00007f5b4d71e836 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#8 0x00007f5b4d71e863 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#9 0x00007f5b4d71eaa2 in __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#10 0x0000000000a66802 in ceph::__ceph_assert_fail (assertion=assertion@entry=0xb82a98 "soid < scrubber.start || soid >= scrubber.end",
file=file@entry=0xb7e3a0 "osd/ReplicatedPG.cc", line=line@entry=5320,
func=func@entry=0xb8a180 <ReplicatedPG::finish_ctx(ReplicatedPG::OpContext*, int, bool)::__PRETTY_FUNCTION__> "void ReplicatedPG::finish_ctx(ReplicatedPG::OpContext*, int, bool)") at common/assert.cc:77
#11 0x00000000007d3ae6 in ReplicatedPG::finish_ctx (this=this@entry=0x32ba400, ctx=ctx@entry=0x46bea00, log_op_type=log_op_type@entry=8,
maintain_ssc=maintain_ssc@entry=true) at osd/ReplicatedPG.cc:5320
#12 0x00000000007d7c90 in ReplicatedPG::finish_promote (this=0x32ba400, r=<optimized out>, op=..., results=<optimized out>, obc=...)
at osd/ReplicatedPG.cc:6025
#13 0x0000000000841e9c in PromoteCallback::finish (this=<optimized out>, results=...) at osd/ReplicatedPG.cc:1687
#14 0x0000000000816ca9 in GenContext<boost::tuples::tuple<int, ReplicatedPG::CopyResults*, boost::tuples::null_type, boost::tuples::null_type, boost::tuples::null_type, boost::tuples::null_type, boost::tuples::null_type, boost::tuples::null_type, boost::tuples::null_type, boost::tuples::null_type> >::complete (this=0x49b2420, t=...) at ./include/Context.h:45
#15 0x00000000007ec55d in ReplicatedPG::process_copy_chunk (this=0x32ba400, oid=..., tid=tid@entry=926, r=r@entry=0)
at osd/ReplicatedPG.cc:5711
#16 0x0000000000842b49 in C_Copyfrom::finish (this=0x4b87c60, r=0) at osd/ReplicatedPG.cc:5371
#17 0x0000000000655a19 in Context::complete (this=0x4b87c60, r=<optimized out>) at ./include/Context.h:64
#18 0x00000000009a60d8 in Finisher::finisher_thread_entry (this=0x2ffc340) at common/Finisher.cc:56
#19 0x00007f5b4e766182 in start_thread (arg=0x7f5b35885700) at pthread_create.c:312
#20 0x00007f5b4ced947d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
</pre>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=49865
2015-03-25T19:00:32Z
Loïc Dachary
loic@dachary.org
<ul></ul><p>must be synchronized with <a class="external" href="https://github.com/ceph/ceph-qa-suite/pull/367">https://github.com/ceph/ceph-qa-suite/pull/367</a> which reproduces it (but not all the time, it probably needs a few runs)</p>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=49867
2015-03-25T20:57:55Z
Loïc Dachary
loic@dachary.org
<ul></ul><ul>
<li><a class="external" href="https://github.com/ceph/ceph/pull/4162">https://github.com/ceph/ceph/pull/4162</a></li>
</ul>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=49868
2015-03-25T21:04:00Z
Loïc Dachary
loic@dachary.org
<ul></ul><ul>
<li>firefly backport <a class="external" href="https://github.com/ceph/ceph/pull/4185">https://github.com/ceph/ceph/pull/4185</a></li>
</ul>
<pre>
./virtualenv/bin/teuthology-suite --filter 'upgrade:firefly-x:stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/ec-cache-create.yaml 3-partial-upgrade/firsthalf.yaml 4-thrash/default.yaml 5-mon/mona.yaml 6-workload/ec-cache-agent.yaml 7-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-no-lrc.yaml distros/ubuntu_14.04.yaml}' --suite-branch wip-ec-cache-agent-firefly-backports --priority 101 --suite upgrade/firefly-x/stress-split-erasure-code --machine-type plana,burnupi,mira --email loic@dachary.org --owner loic@dachary.org --ceph hammer
</pre>
<ul>
<li><a href="http://pulpito.ceph.com/loic-2015-03-26_15:22:43-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/822782/" class="external">green</a></li>
<li><a href="http://pulpito.ceph.com/loic-2015-03-26_21:18:14-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/" class="external">red</a></li>
</ul>
<p>because the rados tasks runs in the background, the test does not do what is expected.</p>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=50044
2015-03-27T06:48:58Z
Loïc Dachary
loic@dachary.org
<ul></ul><pre>
./virtualenv/bin/teuthology-suite --filter 'upgrade:firefly-x:stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/ec-cache-create.yaml 3-partial-upgrade/firsthalf.yaml 4-thrash/default.yaml 5-mon/mona.yaml 6-workload/ec-cache-agent.yaml 7-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-no-lrc.yaml distros/ubuntu_14.04.yaml}' --suite-branch wip-ec-cache-agent-firefly-backports --priority 101 --suite upgrade/firefly-x/stress-split-erasure-code --machine-type plana,burnupi,mira --email loic@dachary.org --owner loic@dachary.org --ceph hammer
</pre>
<ul>
<li>1x <a href="http://pulpito.ceph.com/loic-2015-03-27_07:44:47-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/" class="external">green</a></li>
<li>1x <a href="http://pulpito.ceph.com/loic-2015-03-27_08:42:59-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/" class="external">red</a> because of <a class="external" href="http://tracker.ceph.com/issues/11139#note-11">http://tracker.ceph.com/issues/11139#note-11</a></li>
<li>5x <a href="http://pulpito.ceph.com/loic-2015-03-27_08:43:38-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/" class="external">green</a></li>
</ul>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=50050
2015-03-27T09:15:34Z
Loïc Dachary
loic@dachary.org
<ul></ul><p>Same teuthology job as above but on firefly instead of firefly-backports</p>
<pre>
./virtualenv/bin/teuthology-suite --num 5 --filter 'upgrade:firefly-x:stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/ec-cache-create.yaml 3-partial-upgrade/firsthalf.yaml 4-thrash/default.yaml 5-mon/mona.yaml 6-workload/ec-cache-agent.yaml 7-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-no-lrc.yaml distros/ubuntu_14.04.yaml}' --suite-branch wip-ec-cache-agent --priority 101 --suite upgrade/firefly-x/stress-split-erasure-code --machine-type plana,burnupi,mira --email loic@dachary.org --owner loic@dachary.org --ceph hammer
</pre>
<ul>
<li>5x <a href="http://pulpito.ceph.com/loic-2015-03-27_09:57:09-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/" class="external">red</a> because of <a class="external" href="http://tracker.ceph.com/issues/11139#note-12">http://tracker.ceph.com/issues/11139#note-12</a></li>
</ul>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=50354
2015-04-03T09:14:16Z
Loïc Dachary
loic@dachary.org
<ul></ul><p>Same teuthology job as above, on firefly and expecting success now that <a class="external" href="http://tracker.ceph.com/issues/11139">http://tracker.ceph.com/issues/11139</a> has been fixed</p>
<pre>
./virtualenv/bin/teuthology-suite --num 5 --filter 'upgrade:firefly-x:stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/ec-cache-create.yaml 3-partial-upgrade/firsthalf.yaml 4-thrash/default.yaml 5-mon/mona.yaml 6-workload/ec-cache-agent.yaml 7-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-no-lrc.yaml distros/ubuntu_14.04.yaml}' --suite-branch wip-ec-cache-agent --priority 101 --suite upgrade/firefly-x/stress-split-erasure-code --machine-type plana,burnupi,mira --email loic@dachary.org --owner loic@dachary.org --ceph hammer
</pre>
<ul>
<li>5x <a href="http://pulpito.ceph.com/loic-2015-04-03_11:12:16-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/" class="external">green</a></li>
</ul>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=50357
2015-04-03T12:06:59Z
Loïc Dachary
loic@dachary.org
<ul></ul><p>Back to testing firefly-backports and verify it behaves in a split cluster being upgraded with a cache + erasure-coded pool <br /><pre>
./virtualenv/bin/teuthology-suite --num 5 --filter 'upgrade:firefly-x:stress-split-erasure-code/{0-cluster/start.yaml 1-firefly-install/firefly.yaml 2-workload/ec-cache-create.yaml 3-partial-upgrade/firsthalf.yaml 4-thrash/default.yaml 5-mon/mona.yaml 6-workload/ec-cache-agent.yaml 7-next-mon/monb.yaml 8-next-mon/monc.yaml 9-workload/ec-no-lrc.yaml distros/ubuntu_14.04.yaml}' --suite-branch wip-ec-cache-agent-firefly-backports --priority 101 --suite upgrade/firefly-x/stress-split-erasure-code --machine-type plana,burnupi,mira --email loic@dachary.org --owner loic@dachary.org --ceph hammer
</pre></p>
<ul>
<li>5x <a href="http://pulpito.ceph.com/loic-2015-04-03_14:04:02-upgrade:firefly-x:stress-split-erasure-code-hammer---basic-multi/" class="external">green</a></li>
</ul>
Ceph - Bug #11156: FAILED assert(soid < scrubber.start || soid >= scrubber.end)
https://tracker.ceph.com/issues/11156?journal_id=50360
2015-04-03T16:35:37Z
Loïc Dachary
loic@dachary.org
<ul><li><strong>Status</strong> changed from <i>Pending Backport</i> to <i>Resolved</i></li></ul>