Project

General

Profile

Activity

From 11/03/2019 to 12/02/2019

12/02/2019

12:42 PM Backport #43087 (Resolved): nautilus: bluefs: sync_metadata leaks dirty files if log_t is empty
https://github.com/ceph/ceph/pull/34515 Nathan Cutler
12:41 PM Backport #43086 (Rejected): mimic: bluefs: sync_metadata leaks dirty files if log_t is empty
https://github.com/ceph/ceph/pull/34792 Nathan Cutler
08:40 AM Bug #42091 (Pending Backport): bluefs: sync_metadata leaks dirty files if log_t is empty
Kefu Chai

12/01/2019

04:28 PM Bug #43068: on disk size (81292) does not match object info size (81237)
I dump the on-disk object via objectstore tool , seems the last 55 bytes are all zero...
This file is a bash_hist...
Xiaoxi Chen
01:37 AM Bug #43068 (New): on disk size (81292) does not match object info size (81237)
... Xiaoxi Chen

11/25/2019

01:53 PM Backport #41810 (In Progress): nautilus: osd_memory_target isn't applied in runtime.
Sridhar Seshasayee

11/23/2019

07:12 PM Bug #20236: bluestore: ObjectStore/StoreTestSpecificAUSize.Many4KWritesNoCSumTest/2 failure
/a/nojha-2019-11-22_22:10:13-rados-wip-31657-nautilus-distro-basic-smithi/4534580/ Neha Ojha

11/22/2019

04:15 PM Bug #42823: crash in BlueStore::Onode destructor
New crash today. Looks somewhat similar to the old one. This one is based on e4b3036422df70e3 with some cephfs patche... Jeff Layton
08:32 AM Bug #41301 (Resolved): os/bluestore/BlueFS: use 64K alloc_size on the shared device
While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are ... Nathan Cutler

11/21/2019

01:42 PM Bug #42928 (Closed): ceph-bluestore-tool bluefs-bdev-new-db does not update lv tags
Adding a DB Device to an existing OSD with ceph-bluestore-tool bluefs-bdev-new-db does not update the lv tags of the ... Arthur van Kleef
05:52 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
After 24h of testing, we can confirm, that fix is helping.
Good job Igor!
Rafal Wadolowski
01:58 AM Backport #41340 (Resolved): nautilus: os/bluestore/BlueFS: use 64K alloc_size on the shared device
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/30229
m...
Nathan Cutler

11/20/2019

08:07 PM Backport #41340: nautilus: os/bluestore/BlueFS: use 64K alloc_size on the shared device
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/30229
merged
Yuri Weinstein
06:24 PM Bug #42913 (Resolved): nautilus: cram test fails with _do_alloc_write failed with (28) No space l...
... Neha Ojha

11/19/2019

07:26 PM Backport #42834 (Resolved): luminous: STATE_KV_SUBMITTED is set too early.
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/31674
m...
Nathan Cutler
05:02 PM Backport #42834: luminous: STATE_KV_SUBMITTED is set too early.
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/31674
merged
Yuri Weinstein

11/18/2019

02:50 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
TObias, thanks for the info. Hopefully we wouldn't need it any more.
Please let us know if the fix helps...
Igor Fedotov
07:05 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Hi Igor,
looks like you fixed the issue :) nevertheless, i got logs and sst of 2 new OSDs if you need further confir...
Tobias Fischer

11/17/2019

09:02 AM Backport #40449 (Resolved): nautilus: "no available blob id" assertion might occur
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/30144
m...
Nathan Cutler
09:01 AM Backport #40449 (In Progress): nautilus: "no available blob id" assertion might occur
Nathan Cutler
09:00 AM Backport #41460 (Resolved): nautilus: incorrect RW_IO_MAX
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/31397
m...
Nathan Cutler

11/16/2019

09:38 PM Backport #41282 (Resolved): nautilus: BlueStore tool to check fragmentation
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/29949
m...
Nathan Cutler
03:52 PM Backport #41282: nautilus: BlueStore tool to check fragmentation
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/29949
merged
Yuri Weinstein
04:13 PM Bug #38272 (Resolved): "no available blob id" assertion might occur
Igor Fedotov
04:12 PM Backport #40449 (Resolved): nautilus: "no available blob id" assertion might occur
Igor Fedotov
04:07 PM Backport #40449: nautilus: "no available blob id" assertion might occur
Igor Fedotov wrote:
> https://github.com/ceph/ceph/pull/30144
merged
Yuri Weinstein
04:06 PM Backport #41460: nautilus: incorrect RW_IO_MAX
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/31397
merged
Yuri Weinstein
06:34 AM Backport #42041: nautilus: bluestore objectstore_blackhole=true violates read-after-write
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/31019
m...
Nathan Cutler

11/15/2019

11:22 PM Bug #40684 (Resolved): bluestore objectstore_blackhole=true violates read-after-write
Igor Fedotov
11:21 PM Backport #42041 (Resolved): nautilus: bluestore objectstore_blackhole=true violates read-after-write
Igor Fedotov
10:39 PM Backport #42041: nautilus: bluestore objectstore_blackhole=true violates read-after-write
Nathan Cutler wrote:
> https://github.com/ceph/ceph/pull/31019
merged
Yuri Weinstein
02:33 PM Backport #42834 (In Progress): luminous: STATE_KV_SUBMITTED is set too early.
Nathan Cutler
02:29 PM Backport #42834 (Resolved): luminous: STATE_KV_SUBMITTED is set too early.
https://github.com/ceph/ceph/pull/31674 Nathan Cutler
02:30 PM Backport #42833 (In Progress): mimic: STATE_KV_SUBMITTED is set too early.
Nathan Cutler
02:29 PM Backport #42833 (Resolved): mimic: STATE_KV_SUBMITTED is set too early.
https://github.com/ceph/ceph/pull/31673 Nathan Cutler
01:12 PM Bug #42209 (Pending Backport): STATE_KV_SUBMITTED is set too early.
nautilus fix merged in https://github.com/ceph/ceph/pull/30755 Sage Weil
01:09 PM Bug #42223 (Resolved): ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_a...
Sage Weil

11/14/2019

09:07 PM Bug #42823 (Duplicate): crash in BlueStore::Onode destructor
Testing xfstests on cephfs in vstart cluster, and OSD crashed:... Jeff Layton
04:32 PM Bug #42223 (Pending Backport): ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILE...
backport pr: https://github.com/ceph/ceph/pull/31644 Sage Weil

11/13/2019

11:47 PM Bug #42284 (Duplicate): fastbmap_allocator_impl.h: FAILED ceph_assert(available >= allocated) in ...
haha - we've finally got it locally...
https://tracker.ceph.com/issues/42223
Igor Fedotov
09:11 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Marcin,
003808.sst has the same bluefs log pattern inside at e.g. offset 5687664. So it seems it has been overwritt...
Igor Fedotov
08:27 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Igor,
Well done!
Would it also explain problem I had with 003808.sst(30MB) where all others were 16MB as they w...
Marcin W
07:48 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Hopefully here is the final analysis for the root cause.
a) analysis for 002375.sst dump from comment #94 reveals ...
Igor Fedotov
05:39 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Rafal - great, thank you. Now I can tell that data extents in this file which are supposed to be RocksDB data belong... Igor Fedotov
11:25 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Yes it is available, I didn't redeployed failed OSDs... Rafal Wadolowski
07:12 PM Bug #20236: bluestore: ObjectStore/StoreTestSpecificAUSize.Many4KWritesNoCSumTest/2 failure
/a/yuriw-2019-11-08_20:50:44-rados-wip-yuri3-testing-2019-11-08-1221-nautilus-distro-basic-smithi/4485359/ Neha Ojha
06:17 PM Bug #20236: bluestore: ObjectStore/StoreTestSpecificAUSize.Many4KWritesNoCSumTest/2 failure
This appeared in nautilus
/a/yuriw-2019-11-12_15:30:19-rados-wip-yuri5-testing-2019-11-11-1520-nautilus-distro-bas...
Neha Ojha
05:25 PM Bug #42683: OSD Segmentation fault
@Antonio - yes, please go head. Igor Fedotov
04:17 PM Bug #42683: OSD Segmentation fault
@Igor if you don't object I would scratch the OSD to keep testing the system. Antonio Falabella

11/12/2019

05:00 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Rafal, is osd.35 still available? If so could you please run bluestore-tool:
CEPH_ARGS="--debug-bluefs 10 --log-fil...
Igor Fedotov
09:22 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Rafal Wadolowski wrote:
> I'm just upgraded version, so they are created with 14.2.3 version.
> So do you suggest t...
Igor Fedotov
09:17 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
I'm just upgraded version, so they are created with 14.2.3 version.
So do you suggest to redeploy cluster?
Rafal Wadolowski
09:15 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Thanks, Rafal! One clarification though - have you redeployed all the OSDs before running Ceph with the latest RocksD... Igor Fedotov
08:55 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Igor version with upgraded rocksdb broke two OSD for now. Logs from one of them:... Rafal Wadolowski
03:15 PM Bug #42166: crash when LRU trimming
Just to note, osd log contains multiple odd checksum verification failures from RocksDB, e.g.
2019-10-02T11:44:22....
Igor Fedotov
12:15 AM Bug #42712 (Resolved): ObjectStore/StoreTest.ColSplitTest0/2 hangs
Sage Weil

11/11/2019

08:48 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Krzysztof - what I'd like to do for broken OSDs is:
a) (simple case) export bluefs log using ceph-bluestore-tool's ...
Igor Fedotov
08:23 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
I'm actually not sure - I see that the cluster has been upgrade to a new 14.2.4 build with upgraded rocksdb, but osd-... Krzysztof Klimonda
06:59 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Rafal, @Krzystzof - am I right that data for OSDs from comment #87 aren't available any more as you deployed a new c... Igor Fedotov
03:03 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
I deployed the version with new rocksdb and started tests. I will come up with results :) Rafal Wadolowski
01:41 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Hi Marcin,
there is bluefs_buffered_io parameter (true by default) which controls buffered vs. direct IO mode. And y...
Igor Fedotov

11/10/2019

12:02 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Dev guys,
I haven't checked the source code for handling KV store but is it possible that some parts use buffered ...
Marcin W

11/08/2019

11:34 PM Bug #42712 (Fix Under Review): ObjectStore/StoreTest.ColSplitTest0/2 hangs
Sage Weil
11:28 PM Bug #42712: ObjectStore/StoreTest.ColSplitTest0/2 hangs
I think the problem is ff71ad472e94e14f392c618b6eb5e8608afec94f
Here's the log:...
Sage Weil
11:13 PM Bug #42712: ObjectStore/StoreTest.ColSplitTest0/2 hangs
/a/sage-2019-11-08_19:27:06-rados-master-distro-basic-smithi/4484836 Sage Weil
05:43 PM Bug #42712 (Resolved): ObjectStore/StoreTest.ColSplitTest0/2 hangs
... Sage Weil
02:54 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Entire db/000960.sst for osd.50 can be downloaded from https://cf2.cloudferro.com:8080/swift/v1/AUTH_36d73de269134544... Krzysztof Klimonda
01:32 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Entire db/000960.sst can be downloaded from https://cf2.cloudferro.com:8080/swift/v1/AUTH_36d73de2691345449a04f9b9f95... Krzysztof Klimonda
01:25 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Another crash, attached osd log, and exert below:... Krzysztof Klimonda
12:32 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
IF anyone has spare cluster to try custom build here is nautilus v14.2.4 with RocksDB updated to 6.4.6.
Worth checki...
Igor Fedotov
09:52 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
And this time it is still happens during compaction, isn't it? Igor Fedotov
09:50 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Krzystzof- thanks for the info. Please share more when available.
Please also export bluefs for this OSD and shar...
Igor Fedotov
09:20 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Attached is a log from OSD that has crashed with Igor's patch applied, the interesting part is below:... Krzysztof Klimonda
11:04 AM Bug #42683: OSD Segmentation fault
@Igor here is a link to the file:
https://drive.google.com/open?id=1sd3507O58wyb0a1iGt4fjWjQGkoOgnwH
Thanks aga...
Antonio Falabella
10:35 AM Bug #42683: OSD Segmentation fault
Here it is.
The proper command is:
ceph-bluestore-tool --path <osd-path> --out-dir <destination dir> --command bl...
Igor Fedotov
10:33 AM Bug #42683: OSD Segmentation fault
@Igor I don't know how exactly I should to do this, if you can give some instruction of point me to some docs I would... Antonio Falabella
10:26 AM Bug #42683: OSD Segmentation fault
@Antonio - would you be able to export bluefs for the broken OSD to regular file system and then share content of db/... Igor Fedotov
10:24 AM Bug #42683 (Duplicate): OSD Segmentation fault
Duplicate of https://tracker.ceph.com/issues/42223 Igor Fedotov
10:23 AM Bug #42683: OSD Segmentation fault
@Antonio, thanks a lot.
So the same pattern:
-49> 2019-11-06 13:08:33.333 7f30b5b93700 3 rocksdb: [db/db_impl_c...
Igor Fedotov
10:15 AM Bug #42683: OSD Segmentation fault
@Igor You can find attached the very first error portion of the log. I am afraid at that moment the debug level was n... Antonio Falabella
10:00 AM Bug #42683: OSD Segmentation fault
@Antonio, could you please share the log for this first crash Igor Fedotov
08:25 AM Bug #42683: OSD Segmentation fault
After the 1Gb tuning the cluster was all fine. Then we started our stress test that is fio with with increasing numbe... Antonio Falabella

11/07/2019

11:36 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Another option to try (once the current tests are done): set rocksdb_enable_rmrange = false
Sage Weil
03:17 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Tobias Fischer wrote:
> @Igor: I installed 14.2.4 with the patch on 2 Clusters that already had failed OSDs. As soon...
Igor Fedotov
02:24 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
@Igor: I installed 14.2.4 with the patch on 2 Clusters that already had failed OSDs. As soon as new OSDs fail i will ... Tobias Fischer
08:17 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Igor Fedotov wrote:
> Can anybody try to make a custom build for Nautilus 14.2.3 or. 4 using this patch, update a cl...
Tobias Fischer
05:28 PM Bug #42683: OSD Segmentation fault
well, please disregard my words about recovery referenced in the log - they are present after regular shutdown as wel... Igor Fedotov
05:17 PM Bug #42683: OSD Segmentation fault
@Antonio - IMO it doesn't make much sense to fix these specific parameters - who knows what else has been broken... H... Igor Fedotov
04:40 PM Bug #42683: OSD Segmentation fault
No, any assertions before this. What we were doing was to test the lower limit at which the OSD could operate, given ... Antonio Falabella
04:28 PM Bug #42683: OSD Segmentation fault
So brief log analysis:
Freelist init shows some garbage in DB for its key records
>> -9> 2019-11-07 17:08:33.20...
Igor Fedotov
04:23 PM Bug #42683: OSD Segmentation fault
I attached the portion of the log produced after the restart with increased debug level, you can find it attached.
T...
Antonio Falabella
03:52 PM Bug #42683: OSD Segmentation fault
@Antonio - thanks for the info, but I need more...
First of all please preserve all the available logs for this sp...
Igor Fedotov
03:32 PM Bug #42683: OSD Segmentation fault
Dear Igor,
I attached the log portion you required.
Thanks
Antonio
Antonio Falabella
03:19 PM Bug #42683: OSD Segmentation fault
@Antonio - could you please provide the whole log for the failure. Igor Fedotov
02:11 PM Bug #42683 (Duplicate): OSD Segmentation fault
Dear support,
I have a small ceph cluster installed with nautilus 14.2.4 meant for a test for future larger deployme...
Antonio Falabella

11/06/2019

08:47 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
As a quick update, I've purged and re-deployed our cluster with 14.2.2. I've been running same stress tests for the l... Krzysztof Klimonda
05:25 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Mines aren't crashing anymore... But I managed to reduce the load Dmitry Mishin
02:54 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Can anybody try to make a custom build for Nautilus 14.2.3 or. 4 using this patch, update a cluster and collect logs ... Igor Fedotov
07:29 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Did anybody find a way to fast reproduce the issue? Right now it's still occurs randomly. Rafal Wadolowski
09:13 AM Bug #41215 (Duplicate): os/bluestore: do not set osd_memory_target default from cgroup limit
duplicate of #41200 Nathan Cutler

11/05/2019

07:09 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Yeah, from this ticket point of view 14.2.2 is the best choice. Not sure how good it is in general though - it makes ... Igor Fedotov
06:30 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
I'm currently considering biting the bullet and redeploying one of our clusters with one of earlier nautilus releases... Krzysztof Klimonda
05:42 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
I had the cluster upgraded to 14.2.4, and after that problems started under heavy load.
I don't have any other clust...
Dmitry Mishin
04:36 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
There were two changes in rocksdb default configuration.
First was version upgrade from 5.17.2 to 6.1.20 (https://g...
Rafal Wadolowski
01:30 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Krzysztof and me are working on the same clusters Rafal Wadolowski
01:18 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Krzysztof - are you referring the same clusters as Rafal above? Igor Fedotov
01:01 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
We have 2 clusters that were deployed with 14.2.3 and have failed OSDs during stress testing. We have 1 more cluster ... Krzysztof Klimonda
12:42 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
General questions to everybody experiencing the issue.
1)Have you run Nautilus before v14.2.3? Have you ever seen ...
Igor Fedotov
12:30 PM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Rafal, thanks for your information.
I don't think switching to stupid allocator will help. IMO this problem isn't re...
Igor Fedotov
07:57 AM Bug #42223: ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(avail...
Igor,
We are facing this same issue. Clean install 14.2.3.
Right now we have over 10 OSDs down....
Rafal Wadolowski
12:39 PM Backport #41810 (Need More Info): nautilus: osd_memory_target isn't applied in runtime.
non-trivial backport assigned to developer Nathan Cutler
12:10 AM Bug #42605: KernelDevice.cc: 688: FAILED assert(off % block_size == 0)
黄 维 wrote:
> Igor Fedotov wrote:
> > Looks like bluefs replay tries to read an out-of-bound extent (#3 while just 2...
黄 维
12:08 AM Bug #42605: KernelDevice.cc: 688: FAILED assert(off % block_size == 0)
Igor Fedotov wrote:
> Looks like bluefs replay tries to read an out-of-bound extent (#3 while just 2 are present for...
黄 维

11/04/2019

09:51 PM Documentation #39522 (Resolved): fix and improve doc regarding manual bluestore cache settings.
While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are ... Nathan Cutler
05:56 PM Backport #41290 (Resolved): nautilus: fix and improve doc regarding manual bluestore cache settings.
This update was made using the script "backport-resolve-issue".
backport PR https://github.com/ceph/ceph/pull/31259
m...
Nathan Cutler
05:46 PM Bug #39569 (Duplicate): os/bluestore: fix for FreeBSD iocb structure #27458
Nathan Cutler
04:41 PM Backport #41460 (In Progress): nautilus: incorrect RW_IO_MAX
Nathan Cutler
01:56 PM Bug #42605: KernelDevice.cc: 688: FAILED assert(off % block_size == 0)
Looks like bluefs replay tries to read an out-of-bound extent (#3 while just 2 are present for log file (aka ino 1) i... Igor Fedotov
01:53 AM Bug #42605 (Closed): KernelDevice.cc: 688: FAILED assert(off % block_size == 0)
OSD start failed after server power down
ceph version: v12.2.9
stack info:
/clove/vm/zstor/ceph/rpmbuild/BUILD...
黄 维
 

Also available in: Atom