Actions
Bug #50853
closedlibcephsqlite: Core dump while running test_libcephsqlite.sh.
Status:
Can't reproduce
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Observed on master during following run:
/a/sseshasa-2021-05-17_11:08:21-rados-wip-sseshasa-testing-2021-05-17-1504-distro-basic-smithi/6118255
2021-05-17T11:53:40.255 INFO:tasks.workunit.client.0.smithi103.stderr:INSERT INTO foo (a)
2021-05-17T11:53:40.255 INFO:tasks.workunit.client.0.smithi103.stderr: SELECT RANDOMBLOB(1<<20)
2021-05-17T11:53:40.256 INFO:tasks.workunit.client.0.smithi103.stderr: FROM c
2021-05-17T11:53:40.256 INFO:tasks.workunit.client.0.smithi103.stderr: LIMIT (1<<20);+ '[' b '!=' b ']'
2021-05-17T11:53:40.256 INFO:tasks.workunit.client.0.smithi103.stderr:+ sleep 20
2021-05-17T11:53:40.256 INFO:tasks.workunit.client.0.smithi103.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout'
2021-05-17T11:54:00.247 INFO:tasks.workunit.client.0.smithi103.stdout:[1]+ 38887 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" &
2021-05-17T11:54:00.248 INFO:tasks.workunit.client.0.smithi103.stderr:+ jobs -l
2021-05-17T11:54:00.249 INFO:tasks.workunit.client.0.smithi103.stderr:++ jobs -p
2021-05-17T11:54:00.249 INFO:tasks.workunit.client.0.smithi103.stderr:+ kill -STOP -- 38887
2021-05-17T11:54:00.249 INFO:tasks.workunit.client.0.smithi103.stderr:+ sleep 45
2021-05-17T11:54:45.249 INFO:tasks.workunit.client.0.smithi103.stderr:+ date
2021-05-17T11:54:45.250 INFO:tasks.workunit.client.0.smithi103.stdout:Mon May 17 11:54:45 UTC 2021
2021-05-17T11:54:45.251 INFO:tasks.workunit.client.0.smithi103.stderr:++ jobs -p
2021-05-17T11:54:45.251 INFO:tasks.workunit.client.0.smithi103.stderr:+ kill -CONT -- 38887
2021-05-17T11:54:45.252 INFO:tasks.workunit.client.0.smithi103.stderr:+ sleep 10
2021-05-17T11:54:45.270 INFO:tasks.workunit.client.0.smithi103.stderr:Error: near line 3: disk I/O error
2021-05-17T11:54:45.271 INFO:tasks.workunit.client.0.smithi103.stderr:terminate called after throwing an instance of 'boost::wrapexcept<boost::bad_get>'
2021-05-17T11:54:45.271 INFO:tasks.workunit.client.0.smithi103.stderr: what(): boost::bad_get: failed value get using boost::get
2021-05-17T11:54:55.253 INFO:tasks.workunit.client.0.smithi103.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh: line 129: 38887 Aborted (core dumped) sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a"
Updated by Sage Weil almost 3 years ago
/a/sage-2021-05-29_16:04:00-rados-wip-sage3-testing-2021-05-29-1009-distro-basic-smithi/6142109
Updated by Patrick Donnelly almost 3 years ago
- Status changed from New to In Progress
- Target version set to v17.0.0
- Source set to Q/A
Updated by Patrick Donnelly almost 3 years ago
- Status changed from In Progress to Need More Info
So, unfortunately I've been unable to get the correct debugging symbols for the core file so I haven't been able to get a backtrace. The exception is most likely generated from a bad configuration get (wrong type). Due to the timing of this failure (May 17th), I think the most likely cause was Kefu's refactoring of the options code into yaml files. In particular, "common/options: extract osd and mgr settings out" was merged May 14th. It's hard to say which code path could have been hit which caused this. I didn't see any bad config gets with a cusory look at librados or libcephsqlite.
Updated by Patrick Donnelly almost 3 years ago
Also a little more information about what the test is doing: this stage is testing that libcephsqlite kills all I/O if it loses its lock due to failed renewal. In this case, it was SIGSTOPped for longer than the renewal timeout. So when it comes back it tells sqlite:
2021-05-29T20:56:34.177+0000 7f1bd9ffb700 -1 client.4611: SimpleRADOSStriper: lock_keeper_main: baz.db: lock renewal failed: (2) No such file or directory ... 2021-05-29T20:56:34.177+0000 7f1bfc165740 5 cephsqlite: Write: (client.4611) [cephsqlite:test_libcephsqlite.sh/baz.db] 71884800~4096 2021-05-29T20:56:34.177+0000 7f1bfc165740 5 client.4611: SimpleRADOSStriper: write: baz.db: 71884800~4096 2021-05-29T20:56:34.177+0000 7f1bf2f79700 1 -- 172.21.15.185:0/341889013 <== osd.1 v1:172.21.15.185:6804/30562 650 ==== osd_op_reply(17017 baz.db.0000000000000010 [write 2052096~4096] v22'6140 uv6140 ondisk = 0) v8 ==== 167+0+0 (unknown 390906517 0 0) 0x7f1bdc005d40 con 0x7f1bd4106520 2021-05-29T20:56:34.177+0000 7f1bfc165740 5 cephsqlite: Write: (client.4611) [cephsqlite:test_libcephsqlite.sh/baz.db] write failed: (108) Cannot send after transport endpoint shutdown
That produces this error:
2021-05-29T20:56:34.178 INFO:tasks.workunit.client.0.smithi185.stderr:Error: near line 3: disk I/O error
and then during cleanup:
2021-05-29T20:56:34.177+0000 7f1bfc165740 5 cephsqlite: Close: (client.4611) [cephsqlite:test_libcephsqlite.sh/baz.db] 2021-05-29T20:56:34.177+0000 7f1bfc165740 5 client.4611: SimpleRADOSStriper: ~SimpleRADOSStriper: baz.db: 2021-05-29T20:56:34.177+0000 7f1bfc165740 5 client.4611: SimpleRADOSStriper: unlock: baz.db: 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 >> v1:172.21.15.185:6804/30562 conn(0x7f1bd4106520 legacy=0x7f1bd4082e30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16462 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 3973120~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1be0001a70 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16463 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 3977216~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4107cb0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16464 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 3981312~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4108060 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16465 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 3985408~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4108410 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16466 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 3989504~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd41087c0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16467 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 3993600~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4108bb0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16468 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 3997696~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4108fc0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16469 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4001792~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd41093d0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16470 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4005888~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd41097e0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16471 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4009984~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4109bf0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16472 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4014080~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd410a000 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16473 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4018176~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd410a410 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16474 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4022272~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd410a820 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16475 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4026368~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd410ac70 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16476 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4030464~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd410b080 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16477 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4034560~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4077870 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16478 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4038656~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4077ca0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16479 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4042752~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40780b0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16480 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4046848~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40784c0 con 0x7f1bd41007a0 2021-05-29T20:56:34.177+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16481 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4050944~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40788d0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16482 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4055040~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4078ce0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16483 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4059136~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40790f0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16484 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4063232~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4079500 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16485 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4067328~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4079910 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16486 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4071424~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd4079d00 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16487 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4075520~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd407a110 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16488 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4079616~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd407a520 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16489 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4083712~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd407a930 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16490 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4087808~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd407ad40 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16491 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4091904~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411b9b0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16492 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4096000~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411be00 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16493 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4100096~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411c210 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16494 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4104192~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411c620 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16495 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4108288~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411ca30 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16496 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4112384~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411ce40 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16497 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4116480~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411d250 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16498 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4120576~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411d660 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16499 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4124672~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411da70 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16500 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4128768~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411de80 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16501 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4132864~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411e290 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16502 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4136960~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411e6a0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16503 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4141056~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411eab0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16504 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4145152~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411eec0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16505 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4149248~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd411f2d0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16506 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4153344~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ab5c0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16507 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4157440~4096 in=4096b] snapc 0=[] RETRY=122 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40aba10 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16508 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4161536~4096 in=4096b] snapc 0=[] RETRY=121 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40abe20 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16509 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4165632~4096 in=4096b] snapc 0=[] RETRY=121 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ac230 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16510 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4169728~4096 in=4096b] snapc 0=[] RETRY=121 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ac640 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16511 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4173824~4096 in=4096b] snapc 0=[] RETRY=121 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40aca50 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16512 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4177920~4096 in=4096b] snapc 0=[] RETRY=120 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ace60 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16513 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4182016~4096 in=4096b] snapc 0=[] RETRY=120 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ad270 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16514 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4186112~4096 in=4096b] snapc 0=[] RETRY=120 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ad680 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16515 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 4190208~4096 in=4096b] snapc 0=[] RETRY=120 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ada90 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:16539 3.19 3:9d4380ad:test_libcephsqlite.sh::baz.db.000000000000000f:head [write 1138688~4096 in=4096b] snapc 0=[] RETRY=120 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40adea0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17024 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2080768~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ae2b0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17025 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2084864~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40ae6c0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17026 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2088960~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40aead0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17027 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2093056~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40aeee0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17028 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2097152~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40af2f0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17029 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2101248~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40afb10 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17030 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2105344~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40aff60 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17031 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2109440~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b0370 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17032 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2113536~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b0780 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17033 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2117632~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b0b90 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17034 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2121728~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b0fa0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17035 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2125824~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b13b0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17036 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2129920~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b17c0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17037 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2134016~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b1bd0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17038 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2138112~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b1fe0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17039 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2142208~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b23f0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17040 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2146304~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b2800 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17041 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2150400~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b2c10 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17042 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2154496~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b3020 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17043 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2158592~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b3430 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17044 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2162688~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b3840 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17045 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2166784~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b3c50 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17046 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2170880~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b4ad0 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17047 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2174976~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b4f20 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17048 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2179072~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b5330 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17049 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2183168~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b5740 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17050 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2187264~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b5b50 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17051 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2191360~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b5f60 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17052 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2195456~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b6370 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17053 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2199552~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b6780 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17054 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2203648~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b6b90 con 0x7f1bd41007a0 2021-05-29T20:56:34.178+0000 7f1bdbfff700 1 -- 172.21.15.185:0/341889013 --> v1:172.21.15.185:6804/30562 -- osd_op(unknown.0.0:17055 3.4 3:256f392a:test_libcephsqlite.sh::baz.db.0000000000000010:head [write 2207744~4096 in=4096b] snapc 0=[] RETRY=91 ondisk+retry+write+known_if_redirected e22) v8 -- 0x7f1bd40b6fa0 con 0x7f1bd41007a0
From: /ceph/teuthology-archive/sage-2021-05-29_16:04:00-rados-wip-sage3-testing-2021-05-29-1009-distro-basic-smithi/6142109/remote/smithi185/log/ceph-client.libcephsqlite.36029.log.gz
So at this point the ioctx will have been destroyed when ~SimpleRADOSStriper completes. Sometime after, during handling of the aio completions, this exception gets raised.
Updated by Patrick Donnelly over 1 year ago
- Status changed from Need More Info to Can't reproduce
Actions