Project

General

Profile

Actions

Bug #50119

closed

Invalid read of size 4 in ceph::logging::Log::dump_recent()

Added by Sage Weil about 3 years ago. Updated over 2 years ago.

Status:
Can't reproduce
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

the test does the 2 writes, creates the digest, deletes the pool, and submits the final op, but that op hangs

/a/sage-2021-04-02_14:05:32-rados-wip-sage2-testing-2021-04-01-1417-pacific-distro-basic-smithi/6017373

client log is ./remote/smithi122/log/ceph-client.admin.39306.log.gz

osd.2 gets as far as


2021-04-02T17:35:02.897+0000 3b13d700 20 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] do_op: op osd_op(client.14672.0:7610 212.c 212:34762567:test-rados-api-smithi122-39306-84::foo:head [tier-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e655) v8
2021-04-02T17:35:02.897+0000 3b13d700 20 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] op_has_sufficient_caps session=0x203eee70 pool=212 (test-rados-api-smithi122-39306-83 test-rados-api-smithi122-39306-84) pool_app_metadata={rados={}} need_read_cap=0 need_write_cap=0 classes=[] -> yes
2021-04-02T17:35:02.897+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] do_op osd_op(client.14672.0:7610 212.c 212:34762567:test-rados-api-smithi122-39306-84::foo:head [tier-flush] snapc 0=[] ondisk+read+ignore_cache+known_if_redirected e655) v8 may_cache -> write-ordered flags ondisk+read+ignore_cache+known_if_redirected
2021-04-02T17:35:02.897+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] get_object_context: found obc in cache: 0x20b7fff0
2021-04-02T17:35:02.898+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] get_object_context: 0x20b7fff0 212:34762567:test-rados-api-smithi122-39306-84::foo:head rwstate(none n=0 w=0) oi: 212:34762567:test-rados-api-smithi122-39306-84::foo:head(653'2 client.14672.0:7608 dirty|data_digest|manifest s 8192 uv 1 dd ff44a93c alloc_hint [0 0 0] manifest(chunked {0=(len: 2 oid: 78:08bc4ac3:test-rados-api-smithi122-39306-84::bar:0 offset: 0 flags: has_reference)})) exists: 1 ssc: 0x22971230 snapset: 0=[]:{}
2021-04-02T17:35:02.898+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] find_object_context 212:34762567:test-rados-api-smithi122-39306-84::foo:head @head oi=212:34762567:test-rados-api-smithi122-39306-84::foo:head(653'2 client.14672.0:7608 dirty|data_digest|manifest s 8192 uv 1 dd ff44a93c alloc_hint [0 0 0] manifest(chunked {0=(len: 2 oid: 78:08bc4ac3:test-rados-api-smithi122-39306-84::bar:0 offset: 0 flags: has_reference)}))
2021-04-02T17:35:02.899+0000 3b13d700 20 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] do_op obc obc(212:34762567:test-rados-api-smithi122-39306-84::foo:head rwstate(write n=1 w=0))
2021-04-02T17:35:02.899+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] execute_ctx 0x47642e30
2021-04-02T17:35:02.899+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] execute_ctx 212:34762567:test-rados-api-smithi122-39306-84::foo:head [tier-flush] ov 653'2 av 655'3 snapc 0=[] snapset 0=[]:{}
2021-04-02T17:35:02.899+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] do_osd_op 212:34762567:test-rados-api-smithi122-39306-84::foo:head [tier-flush]
2021-04-02T17:35:02.899+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] do_osd_op  tier-flush
2021-04-02T17:35:02.900+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] start_flush 212:34762567:test-rados-api-smithi122-39306-84::foo:head v653'2 uv1 blocking
2021-04-02T17:35:02.901+0000 3b13d700 20 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean]  snapset 0=[]:{}
2021-04-02T17:35:02.901+0000 3b13d700 20 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] start_flush no older clones
...
2021-04-02T17:35:02.938+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] do_cdc oid: 212:34762567:test-rados-api-smithi122-39306-84::foo:head len: 8192 oi.size: 8192 chunk_size: 1024
2021-04-02T17:35:02.986+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] refcount_manifest Start refcount from 212:34762567:test-rados-api-smithi122-39306-84::foo:head to 0:00000000:test-rados-api-smithi122-39306-84::0b0692abe73bf7a995bf44f5e9951ddb037acf28:0
2021-04-02T17:35:02.989+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] get_object_context: found obc in cache: 0x20b7fff0
2021-04-02T17:35:02.989+0000 3b13d700 10 osd.2 pg_epoch: 655 pg[212.c( v 653'2 (0'0,653'2] local-lis/les=648/649 n=1 ec=648/648 lis/c=648/648 les/c/f=649/649/0 sis=648) [2,0] r=0 lpr=648 crt=653'2 lcod 653'1 mlcod 653'1 active+clean] get_object_context: 0x20b7fff0 212:34762567:test-rados-api-smithi122-39306-84::foo:head rwstate(write n=1 w=0) oi: 212:34762567:test-rados-api-smithi122-39306-84::foo:head(653'2 client.14672.0:7608 dirty|data_digest|manifest s 8192 uv 1 dd ff44a93c alloc_hint [0 0 0] manifest(chunked {0=(len: 2 oid: 78:08bc4ac3:test-rados-api-smithi122-39306-84::bar:0 offset: 0 flags: has_reference)})) exists: 1 ssc: 0x22971230 snapset: 0=[]:{}
2021-04-02T17:35:02.990+0000 3b13d700 10 monclient: _renew_subs
2021-04-02T17:35:02.990+0000 3b13d700 10 monclient: _send_mon_message to mon.b at v2:172.21.15.133:3300/0
2021-04-02T17:35:02.990+0000 3b13d700  1 -- [v2:172.21.15.122:6826/34231,v1:172.21.15.122:6827/34231] --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=656}) v3 -- 0x20155d20 con 0xf29eae0

Actions

Also available in: Atom PDF