Project

General

Profile

Actions

Bug #54675

open

crash: void KernelDevice::_aio_thread(): abort

Added by Telemetry Bot about 2 years ago. Updated 11 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Telemetry
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):

01679b32f4ca7655d7987f3bbebe4dc1af054c4c5138f2632ee3d36c8426eb24
188a8977ed5b06b55607cb5a81e63e7e8f851f895c3fc91c4d7716bc5184f7ea
2291bb02d73535bbe5c721e50e897c2eadcd5edd4d1243acf7aec6b81292d3d3
3410dc9a17ccdbe7ef19435610a7eb7d610162246fc1901f17ab4a1563d65b46
76390931f4775fbb274d38eab0255040ca3fc2b26263512adbcc42df71f393b0
98cfa8988e74520b03eff14626950eb699a33f9833c192d92a5dfb020d1268dc
9ee13dd03a8461554657b36189439dfcb41e046b6539d060f373eee7f1b8f79a
a64b7849dbd5761b38882afd2cb510f1e8776e8b5a1d7ae40323e7349c3285e2
b4351a326a50488fd60e52fc6a6bf8588f5a18279c455fa10df183905ba92fbc
e9ffa7c01a5acb6c433b04c21b2fd7a595e99a16e9ade4a0f3d3f05306968ae9
00cc8caea2198056058eacd5e2afe40f9bdfb6ba95582c51e6d714dc36493aa2
030082f7250582f8b32f5ee9be256c26f337d615740805d13f4f0dd37cc733f2
0dae8839121c18ae9226859c6fb0c45f85ce75bea2a4035d0c609599d862390b
0ea49a7112001ebcaff72ccc79941d78d5455fd4ac81bc25c2afe06c5fc74d9f
1224ea14e2c50ded17cce1ee5d5b8be29849afc5705918381ac1c1ca31136938
12d38ed9faccadbbd108867ff2158a745236c2393ca7f9285dabf1f072030f37
153a8a13a1c9c52e380199a32d5452ec547f371c2b889605af7a86b308b12e54
171ffaa563c550de34fbf862521512f557665b78ff01c94b38eff059f854e6de
2766bda4e9b16bd36dbafa1be4c702920f4c8d13400870d00bba043ead775ae5
2d36df8a8bf92768791fbfab39f0d4b895a3458817cf17cd7069f67e98a49554
2f733afd43179a5e622ca6a881e08459bd038e069cb616a4ec3d6eafa70b62d1
30d8632cc014a5ec26930d62d6fc44a8365dd1ce4020a4265a23ae37800cc72f
339a0fab3020c73b546fe75484513541f7f96267693ac4f77b7294e4b7cbf870
3887b07c91fa950378e713632c33270707557dc4e1ba9f4fd9fe2c88bf81c6fc
41c9f7e8e17c1a87d25031287f89e186394857fb8711135097c43a85be666666
432a375b0acf4a23e7f467af706cb26412615a29b2b9613aa5a6dd6185d7f18c
44bcd5237ec71558043d00382f3f39b76b48a19cc32d3095b2402bc98d55b459
47739323e0be96c6c4c525f33667d3bdd57d536ee1725e0e62183edd43176e91
4d51e1c809e22f343cea27dc347b339139f5ea335e51aa8f0c0ae742ae4af635
4ee9bf437dd10ef90e645f069cab4b3874d0abfccf03927ac9a871d0c5d7ecf1
4eeecb2f3e6f14afd903552d22e59569fcb7029e4e2065e2a40cb6b6951cd60a
53494dedd0a5903867bc4c729b890137d8120d81937264109f45f8fe8797583d
53cb40b4b466f57271bff9bc618ecf5b4ab25d50703c19492cb247aaad8ccd01
5d19a8d62da83598cafefe79332e6cf4b49cfa479fbe045009e974c02f0e72e0
61d6364b1b4233539445b690a8b2d2a0b14ce6591368dda767b2ca4a7233155d
631c872d2bfaf297a18c0361571894ae079f0ac7bafb7e203139543289a1af4a
665102b579a45006b08d967268f857c4b3a1d667378253f9c0439a861aa6b54b
67634b0a1f25cf74e6949ed101aa3db596a77ff13a41bb8b7c5839d2ddd1bd45
6804aa5959d94b24e486472dcb87e23024c3e4bac6b3d1891eebd8f269fd1b05
68801000fed018d3a3377a0fcb1d26ca339b1a1e72228504f785bbf9e99ec685
69f55caa2655be6074efe469b61df87a03d2dad2f6cf9d8022deabdab5be4116
6c989c5ab0a30b9291ce9a056e931c7480a0bcafac39f1c51726750fefb53b09
7732c59dfefd9d69a8aef9d28476ccbd695b7eb746b267dc07f6b68bf405e46b
7981fa2c173c2d4c70a256adad6ed45c0814ecb52cdce05148c39a465fa26740
801c8416f74031cd36fe18b0a7bd2355f1be582e4e2a59208013b57c55b8a35c
82f8a84d97ceb1d0ac5b82c5fefa178c98165ed12dbd18c9cbcb09967b1bd2ce
84369fd1a24613ac56206514b50a1fcb2760db13010a7ca49810aae99abe1b41
9781728369e631833341b5c94f922b4bf7afa7385f143d212f62b91fd5c13686
9dcd6184540b1f6b05f6e83387d44b1e457ecbdf79a165760d6ebb911b632ffa
9ef4658bfe4370d05d02d0cb43eace04d8f22a1a534dca9c94b7d736bf5d589f
a242aa01978106677062f25311c71f0764c6f7d72e817900f6069e9898c93fb2
a747042129c18aadc45d0874bb5705803dbffe71d91e69a59bd92bc1f8c32601
a750955f27a329ceaaa2c0e70ecd15f8ff4d59905c56689e7639a3a55bf2c1f3
aeec02541511a125b498533a1e092133febd743f2a5cc88c90477c5db4847411
b0b4dcd6f0fa0a2c76f9c8ed459bcccdde85ea6225a94f08a8d2c28f31bd83d7
bd9d8ab020b02d42855f0dfa2f07f35981b09be8bba8632baddfe13b07939181
c17ae43bd1512576ea987e5123bf5af843f6cbd5fff4e5f2d0d31eae69603954
c2c6e7d8ee428acec81762c80104fbfca13a3acbb510d4b3a7f30db09639bb66
c36979954588b5d3f48ab6c10b5ed67adb30654d5308bbdb13b7bdbade719c9e
c992d51abe02b34cbfff2129558fa30e798c0e055a25dea3d0343207537875ca
cb83081805dccb7399d00ec1ddcd40eb36a6bd6a6343a403164699321b4cc4c3
d4180cd4c8954c5d0ac4bee921990112c67df1a09ffd77959c47fe88f13f5fd3
d5b97321f0757b27cfeba2a540c06afcb894bf99a6a25497a87101ae90660fc6
d755aedec35201501a92fb1b04777a43cb876971aeebae41cf076022a9df0020
d8b3f483a2fc6440c50f4d769e72663c1a084f78494d35d85c2ad73ef402da3d
e0620d8b797e450ac3f3e2c1f5006c0d8cbd8ade5e446fc97d2c4967e24a0e9b
e76b89919705040ba7c1746bac4d18d82ebdef54d667cba0b946eadeb7ca854b
ea65280cfc6a0af6f68c61f3098f7466827350fe9a0a81df5c19ed6970fe6b59
f00913dabfbc7d9a9d4873b9825a51834871c7d7be13cef26e1bc4257e336fb2
f9d79522944b0e56fef6ae44f46e61cf201ee7c2d913a9f9d841a5506befaf59
07ce579e4062e42e9b98fe8b08288ef07cc4210e6b371651f24426b60809bbf9
1002a915d8d76fe9e0a4bc22d2a832195e9064604170b2d33978cb0e220a3427
3e652089efccffdb970594b22a7be1443f00739749c392b53385426db72cce77
4e78c3fc35309ce08ecbfd378e2ee1d053ca3cf9623679f3f31941cbc42af55c
5b68eb315543e4e21a3dce9057483992441b582962617edeb00473dcb46875bb
8efdfbde22ceb0f2b1083884f22106907f4d0d0662c1c594ee6cea97507d7b1f
97d208767c64e92e782e70726db40a396c3f5fc0f6adb6f588a769029af30505
9cae0314b763e38a7b80fb70c567a40c13ba81a2c60d54d0e2705329df65d53b
9faa95adab51a5446b076d9f13a27da9e2c007955aa1546554aef79057446ae5
a115a92a51d89eefcd572e1d83612a2ed0ba6c166b0686e4681e92e2e6e87936
a3621fd32b57c5f12805e486e3fe47b20ff4ceaaebef2e4ff9396cc9be3a217b
b0399431d06e8e1c00b35e85480174fb604e294e4ec2e9b9999e2665ff043713
b1c49a9d3e6b6aaeeca97886c8fbe990d7e374946f40be4649f1452b2aeb2fc1
b368c6fdccf81a35217c13560499051f489882d27a71859d8616b3188f965cda
c4e76bbea5bb9349613df4f7ddbb780d8b07fcc1e7f0953fb0e1aafda0bca2f4
d67ef873bc5ee1f7bdbbcbee55d39fdd82d47e44d03a1f89326b96f22beb48f8
ea78af43fea7f531cdde36d09a4f529fbbe48942af7986fd6a0d4aa1e90603d6
ea87cdd2279058468433ae09154462570e0049511472b62419674502cd78a800
ec253737811e90629930b5994c3b547d463efc543f20d3fdd11f3f4950d50f85


Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3a56e4d96576b02d2ecd98bc8a94bf3c460187caae82bba2085ed965a174a122

Assert condition: abort
Assert function: void KernelDevice::_aio_thread()

Sanitized backtrace:

    KernelDevice::flush()
    BlueStore::_kv_sync_thread()
    BlueStore::KVSyncThread::entry()

Crash dump sample:
{
    "archived": "2022-02-09 23:30:45.530422",
    "assert_condition": "abort",
    "assert_file": "os/bluestore/KernelDevice.cc",
    "assert_func": "void KernelDevice::_aio_thread()",
    "assert_line": 572,
    "assert_msg": "os/bluestore/KernelDevice.cc: In function 'virtual int KernelDevice::flush()' thread 7f080097c700 time 2022-02-09T23:48:14.431131+0100\nos/bluestore/KernelDevice.cc: 435: ceph_abort_msg(\"abort() called\")",
    "assert_thread_name": "bstore_aio",
    "backtrace": [
        "(()+0x153c0) [0x7f08113313c0]",
        "(gsignal()+0xcb) [0x7f0810db518b]",
        "(abort()+0x12b) [0x7f0810d94859]",
        "(ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x1b9) [0x56023ed8a07d]",
        "(KernelDevice::flush()+0x773) [0x56023f4e0ca3]",
        "(BlueStore::_kv_sync_thread()+0xbc8) [0x56023f3ec8b8]",
        "(BlueStore::KVSyncThread::entry()+0x11) [0x56023f418061]",
        "(()+0x9609) [0x7f0811325609]",
        "(clone()+0x43) [0x7f0810e91293]" 
    ],
    "ceph_version": "15.2.15",
    "crash_id": "2022-02-09T22:48:14.444130Z_7152cdf3-e7d4-44da-92c4-9a2ad40c810c",
    "entity_name": "osd.de1dcae439379241a8222b5020cbc24c286a27c9",
    "io_error": true,
    "io_error_code": -121,
    "io_error_devname": "dm-3",
    "io_error_length": 65536,
    "io_error_offset": 1197120319488,
    "io_error_optype": 8,
    "io_error_path": "/var/lib/ceph/osd/ceph-15/block",
    "os_id": "ubuntu",
    "os_name": "Ubuntu",
    "os_version": "20.04.3 LTS (Focal Fossa)",
    "os_version_id": "20.04",
    "process_name": "ceph-osd",
    "stack_sig": "9ee13dd03a8461554657b36189439dfcb41e046b6539d060f373eee7f1b8f79a",
    "timestamp": "2022-02-09T22:48:14.444130Z",
    "utsname_machine": "x86_64",
    "utsname_release": "5.4.0-96-generic",
    "utsname_sysname": "Linux",
    "utsname_version": "#109-Ubuntu SMP Wed Jan 12 16:49:16 UTC 2022" 
}

Actions #1

Updated by Telemetry Bot about 2 years ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v14.2.21, v15.2.1, v15.2.13, v15.2.15, v15.2.3, v15.2.9, v16.2.7 added
Actions #2

Updated by Telemetry Bot over 1 year ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v14.2.11, v14.2.15, v14.2.16, v14.2.19, v14.2.20, v14.2.22, v14.2.4, v14.2.5, v14.2.6, v14.2.7, v14.2.9, v15.2.0, v15.2.10, v15.2.11, v15.2.14, v15.2.16, v15.2.2, v15.2.4, v15.2.5, v15.2.6, v15.2.7, v15.2.8, v16.2.1, v16.2.4, v16.2.5, v16.2.6, v16.2.9, v17.2.1 added
Actions #3

Updated by Telemetry Bot 11 months ago

  • Crash signature (v1) updated (diff)
  • Affected Versions v15.2.17, v15.2.18, v16.2.10, v16.2.11, v17.2.3, v17.2.4, v17.2.5, v17.2.6 added
Actions

Also available in: Atom PDF