Project

General

Profile

Actions
Copy link

Bug #64110

open

ceph_assert(image_extents.size() == 1) failure in TestLibRBD.TestIO

Added by Ilya Dryomov 4 months ago. Updated 3 months ago.

Status:
Triaged
Priority:
Normal
Assignee:
Ilya Dryomov
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

https://pulpito.ceph.com/yuriw-2024-01-18_21:22:11-rbd-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7521376

2024-01-19T11:20:25.811 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN      ] TestLibRBD.TestIO
2024-01-19T11:20:25.811 INFO:tasks.workunit.client.0.smithi131.stdout:using old format
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 512
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 512
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 512
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 512
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 512
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:started write
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.183 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:finished write
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:started write
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:finished write
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:started write
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:finished write
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.184 INFO:tasks.workunit.client.0.smithi131.stdout:started write
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:finished write
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:started write
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:finished write
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:start compare and write
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:compare and  wrote: 512
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:start compare and write
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:compare and  wrote: 512
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:start compare and write
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:compare and  wrote: 512
2024-01-19T11:20:27.185 INFO:tasks.workunit.client.0.smithi131.stdout:start compare and write
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:compare and  wrote: 512
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:start compare and write
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:compare and  wrote: 512
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:started aio compare and write
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:finished aio compare and write
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:started aio compare and write
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:finished aio compare and write
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:started aio compare and write
2024-01-19T11:20:27.186 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:finished aio compare and write
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:started aio compare and write
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:finished aio compare and write
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:started aio compare and write
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:finished aio compare and write
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.187 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:started read
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:read completion cb called!
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 512
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:started read
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:read completion cb called!
2024-01-19T11:20:27.188 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 512
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:started read
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:read completion cb called!
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 512
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:started read
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:read completion cb called!
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 512
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:started read
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:read completion cb called!
2024-01-19T11:20:27.192 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 512
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:discard: 512~512 = 512
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:aio discard: 1536~512 = 0
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:read: 512
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 0
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 0
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.193 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 16384
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 16384
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 49152
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 49152
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 65536
2024-01-19T11:20:27.194 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 65536
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 98304
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 98304
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 114688
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 114688
2024-01-19T11:20:27.195 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 147456
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 147456
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 163840
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 163840
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.196 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 196608
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 196608
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 212992
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 212992
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.197 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.198 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.199 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:27.200 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:27.201 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:27.201 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:27.201 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.358 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.359 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.360 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.361 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.362 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.363 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.364 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:write completion cb called!
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:return value is: 0
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:finished writesame
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:to verify the data
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:verified
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.365 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stdout:created completion
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stdout:started writesame
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stdout:expected fail, finished writesame
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stdout:read completion cb called!
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stdout:read completion cb called!
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stdout:wrote: 512
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-766-g0edf41a6/rpm/el9/BUILD/ceph-19.0.0-766-g0edf41a6/src/librbd/io/ObjectRequest.cc: In function 'int librbd::io::ObjectCompareAndWriteRequest<ImageCtxT>::filter_write_result(int) const [with ImageCtxT = librbd::ImageCtx]' thread 7fcf9a7fc640 time 2024-01-19T11:20:28.355257+0000
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-766-g0edf41a6/rpm/el9/BUILD/ceph-19.0.0-766-g0edf41a6/src/librbd/io/ObjectRequest.cc: 721: FAILED ceph_assert(image_extents.size() == 1)
2024-01-19T11:20:28.366 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 19.0.0-766-g0edf41a6 (0edf41a622739843d6b978b179ff3227b476dd9d) squid (dev)
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcfa6f7fc3c]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x17fdfa) [0x7fcfa6f7fdfa]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (librbd::io::ObjectCompareAndWriteRequest<librbd::ImageCtx>::filter_write_result(int) const+0x130) [0x55a3bd23f050]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (librbd::io::AbstractObjectWriteRequest<librbd::ImageCtx>::handle_write_object(int)+0x4f) [0x55a3bd2483ef]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 5: _ZN5boost4asio6detail30any_completion_handler_call_fnIFvNS_6system10error_codeEEE4implINS1_15consign_handlerIZN6librbd4asio4util20get_callback_adapterIZNS9_2io26AbstractObjectWriteRequestINS9_8ImageCtxEE12write_objectEvEUliE2_EEDaOT_EUlS4_DpOT_E_JNS0_19executor_work_guardINS0_10io_context19basic_executor_typeISaIvELm0EEEvvEEEEEEEvPNS1_32any_completion_handler_impl_baseES4_()
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/librados.so.2(+0xcaaf5) [0x7fcfa7b3faf5]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 7: /lib64/librados.so.2(+0xb3380) [0x7fcfa7b28380]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 8: /lib64/librados.so.2(+0xc682c) [0x7fcfa7b3b82c]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 9: /lib64/librados.so.2(+0xc6c7e) [0x7fcfa7b3bc7e]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/librados.so.2(+0x1351be) [0x7fcfa7baa1be]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 11: /lib64/librados.so.2(+0xcee7f) [0x7fcfa7b43e7f]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 12: /lib64/libstdc++.so.6(+0xdb924) [0x7fcfa64db924]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 13: /lib64/libc.so.6(+0x9f802) [0x7fcfa609f802]
2024-01-19T11:20:28.367 INFO:tasks.workunit.client.0.smithi131.stderr: 14: /lib64/libc.so.6(+0x3f450) [0x7fcfa603f450]
2024-01-19T11:20:29.245 DEBUG:teuthology.orchestra.run:got remote process result: 134

Not sure what happened in this particular case with the old format, but 

    auto [image_extents, _] = io::util::object_to_area_extents(
        image_ctx, this->m_object_no, {{m_mismatch_object_offset, this->m_object_len}});
    ceph_assert(image_extents.size() == 1);

seems wrong to me. I would expect 1 to be passed instead of this->m_object_len -- otherwise m_mismatch_object_offset~this->m_object_len extent could run outside the stripe unit or even outside the object.

Actions
Copy link
 #1

Updated by Ilya Dryomov 3 months ago

Another recent failure, not an assert but a similar test which never failed sporadically before:

http://qa-proxy.ceph.com/teuthology/dis-2024-01-25_23:43:52-rbd-wip-dis-testing-distro-default-smithi/7532789

2024-01-26T03:50:41.072 INFO:tasks.workunit.client.0.smithi194.stdout:[ RUN      ] TestLibRBD.TestAioCompareAndWriteMismatchPP
2024-01-26T03:50:41.072 INFO:tasks.workunit.client.0.smithi194.stdout:using new format!
2024-01-26T03:50:41.129 INFO:tasks.workunit.client.0.smithi194.stdout:write completion cb called!
2024-01-26T03:50:41.129 INFO:tasks.workunit.client.0.smithi194.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-878-g23d54e4f/rpm/el9/BUILD/ceph-19.0.0-878-g23d54e4f/src/test/librbd/test_librbd.cc:5456: Failure
2024-01-26T03:50:41.129 INFO:tasks.workunit.client.0.smithi194.stdout:Expected equality of these values:
2024-01-26T03:50:41.129 INFO:tasks.workunit.client.0.smithi194.stdout:  -84
2024-01-26T03:50:41.129 INFO:tasks.workunit.client.0.smithi194.stdout:  aio_ret
2024-01-26T03:50:41.129 INFO:tasks.workunit.client.0.smithi194.stdout:    Which is: -4100
Actions
Copy link
 #2

Updated by Ilya Dryomov 3 months ago

I managed to reproduce the -84 vs -4100 failure and filed https://tracker.ceph.com/issues/64192.

Actions
Copy link
 #3

Updated by Ilya Dryomov 3 months ago

  • Status changed from New to Triaged
  • Assignee set to Ilya Dryomov
Actions
Copy link

Also available in: Atom PDF