Project

General

Profile

Bug #45694

"TestMigration.StressLive" fails

Added by Kefu Chai 6 months ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

[ RUN      ] TestMigration.StressLive
...
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user1, block 29360128~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user2, block 29360128~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user3, block 29360128~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
[  FAILED  ] TestMigration.StressLive (5373 ms)
...
The following tests FAILED:
      6 - run-rbd-unit-tests-N.sh (Failed)

found in 'make check' runs performed by jenkins.

see https://github.com/ceph/ceph/pull/35222

History

#1 Updated by Kefu Chai 6 months ago

hi Jason, mind taking a look?

#2 Updated by Kefu Chai 6 months ago

  • Description updated (diff)

#4 Updated by Sebastian Wagner 4 months ago

[ RUN      ] TestMigration.StressLive
resize: 83886080
write: A 14189046~7453310
discard: 20225079~2701729
write: A 30885423~5709049
discard: 46481821~6993441
write: A 77667211~6218869
discard: 52802612~6566589
write: A 48946668~7555490
discard: 7683394~7533955
snap_create: snap0
resize: 150454613
write: B 102177830~2310820
discard: 103664482~4432103
write: B 73141758~6662509
discard: 35848104~5951569
write: B 51378288~2250537
discard: 2300898~704489
write: B 108821095~2247739
discard: 19822048~5940012
snap_create: snap1
write: C 145427126~3260454
discard: 147960604~1821887
write: C 30230407~110720
discard: 128410804~5977216
write: C 17303492~7216763
discard: 53317568~1727031
write: C 14438287~7100246
discard: 24027691~433762
snap_create: snap2
resize: 175529756
write: D 37093319~6348350
discard: 156757704~7225194
write: D 73302210~110316
discard: 47241027~3943201
write: D 43576944~2130965
discard: 19886125~6189903
write: D 3585797~6929446
discard: 119696274~972285
snap_create: snap3
migration_prepare
migration_execute
write: a 33578431~1083005
discard: 123629250~6449592
write: a 83829801~7240762
discard: 33684588~5391721
write: a 6578422~1364859
discard: 148074120~5797466
write: a 97267290~3808617
discard: 82844977~7399050
snap_create: user0
write: b 11429345~2249154
discard: 43532859~5790903
write: b 60146552~2028604
discard: 121687496~1516139
write: b 161964577~6613694
discard: 3614455~891649
write: b 94269726~419703
discard: 139709526~280376
snap_create: user1
write: c 170223077~3945066
discard: 164748816~2078231
write: c 42676630~4659561
discard: 159373483~7526602
write: c 41549139~4493790
discard: 142770056~750901
write: c 76922502~4615008
discard: 94696886~5753386
snap_create: user2
resize: 295079925
write: d 262162336~33718
discard: 192801602~5073272
write: d 39680065~1819219
discard: 2011973~755268
write: d 76138121~5549953
discard: 274429112~1296967
write: d 97033459~1544304
discard: 131925684~5289513
snap_create: user3
resize: 424312527
write: 1 42431252~10607813
discard: 45083205~5303906
write: 2 84862505~10607813
discard: 87514458~5303906
write: 3 127293758~10607813
discard: 129945711~5303906
write: 4 169725010~10607813
discard: 172376963~5303906
write: 5 212156263~10607813
discard: 214808216~5303906
migration_commit
after commit snap: user0, block 4194304~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user1, block 4194304~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user2, block 4194304~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user3, block 4194304~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: null, block 4194304~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
[  FAILED  ] TestMigration.StressLive (3571 ms)

https://jenkins.ceph.com/job/ceph-pull-requests/56940/consoleFull#-78274084e840cee4-f4a4-4183-81dd-42855615f2c1

#5 Updated by Sebastian Wagner 4 months ago

[ RUN      ] TestMigration.StressLive
resize: 83886080
write: A 13702922~2678541
discard: 13881004~6810979
write: A 49110948~6936813
discard: 51541425~4051199
write: A 53674946~6887683
discard: 18777008~2019298
write: A 82464644~210883
discard: 21455060~7998643
snap_create: snap0
write: B 35588620~5280154
discard: 78181009~5705071
write: B 64823389~4046205
discard: 5955270~7625100
write: B 540442~3117380
discard: 9789278~4777867
write: B 65035742~6723938
discard: 20426860~4079211
snap_create: snap1
resize: 143789335
write: C 97082460~2197849
discard: 111384147~5234198
write: C 30194323~2016233
discard: 84353109~5426925
write: C 120263003~399772
discard: 61539489~3626061
write: C 12562828~4852372
discard: 111435969~7111804
snap_create: snap2
resize: 134728747
write: D 112147305~8271968
discard: 37278495~336064
write: D 63834187~4657881
discard: 36036624~4401410
write: D 93601043~3040810
discard: 12590142~6642855
write: D 123215103~1275013
discard: 109428887~2907217
snap_create: snap3
migration_prepare
migration_execute
write: a 40252532~4923451
discard: 7917439~898041
write: a 105055808~7097872
discard: 40619730~4176930
write: a 45615540~1367295
discard: 86400172~2510076
write: a 96021109~1186877
discard: 68325028~3419490
snap_create: user0
resize: 174192390
write: b 38801862~1573590
discard: 3536609~2433032
write: b 127323974~5381676
discard: 67428748~2821049
write: b 43670898~3800059
discard: 166513437~7678953
write: b 2668508~7132870
discard: 8030911~230154
snap_create: user1
resize: 200261933
write: c 95085658~4545835
discard: 25884323~2726298
write: c 103899017~5247526
discard: 28534915~1060653
write: c 44422529~2127245
discard: 173514294~3350112
write: c 53254696~2511766
discard: 160198378~1695047
snap_create: user2
write: d 134363623~7076723
discard: 83215959~3922945
write: d 91210835~2881295
discard: 132889060~2750197
write: d 12287288~5940353
discard: 131540440~5032112
write: d 78533008~3340051
discard: 185377102~1739883
snap_create: user3
resize: 194842727
write: 1 19484272~4871068
discard: 20702039~2435534
write: 2 38968545~4871068
discard: 40186312~2435534
write: 3 58452818~4871068
discard: 59670585~2435534
write: 4 77937090~4871068
discard: 79154857~2435534
write: 5 97421363~4871068
discard: 98639130~2435534
migration_commit
after commit snap: user0, block 46137344~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user0, block 67108864~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user1, block 67108864~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user2, block 67108864~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user3, block 67108864~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: null, block 67108864~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
[  FAILED  ] TestMigration.StressLive (2776 ms)
[----------] 54 tests from TestMigration (31173 ms total)

https://jenkins.ceph.com/job/ceph-pull-requests/57111/consoleFull#512427994e840cee4-f4a4-4183-81dd-42855615f2c1

#7 Updated by Kefu Chai about 2 months ago

[ RUN      ] TestMigration.StressLive
resize: 83886080
write: A 71159214~6293317
discard: 57226936~4585181

...
migration_commit
after commit snap: user0, block 134217728~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user1, block 134217728~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user2, block 134217728~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
after commit snap: user3, block 134217728~4194304 differs
/home/jenkins-build/build/workspace/ceph-pull-requests/src/test/librbd/test_Migration.cc:153: Failure
Value of: src_bl.contents_equal(dst_bl)
  Actual: false
Expected: true
[  FAILED  ] TestMigration.StressLive (4511 ms)

Also available in: Atom PDF