Project

General

Profile

Edit History

Wiki » QA »

Pacific » History » Version 41

Patrick Donnelly, 09/14/2021 03:04 PM

1 1 Patrick Donnelly 
h1. Pacific
2 





    3
    4
    Patrick Donnelly
    
h2. On-call Schedule





    4
    
    
    





    5
    
    
    
* April: Patrick





    6
    7
    Milind Changire
    
* May: Milind





    7
    8
    Jeff Layton
    
* June: Jeff





    8
    10
    Jos Collin
    
* July: Jos Collin





    9
    9
    Ramana Raja
    
* Aug: Ramana





    10
    39
    Xiubo Li
    
* Sep: Xiubo





    11
    38
    Ramana Raja
    





    12
    1
    Patrick Donnelly
    
h2. Reviews





    13
    40
    Ramana Raja
    





    14
    41
    Patrick Donnelly
    





    15
    
    
    
h3. 2021 September 14 (QE)





    16
    
    
    





    17
    
    
    
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/





    18
    
    
    
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/





    19
    
    
    





    20
    
    
    
* https://tracker.ceph.com/issues/52606





    21
    
    
    
    qa: test_dirfrag_limit





    22
    
    
    
* https://tracker.ceph.com/issues/52607





    23
    
    
    
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"





    24
    
    
    





    25
    
    
    





    26
    40
    Ramana Raja
    
h3. 2021 Sep 7





    27
    
    
    





    28
    
    
    
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/





    29
    
    
    
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/





    30
    
    
    





    31
    
    
    





    32
    
    
    
* https://tracker.ceph.com/issues/52396





    33
    
    
    
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)





    34
    
    
    
* https://tracker.ceph.com/issues/51705





    35
    
    
    
    qa: tasks.cephfs.fuse_mount:mount command failed





    36
    4
    Patrick Donnelly
    





    37
    34
    Ramana Raja
    
h3. 2021 Aug 30





    38
    
    
    





    39
    
    
    
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific





    40
    
    
    





    41
    
    
    
* https://tracker.ceph.com/issues/45434





    42
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    43
    
    
    
* https://tracker.ceph.com/issues/51705





    44
    
    
    
    qa: tasks.cephfs.fuse_mount:mount command failed





    45
    
    
    
* https://tracker.ceph.com/issues/52396





    46
    
    
    
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)





    47
    35
    Ramana Raja
    
* https://tracker.ceph.com/issues/52487





    48
    36
    Ramana Raja
    
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)





    49
    
    
    
* https://tracker.ceph.com/issues/51267





    50
    37
    Ramana Raja
    
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)





    51
    
    
    
* https://tracker.ceph.com/issues/48772





    52
    
    
    
   qa: pjd: not ok 9, 44, 80





    53
    35
    Ramana Raja
    





    54
    34
    Ramana Raja
    





    55
    31
    Ramana Raja
    
h3. 2021 Aug 23





    56
    
    
    





    57
    
    
    
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/





    58
    
    
    





    59
    
    
    
* https://tracker.ceph.com/issues/45434





    60
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    61
    
    
    
* https://tracker.ceph.com/issues/51705





    62
    
    
    
    qa: tasks.cephfs.fuse_mount:mount command failed





    63
    32
    Ramana Raja
    
* https://tracker.ceph.com/issues/52396





    64
    33
    Ramana Raja
    
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)





    65
    
    
    
* https://tracker.ceph.com/issues/52397





    66
    
    
    
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed





    67
    
    
    





    68
    31
    Ramana Raja
    





    69
    29
    Ramana Raja
    
h3. 2021 Aug 11





    70
    
    
    





    71
    
    
    
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/





    72
    
    
    
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/





    73
    
    
    





    74
    
    
    
* https://tracker.ceph.com/issues/45434





    75
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    76
    
    
    
* https://tracker.ceph.com/issues/51705





    77
    
    
    
    qa: tasks.cephfs.fuse_mount:mount command failed





    78
    30
    Ramana Raja
    
* https://tracker.ceph.com/issues/50222





    79
    
    
    
    osd: 5.2s0 deep-scrub : stat mismatch





    80
    29
    Ramana Raja
    





    81
    19
    Jos Collin
    
h3. 2021 July 15





    82
    20
    Jos Collin
    





    83
    19
    Jos Collin
    
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/





    84
    
    
    





    85
    26
    Jos Collin
    
* https://tracker.ceph.com/issues/45434





    86
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    87
    
    
    
* https://tracker.ceph.com/issues/51705





    88
    
    
    
    qa: tasks.cephfs.fuse_mount:mount command failed





    89
    27
    Jos Collin
    
* https://tracker.ceph.com/issues/51183





    90
    
    
    
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)





    91
    28
    Jos Collin
    
* https://tracker.ceph.com/issues/50528





    92
    
    
    
    qa: fs:thrash: pjd suite not ok 80





    93
    
    
    
* https://tracker.ceph.com/issues/51706





    94
    
    
    
    qa: osd deep-scrub stat mismatch





    95
    26
    Jos Collin
    





    96
    19
    Jos Collin
    
h3. 2021 July 13





    97
    20
    Jos Collin
    





    98
    19
    Jos Collin
    
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/





    99
    
    
    





    100
    21
    Jos Collin
    
* https://tracker.ceph.com/issues/51704





    101
    
    
    
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)





    102
    23
    Jos Collin
    
* https://tracker.ceph.com/issues/45434





    103
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    104
    24
    Jos Collin
    
* https://tracker.ceph.com/issues/51705





    105
    25
    Jos Collin
    
    qa: tasks.cephfs.fuse_mount:mount command failed





    106
    
    
    
* https://tracker.ceph.com/issues/48640





    107
    24
    Jos Collin
    
    qa: snapshot mismatch during mds thrashing





    108
    21
    Jos Collin
    





    109
    18
    Patrick Donnelly
    
h3. 2021 June 29 (Integration Branch)





    110
    
    
    





    111
    
    
    
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/





    112
    
    
    





    113
    
    
    
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065





    114
    
    
    
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/





    115
    
    
    





    116
    
    
    
* https://tracker.ceph.com/issues/45434





    117
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    118
    
    
    
* https://tracker.ceph.com/issues/50260





    119
    
    
    
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"





    120
    
    
    
* https://tracker.ceph.com/issues/51183





    121
    
    
    
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'





    122
    
    
    





    123
    
    
    





    124
    16
    Jeff Layton
    
h3. 2021 June 28





    125
    
    
    





    126
    
    
    
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/





    127
    
    
    





    128
    
    
    
* https://tracker.ceph.com/issues/45434





    129
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    130
    
    
    
* https://tracker.ceph.com/issues/51440





    131
    17
    Jeff Layton
    
    fallocate fails with EACCES





    132
    16
    Jeff Layton
    
* https://tracker.ceph.com/issues/51264





    133
    
    
    
    TestVolumeClient failure





    134
    
    
    
* https://tracker.ceph.com/issues/51266





    135
    
    
    
    test cleanup failure





    136
    
    
    
* https://tracker.ceph.com/issues/51183





    137
    
    
    
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 





    138
    
    
    





    139
    12
    Jeff Layton
    
h3. 2021 June 14





    140
    
    
    





    141
    
    
    
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/





    142
    
    
    
 





    143
    
    
    
* https://tracker.ceph.com/issues/45434





    144
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    145
    
    
    
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276





    146
    
    
    
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com





    147
    
    
    
* https://tracker.ceph.com/issues/51263





    148
    
    
    
    pjdfstest rename test 10.t failed with EACCES





    149
    
    
    
* https://tracker.ceph.com/issues/51264





    150
    
    
    
    TestVolumeClient failure





    151
    13
    Jeff Layton
    
* https://tracker.ceph.com/issues/51266





    152
    
    
    
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 





    153
    14
    Jeff Layton
    
* https://tracker.ceph.com/issues/50279





    154
    
    
    
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"





    155
    15
    Jeff Layton
    
* https://tracker.ceph.com/issues/51267





    156
    
    
    
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1





    157
    11
    Patrick Donnelly
    





    158
    
    
    
h3. 2021 June 07 (Integration Branch)





    159
    
    
    





    160
    
    
    
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific





    161
    
    
    





    162
    
    
    
* https://tracker.ceph.com/issues/45434





    163
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    164
    
    
    
* https://tracker.ceph.com/issues/50279





    165
    
    
    
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"





    166
    
    
    
* https://tracker.ceph.com/issues/48773





    167
    
    
    
    qa: scrub does not complete





    168
    
    
    
* https://tracker.ceph.com/issues/51170





    169
    
    
    
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'





    170
    
    
    
* https://tracker.ceph.com/issues/48203 (stock kernel update required)





    171
    
    
    
    qa: quota failure





    172
    
    
    





    173
    
    
    





    174
    6
    Patrick Donnelly
    
h3. 2021 Apr 28 (QE pre-release)





    175
    
    
    





    176
    
    
    
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/





    177
    
    
    
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/





    178
    
    
    





    179
    
    
    
* https://tracker.ceph.com/issues/45434





    180
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    181
    
    
    
* https://tracker.ceph.com/issues/50258





    182
    
    
    
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"





    183
    
    
    
* https://tracker.ceph.com/issues/50260





    184
    
    
    
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"





    185
    
    
    
* https://tracker.ceph.com/issues/49962





    186
    
    
    
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes





    187
    
    
    
* https://tracker.ceph.com/issues/50016





    188
    
    
    
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"





    189
    
    
    
* https://tracker.ceph.com/issues/48203 (stock kernel update required)





    190
    
    
    
    qa: quota failure





    191
    
    
    
* https://tracker.ceph.com/issues/50528





    192
    
    
    
    pacific: qa: fs:thrash: pjd suite not ok 20





    193
    
    
    





    194
    
    
    





    195
    3
    Patrick Donnelly
    
h3. 2021 Apr 22 (Integration Branch)





    196
    
    
    





    197
    
    
    
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/





    198
    
    
    





    199
    
    
    
* https://tracker.ceph.com/issues/50527





    200
    
    
    
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)





    201
    
    
    
* https://tracker.ceph.com/issues/50528





    202
    
    
    
    pacific: qa: fs:thrash: pjd suite not ok 20





    203
    
    
    
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)





    204
    
    
    
    qa: "Assertion `cb_done' failed."





    205
    
    
    
* https://tracker.ceph.com/issues/49500





    206
    
    
    
    qa: "Assertion `cb_done' failed."





    207
    
    
    
* https://tracker.ceph.com/issues/48203 (stock kernel update required)





    208
    
    
    
    qa: quota failure





    209
    
    
    
* https://tracker.ceph.com/issues/45434





    210
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    211
    
    
    
* https://tracker.ceph.com/issues/50279





    212
    
    
    
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"





    213
    
    
    
* https://tracker.ceph.com/issues/50258





    214
    
    
    
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"





    215
    
    
    
* https://tracker.ceph.com/issues/49962





    216
    
    
    
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes





    217
    
    
    
* https://tracker.ceph.com/issues/49962





    218
    
    
    
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes





    219
    
    
    
* https://tracker.ceph.com/issues/50530





    220
    
    
    
    pacific: client: abort after MDS blocklist





    221
    
    
    





    222
    2
    Patrick Donnelly
    





    223
    
    
    
h3. 2021 Apr 21 (Integration Branch)





    224
    
    
    





    225
    
    
    
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/





    226
    
    
    





    227
    
    
    
* https://tracker.ceph.com/issues/45434





    228
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    229
    
    
    
* https://tracker.ceph.com/issues/50250





    230
    
    
    
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"





    231
    
    
    
* https://tracker.ceph.com/issues/50258





    232
    
    
    
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"





    233
    
    
    
* https://tracker.ceph.com/issues/48203 (stock kernel update required)





    234
    
    
    
    qa: quota failure





    235
    
    
    
* https://tracker.ceph.com/issues/50016





    236
    
    
    
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"





    237
    
    
    
* https://tracker.ceph.com/issues/50495





    238
    
    
    
    pacific: client: shutdown race fails with status 141





    239
    
    
    





    240
    
    
    





    241
    1
    Patrick Donnelly
    
h3. 2021 Apr 07 (Integration Branch)





    242
    
    
    





    243
    
    
    
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/





    244
    
    
    





    245
    
    
    
* https://tracker.ceph.com/issues/45434





    246
    
    
    
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed





    247
    
    
    
* https://tracker.ceph.com/issues/48805





    248
    
    
    
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"





    249
    
    
    
* https://tracker.ceph.com/issues/49500





    250
    
    
    
    qa: "Assertion `cb_done' failed."





    251
    
    
    
* https://tracker.ceph.com/issues/50258 (new)





    252
    
    
    
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"





    253
    
    
    
* https://tracker.ceph.com/issues/49962





    254
    
    
    
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes





    255
    
    
    
* https://tracker.ceph.com/issues/48203 (stock kernel update required)





    256
    
    
    
    qa: quota failure





    257
    
    
    
* https://tracker.ceph.com/issues/50260





    258
    
    
    
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"





    259
    
    
    
* https://tracker.ceph.com/issues/50016





    260
    
    
    
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"