Pacific » History » Version 46
Kotresh Hiremath Ravishankar, 11/22/2021 08:01 AM
| 1 | 1 | Patrick Donnelly | h1. Pacific |
|---|---|---|---|
| 2 | |||
| 3 | 4 | Patrick Donnelly | h2. On-call Schedule |
| 4 | |||
| 5 | * April: Patrick |
||
| 6 | 7 | Milind Changire | * May: Milind |
| 7 | 8 | Jeff Layton | * June: Jeff |
| 8 | 10 | Jos Collin | * July: Jos Collin |
| 9 | 9 | Ramana Raja | * Aug: Ramana |
| 10 | 39 | Xiubo Li | * Sep: Xiubo |
| 11 | 45 | Patrick Donnelly | * Oct: Rishabh |
| 12 | * Nov: Kotresh |
||
| 13 | * Dec: Venky |
||
| 14 | * Jan: Milind |
||
| 15 | 38 | Ramana Raja | |
| 16 | 1 | Patrick Donnelly | h2. Reviews |
| 17 | 40 | Ramana Raja | |
| 18 | 46 | Kotresh Hiremath Ravishankar | h3. 2021 November 22 |
| 19 | |||
| 20 | http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi |
||
| 21 | http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi |
||
| 22 | http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi |
||
| 23 | |||
| 24 | |||
| 25 | NEW |
||
| 26 | |||
| 27 | * https://tracker.ceph.com/issues/53300 |
||
| 28 | qa: cluster [WRN] Scrub error on inode |
||
| 29 | * https://tracker.ceph.com/issues/53302 |
||
| 30 | qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1 |
||
| 31 | * https://tracker.ceph.com/issues/53314 |
||
| 32 | qa: fs/upgrade/mds_upgrade_sequence test timeout |
||
| 33 | * https://tracker.ceph.com/issues/53316 |
||
| 34 | qa: (smithi150) slow request osd_op, currently waiting for sub ops warning |
||
| 35 | |||
| 36 | OLD ONES SEEN |
||
| 37 | |||
| 38 | * https://tracker.ceph.com/issues/52624 |
||
| 39 | qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" |
||
| 40 | * https://tracker.ceph.com/issues/52396 |
||
| 41 | pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
||
| 42 | * https://tracker.ceph.com/issues/52875 |
||
| 43 | pacific: qa: test_dirfrag_limit |
||
| 44 | * https://tracker.ceph.com/issues/51705 |
||
| 45 | pacific: qa: tasks.cephfs.fuse_mount:mount command failed |
||
| 46 | * https://tracker.ceph.com/issues/39634 |
||
| 47 | qa: test_full_same_file timeout |
||
| 48 | * https://tracker.ceph.com/issues/49748 |
||
| 49 | gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds |
||
| 50 | |||
| 51 | 41 | Patrick Donnelly | h3. 2021 September 14 (QE) |
| 52 | |||
| 53 | https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/ |
||
| 54 | 1 | Patrick Donnelly | http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/ |
| 55 | 43 | Ramana Raja | https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/ |
| 56 | 41 | Patrick Donnelly | |
| 57 | * https://tracker.ceph.com/issues/52606 |
||
| 58 | qa: test_dirfrag_limit |
||
| 59 | * https://tracker.ceph.com/issues/52607 |
||
| 60 | qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)" |
||
| 61 | 44 | Ramana Raja | * https://tracker.ceph.com/issues/51705 |
| 62 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
| 63 | 41 | Patrick Donnelly | |
| 64 | 40 | Ramana Raja | h3. 2021 Sep 7 |
| 65 | |||
| 66 | https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/ |
||
| 67 | https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/ |
||
| 68 | |||
| 69 | |||
| 70 | * https://tracker.ceph.com/issues/52396 |
||
| 71 | qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
||
| 72 | * https://tracker.ceph.com/issues/51705 |
||
| 73 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
| 74 | 4 | Patrick Donnelly | |
| 75 | 34 | Ramana Raja | h3. 2021 Aug 30 |
| 76 | |||
| 77 | https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific |
||
| 78 | |||
| 79 | * https://tracker.ceph.com/issues/45434 |
||
| 80 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 81 | * https://tracker.ceph.com/issues/51705 |
||
| 82 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
| 83 | * https://tracker.ceph.com/issues/52396 |
||
| 84 | qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
||
| 85 | 35 | Ramana Raja | * https://tracker.ceph.com/issues/52487 |
| 86 | 36 | Ramana Raja | qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation) |
| 87 | * https://tracker.ceph.com/issues/51267 |
||
| 88 | 37 | Ramana Raja | Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) |
| 89 | * https://tracker.ceph.com/issues/48772 |
||
| 90 | qa: pjd: not ok 9, 44, 80 |
||
| 91 | 35 | Ramana Raja | |
| 92 | 34 | Ramana Raja | |
| 93 | 31 | Ramana Raja | h3. 2021 Aug 23 |
| 94 | |||
| 95 | https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/ |
||
| 96 | |||
| 97 | * https://tracker.ceph.com/issues/45434 |
||
| 98 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 99 | * https://tracker.ceph.com/issues/51705 |
||
| 100 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
| 101 | 32 | Ramana Raja | * https://tracker.ceph.com/issues/52396 |
| 102 | 33 | Ramana Raja | qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
| 103 | * https://tracker.ceph.com/issues/52397 |
||
| 104 | qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed |
||
| 105 | |||
| 106 | 31 | Ramana Raja | |
| 107 | 29 | Ramana Raja | h3. 2021 Aug 11 |
| 108 | |||
| 109 | https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/ |
||
| 110 | https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/ |
||
| 111 | |||
| 112 | * https://tracker.ceph.com/issues/45434 |
||
| 113 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 114 | * https://tracker.ceph.com/issues/51705 |
||
| 115 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
| 116 | 30 | Ramana Raja | * https://tracker.ceph.com/issues/50222 |
| 117 | osd: 5.2s0 deep-scrub : stat mismatch |
||
| 118 | 29 | Ramana Raja | |
| 119 | 19 | Jos Collin | h3. 2021 July 15 |
| 120 | 20 | Jos Collin | |
| 121 | 19 | Jos Collin | https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/ |
| 122 | |||
| 123 | 26 | Jos Collin | * https://tracker.ceph.com/issues/45434 |
| 124 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 125 | * https://tracker.ceph.com/issues/51705 |
||
| 126 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
| 127 | 27 | Jos Collin | * https://tracker.ceph.com/issues/51183 |
| 128 | Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) |
||
| 129 | 28 | Jos Collin | * https://tracker.ceph.com/issues/50528 |
| 130 | qa: fs:thrash: pjd suite not ok 80 |
||
| 131 | * https://tracker.ceph.com/issues/51706 |
||
| 132 | qa: osd deep-scrub stat mismatch |
||
| 133 | 26 | Jos Collin | |
| 134 | 19 | Jos Collin | h3. 2021 July 13 |
| 135 | 20 | Jos Collin | |
| 136 | 19 | Jos Collin | https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/ |
| 137 | |||
| 138 | 21 | Jos Collin | * https://tracker.ceph.com/issues/51704 |
| 139 | Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) |
||
| 140 | 23 | Jos Collin | * https://tracker.ceph.com/issues/45434 |
| 141 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 142 | 24 | Jos Collin | * https://tracker.ceph.com/issues/51705 |
| 143 | 25 | Jos Collin | qa: tasks.cephfs.fuse_mount:mount command failed |
| 144 | * https://tracker.ceph.com/issues/48640 |
||
| 145 | 24 | Jos Collin | qa: snapshot mismatch during mds thrashing |
| 146 | 21 | Jos Collin | |
| 147 | 18 | Patrick Donnelly | h3. 2021 June 29 (Integration Branch) |
| 148 | |||
| 149 | https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/ |
||
| 150 | |||
| 151 | Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065 |
||
| 152 | Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/ |
||
| 153 | |||
| 154 | * https://tracker.ceph.com/issues/45434 |
||
| 155 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 156 | * https://tracker.ceph.com/issues/50260 |
||
| 157 | pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty" |
||
| 158 | * https://tracker.ceph.com/issues/51183 |
||
| 159 | qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions' |
||
| 160 | |||
| 161 | |||
| 162 | 16 | Jeff Layton | h3. 2021 June 28 |
| 163 | |||
| 164 | https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/ |
||
| 165 | |||
| 166 | * https://tracker.ceph.com/issues/45434 |
||
| 167 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 168 | * https://tracker.ceph.com/issues/51440 |
||
| 169 | 17 | Jeff Layton | fallocate fails with EACCES |
| 170 | 16 | Jeff Layton | * https://tracker.ceph.com/issues/51264 |
| 171 | TestVolumeClient failure |
||
| 172 | * https://tracker.ceph.com/issues/51266 |
||
| 173 | test cleanup failure |
||
| 174 | * https://tracker.ceph.com/issues/51183 |
||
| 175 | Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) |
||
| 176 | |||
| 177 | 12 | Jeff Layton | h3. 2021 June 14 |
| 178 | |||
| 179 | https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/ |
||
| 180 | |||
| 181 | * https://tracker.ceph.com/issues/45434 |
||
| 182 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 183 | * https://bugzilla.redhat.com/show_bug.cgi?id=1973276 |
||
| 184 | Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com |
||
| 185 | * https://tracker.ceph.com/issues/51263 |
||
| 186 | pjdfstest rename test 10.t failed with EACCES |
||
| 187 | * https://tracker.ceph.com/issues/51264 |
||
| 188 | TestVolumeClient failure |
||
| 189 | 13 | Jeff Layton | * https://tracker.ceph.com/issues/51266 |
| 190 | Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' |
||
| 191 | 14 | Jeff Layton | * https://tracker.ceph.com/issues/50279 |
| 192 | qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c" |
||
| 193 | 15 | Jeff Layton | * https://tracker.ceph.com/issues/51267 |
| 194 | Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1 |
||
| 195 | 11 | Patrick Donnelly | |
| 196 | h3. 2021 June 07 (Integration Branch) |
||
| 197 | |||
| 198 | http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific |
||
| 199 | |||
| 200 | * https://tracker.ceph.com/issues/45434 |
||
| 201 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 202 | * https://tracker.ceph.com/issues/50279 |
||
| 203 | qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c" |
||
| 204 | * https://tracker.ceph.com/issues/48773 |
||
| 205 | qa: scrub does not complete |
||
| 206 | * https://tracker.ceph.com/issues/51170 |
||
| 207 | pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split' |
||
| 208 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
| 209 | qa: quota failure |
||
| 210 | |||
| 211 | |||
| 212 | 6 | Patrick Donnelly | h3. 2021 Apr 28 (QE pre-release) |
| 213 | |||
| 214 | https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/ |
||
| 215 | https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/ |
||
| 216 | |||
| 217 | * https://tracker.ceph.com/issues/45434 |
||
| 218 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 219 | * https://tracker.ceph.com/issues/50258 |
||
| 220 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
| 221 | * https://tracker.ceph.com/issues/50260 |
||
| 222 | pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty" |
||
| 223 | * https://tracker.ceph.com/issues/49962 |
||
| 224 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
| 225 | * https://tracker.ceph.com/issues/50016 |
||
| 226 | qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes" |
||
| 227 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
| 228 | qa: quota failure |
||
| 229 | * https://tracker.ceph.com/issues/50528 |
||
| 230 | pacific: qa: fs:thrash: pjd suite not ok 20 |
||
| 231 | |||
| 232 | |||
| 233 | 3 | Patrick Donnelly | h3. 2021 Apr 22 (Integration Branch) |
| 234 | |||
| 235 | https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/ |
||
| 236 | |||
| 237 | * https://tracker.ceph.com/issues/50527 |
||
| 238 | pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse) |
||
| 239 | * https://tracker.ceph.com/issues/50528 |
||
| 240 | pacific: qa: fs:thrash: pjd suite not ok 20 |
||
| 241 | * https://tracker.ceph.com/issues/49500 (fixed in another integration run) |
||
| 242 | qa: "Assertion `cb_done' failed." |
||
| 243 | * https://tracker.ceph.com/issues/49500 |
||
| 244 | qa: "Assertion `cb_done' failed." |
||
| 245 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
| 246 | qa: quota failure |
||
| 247 | * https://tracker.ceph.com/issues/45434 |
||
| 248 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 249 | * https://tracker.ceph.com/issues/50279 |
||
| 250 | qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c" |
||
| 251 | * https://tracker.ceph.com/issues/50258 |
||
| 252 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
| 253 | * https://tracker.ceph.com/issues/49962 |
||
| 254 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
| 255 | * https://tracker.ceph.com/issues/49962 |
||
| 256 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
| 257 | * https://tracker.ceph.com/issues/50530 |
||
| 258 | pacific: client: abort after MDS blocklist |
||
| 259 | |||
| 260 | 2 | Patrick Donnelly | |
| 261 | h3. 2021 Apr 21 (Integration Branch) |
||
| 262 | |||
| 263 | https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/ |
||
| 264 | |||
| 265 | * https://tracker.ceph.com/issues/45434 |
||
| 266 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 267 | * https://tracker.ceph.com/issues/50250 |
||
| 268 | mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" |
||
| 269 | * https://tracker.ceph.com/issues/50258 |
||
| 270 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
| 271 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
| 272 | qa: quota failure |
||
| 273 | * https://tracker.ceph.com/issues/50016 |
||
| 274 | qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes" |
||
| 275 | * https://tracker.ceph.com/issues/50495 |
||
| 276 | pacific: client: shutdown race fails with status 141 |
||
| 277 | |||
| 278 | |||
| 279 | 1 | Patrick Donnelly | h3. 2021 Apr 07 (Integration Branch) |
| 280 | |||
| 281 | https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/ |
||
| 282 | |||
| 283 | * https://tracker.ceph.com/issues/45434 |
||
| 284 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
| 285 | * https://tracker.ceph.com/issues/48805 |
||
| 286 | mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details" |
||
| 287 | * https://tracker.ceph.com/issues/49500 |
||
| 288 | qa: "Assertion `cb_done' failed." |
||
| 289 | * https://tracker.ceph.com/issues/50258 (new) |
||
| 290 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
| 291 | * https://tracker.ceph.com/issues/49962 |
||
| 292 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
| 293 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
| 294 | qa: quota failure |
||
| 295 | * https://tracker.ceph.com/issues/50260 |
||
| 296 | pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty" |
||
| 297 | * https://tracker.ceph.com/issues/50016 |
||
| 298 | qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes" |