Pacific » History » Version 54
Venky Shankar, 03/22/2022 01:30 PM
1 | 1 | Patrick Donnelly | h1. Pacific |
---|---|---|---|
2 | |||
3 | 4 | Patrick Donnelly | h2. On-call Schedule |
4 | |||
5 | 52 | Venky Shankar | * Feb: Patrick |
6 | 53 | Venky Shankar | * Mar: Jeff |
7 | * Apr: Jos Collin |
||
8 | * May: Ramana |
||
9 | * Jun: Xiubo |
||
10 | * Jul: Rishabh |
||
11 | * Aug: Kotresh |
||
12 | * Sep: Venky |
||
13 | * Oct: Milind |
||
14 | 38 | Ramana Raja | |
15 | 1 | Patrick Donnelly | h2. Reviews |
16 | 40 | Ramana Raja | |
17 | 47 | Patrick Donnelly | |
18 | 54 | Venky Shankar | h3. 2022 March 22 |
19 | |||
20 | https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/ |
||
21 | |||
22 | * https://tracker.ceph.com/issues/52624 |
||
23 | qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" |
||
24 | * https://tracker.ceph.com/issues/52606 |
||
25 | qa: test_dirfrag_limit |
||
26 | * https://tracker.ceph.com/issues/51183 |
||
27 | Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) |
||
28 | * https://tracker.ceph.com/issues/51905 |
||
29 | qa: "error reading sessionmap 'mds1_sessionmap'" |
||
30 | * https://tracker.ceph.com/issues/53360 |
||
31 | pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" |
||
32 | * https://tracker.ceph.com/issues/54411 |
||
33 | mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; |
||
34 | 33 daemons have recently crashed" during suites/fsstress.sh |
||
35 | 47 | Patrick Donnelly | |
36 | 46 | Kotresh Hiremath Ravishankar | h3. 2021 November 22 |
37 | |||
38 | http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi |
||
39 | http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi |
||
40 | http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi |
||
41 | |||
42 | |||
43 | * https://tracker.ceph.com/issues/53300 |
||
44 | qa: cluster [WRN] Scrub error on inode |
||
45 | * https://tracker.ceph.com/issues/53302 |
||
46 | qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1 |
||
47 | * https://tracker.ceph.com/issues/53314 |
||
48 | qa: fs/upgrade/mds_upgrade_sequence test timeout |
||
49 | * https://tracker.ceph.com/issues/53316 |
||
50 | qa: (smithi150) slow request osd_op, currently waiting for sub ops warning |
||
51 | * https://tracker.ceph.com/issues/52624 |
||
52 | qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" |
||
53 | * https://tracker.ceph.com/issues/52396 |
||
54 | pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
||
55 | * https://tracker.ceph.com/issues/52875 |
||
56 | pacific: qa: test_dirfrag_limit |
||
57 | * https://tracker.ceph.com/issues/51705 |
||
58 | 1 | Patrick Donnelly | pacific: qa: tasks.cephfs.fuse_mount:mount command failed |
59 | * https://tracker.ceph.com/issues/39634 |
||
60 | qa: test_full_same_file timeout |
||
61 | 46 | Kotresh Hiremath Ravishankar | * https://tracker.ceph.com/issues/49748 |
62 | gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds |
||
63 | 48 | Kotresh Hiremath Ravishankar | * https://tracker.ceph.com/issues/51964 |
64 | qa: test_cephfs_mirror_restart_sync_on_blocklist failure |
||
65 | 49 | Kotresh Hiremath Ravishankar | * https://tracker.ceph.com/issues/50223 |
66 | qa: "client.4737 isn't responding to mclientcaps(revoke)" |
||
67 | 48 | Kotresh Hiremath Ravishankar | |
68 | 47 | Patrick Donnelly | |
69 | h3. 2021 November 20 |
||
70 | |||
71 | https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific |
||
72 | |||
73 | * https://tracker.ceph.com/issues/53360 |
||
74 | pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" |
||
75 | 46 | Kotresh Hiremath Ravishankar | |
76 | 41 | Patrick Donnelly | h3. 2021 September 14 (QE) |
77 | |||
78 | https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/ |
||
79 | 1 | Patrick Donnelly | http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/ |
80 | 43 | Ramana Raja | https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/ |
81 | 41 | Patrick Donnelly | |
82 | * https://tracker.ceph.com/issues/52606 |
||
83 | qa: test_dirfrag_limit |
||
84 | * https://tracker.ceph.com/issues/52607 |
||
85 | qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)" |
||
86 | 44 | Ramana Raja | * https://tracker.ceph.com/issues/51705 |
87 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
88 | 41 | Patrick Donnelly | |
89 | 40 | Ramana Raja | h3. 2021 Sep 7 |
90 | |||
91 | https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/ |
||
92 | https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/ |
||
93 | |||
94 | |||
95 | * https://tracker.ceph.com/issues/52396 |
||
96 | qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
||
97 | * https://tracker.ceph.com/issues/51705 |
||
98 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
99 | 4 | Patrick Donnelly | |
100 | 34 | Ramana Raja | h3. 2021 Aug 30 |
101 | |||
102 | https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific |
||
103 | |||
104 | * https://tracker.ceph.com/issues/45434 |
||
105 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
106 | * https://tracker.ceph.com/issues/51705 |
||
107 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
108 | * https://tracker.ceph.com/issues/52396 |
||
109 | qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
||
110 | 35 | Ramana Raja | * https://tracker.ceph.com/issues/52487 |
111 | 36 | Ramana Raja | qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation) |
112 | * https://tracker.ceph.com/issues/51267 |
||
113 | 37 | Ramana Raja | Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) |
114 | * https://tracker.ceph.com/issues/48772 |
||
115 | qa: pjd: not ok 9, 44, 80 |
||
116 | 35 | Ramana Raja | |
117 | 34 | Ramana Raja | |
118 | 31 | Ramana Raja | h3. 2021 Aug 23 |
119 | |||
120 | https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/ |
||
121 | |||
122 | * https://tracker.ceph.com/issues/45434 |
||
123 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
124 | * https://tracker.ceph.com/issues/51705 |
||
125 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
126 | 32 | Ramana Raja | * https://tracker.ceph.com/issues/52396 |
127 | 33 | Ramana Raja | qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) |
128 | * https://tracker.ceph.com/issues/52397 |
||
129 | qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed |
||
130 | |||
131 | 31 | Ramana Raja | |
132 | 29 | Ramana Raja | h3. 2021 Aug 11 |
133 | |||
134 | https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/ |
||
135 | https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/ |
||
136 | |||
137 | * https://tracker.ceph.com/issues/45434 |
||
138 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
139 | * https://tracker.ceph.com/issues/51705 |
||
140 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
141 | 30 | Ramana Raja | * https://tracker.ceph.com/issues/50222 |
142 | osd: 5.2s0 deep-scrub : stat mismatch |
||
143 | 29 | Ramana Raja | |
144 | 19 | Jos Collin | h3. 2021 July 15 |
145 | 20 | Jos Collin | |
146 | 19 | Jos Collin | https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/ |
147 | |||
148 | 26 | Jos Collin | * https://tracker.ceph.com/issues/45434 |
149 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
150 | * https://tracker.ceph.com/issues/51705 |
||
151 | qa: tasks.cephfs.fuse_mount:mount command failed |
||
152 | 27 | Jos Collin | * https://tracker.ceph.com/issues/51183 |
153 | Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) |
||
154 | 28 | Jos Collin | * https://tracker.ceph.com/issues/50528 |
155 | qa: fs:thrash: pjd suite not ok 80 |
||
156 | * https://tracker.ceph.com/issues/51706 |
||
157 | qa: osd deep-scrub stat mismatch |
||
158 | 26 | Jos Collin | |
159 | 19 | Jos Collin | h3. 2021 July 13 |
160 | 20 | Jos Collin | |
161 | 19 | Jos Collin | https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/ |
162 | |||
163 | 21 | Jos Collin | * https://tracker.ceph.com/issues/51704 |
164 | Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) |
||
165 | 23 | Jos Collin | * https://tracker.ceph.com/issues/45434 |
166 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
167 | 24 | Jos Collin | * https://tracker.ceph.com/issues/51705 |
168 | 25 | Jos Collin | qa: tasks.cephfs.fuse_mount:mount command failed |
169 | * https://tracker.ceph.com/issues/48640 |
||
170 | 24 | Jos Collin | qa: snapshot mismatch during mds thrashing |
171 | 21 | Jos Collin | |
172 | 18 | Patrick Donnelly | h3. 2021 June 29 (Integration Branch) |
173 | |||
174 | https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/ |
||
175 | |||
176 | Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065 |
||
177 | Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/ |
||
178 | |||
179 | * https://tracker.ceph.com/issues/45434 |
||
180 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
181 | * https://tracker.ceph.com/issues/50260 |
||
182 | pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty" |
||
183 | * https://tracker.ceph.com/issues/51183 |
||
184 | qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions' |
||
185 | |||
186 | |||
187 | 16 | Jeff Layton | h3. 2021 June 28 |
188 | |||
189 | https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/ |
||
190 | |||
191 | * https://tracker.ceph.com/issues/45434 |
||
192 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
193 | * https://tracker.ceph.com/issues/51440 |
||
194 | 17 | Jeff Layton | fallocate fails with EACCES |
195 | 16 | Jeff Layton | * https://tracker.ceph.com/issues/51264 |
196 | TestVolumeClient failure |
||
197 | * https://tracker.ceph.com/issues/51266 |
||
198 | test cleanup failure |
||
199 | * https://tracker.ceph.com/issues/51183 |
||
200 | Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) |
||
201 | |||
202 | 12 | Jeff Layton | h3. 2021 June 14 |
203 | |||
204 | https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/ |
||
205 | |||
206 | * https://tracker.ceph.com/issues/45434 |
||
207 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
208 | * https://bugzilla.redhat.com/show_bug.cgi?id=1973276 |
||
209 | Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com |
||
210 | * https://tracker.ceph.com/issues/51263 |
||
211 | pjdfstest rename test 10.t failed with EACCES |
||
212 | * https://tracker.ceph.com/issues/51264 |
||
213 | TestVolumeClient failure |
||
214 | 13 | Jeff Layton | * https://tracker.ceph.com/issues/51266 |
215 | Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' |
||
216 | 14 | Jeff Layton | * https://tracker.ceph.com/issues/50279 |
217 | qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c" |
||
218 | 15 | Jeff Layton | * https://tracker.ceph.com/issues/51267 |
219 | Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1 |
||
220 | 11 | Patrick Donnelly | |
221 | h3. 2021 June 07 (Integration Branch) |
||
222 | |||
223 | http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific |
||
224 | |||
225 | * https://tracker.ceph.com/issues/45434 |
||
226 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
227 | * https://tracker.ceph.com/issues/50279 |
||
228 | qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c" |
||
229 | * https://tracker.ceph.com/issues/48773 |
||
230 | qa: scrub does not complete |
||
231 | * https://tracker.ceph.com/issues/51170 |
||
232 | pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split' |
||
233 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
234 | qa: quota failure |
||
235 | |||
236 | |||
237 | 6 | Patrick Donnelly | h3. 2021 Apr 28 (QE pre-release) |
238 | |||
239 | https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/ |
||
240 | https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/ |
||
241 | |||
242 | * https://tracker.ceph.com/issues/45434 |
||
243 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
244 | * https://tracker.ceph.com/issues/50258 |
||
245 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
246 | * https://tracker.ceph.com/issues/50260 |
||
247 | pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty" |
||
248 | * https://tracker.ceph.com/issues/49962 |
||
249 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
250 | * https://tracker.ceph.com/issues/50016 |
||
251 | qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes" |
||
252 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
253 | qa: quota failure |
||
254 | * https://tracker.ceph.com/issues/50528 |
||
255 | pacific: qa: fs:thrash: pjd suite not ok 20 |
||
256 | |||
257 | |||
258 | 3 | Patrick Donnelly | h3. 2021 Apr 22 (Integration Branch) |
259 | |||
260 | https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/ |
||
261 | |||
262 | * https://tracker.ceph.com/issues/50527 |
||
263 | pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse) |
||
264 | * https://tracker.ceph.com/issues/50528 |
||
265 | pacific: qa: fs:thrash: pjd suite not ok 20 |
||
266 | * https://tracker.ceph.com/issues/49500 (fixed in another integration run) |
||
267 | qa: "Assertion `cb_done' failed." |
||
268 | * https://tracker.ceph.com/issues/49500 |
||
269 | qa: "Assertion `cb_done' failed." |
||
270 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
271 | qa: quota failure |
||
272 | * https://tracker.ceph.com/issues/45434 |
||
273 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
274 | * https://tracker.ceph.com/issues/50279 |
||
275 | qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c" |
||
276 | * https://tracker.ceph.com/issues/50258 |
||
277 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
278 | * https://tracker.ceph.com/issues/49962 |
||
279 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
280 | * https://tracker.ceph.com/issues/49962 |
||
281 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
282 | * https://tracker.ceph.com/issues/50530 |
||
283 | pacific: client: abort after MDS blocklist |
||
284 | |||
285 | 2 | Patrick Donnelly | |
286 | h3. 2021 Apr 21 (Integration Branch) |
||
287 | |||
288 | https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/ |
||
289 | |||
290 | * https://tracker.ceph.com/issues/45434 |
||
291 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
292 | * https://tracker.ceph.com/issues/50250 |
||
293 | mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" |
||
294 | * https://tracker.ceph.com/issues/50258 |
||
295 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
296 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
297 | qa: quota failure |
||
298 | * https://tracker.ceph.com/issues/50016 |
||
299 | qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes" |
||
300 | * https://tracker.ceph.com/issues/50495 |
||
301 | pacific: client: shutdown race fails with status 141 |
||
302 | |||
303 | |||
304 | 1 | Patrick Donnelly | h3. 2021 Apr 07 (Integration Branch) |
305 | |||
306 | https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/ |
||
307 | |||
308 | * https://tracker.ceph.com/issues/45434 |
||
309 | qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed |
||
310 | * https://tracker.ceph.com/issues/48805 |
||
311 | mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details" |
||
312 | * https://tracker.ceph.com/issues/49500 |
||
313 | qa: "Assertion `cb_done' failed." |
||
314 | * https://tracker.ceph.com/issues/50258 (new) |
||
315 | pacific: qa: "run() got an unexpected keyword argument 'stdin_data'" |
||
316 | * https://tracker.ceph.com/issues/49962 |
||
317 | 'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes |
||
318 | * https://tracker.ceph.com/issues/48203 (stock kernel update required) |
||
319 | qa: quota failure |
||
320 | * https://tracker.ceph.com/issues/50260 |
||
321 | pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty" |
||
322 | * https://tracker.ceph.com/issues/50016 |
||
323 | qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes" |