Project

General

Profile

Pacific » History » Version 128

Venky Shankar, 12/21/2023 10:28 AM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 98 Venky Shankar
* Jul: Venky
6
* Aug: Patrick
7 118 Jos Collin
* Sep: Jos Collin
8 98 Venky Shankar
* Oct: Xiubo
9
* Nov: Rishabh
10
* Dec: Kotresh
11
* Jan: Milind
12 81 Venky Shankar
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 119 Rishabh Dave
h3. ADD NEW ENTRY BELOW
16
17 128 Venky Shankar
h3. 21 Dec 2023
18
19
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2023-12-14-1107-pacific
20
21
* https://tracker.ceph.com/issues/52624
22
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
23
* https://tracker.ceph.com/issues/63539
24
    fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
25
* test_acls failed because known distro wasn't detected
26
27 127 Rishabh Dave
h3. 4 Dec 2023 2
28 126 Rishabh Dave
29
https://pulpito.ceph.com/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/
30
31
* ior/mdtest failures because packages were missing from download.ceph.com
32
* test_acls failed because known distro wasn't detected
33
* https://tracker.ceph.com/issues/63539
34
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
35
* https://tracker.ceph.com/issues/52624
36
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
37
* https://tracker.ceph.com/issues/37808
38
  osd: osdmap cache weak_refs assert during shutdown
39 125 Kotresh Hiremath Ravishankar
40
h3. 04 Dec 2023
41
42
https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/
43
44
* ior package was missing because it was deleted from download.ceph.com
45
* Error re-imaging machines:
46
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472083
47
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472084
48
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472104
49
* https://tracker.ceph.com/issues/52624
50
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
51
* https://tracker.ceph.com/issues/51282
52
  cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
53
* https://tracker.ceph.com/issues/62501
54
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
55
* https://tracker.ceph.com/issues/58992
56
  test_acls (tasks.cephfs.test_acls.TestACLs)
57
* https://tracker.ceph.com/issues/54462
58
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
59
60
61 123 Rishabh Dave
h3. 22 Nov 2023
62
63
https://pulpito.ceph.com/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
64 124 Rishabh Dave
https://pulpito.ceph.com/yuriw-2023-11-21_15:54:56-smoke-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
65 123 Rishabh Dave
66
* https://tracker.ceph.com/issues/62501
67
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
68
* https://tracker.ceph.com/issues/50223
69
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
70
* ior/mdtest failures because packages were missing from download.ceph.com
71
* test_acls failed because known distro wasn't detected
72
* https://tracker.ceph.com/issues/52624
73
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
74
75 122 Rishabh Dave
h3. 15 Nov 2023
76
77
https://pulpito.ceph.com/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/
78
79
* https://tracker.ceph.com/issues/63539
80
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
81
* test_acls: distro name for RHEL 8.4 wasn't recognized one by xfstests_dev.py
82
* ior package was missing because it was deleted from download.ceph.com
83
* https://tracker.ceph.com/issues/52624
84
  qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
85
86 120 Rishabh Dave
h3. 8 Nov 2023
87 121 Rishabh Dave
88 120 Rishabh Dave
fs: https://pulpito.ceph.com/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
89 121 Rishabh Dave
smoke: https://pulpito.ceph.com/vshankar-2023-11-06_07:53:57-smoke-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
90 120 Rishabh Dave
91
* https://tracker.ceph.com/issues/51964
92
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
93
* https://tracker.ceph.com/issues/62501
94
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
95
* https://tracker.ceph.com/issues/52624
96
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
97
98 114 Jos Collin
h3. 2023 September 12
99
100 117 Jos Collin
https://pulpito.ceph.com/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi
101 115 Jos Collin
102 117 Jos Collin
  * https://tracker.ceph.com/issues/58992
103
    test_acls (tasks.cephfs.test_acls.TestACLs)
104
  * https://tracker.ceph.com/issues/62580
105
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
106 114 Jos Collin
107 111 Patrick Donnelly
h3. 2023 August 31
108
109 113 Patrick Donnelly
https://github.com/ceph/ceph/pull/53189
110
https://github.com/ceph/ceph/pull/53243
111
https://github.com/ceph/ceph/pull/53185
112
https://github.com/ceph/ceph/pull/52744
113
https://github.com/ceph/ceph/pull/51045
114
115 111 Patrick Donnelly
https://pulpito.ceph.com/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/
116
117 112 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
118
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
119
* https://tracker.ceph.com/issues/52624
120
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
121
* https://tracker.ceph.com/issues/54462
122
    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
123
* https://tracker.ceph.com/issues/50222
124
    osd: 5.2s0 deep-scrub : stat mismatch
125
* https://tracker.ceph.com/issues/50250
126
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" ("freshly-calculated rstats don't match existing ones")
127
128
Some spurious infrastructure / valgrind noise during cleanup.
129 111 Patrick Donnelly
130 107 Patrick Donnelly
h3. 2023 August 22
131
132
Pacific v16.2.14 QA
133
134
https://pulpito.ceph.com/yuriw-2023-08-22_14:48:56-fs-pacific-release-distro-default-smithi/
135
https://pulpito.ceph.com/yuriw-2023-08-22_23:49:19-fs-pacific-release-distro-default-smithi/
136
137
* https://tracker.ceph.com/issues/62578
138
    mon: osd pg-upmap-items command causes PG_DEGRADED warnings
139 109 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
140
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
141 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
142
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
143 107 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
144
    test_acls (tasks.cephfs.test_acls.TestACLs)
145 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62579
146
    client: evicted warning because client completes unmount before thrashed MDS comes back
147 110 Patrick Donnelly
* https://tracker.ceph.com/issues/62580
148
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
149 107 Patrick Donnelly
150 106 Patrick Donnelly
h3. 2023 August 16-2
151
152
https://trello.com/c/qRJogcXu/1827-wip-yuri2-testing-2023-08-16-1142-pacific
153
https://pulpito.ceph.com/?branch=wip-yuri2-testing-2023-08-16-1142-pacific
154
155
* https://tracker.ceph.com/issues/52624
156
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
157
* https://tracker.ceph.com/issues/58992
158
    test_acls (tasks.cephfs.test_acls.TestACLs)
159
* https://tracker.ceph.com/issues/62501
160
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
161
162 105 Patrick Donnelly
h3. 2023 August 16
163
164
https://trello.com/c/4TiiTR0k/1821-wip-yuri7-testing-2023-08-16-1309-pacific-old-wip-yuri7-testing-2023-08-16-0933-pacific-old-wip-yuri7-testing-2023-08-15-0741-pa
165
https://pulpito.ceph.com/?branch=wip-yuri7-testing-2023-08-16-1309-pacific
166
167
* https://tracker.ceph.com/issues/62499
168
    testing (?): deadlock ffsb task
169
* https://tracker.ceph.com/issues/62501
170
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
171
172 103 Patrick Donnelly
h3. 2023 August 11
173
174
https://trello.com/c/ONHeA3yz/1823-wip-yuri8-testing-2023-08-11-0834-pacific
175
https://pulpito.ceph.com/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/
176
177
Some infra noise causes dead job.
178
179
* https://tracker.ceph.com/issues/52624
180
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
181
* https://tracker.ceph.com/issues/58992
182
    test_acls (tasks.cephfs.test_acls.TestACLs)
183 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58340
184 107 Patrick Donnelly
    fsstress.sh failed with errno 124 
185 103 Patrick Donnelly
* https://tracker.ceph.com/issues/48773
186 107 Patrick Donnelly
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
187 103 Patrick Donnelly
* https://tracker.ceph.com/issues/50527
188
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
189
190 100 Venky Shankar
h3. 2023 August 8
191
192
https://pulpito.ceph.com/?branch=wip-yuri10-testing-2023-08-01-0753-pacific
193
194
* https://tracker.ceph.com/issues/52624
195
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
196 1 Patrick Donnelly
* https://tracker.ceph.com/issues/50223
197
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
198 101 Patrick Donnelly
* https://tracker.ceph.com/issues/62164
199
    qa: "cluster [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13..."
200
* https://tracker.ceph.com/issues/51964
201
    qa: test_cephfs_mirror_restart_sync_on_blocklist failure
202
* https://tracker.ceph.com/issues/58992
203
    test_acls (tasks.cephfs.test_acls.TestACLs)
204
* https://tracker.ceph.com/issues/62465
205
    pacific (?): LibCephFS.ShutdownRace segmentation fault
206 102 Patrick Donnelly
* "fs/full/subvolume_snapshot_rm.sh" failure caused by bluestore crash.
207 100 Venky Shankar
208 104 Patrick Donnelly
h3. 2023 August 03
209
210
https://trello.com/c/8HALLv9T/1813-wip-yuri6-testing-2023-08-03-0807-pacific-old-wip-yuri6-testing-2023-07-24-0819-pacific2-old-wip-yuri6-testing-2023-07-24-0819-p
211
https://pulpito.ceph.com/?branch=wip-yuri6-testing-2023-08-03-0807-pacific
212
213
* https://tracker.ceph.com/issues/52624
214
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
215
* https://tracker.ceph.com/issues/58992
216
    test_acls (tasks.cephfs.test_acls.TestACLs)
217
218 99 Venky Shankar
h3. 2023 July 25
219
220
https://pulpito.ceph.com/?branch=wip-yuri-testing-2023-07-19-1340-pacific
221
222
* https://tracker.ceph.com/issues/52624
223
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
224
* https://tracker.ceph.com/issues/58992
225
    test_acls (tasks.cephfs.test_acls.TestACLs)
226
* https://tracker.ceph.com/issues/50223
227
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
228
* https://tracker.ceph.com/issues/62160
229
    mds: MDS abort because newly corrupt dentry to be committed
230
* https://tracker.ceph.com/issues/61201
231
    qa: test_rebuild_moved_file (tasks/data-scan) fails because mds crashes in pacific (recovery thread crash)
232
233
234 94 Kotresh Hiremath Ravishankar
h3. 2023 May 17
235
236
https://pulpito.ceph.com/yuriw-2023-05-15_21:56:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/
237 97 Kotresh Hiremath Ravishankar
https://pulpito.ceph.com/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/ (fresh pkg and re-run because of package/installation issues)
238 94 Kotresh Hiremath Ravishankar
239
* https://tracker.ceph.com/issues/52624
240
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
241 96 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/61201 (NEW)
242 94 Kotresh Hiremath Ravishankar
  Test failure: test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan)
243
* https://tracker.ceph.com/issues/58340
244
  fsstress.sh failed with errno 124 
245 1 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
246 94 Kotresh Hiremath Ravishankar
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
247
* https://tracker.ceph.com/issues/58992
248
  test_acls (tasks.cephfs.test_acls.TestACLs)
249
* https://tracker.ceph.com/issues/54462
250 95 Kotresh Hiremath Ravishankar
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128 
251 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58674
252 95 Kotresh Hiremath Ravishankar
  teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds 
253 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/55446
254 95 Kotresh Hiremath Ravishankar
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
255
 
256 94 Kotresh Hiremath Ravishankar
257
258 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
259
260
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
261
262
* https://tracker.ceph.com/issues/52624
263
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
264
* https://tracker.ceph.com/issues/51964
265
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
266
* https://tracker.ceph.com/issues/48773
267
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
268
* https://tracker.ceph.com/issues/50223
269
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
270 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
271
  test_acls (tasks.cephfs.test_acls.TestACLs)
272 91 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58340
273
  fsstress.sh failed with errno 124
274 93 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
275
  Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
276
* https://tracker.ceph.com/issues/55446
277
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
278 91 Kotresh Hiremath Ravishankar
279 90 Rishabh Dave
h3. 2023 May 4
280
281
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
282
283
* https://tracker.ceph.com/issues/59560
284
  qa: RuntimeError: more than one file system available
285
* https://tracker.ceph.com/issues/59626
286
  FSMissing: File system xxxx does not exist in the map
287
* https://tracker.ceph.com/issues/58340
288
  fsstress.sh failed with errno 124
289
* https://tracker.ceph.com/issues/58992
290
  test_acls
291
* https://tracker.ceph.com/issues/48773
292
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
293
* https://tracker.ceph.com/issues/57676
294
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
295
296
297 86 Rishabh Dave
h3. 2023 Apr 13
298
299
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
300
301
https://tracker.ceph.com/issues/52624
302
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
303
* https://tracker.ceph.com/issues/57594
304
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
305
* https://tracker.ceph.com/issues/54108
306
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
307
* https://tracker.ceph.com/issues/58340
308
  fsstress.sh failed with errno 125
309
* https://tracker.ceph.com/issues/54462
310
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
311
* https://tracker.ceph.com/issues/49287     
312
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
313
* https://tracker.ceph.com/issues/58726
314
  test_acls: expected a yum based or a apt based system
315 40 Ramana Raja
316 84 Venky Shankar
h3. 2022 Dec 07
317
318
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
319
320
many transient git.ceph.com related timeouts
321
322
* https://tracker.ceph.com/issues/52624
323
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
324
* https://tracker.ceph.com/issues/50224
325
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
326
* https://tracker.ceph.com/issues/56644
327
    qa: test_rapid_creation fails with "No space left on device"
328
* https://tracker.ceph.com/issues/58221
329
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
330
331 83 Venky Shankar
h3. 2022 Dec 02
332
333
many transient git.ceph.com related timeouts
334
many transient 'Failed to connect to the host via ssh' failures
335
336
* https://tracker.ceph.com/issues/57723
337
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
338
* https://tracker.ceph.com/issues/52624
339
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
340
341 82 Venky Shankar
h3. 2022 Dec 01
342
343
many transient git.ceph.com related timeouts
344
345
* https://tracker.ceph.com/issues/57723
346
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
347
* https://tracker.ceph.com/issues/52624
348
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
349
350 80 Patrick Donnelly
h3. 2022 Nov 18
351
352
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
353
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
354
355
2 ansible dead failures.
356
12 transient git.ceph.com related timeouts
357
358
* https://tracker.ceph.com/issues/57723
359
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
360
* https://tracker.ceph.com/issues/52624
361
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
362
363 78 Milind Changire
h3. 2022 Oct 19
364
365
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
366
367
* https://tracker.ceph.com/issues/57723
368
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
369
* https://tracker.ceph.com/issues/52624
370
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
371
* https://tracker.ceph.com/issues/56644
372
  qa: test_rapid_creation fails with "No space left on device"
373
* https://tracker.ceph.com/issues/54460
374
  snaptest-multiple-capsnaps.sh test failure
375
* https://tracker.ceph.com/issues/57892
376
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
377
378
379
380 76 Venky Shankar
h3. 2022 Oct 06
381
382
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
383
384
* https://tracker.ceph.com/issues/52624
385
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
386
* https://tracker.ceph.com/issues/50223
387
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
388 77 Milind Changire
* https://tracker.ceph.com/issues/56507
389
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
390 76 Venky Shankar
391 75 Venky Shankar
h3. 2022 Sep 27
392
393
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
394
395
* https://tracker.ceph.com/issues/52624
396
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
397
* https://tracker.ceph.com/issues/48773
398
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
399
* https://tracker.ceph.com/issues/50224
400
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
401
* https://tracker.ceph.com/issues/56507
402
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
403
* https://tracker.ceph.com/issues/50223
404
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
405
406 74 Venky Shankar
h3. 2022 Sep 22
407
408
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
409
410
* https://tracker.ceph.com/issues/52624
411
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
412
* https://tracker.ceph.com/issues/51282
413
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
414
* https://tracker.ceph.com/issues/53360
415
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
416
417 73 Venky Shankar
h3. 2022 Sep 19
418
419
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
420
421
* https://tracker.ceph.com/issues/52624
422
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
423
* https://tracker.ceph.com/issues/57594
424
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
425
426 71 Venky Shankar
h3. 2022 Sep 15
427
428
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
429
430
* https://tracker.ceph.com/issues/51282
431
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
432
* https://tracker.ceph.com/issues/52624
433
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
434
* https://tracker.ceph.com/issues/53360
435
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
436 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
437
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
438 71 Venky Shankar
439 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
440
441
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
442
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
443
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
444
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
445
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
446
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
447
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
448
449
450
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
451
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
452
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
453
454
455 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
456
457
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
458
* Most of the failures are passed in re-run. Please check rerun failures below.
459
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
460
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
461
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
462
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
463
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
464
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
465
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
466
467
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
468
* https://tracker.ceph.com/issues/52624
469
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
470
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
471
* https://tracker.ceph.com/issues/57083
472
* https://tracker.ceph.com/issues/53360
473
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
474
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
475
* https://tracker.ceph.com/issues/51183
476
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
477
* https://tracker.ceph.com/issues/56507
478
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
479
480 68 Kotresh Hiremath Ravishankar
481
h3. 2022 AUG 04
482
483
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
484
485
* https://tracker.ceph.com/issues/57087
486
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
487
* https://tracker.ceph.com/issues/52624
488
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
489
* https://tracker.ceph.com/issues/51267
490
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
491
* https://tracker.ceph.com/issues/53360
492
* https://tracker.ceph.com/issues/57083
493
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
494
* https://tracker.ceph.com/issues/56507
495
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
496
497
498 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
499
500
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
501
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
502
503
* https://tracker.ceph.com/issues/52624
504
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
505
* https://tracker.ceph.com/issues/57083
506
* https://tracker.ceph.com/issues/53360
507
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
508
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
509
* https://tracker.ceph.com/issues/51183
510
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
511
* https://tracker.ceph.com/issues/56507
512
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
513
514
515 66 Venky Shankar
h3. 2022 July 08
516
517
* https://tracker.ceph.com/issues/52624
518
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
519
* https://tracker.ceph.com/issues/53360
520
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
521
* https://tracker.ceph.com/issues/51183
522
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
523
* https://tracker.ceph.com/issues/56506
524
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
525
* https://tracker.ceph.com/issues/56507
526
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
527
528 65 Venky Shankar
h3. 2022 Jun 28
529
530
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
531
532
* https://tracker.ceph.com/issues/52624
533
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
534
* https://tracker.ceph.com/issues/53360
535
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
536
* https://tracker.ceph.com/issues/51183
537
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
538
539 64 Venky Shankar
h3. 2022 Jun 22
540
541
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
542
543
* https://tracker.ceph.com/issues/52624
544
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
545
* https://tracker.ceph.com/issues/53360
546
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
547
* https://tracker.ceph.com/issues/51183
548
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
549
550 63 Venky Shankar
h3. 2022 Jun 17
551
552
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
553
554
* https://tracker.ceph.com/issues/52624
555
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
556
* https://tracker.ceph.com/issues/53360
557
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
558
* https://tracker.ceph.com/issues/51183
559
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
560
561 62 Venky Shankar
h3. 2022 Jun 16
562
563
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
564
565
* https://tracker.ceph.com/issues/52624
566
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
567
* https://tracker.ceph.com/issues/53360
568
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
569
* https://tracker.ceph.com/issues/55449
570
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
571
* https://tracker.ceph.com/issues/51267
572
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
573
* https://tracker.ceph.com/issues/55332
574
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
575
576 61 Venky Shankar
h3. 2022 Jun 15
577
578
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
579
580
* https://tracker.ceph.com/issues/52624
581
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
582
* https://tracker.ceph.com/issues/53360
583
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
584
* https://tracker.ceph.com/issues/55449
585
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
586
587
588 60 Venky Shankar
h3. 2022 Jun 10
589
590
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
591
592
* https://tracker.ceph.com/issues/52624
593
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
594
* https://tracker.ceph.com/issues/53360
595
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
596
* https://tracker.ceph.com/issues/55449
597
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
598
599 59 Venky Shankar
h3. 2022 Jun 09
600
601
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
602
603
* https://tracker.ceph.com/issues/52624
604
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
605
* https://tracker.ceph.com/issues/53360
606
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
607
* https://tracker.ceph.com/issues/55449
608
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
609
610 58 Venky Shankar
h3. 2022 May 06
611
612
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
613
614
* https://tracker.ceph.com/issues/52624
615
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
616
* https://tracker.ceph.com/issues/53360
617
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
618
619 57 Venky Shankar
h3. 2022 April 18
620
621
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
622
(only mgr/snap_schedule backport pr)
623
624
* https://tracker.ceph.com/issues/52624
625
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
626 56 Venky Shankar
627
h3. 2022 March 28
628
629
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
630
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
631
632
* https://tracker.ceph.com/issues/52624
633
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
634
* https://tracker.ceph.com/issues/53360
635
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
636
* https://tracker.ceph.com/issues/54411
637
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
638
	33 daemons have recently crashed" during suites/fsstress.sh
639
640 55 Venky Shankar
h3. 2022 March 25
641
642
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
643
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
644
645
* https://tracker.ceph.com/issues/52624
646
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
647
* https://tracker.ceph.com/issues/52606
648
        qa: test_dirfrag_limit
649
* https://tracker.ceph.com/issues/51905
650
        qa: "error reading sessionmap 'mds1_sessionmap'"
651
* https://tracker.ceph.com/issues/53360
652
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
653
* https://tracker.ceph.com/issues/51183
654
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
655 47 Patrick Donnelly
656 54 Venky Shankar
h3. 2022 March 22
657
658
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
659
660
* https://tracker.ceph.com/issues/52624
661
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
662
* https://tracker.ceph.com/issues/52606
663
        qa: test_dirfrag_limit
664
* https://tracker.ceph.com/issues/51183
665
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
666
* https://tracker.ceph.com/issues/51905
667
        qa: "error reading sessionmap 'mds1_sessionmap'"
668
* https://tracker.ceph.com/issues/53360
669
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
670
* https://tracker.ceph.com/issues/54411
671
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
672
	33 daemons have recently crashed" during suites/fsstress.sh
673 47 Patrick Donnelly
674 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
675
676
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
677
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
678
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
679
680
681
* https://tracker.ceph.com/issues/53300
682
	qa: cluster [WRN] Scrub error on inode
683
* https://tracker.ceph.com/issues/53302
684
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
685
* https://tracker.ceph.com/issues/53314
686
	qa: fs/upgrade/mds_upgrade_sequence test timeout
687
* https://tracker.ceph.com/issues/53316
688
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
689
* https://tracker.ceph.com/issues/52624
690
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
691
* https://tracker.ceph.com/issues/52396
692
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
693
* https://tracker.ceph.com/issues/52875
694
	pacific: qa: test_dirfrag_limit
695
* https://tracker.ceph.com/issues/51705
696 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
697
* https://tracker.ceph.com/issues/39634
698
	qa: test_full_same_file timeout
699 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
700
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
701 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
702
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
703 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
704
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
705 48 Kotresh Hiremath Ravishankar
706 47 Patrick Donnelly
707
h3. 2021 November 20
708
709
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
710
711
* https://tracker.ceph.com/issues/53360
712
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
713 46 Kotresh Hiremath Ravishankar
714 41 Patrick Donnelly
h3. 2021 September 14 (QE)
715
716
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
717 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
718 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
719 41 Patrick Donnelly
720
* https://tracker.ceph.com/issues/52606
721
    qa: test_dirfrag_limit
722
* https://tracker.ceph.com/issues/52607
723
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
724 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
725
    qa: tasks.cephfs.fuse_mount:mount command failed
726 41 Patrick Donnelly
727 40 Ramana Raja
h3. 2021 Sep 7
728
729
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
730
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
731
732
733
* https://tracker.ceph.com/issues/52396
734
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
735
* https://tracker.ceph.com/issues/51705
736
    qa: tasks.cephfs.fuse_mount:mount command failed
737 4 Patrick Donnelly
738 34 Ramana Raja
h3. 2021 Aug 30
739
740
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
741
742
* https://tracker.ceph.com/issues/45434
743
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
744
* https://tracker.ceph.com/issues/51705
745
    qa: tasks.cephfs.fuse_mount:mount command failed
746
* https://tracker.ceph.com/issues/52396
747
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
748 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
749 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
750
* https://tracker.ceph.com/issues/51267
751 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
752
* https://tracker.ceph.com/issues/48772
753
   qa: pjd: not ok 9, 44, 80
754 35 Ramana Raja
755 34 Ramana Raja
756 31 Ramana Raja
h3. 2021 Aug 23
757
758
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
759
760
* https://tracker.ceph.com/issues/45434
761
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
762
* https://tracker.ceph.com/issues/51705
763
    qa: tasks.cephfs.fuse_mount:mount command failed
764 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
765 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
766
* https://tracker.ceph.com/issues/52397
767
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
768
769 31 Ramana Raja
770 29 Ramana Raja
h3. 2021 Aug 11
771
772
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
773
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
774
775
* https://tracker.ceph.com/issues/45434
776
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
777
* https://tracker.ceph.com/issues/51705
778
    qa: tasks.cephfs.fuse_mount:mount command failed
779 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
780
    osd: 5.2s0 deep-scrub : stat mismatch
781 29 Ramana Raja
782 19 Jos Collin
h3. 2021 July 15
783 20 Jos Collin
784 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
785
786 26 Jos Collin
* https://tracker.ceph.com/issues/45434
787
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
788
* https://tracker.ceph.com/issues/51705
789
    qa: tasks.cephfs.fuse_mount:mount command failed
790 27 Jos Collin
* https://tracker.ceph.com/issues/51183
791
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
792 28 Jos Collin
* https://tracker.ceph.com/issues/50528
793
    qa: fs:thrash: pjd suite not ok 80
794
* https://tracker.ceph.com/issues/51706
795
    qa: osd deep-scrub stat mismatch
796 26 Jos Collin
797 19 Jos Collin
h3. 2021 July 13
798 20 Jos Collin
799 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
800
801 21 Jos Collin
* https://tracker.ceph.com/issues/51704
802
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
803 23 Jos Collin
* https://tracker.ceph.com/issues/45434
804
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
805 24 Jos Collin
* https://tracker.ceph.com/issues/51705
806 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
807
* https://tracker.ceph.com/issues/48640
808 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
809 21 Jos Collin
810 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
811
812
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
813
814
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
815
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
816
817
* https://tracker.ceph.com/issues/45434
818
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
819
* https://tracker.ceph.com/issues/50260
820
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
821
* https://tracker.ceph.com/issues/51183
822
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
823
824
825 16 Jeff Layton
h3. 2021 June 28
826
827
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
828
829
* https://tracker.ceph.com/issues/45434
830
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
831
* https://tracker.ceph.com/issues/51440
832 17 Jeff Layton
    fallocate fails with EACCES
833 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
834
    TestVolumeClient failure
835
* https://tracker.ceph.com/issues/51266
836
    test cleanup failure
837
* https://tracker.ceph.com/issues/51183
838
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
839
840 12 Jeff Layton
h3. 2021 June 14
841
842
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
843
 
844
* https://tracker.ceph.com/issues/45434
845
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
846
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
847
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
848
* https://tracker.ceph.com/issues/51263
849
    pjdfstest rename test 10.t failed with EACCES
850
* https://tracker.ceph.com/issues/51264
851
    TestVolumeClient failure
852 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
853
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
854 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
855
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
856 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
857
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
858 11 Patrick Donnelly
859
h3. 2021 June 07 (Integration Branch)
860
861
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
862
863
* https://tracker.ceph.com/issues/45434
864
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
865
* https://tracker.ceph.com/issues/50279
866
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
867
* https://tracker.ceph.com/issues/48773
868
    qa: scrub does not complete
869
* https://tracker.ceph.com/issues/51170
870
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
871
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
872
    qa: quota failure
873
874
875 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
876
877
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
878
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
879
880
* https://tracker.ceph.com/issues/45434
881
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
882
* https://tracker.ceph.com/issues/50258
883
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
884
* https://tracker.ceph.com/issues/50260
885
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
886
* https://tracker.ceph.com/issues/49962
887
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
888
* https://tracker.ceph.com/issues/50016
889
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
890
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
891
    qa: quota failure
892
* https://tracker.ceph.com/issues/50528
893
    pacific: qa: fs:thrash: pjd suite not ok 20
894
895
896 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
897
898
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
899
900
* https://tracker.ceph.com/issues/50527
901
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
902
* https://tracker.ceph.com/issues/50528
903
    pacific: qa: fs:thrash: pjd suite not ok 20
904
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
905
    qa: "Assertion `cb_done' failed."
906
* https://tracker.ceph.com/issues/49500
907
    qa: "Assertion `cb_done' failed."
908
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
909
    qa: quota failure
910
* https://tracker.ceph.com/issues/45434
911
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
912
* https://tracker.ceph.com/issues/50279
913
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
914
* https://tracker.ceph.com/issues/50258
915
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
916
* https://tracker.ceph.com/issues/49962
917
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
918
* https://tracker.ceph.com/issues/49962
919
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
920
* https://tracker.ceph.com/issues/50530
921
    pacific: client: abort after MDS blocklist
922
923 2 Patrick Donnelly
924
h3. 2021 Apr 21 (Integration Branch)
925
926
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
927
928
* https://tracker.ceph.com/issues/45434
929
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
930
* https://tracker.ceph.com/issues/50250
931
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
932
* https://tracker.ceph.com/issues/50258
933
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
934
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
935
    qa: quota failure
936
* https://tracker.ceph.com/issues/50016
937
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
938
* https://tracker.ceph.com/issues/50495
939
    pacific: client: shutdown race fails with status 141
940
941
942 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
943
944
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
945
946
* https://tracker.ceph.com/issues/45434
947
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
948
* https://tracker.ceph.com/issues/48805
949
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
950
* https://tracker.ceph.com/issues/49500
951
    qa: "Assertion `cb_done' failed."
952
* https://tracker.ceph.com/issues/50258 (new)
953
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
954
* https://tracker.ceph.com/issues/49962
955
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
956
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
957
    qa: quota failure
958
* https://tracker.ceph.com/issues/50260
959
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
960
* https://tracker.ceph.com/issues/50016
961
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"