Project

General

Profile

Pacific » History » Version 133

Venky Shankar, 01/31/2024 01:51 PM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 98 Venky Shankar
* Jul: Venky
6
* Aug: Patrick
7 118 Jos Collin
* Sep: Jos Collin
8 98 Venky Shankar
* Oct: Xiubo
9
* Nov: Rishabh
10
* Dec: Kotresh
11
* Jan: Milind
12 81 Venky Shankar
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 119 Rishabh Dave
h3. ADD NEW ENTRY BELOW
16
17 133 Venky Shankar
h3. 31 Jan 2024
18
19
https://pulpito.ceph.com/?branch=pacific-release
20
21
* https://tracker.ceph.com/issues/52624
22
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
23
* https://tracker.ceph.com/issues/58992
24
    test_acls (tasks.cephfs.test_acls.TestACLs) 
25
* https://tracker.ceph.com/issues/62501
26
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
27 132 Milind Changire
28
h3. 24 Jan 2024
29
30
https://pulpito.ceph.com/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/
31
32
* https://tracker.ceph.com/issues/64059
33
  https://download.ceph.com/qa/ior.tbz2 - ERROR 404: Not Found
34
* https://tracker.ceph.com/issues/62501
35
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
36
* https://tracker.ceph.com/issues/51964
37
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
38
* https://tracker.ceph.com/issues/58992
39
  test_acls (tasks.cephfs.test_acls.TestACLs) 
40
* https://tracker.ceph.com/issues/50224
41
  test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring) 
42
43
44 131 Kotresh Hiremath Ravishankar
h3. 29 Dec 2023
45
46
https://pulpito.ceph.com/yuriw-2023-12-28_15:45:00-fs-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi/
47
48
* https://tracker.ceph.com/issues/63212
49
  qa: failed to download ior.tbz2
50
* https://tracker.ceph.com/issues/52624
51
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
52
* https://tracker.ceph.com/issues/62501
53
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
54
* https://tracker.ceph.com/issues/50224
55
  test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring) 
56
* https://tracker.ceph.com/issues/58992
57
  test_acls (tasks.cephfs.test_acls.TestACLs) 
58
* https://tracker.ceph.com/issues/50223
59
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
60
* https://tracker.ceph.com/issues/63907
61
  cephfs-mirror: Mirror::update_fs_mirrors crashes while taking lock (coredump)
62
63 128 Venky Shankar
h3. 21 Dec 2023
64
65
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2023-12-14-1107-pacific
66
67
* https://tracker.ceph.com/issues/52624
68
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
69
* https://tracker.ceph.com/issues/63539
70
    fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
71
* test_acls failed because known distro wasn't detected
72 129 Venky Shankar
* https://tracker.ceph.com/issues/50223
73
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
74 128 Venky Shankar
75 127 Rishabh Dave
h3. 4 Dec 2023 2
76 126 Rishabh Dave
77
https://pulpito.ceph.com/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/
78
79
* ior/mdtest failures because packages were missing from download.ceph.com
80
* test_acls failed because known distro wasn't detected
81
* https://tracker.ceph.com/issues/63539
82
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
83
* https://tracker.ceph.com/issues/52624
84
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
85
* https://tracker.ceph.com/issues/37808
86
  osd: osdmap cache weak_refs assert during shutdown
87 125 Kotresh Hiremath Ravishankar
88
h3. 04 Dec 2023
89
90
https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/
91
92
* ior package was missing because it was deleted from download.ceph.com
93
* Error re-imaging machines:
94
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472083
95
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472084
96
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472104
97
* https://tracker.ceph.com/issues/52624
98
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
99
* https://tracker.ceph.com/issues/51282
100
  cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
101
* https://tracker.ceph.com/issues/62501
102
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
103
* https://tracker.ceph.com/issues/58992
104
  test_acls (tasks.cephfs.test_acls.TestACLs)
105
* https://tracker.ceph.com/issues/54462
106
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
107
108
109 123 Rishabh Dave
h3. 22 Nov 2023
110
111
https://pulpito.ceph.com/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
112 124 Rishabh Dave
https://pulpito.ceph.com/yuriw-2023-11-21_15:54:56-smoke-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
113 123 Rishabh Dave
114
* https://tracker.ceph.com/issues/62501
115
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
116
* https://tracker.ceph.com/issues/50223
117
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
118
* ior/mdtest failures because packages were missing from download.ceph.com
119
* test_acls failed because known distro wasn't detected
120
* https://tracker.ceph.com/issues/52624
121
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
122
123 122 Rishabh Dave
h3. 15 Nov 2023
124
125
https://pulpito.ceph.com/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/
126
127
* https://tracker.ceph.com/issues/63539
128
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
129
* test_acls: distro name for RHEL 8.4 wasn't recognized one by xfstests_dev.py
130
* ior package was missing because it was deleted from download.ceph.com
131
* https://tracker.ceph.com/issues/52624
132
  qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
133
134 120 Rishabh Dave
h3. 8 Nov 2023
135 121 Rishabh Dave
136 120 Rishabh Dave
fs: https://pulpito.ceph.com/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
137 121 Rishabh Dave
smoke: https://pulpito.ceph.com/vshankar-2023-11-06_07:53:57-smoke-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
138 120 Rishabh Dave
139
* https://tracker.ceph.com/issues/51964
140
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
141
* https://tracker.ceph.com/issues/62501
142
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
143
* https://tracker.ceph.com/issues/52624
144
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
145
146 114 Jos Collin
h3. 2023 September 12
147
148 117 Jos Collin
https://pulpito.ceph.com/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi
149 115 Jos Collin
150 117 Jos Collin
  * https://tracker.ceph.com/issues/58992
151
    test_acls (tasks.cephfs.test_acls.TestACLs)
152
  * https://tracker.ceph.com/issues/62580
153
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
154 114 Jos Collin
155 111 Patrick Donnelly
h3. 2023 August 31
156
157 113 Patrick Donnelly
https://github.com/ceph/ceph/pull/53189
158
https://github.com/ceph/ceph/pull/53243
159
https://github.com/ceph/ceph/pull/53185
160
https://github.com/ceph/ceph/pull/52744
161
https://github.com/ceph/ceph/pull/51045
162
163 111 Patrick Donnelly
https://pulpito.ceph.com/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/
164
165 112 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
166
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
167
* https://tracker.ceph.com/issues/52624
168
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
169
* https://tracker.ceph.com/issues/54462
170
    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
171
* https://tracker.ceph.com/issues/50222
172
    osd: 5.2s0 deep-scrub : stat mismatch
173
* https://tracker.ceph.com/issues/50250
174
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" ("freshly-calculated rstats don't match existing ones")
175
176
Some spurious infrastructure / valgrind noise during cleanup.
177 111 Patrick Donnelly
178 107 Patrick Donnelly
h3. 2023 August 22
179
180
Pacific v16.2.14 QA
181
182
https://pulpito.ceph.com/yuriw-2023-08-22_14:48:56-fs-pacific-release-distro-default-smithi/
183
https://pulpito.ceph.com/yuriw-2023-08-22_23:49:19-fs-pacific-release-distro-default-smithi/
184
185
* https://tracker.ceph.com/issues/62578
186
    mon: osd pg-upmap-items command causes PG_DEGRADED warnings
187 109 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
188
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
189 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
190
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
191 107 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
192
    test_acls (tasks.cephfs.test_acls.TestACLs)
193 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62579
194
    client: evicted warning because client completes unmount before thrashed MDS comes back
195 110 Patrick Donnelly
* https://tracker.ceph.com/issues/62580
196
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
197 107 Patrick Donnelly
198 106 Patrick Donnelly
h3. 2023 August 16-2
199
200
https://trello.com/c/qRJogcXu/1827-wip-yuri2-testing-2023-08-16-1142-pacific
201
https://pulpito.ceph.com/?branch=wip-yuri2-testing-2023-08-16-1142-pacific
202
203
* https://tracker.ceph.com/issues/52624
204
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
205
* https://tracker.ceph.com/issues/58992
206
    test_acls (tasks.cephfs.test_acls.TestACLs)
207
* https://tracker.ceph.com/issues/62501
208
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
209
210 105 Patrick Donnelly
h3. 2023 August 16
211
212
https://trello.com/c/4TiiTR0k/1821-wip-yuri7-testing-2023-08-16-1309-pacific-old-wip-yuri7-testing-2023-08-16-0933-pacific-old-wip-yuri7-testing-2023-08-15-0741-pa
213
https://pulpito.ceph.com/?branch=wip-yuri7-testing-2023-08-16-1309-pacific
214
215
* https://tracker.ceph.com/issues/62499
216
    testing (?): deadlock ffsb task
217
* https://tracker.ceph.com/issues/62501
218
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
219
220 103 Patrick Donnelly
h3. 2023 August 11
221
222
https://trello.com/c/ONHeA3yz/1823-wip-yuri8-testing-2023-08-11-0834-pacific
223
https://pulpito.ceph.com/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/
224
225
Some infra noise causes dead job.
226
227
* https://tracker.ceph.com/issues/52624
228
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
229
* https://tracker.ceph.com/issues/58992
230
    test_acls (tasks.cephfs.test_acls.TestACLs)
231 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58340
232 107 Patrick Donnelly
    fsstress.sh failed with errno 124 
233 103 Patrick Donnelly
* https://tracker.ceph.com/issues/48773
234 107 Patrick Donnelly
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
235 103 Patrick Donnelly
* https://tracker.ceph.com/issues/50527
236
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
237
238 100 Venky Shankar
h3. 2023 August 8
239
240
https://pulpito.ceph.com/?branch=wip-yuri10-testing-2023-08-01-0753-pacific
241
242
* https://tracker.ceph.com/issues/52624
243
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
244 1 Patrick Donnelly
* https://tracker.ceph.com/issues/50223
245
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
246 101 Patrick Donnelly
* https://tracker.ceph.com/issues/62164
247
    qa: "cluster [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13..."
248
* https://tracker.ceph.com/issues/51964
249
    qa: test_cephfs_mirror_restart_sync_on_blocklist failure
250
* https://tracker.ceph.com/issues/58992
251
    test_acls (tasks.cephfs.test_acls.TestACLs)
252
* https://tracker.ceph.com/issues/62465
253
    pacific (?): LibCephFS.ShutdownRace segmentation fault
254 102 Patrick Donnelly
* "fs/full/subvolume_snapshot_rm.sh" failure caused by bluestore crash.
255 100 Venky Shankar
256 104 Patrick Donnelly
h3. 2023 August 03
257
258
https://trello.com/c/8HALLv9T/1813-wip-yuri6-testing-2023-08-03-0807-pacific-old-wip-yuri6-testing-2023-07-24-0819-pacific2-old-wip-yuri6-testing-2023-07-24-0819-p
259
https://pulpito.ceph.com/?branch=wip-yuri6-testing-2023-08-03-0807-pacific
260
261
* https://tracker.ceph.com/issues/52624
262
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
263
* https://tracker.ceph.com/issues/58992
264
    test_acls (tasks.cephfs.test_acls.TestACLs)
265
266 99 Venky Shankar
h3. 2023 July 25
267
268
https://pulpito.ceph.com/?branch=wip-yuri-testing-2023-07-19-1340-pacific
269
270
* https://tracker.ceph.com/issues/52624
271
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
272
* https://tracker.ceph.com/issues/58992
273
    test_acls (tasks.cephfs.test_acls.TestACLs)
274
* https://tracker.ceph.com/issues/50223
275
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
276
* https://tracker.ceph.com/issues/62160
277
    mds: MDS abort because newly corrupt dentry to be committed
278
* https://tracker.ceph.com/issues/61201
279
    qa: test_rebuild_moved_file (tasks/data-scan) fails because mds crashes in pacific (recovery thread crash)
280
281
282 94 Kotresh Hiremath Ravishankar
h3. 2023 May 17
283
284
https://pulpito.ceph.com/yuriw-2023-05-15_21:56:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/
285 97 Kotresh Hiremath Ravishankar
https://pulpito.ceph.com/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/ (fresh pkg and re-run because of package/installation issues)
286 94 Kotresh Hiremath Ravishankar
287
* https://tracker.ceph.com/issues/52624
288
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
289 96 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/61201 (NEW)
290 94 Kotresh Hiremath Ravishankar
  Test failure: test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan)
291
* https://tracker.ceph.com/issues/58340
292
  fsstress.sh failed with errno 124 
293 1 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
294 94 Kotresh Hiremath Ravishankar
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
295
* https://tracker.ceph.com/issues/58992
296
  test_acls (tasks.cephfs.test_acls.TestACLs)
297
* https://tracker.ceph.com/issues/54462
298 95 Kotresh Hiremath Ravishankar
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128 
299 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58674
300 95 Kotresh Hiremath Ravishankar
  teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds 
301 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/55446
302 95 Kotresh Hiremath Ravishankar
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
303
 
304 94 Kotresh Hiremath Ravishankar
305
306 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
307
308
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
309
310
* https://tracker.ceph.com/issues/52624
311
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
312
* https://tracker.ceph.com/issues/51964
313
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
314
* https://tracker.ceph.com/issues/48773
315
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
316
* https://tracker.ceph.com/issues/50223
317
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
318 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
319
  test_acls (tasks.cephfs.test_acls.TestACLs)
320 91 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58340
321
  fsstress.sh failed with errno 124
322 93 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
323
  Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
324
* https://tracker.ceph.com/issues/55446
325
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
326 91 Kotresh Hiremath Ravishankar
327 90 Rishabh Dave
h3. 2023 May 4
328
329
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
330
331
* https://tracker.ceph.com/issues/59560
332
  qa: RuntimeError: more than one file system available
333
* https://tracker.ceph.com/issues/59626
334
  FSMissing: File system xxxx does not exist in the map
335
* https://tracker.ceph.com/issues/58340
336
  fsstress.sh failed with errno 124
337
* https://tracker.ceph.com/issues/58992
338
  test_acls
339
* https://tracker.ceph.com/issues/48773
340
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
341
* https://tracker.ceph.com/issues/57676
342
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
343
344
345 86 Rishabh Dave
h3. 2023 Apr 13
346
347
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
348
349
https://tracker.ceph.com/issues/52624
350
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
351
* https://tracker.ceph.com/issues/57594
352
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
353
* https://tracker.ceph.com/issues/54108
354
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
355
* https://tracker.ceph.com/issues/58340
356
  fsstress.sh failed with errno 125
357
* https://tracker.ceph.com/issues/54462
358
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
359
* https://tracker.ceph.com/issues/49287     
360
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
361
* https://tracker.ceph.com/issues/58726
362
  test_acls: expected a yum based or a apt based system
363 40 Ramana Raja
364 84 Venky Shankar
h3. 2022 Dec 07
365
366
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
367
368
many transient git.ceph.com related timeouts
369
370
* https://tracker.ceph.com/issues/52624
371
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
372
* https://tracker.ceph.com/issues/50224
373
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
374
* https://tracker.ceph.com/issues/56644
375
    qa: test_rapid_creation fails with "No space left on device"
376
* https://tracker.ceph.com/issues/58221
377
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
378
379 83 Venky Shankar
h3. 2022 Dec 02
380
381
many transient git.ceph.com related timeouts
382
many transient 'Failed to connect to the host via ssh' failures
383
384
* https://tracker.ceph.com/issues/57723
385
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
386
* https://tracker.ceph.com/issues/52624
387
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
388
389 82 Venky Shankar
h3. 2022 Dec 01
390
391
many transient git.ceph.com related timeouts
392
393
* https://tracker.ceph.com/issues/57723
394
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
395
* https://tracker.ceph.com/issues/52624
396
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
397
398 80 Patrick Donnelly
h3. 2022 Nov 18
399
400
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
401
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
402
403
2 ansible dead failures.
404
12 transient git.ceph.com related timeouts
405
406
* https://tracker.ceph.com/issues/57723
407
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
408
* https://tracker.ceph.com/issues/52624
409
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
410
411 78 Milind Changire
h3. 2022 Oct 19
412
413
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
414
415
* https://tracker.ceph.com/issues/57723
416
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
417
* https://tracker.ceph.com/issues/52624
418
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
419
* https://tracker.ceph.com/issues/56644
420
  qa: test_rapid_creation fails with "No space left on device"
421
* https://tracker.ceph.com/issues/54460
422
  snaptest-multiple-capsnaps.sh test failure
423
* https://tracker.ceph.com/issues/57892
424
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
425
426
427
428 76 Venky Shankar
h3. 2022 Oct 06
429
430
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
431
432
* https://tracker.ceph.com/issues/52624
433
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
434
* https://tracker.ceph.com/issues/50223
435
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
436 77 Milind Changire
* https://tracker.ceph.com/issues/56507
437
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
438 76 Venky Shankar
439 75 Venky Shankar
h3. 2022 Sep 27
440
441
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
442
443
* https://tracker.ceph.com/issues/52624
444
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
445
* https://tracker.ceph.com/issues/48773
446
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
447
* https://tracker.ceph.com/issues/50224
448
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
449
* https://tracker.ceph.com/issues/56507
450
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
451
* https://tracker.ceph.com/issues/50223
452
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
453
454 74 Venky Shankar
h3. 2022 Sep 22
455
456
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
457
458
* https://tracker.ceph.com/issues/52624
459
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
460
* https://tracker.ceph.com/issues/51282
461
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
462
* https://tracker.ceph.com/issues/53360
463
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
464
465 73 Venky Shankar
h3. 2022 Sep 19
466
467
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
468
469
* https://tracker.ceph.com/issues/52624
470
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
471
* https://tracker.ceph.com/issues/57594
472
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
473
474 71 Venky Shankar
h3. 2022 Sep 15
475
476
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
477
478
* https://tracker.ceph.com/issues/51282
479
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
480
* https://tracker.ceph.com/issues/52624
481
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
482
* https://tracker.ceph.com/issues/53360
483
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
484 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
485
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
486 71 Venky Shankar
487 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
488
489
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
490
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
491
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
492
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
493
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
494
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
495
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
496
497
498
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
499
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
500
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
501
502
503 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
504
505
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
506
* Most of the failures are passed in re-run. Please check rerun failures below.
507
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
508
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
509
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
510
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
511
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
512
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
513
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
514
515
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
516
* https://tracker.ceph.com/issues/52624
517
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
518
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
519
* https://tracker.ceph.com/issues/57083
520
* https://tracker.ceph.com/issues/53360
521
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
522
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
523
* https://tracker.ceph.com/issues/51183
524
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
525
* https://tracker.ceph.com/issues/56507
526
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
527
528 68 Kotresh Hiremath Ravishankar
529
h3. 2022 AUG 04
530
531
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
532
533
* https://tracker.ceph.com/issues/57087
534
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
535
* https://tracker.ceph.com/issues/52624
536
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
537
* https://tracker.ceph.com/issues/51267
538
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
539
* https://tracker.ceph.com/issues/53360
540
* https://tracker.ceph.com/issues/57083
541
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
542
* https://tracker.ceph.com/issues/56507
543
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
544
545
546 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
547
548
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
549
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
550
551
* https://tracker.ceph.com/issues/52624
552
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
553
* https://tracker.ceph.com/issues/57083
554
* https://tracker.ceph.com/issues/53360
555
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
556
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
557
* https://tracker.ceph.com/issues/51183
558
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
559
* https://tracker.ceph.com/issues/56507
560
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
561
562
563 66 Venky Shankar
h3. 2022 July 08
564
565
* https://tracker.ceph.com/issues/52624
566
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
567
* https://tracker.ceph.com/issues/53360
568
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
569
* https://tracker.ceph.com/issues/51183
570
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
571
* https://tracker.ceph.com/issues/56506
572
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
573
* https://tracker.ceph.com/issues/56507
574
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
575
576 65 Venky Shankar
h3. 2022 Jun 28
577
578
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
579
580
* https://tracker.ceph.com/issues/52624
581
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
582
* https://tracker.ceph.com/issues/53360
583
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
584
* https://tracker.ceph.com/issues/51183
585
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
586
587 64 Venky Shankar
h3. 2022 Jun 22
588
589
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
590
591
* https://tracker.ceph.com/issues/52624
592
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
593
* https://tracker.ceph.com/issues/53360
594
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
595
* https://tracker.ceph.com/issues/51183
596
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
597
598 63 Venky Shankar
h3. 2022 Jun 17
599
600
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
601
602
* https://tracker.ceph.com/issues/52624
603
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
604
* https://tracker.ceph.com/issues/53360
605
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
606
* https://tracker.ceph.com/issues/51183
607
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
608
609 62 Venky Shankar
h3. 2022 Jun 16
610
611
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
612
613
* https://tracker.ceph.com/issues/52624
614
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
615
* https://tracker.ceph.com/issues/53360
616
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
617
* https://tracker.ceph.com/issues/55449
618
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
619
* https://tracker.ceph.com/issues/51267
620
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
621
* https://tracker.ceph.com/issues/55332
622
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
623
624 61 Venky Shankar
h3. 2022 Jun 15
625
626
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
627
628
* https://tracker.ceph.com/issues/52624
629
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
630
* https://tracker.ceph.com/issues/53360
631
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
632
* https://tracker.ceph.com/issues/55449
633
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
634
635
636 60 Venky Shankar
h3. 2022 Jun 10
637
638
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
639
640
* https://tracker.ceph.com/issues/52624
641
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
642
* https://tracker.ceph.com/issues/53360
643
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
644
* https://tracker.ceph.com/issues/55449
645
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
646
647 59 Venky Shankar
h3. 2022 Jun 09
648
649
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
650
651
* https://tracker.ceph.com/issues/52624
652
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
653
* https://tracker.ceph.com/issues/53360
654
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
655
* https://tracker.ceph.com/issues/55449
656
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
657
658 58 Venky Shankar
h3. 2022 May 06
659
660
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
661
662
* https://tracker.ceph.com/issues/52624
663
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
664
* https://tracker.ceph.com/issues/53360
665
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
666
667 57 Venky Shankar
h3. 2022 April 18
668
669
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
670
(only mgr/snap_schedule backport pr)
671
672
* https://tracker.ceph.com/issues/52624
673
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
674 56 Venky Shankar
675
h3. 2022 March 28
676
677
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
678
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
679
680
* https://tracker.ceph.com/issues/52624
681
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
682
* https://tracker.ceph.com/issues/53360
683
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
684
* https://tracker.ceph.com/issues/54411
685
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
686
	33 daemons have recently crashed" during suites/fsstress.sh
687
688 55 Venky Shankar
h3. 2022 March 25
689
690
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
691
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
692
693
* https://tracker.ceph.com/issues/52624
694
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
695
* https://tracker.ceph.com/issues/52606
696
        qa: test_dirfrag_limit
697
* https://tracker.ceph.com/issues/51905
698
        qa: "error reading sessionmap 'mds1_sessionmap'"
699
* https://tracker.ceph.com/issues/53360
700
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
701
* https://tracker.ceph.com/issues/51183
702
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
703 47 Patrick Donnelly
704 54 Venky Shankar
h3. 2022 March 22
705
706
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
707
708
* https://tracker.ceph.com/issues/52624
709
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
710
* https://tracker.ceph.com/issues/52606
711
        qa: test_dirfrag_limit
712
* https://tracker.ceph.com/issues/51183
713
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
714
* https://tracker.ceph.com/issues/51905
715
        qa: "error reading sessionmap 'mds1_sessionmap'"
716
* https://tracker.ceph.com/issues/53360
717
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
718
* https://tracker.ceph.com/issues/54411
719
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
720
	33 daemons have recently crashed" during suites/fsstress.sh
721 47 Patrick Donnelly
722 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
723
724
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
725
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
726
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
727
728
729
* https://tracker.ceph.com/issues/53300
730
	qa: cluster [WRN] Scrub error on inode
731
* https://tracker.ceph.com/issues/53302
732
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
733
* https://tracker.ceph.com/issues/53314
734
	qa: fs/upgrade/mds_upgrade_sequence test timeout
735
* https://tracker.ceph.com/issues/53316
736
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
737
* https://tracker.ceph.com/issues/52624
738
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
739
* https://tracker.ceph.com/issues/52396
740
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
741
* https://tracker.ceph.com/issues/52875
742
	pacific: qa: test_dirfrag_limit
743
* https://tracker.ceph.com/issues/51705
744 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
745
* https://tracker.ceph.com/issues/39634
746
	qa: test_full_same_file timeout
747 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
748
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
749 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
750
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
751 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
752
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
753 48 Kotresh Hiremath Ravishankar
754 47 Patrick Donnelly
755
h3. 2021 November 20
756
757
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
758
759
* https://tracker.ceph.com/issues/53360
760
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
761 46 Kotresh Hiremath Ravishankar
762 41 Patrick Donnelly
h3. 2021 September 14 (QE)
763
764
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
765 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
766 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
767 41 Patrick Donnelly
768
* https://tracker.ceph.com/issues/52606
769
    qa: test_dirfrag_limit
770
* https://tracker.ceph.com/issues/52607
771
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
772 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
773
    qa: tasks.cephfs.fuse_mount:mount command failed
774 41 Patrick Donnelly
775 40 Ramana Raja
h3. 2021 Sep 7
776
777
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
778
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
779
780
781
* https://tracker.ceph.com/issues/52396
782
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
783
* https://tracker.ceph.com/issues/51705
784
    qa: tasks.cephfs.fuse_mount:mount command failed
785 4 Patrick Donnelly
786 34 Ramana Raja
h3. 2021 Aug 30
787
788
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
789
790
* https://tracker.ceph.com/issues/45434
791
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
792
* https://tracker.ceph.com/issues/51705
793
    qa: tasks.cephfs.fuse_mount:mount command failed
794
* https://tracker.ceph.com/issues/52396
795
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
796 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
797 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
798
* https://tracker.ceph.com/issues/51267
799 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
800
* https://tracker.ceph.com/issues/48772
801
   qa: pjd: not ok 9, 44, 80
802 35 Ramana Raja
803 34 Ramana Raja
804 31 Ramana Raja
h3. 2021 Aug 23
805
806
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
807
808
* https://tracker.ceph.com/issues/45434
809
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
810
* https://tracker.ceph.com/issues/51705
811
    qa: tasks.cephfs.fuse_mount:mount command failed
812 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
813 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
814
* https://tracker.ceph.com/issues/52397
815
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
816
817 31 Ramana Raja
818 29 Ramana Raja
h3. 2021 Aug 11
819
820
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
821
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
822
823
* https://tracker.ceph.com/issues/45434
824
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
825
* https://tracker.ceph.com/issues/51705
826
    qa: tasks.cephfs.fuse_mount:mount command failed
827 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
828
    osd: 5.2s0 deep-scrub : stat mismatch
829 29 Ramana Raja
830 19 Jos Collin
h3. 2021 July 15
831 20 Jos Collin
832 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
833
834 26 Jos Collin
* https://tracker.ceph.com/issues/45434
835
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
836
* https://tracker.ceph.com/issues/51705
837
    qa: tasks.cephfs.fuse_mount:mount command failed
838 27 Jos Collin
* https://tracker.ceph.com/issues/51183
839
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
840 28 Jos Collin
* https://tracker.ceph.com/issues/50528
841
    qa: fs:thrash: pjd suite not ok 80
842
* https://tracker.ceph.com/issues/51706
843
    qa: osd deep-scrub stat mismatch
844 26 Jos Collin
845 19 Jos Collin
h3. 2021 July 13
846 20 Jos Collin
847 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
848
849 21 Jos Collin
* https://tracker.ceph.com/issues/51704
850
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
851 23 Jos Collin
* https://tracker.ceph.com/issues/45434
852
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
853 24 Jos Collin
* https://tracker.ceph.com/issues/51705
854 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
855
* https://tracker.ceph.com/issues/48640
856 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
857 21 Jos Collin
858 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
859
860
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
861
862
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
863
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
864
865
* https://tracker.ceph.com/issues/45434
866
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
867
* https://tracker.ceph.com/issues/50260
868
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
869
* https://tracker.ceph.com/issues/51183
870
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
871
872
873 16 Jeff Layton
h3. 2021 June 28
874
875
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
876
877
* https://tracker.ceph.com/issues/45434
878
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
879
* https://tracker.ceph.com/issues/51440
880 17 Jeff Layton
    fallocate fails with EACCES
881 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
882
    TestVolumeClient failure
883
* https://tracker.ceph.com/issues/51266
884
    test cleanup failure
885
* https://tracker.ceph.com/issues/51183
886
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
887
888 12 Jeff Layton
h3. 2021 June 14
889
890
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
891
 
892
* https://tracker.ceph.com/issues/45434
893
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
894
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
895
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
896
* https://tracker.ceph.com/issues/51263
897
    pjdfstest rename test 10.t failed with EACCES
898
* https://tracker.ceph.com/issues/51264
899
    TestVolumeClient failure
900 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
901
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
902 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
903
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
904 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
905
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
906 11 Patrick Donnelly
907
h3. 2021 June 07 (Integration Branch)
908
909
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
910
911
* https://tracker.ceph.com/issues/45434
912
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
913
* https://tracker.ceph.com/issues/50279
914
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
915
* https://tracker.ceph.com/issues/48773
916
    qa: scrub does not complete
917
* https://tracker.ceph.com/issues/51170
918
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
919
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
920
    qa: quota failure
921
922
923 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
924
925
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
926
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
927
928
* https://tracker.ceph.com/issues/45434
929
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
930
* https://tracker.ceph.com/issues/50258
931
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
932
* https://tracker.ceph.com/issues/50260
933
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
934
* https://tracker.ceph.com/issues/49962
935
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
936
* https://tracker.ceph.com/issues/50016
937
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
938
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
939
    qa: quota failure
940
* https://tracker.ceph.com/issues/50528
941
    pacific: qa: fs:thrash: pjd suite not ok 20
942
943
944 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
945
946
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
947
948
* https://tracker.ceph.com/issues/50527
949
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
950
* https://tracker.ceph.com/issues/50528
951
    pacific: qa: fs:thrash: pjd suite not ok 20
952
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
953
    qa: "Assertion `cb_done' failed."
954
* https://tracker.ceph.com/issues/49500
955
    qa: "Assertion `cb_done' failed."
956
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
957
    qa: quota failure
958
* https://tracker.ceph.com/issues/45434
959
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
960
* https://tracker.ceph.com/issues/50279
961
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
962
* https://tracker.ceph.com/issues/50258
963
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
964
* https://tracker.ceph.com/issues/49962
965
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
966
* https://tracker.ceph.com/issues/49962
967
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
968
* https://tracker.ceph.com/issues/50530
969
    pacific: client: abort after MDS blocklist
970
971 2 Patrick Donnelly
972
h3. 2021 Apr 21 (Integration Branch)
973
974
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
975
976
* https://tracker.ceph.com/issues/45434
977
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
978
* https://tracker.ceph.com/issues/50250
979
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
980
* https://tracker.ceph.com/issues/50258
981
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
982
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
983
    qa: quota failure
984
* https://tracker.ceph.com/issues/50016
985
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
986
* https://tracker.ceph.com/issues/50495
987
    pacific: client: shutdown race fails with status 141
988
989
990 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
991
992
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
993
994
* https://tracker.ceph.com/issues/45434
995
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
996
* https://tracker.ceph.com/issues/48805
997
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
998
* https://tracker.ceph.com/issues/49500
999
    qa: "Assertion `cb_done' failed."
1000
* https://tracker.ceph.com/issues/50258 (new)
1001
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
1002
* https://tracker.ceph.com/issues/49962
1003
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
1004
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
1005
    qa: quota failure
1006
* https://tracker.ceph.com/issues/50260
1007
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
1008
* https://tracker.ceph.com/issues/50016
1009
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"