Project

General

Profile

Pacific » History » Version 134

Venky Shankar, 02/21/2024 05:43 AM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 98 Venky Shankar
* Jul: Venky
6
* Aug: Patrick
7 118 Jos Collin
* Sep: Jos Collin
8 98 Venky Shankar
* Oct: Xiubo
9
* Nov: Rishabh
10
* Dec: Kotresh
11
* Jan: Milind
12 81 Venky Shankar
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 119 Rishabh Dave
h3. ADD NEW ENTRY BELOW
16
17 134 Venky Shankar
h3. 20 Feb 2024
18
19
https://pulpito.ceph.com/yuriw-2024-02-17_16:03:50-fs-pacific-release-distro-default-smithi/
20
https://pulpito.ceph.com/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi/
21
22
* https://tracker.ceph.com/issues/58992
23
    test_acls (tasks.cephfs.test_acls.TestACLs) 
24
* https://tracker.ceph.com/issues/62501
25
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
26
* https://tracker.ceph.com/issues/62580
27
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
28
29 133 Venky Shankar
h3. 31 Jan 2024
30
31
https://pulpito.ceph.com/?branch=pacific-release
32
33
* https://tracker.ceph.com/issues/52624
34
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
35
* https://tracker.ceph.com/issues/58992
36
    test_acls (tasks.cephfs.test_acls.TestACLs) 
37
* https://tracker.ceph.com/issues/62501
38
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
39 132 Milind Changire
40
h3. 24 Jan 2024
41
42
https://pulpito.ceph.com/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/
43
44
* https://tracker.ceph.com/issues/64059
45
  https://download.ceph.com/qa/ior.tbz2 - ERROR 404: Not Found
46
* https://tracker.ceph.com/issues/62501
47
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
48
* https://tracker.ceph.com/issues/51964
49
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
50
* https://tracker.ceph.com/issues/58992
51
  test_acls (tasks.cephfs.test_acls.TestACLs) 
52
* https://tracker.ceph.com/issues/50224
53
  test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring) 
54
55
56 131 Kotresh Hiremath Ravishankar
h3. 29 Dec 2023
57
58
https://pulpito.ceph.com/yuriw-2023-12-28_15:45:00-fs-wip-yuri7-testing-2023-12-27-1008-pacific-distro-default-smithi/
59
60
* https://tracker.ceph.com/issues/63212
61
  qa: failed to download ior.tbz2
62
* https://tracker.ceph.com/issues/52624
63
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
64
* https://tracker.ceph.com/issues/62501
65
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
66
* https://tracker.ceph.com/issues/50224
67
  test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring) 
68
* https://tracker.ceph.com/issues/58992
69
  test_acls (tasks.cephfs.test_acls.TestACLs) 
70
* https://tracker.ceph.com/issues/50223
71
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
72
* https://tracker.ceph.com/issues/63907
73
  cephfs-mirror: Mirror::update_fs_mirrors crashes while taking lock (coredump)
74
75 128 Venky Shankar
h3. 21 Dec 2023
76
77
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2023-12-14-1107-pacific
78
79
* https://tracker.ceph.com/issues/52624
80
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
81
* https://tracker.ceph.com/issues/63539
82
    fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
83
* test_acls failed because known distro wasn't detected
84 129 Venky Shankar
* https://tracker.ceph.com/issues/50223
85
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
86 128 Venky Shankar
87 127 Rishabh Dave
h3. 4 Dec 2023 2
88 126 Rishabh Dave
89
https://pulpito.ceph.com/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/
90
91
* ior/mdtest failures because packages were missing from download.ceph.com
92
* test_acls failed because known distro wasn't detected
93
* https://tracker.ceph.com/issues/63539
94
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
95
* https://tracker.ceph.com/issues/52624
96
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
97
* https://tracker.ceph.com/issues/37808
98
  osd: osdmap cache weak_refs assert during shutdown
99 125 Kotresh Hiremath Ravishankar
100
h3. 04 Dec 2023
101
102
https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/
103
104
* ior package was missing because it was deleted from download.ceph.com
105
* Error re-imaging machines:
106
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472083
107
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472084
108
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472104
109
* https://tracker.ceph.com/issues/52624
110
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
111
* https://tracker.ceph.com/issues/51282
112
  cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
113
* https://tracker.ceph.com/issues/62501
114
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
115
* https://tracker.ceph.com/issues/58992
116
  test_acls (tasks.cephfs.test_acls.TestACLs)
117
* https://tracker.ceph.com/issues/54462
118
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
119
120
121 123 Rishabh Dave
h3. 22 Nov 2023
122
123
https://pulpito.ceph.com/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
124 124 Rishabh Dave
https://pulpito.ceph.com/yuriw-2023-11-21_15:54:56-smoke-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
125 123 Rishabh Dave
126
* https://tracker.ceph.com/issues/62501
127
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
128
* https://tracker.ceph.com/issues/50223
129
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
130
* ior/mdtest failures because packages were missing from download.ceph.com
131
* test_acls failed because known distro wasn't detected
132
* https://tracker.ceph.com/issues/52624
133
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
134
135 122 Rishabh Dave
h3. 15 Nov 2023
136
137
https://pulpito.ceph.com/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/
138
139
* https://tracker.ceph.com/issues/63539
140
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
141
* test_acls: distro name for RHEL 8.4 wasn't recognized one by xfstests_dev.py
142
* ior package was missing because it was deleted from download.ceph.com
143
* https://tracker.ceph.com/issues/52624
144
  qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
145
146 120 Rishabh Dave
h3. 8 Nov 2023
147 121 Rishabh Dave
148 120 Rishabh Dave
fs: https://pulpito.ceph.com/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
149 121 Rishabh Dave
smoke: https://pulpito.ceph.com/vshankar-2023-11-06_07:53:57-smoke-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
150 120 Rishabh Dave
151
* https://tracker.ceph.com/issues/51964
152
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
153
* https://tracker.ceph.com/issues/62501
154
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
155
* https://tracker.ceph.com/issues/52624
156
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
157
158 114 Jos Collin
h3. 2023 September 12
159
160 117 Jos Collin
https://pulpito.ceph.com/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi
161 115 Jos Collin
162 117 Jos Collin
  * https://tracker.ceph.com/issues/58992
163
    test_acls (tasks.cephfs.test_acls.TestACLs)
164
  * https://tracker.ceph.com/issues/62580
165
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
166 114 Jos Collin
167 111 Patrick Donnelly
h3. 2023 August 31
168
169 113 Patrick Donnelly
https://github.com/ceph/ceph/pull/53189
170
https://github.com/ceph/ceph/pull/53243
171
https://github.com/ceph/ceph/pull/53185
172
https://github.com/ceph/ceph/pull/52744
173
https://github.com/ceph/ceph/pull/51045
174
175 111 Patrick Donnelly
https://pulpito.ceph.com/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/
176
177 112 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
178
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
179
* https://tracker.ceph.com/issues/52624
180
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
181
* https://tracker.ceph.com/issues/54462
182
    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
183
* https://tracker.ceph.com/issues/50222
184
    osd: 5.2s0 deep-scrub : stat mismatch
185
* https://tracker.ceph.com/issues/50250
186
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" ("freshly-calculated rstats don't match existing ones")
187
188
Some spurious infrastructure / valgrind noise during cleanup.
189 111 Patrick Donnelly
190 107 Patrick Donnelly
h3. 2023 August 22
191
192
Pacific v16.2.14 QA
193
194
https://pulpito.ceph.com/yuriw-2023-08-22_14:48:56-fs-pacific-release-distro-default-smithi/
195
https://pulpito.ceph.com/yuriw-2023-08-22_23:49:19-fs-pacific-release-distro-default-smithi/
196
197
* https://tracker.ceph.com/issues/62578
198
    mon: osd pg-upmap-items command causes PG_DEGRADED warnings
199 109 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
200
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
201 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
202
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
203 107 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
204
    test_acls (tasks.cephfs.test_acls.TestACLs)
205 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62579
206
    client: evicted warning because client completes unmount before thrashed MDS comes back
207 110 Patrick Donnelly
* https://tracker.ceph.com/issues/62580
208
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
209 107 Patrick Donnelly
210 106 Patrick Donnelly
h3. 2023 August 16-2
211
212
https://trello.com/c/qRJogcXu/1827-wip-yuri2-testing-2023-08-16-1142-pacific
213
https://pulpito.ceph.com/?branch=wip-yuri2-testing-2023-08-16-1142-pacific
214
215
* https://tracker.ceph.com/issues/52624
216
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
217
* https://tracker.ceph.com/issues/58992
218
    test_acls (tasks.cephfs.test_acls.TestACLs)
219
* https://tracker.ceph.com/issues/62501
220
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
221
222 105 Patrick Donnelly
h3. 2023 August 16
223
224
https://trello.com/c/4TiiTR0k/1821-wip-yuri7-testing-2023-08-16-1309-pacific-old-wip-yuri7-testing-2023-08-16-0933-pacific-old-wip-yuri7-testing-2023-08-15-0741-pa
225
https://pulpito.ceph.com/?branch=wip-yuri7-testing-2023-08-16-1309-pacific
226
227
* https://tracker.ceph.com/issues/62499
228
    testing (?): deadlock ffsb task
229
* https://tracker.ceph.com/issues/62501
230
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
231
232 103 Patrick Donnelly
h3. 2023 August 11
233
234
https://trello.com/c/ONHeA3yz/1823-wip-yuri8-testing-2023-08-11-0834-pacific
235
https://pulpito.ceph.com/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/
236
237
Some infra noise causes dead job.
238
239
* https://tracker.ceph.com/issues/52624
240
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
241
* https://tracker.ceph.com/issues/58992
242
    test_acls (tasks.cephfs.test_acls.TestACLs)
243 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58340
244 107 Patrick Donnelly
    fsstress.sh failed with errno 124 
245 103 Patrick Donnelly
* https://tracker.ceph.com/issues/48773
246 107 Patrick Donnelly
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
247 103 Patrick Donnelly
* https://tracker.ceph.com/issues/50527
248
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
249
250 100 Venky Shankar
h3. 2023 August 8
251
252
https://pulpito.ceph.com/?branch=wip-yuri10-testing-2023-08-01-0753-pacific
253
254
* https://tracker.ceph.com/issues/52624
255
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
256 1 Patrick Donnelly
* https://tracker.ceph.com/issues/50223
257
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
258 101 Patrick Donnelly
* https://tracker.ceph.com/issues/62164
259
    qa: "cluster [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13..."
260
* https://tracker.ceph.com/issues/51964
261
    qa: test_cephfs_mirror_restart_sync_on_blocklist failure
262
* https://tracker.ceph.com/issues/58992
263
    test_acls (tasks.cephfs.test_acls.TestACLs)
264
* https://tracker.ceph.com/issues/62465
265
    pacific (?): LibCephFS.ShutdownRace segmentation fault
266 102 Patrick Donnelly
* "fs/full/subvolume_snapshot_rm.sh" failure caused by bluestore crash.
267 100 Venky Shankar
268 104 Patrick Donnelly
h3. 2023 August 03
269
270
https://trello.com/c/8HALLv9T/1813-wip-yuri6-testing-2023-08-03-0807-pacific-old-wip-yuri6-testing-2023-07-24-0819-pacific2-old-wip-yuri6-testing-2023-07-24-0819-p
271
https://pulpito.ceph.com/?branch=wip-yuri6-testing-2023-08-03-0807-pacific
272
273
* https://tracker.ceph.com/issues/52624
274
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
275
* https://tracker.ceph.com/issues/58992
276
    test_acls (tasks.cephfs.test_acls.TestACLs)
277
278 99 Venky Shankar
h3. 2023 July 25
279
280
https://pulpito.ceph.com/?branch=wip-yuri-testing-2023-07-19-1340-pacific
281
282
* https://tracker.ceph.com/issues/52624
283
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
284
* https://tracker.ceph.com/issues/58992
285
    test_acls (tasks.cephfs.test_acls.TestACLs)
286
* https://tracker.ceph.com/issues/50223
287
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
288
* https://tracker.ceph.com/issues/62160
289
    mds: MDS abort because newly corrupt dentry to be committed
290
* https://tracker.ceph.com/issues/61201
291
    qa: test_rebuild_moved_file (tasks/data-scan) fails because mds crashes in pacific (recovery thread crash)
292
293
294 94 Kotresh Hiremath Ravishankar
h3. 2023 May 17
295
296
https://pulpito.ceph.com/yuriw-2023-05-15_21:56:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/
297 97 Kotresh Hiremath Ravishankar
https://pulpito.ceph.com/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/ (fresh pkg and re-run because of package/installation issues)
298 94 Kotresh Hiremath Ravishankar
299
* https://tracker.ceph.com/issues/52624
300
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
301 96 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/61201 (NEW)
302 94 Kotresh Hiremath Ravishankar
  Test failure: test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan)
303
* https://tracker.ceph.com/issues/58340
304
  fsstress.sh failed with errno 124 
305 1 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
306 94 Kotresh Hiremath Ravishankar
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
307
* https://tracker.ceph.com/issues/58992
308
  test_acls (tasks.cephfs.test_acls.TestACLs)
309
* https://tracker.ceph.com/issues/54462
310 95 Kotresh Hiremath Ravishankar
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128 
311 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58674
312 95 Kotresh Hiremath Ravishankar
  teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds 
313 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/55446
314 95 Kotresh Hiremath Ravishankar
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
315
 
316 94 Kotresh Hiremath Ravishankar
317
318 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
319
320
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
321
322
* https://tracker.ceph.com/issues/52624
323
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
324
* https://tracker.ceph.com/issues/51964
325
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
326
* https://tracker.ceph.com/issues/48773
327
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
328
* https://tracker.ceph.com/issues/50223
329
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
330 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
331
  test_acls (tasks.cephfs.test_acls.TestACLs)
332 91 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58340
333
  fsstress.sh failed with errno 124
334 93 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
335
  Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
336
* https://tracker.ceph.com/issues/55446
337
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
338 91 Kotresh Hiremath Ravishankar
339 90 Rishabh Dave
h3. 2023 May 4
340
341
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
342
343
* https://tracker.ceph.com/issues/59560
344
  qa: RuntimeError: more than one file system available
345
* https://tracker.ceph.com/issues/59626
346
  FSMissing: File system xxxx does not exist in the map
347
* https://tracker.ceph.com/issues/58340
348
  fsstress.sh failed with errno 124
349
* https://tracker.ceph.com/issues/58992
350
  test_acls
351
* https://tracker.ceph.com/issues/48773
352
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
353
* https://tracker.ceph.com/issues/57676
354
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
355
356
357 86 Rishabh Dave
h3. 2023 Apr 13
358
359
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
360
361
https://tracker.ceph.com/issues/52624
362
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
363
* https://tracker.ceph.com/issues/57594
364
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
365
* https://tracker.ceph.com/issues/54108
366
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
367
* https://tracker.ceph.com/issues/58340
368
  fsstress.sh failed with errno 125
369
* https://tracker.ceph.com/issues/54462
370
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
371
* https://tracker.ceph.com/issues/49287     
372
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
373
* https://tracker.ceph.com/issues/58726
374
  test_acls: expected a yum based or a apt based system
375 40 Ramana Raja
376 84 Venky Shankar
h3. 2022 Dec 07
377
378
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
379
380
many transient git.ceph.com related timeouts
381
382
* https://tracker.ceph.com/issues/52624
383
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
384
* https://tracker.ceph.com/issues/50224
385
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
386
* https://tracker.ceph.com/issues/56644
387
    qa: test_rapid_creation fails with "No space left on device"
388
* https://tracker.ceph.com/issues/58221
389
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
390
391 83 Venky Shankar
h3. 2022 Dec 02
392
393
many transient git.ceph.com related timeouts
394
many transient 'Failed to connect to the host via ssh' failures
395
396
* https://tracker.ceph.com/issues/57723
397
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
398
* https://tracker.ceph.com/issues/52624
399
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
400
401 82 Venky Shankar
h3. 2022 Dec 01
402
403
many transient git.ceph.com related timeouts
404
405
* https://tracker.ceph.com/issues/57723
406
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
407
* https://tracker.ceph.com/issues/52624
408
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
409
410 80 Patrick Donnelly
h3. 2022 Nov 18
411
412
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
413
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
414
415
2 ansible dead failures.
416
12 transient git.ceph.com related timeouts
417
418
* https://tracker.ceph.com/issues/57723
419
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
420
* https://tracker.ceph.com/issues/52624
421
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
422
423 78 Milind Changire
h3. 2022 Oct 19
424
425
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
426
427
* https://tracker.ceph.com/issues/57723
428
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
429
* https://tracker.ceph.com/issues/52624
430
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
431
* https://tracker.ceph.com/issues/56644
432
  qa: test_rapid_creation fails with "No space left on device"
433
* https://tracker.ceph.com/issues/54460
434
  snaptest-multiple-capsnaps.sh test failure
435
* https://tracker.ceph.com/issues/57892
436
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
437
438
439
440 76 Venky Shankar
h3. 2022 Oct 06
441
442
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
443
444
* https://tracker.ceph.com/issues/52624
445
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
446
* https://tracker.ceph.com/issues/50223
447
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
448 77 Milind Changire
* https://tracker.ceph.com/issues/56507
449
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
450 76 Venky Shankar
451 75 Venky Shankar
h3. 2022 Sep 27
452
453
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
454
455
* https://tracker.ceph.com/issues/52624
456
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
457
* https://tracker.ceph.com/issues/48773
458
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
459
* https://tracker.ceph.com/issues/50224
460
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
461
* https://tracker.ceph.com/issues/56507
462
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
463
* https://tracker.ceph.com/issues/50223
464
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
465
466 74 Venky Shankar
h3. 2022 Sep 22
467
468
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
469
470
* https://tracker.ceph.com/issues/52624
471
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
472
* https://tracker.ceph.com/issues/51282
473
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
474
* https://tracker.ceph.com/issues/53360
475
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
476
477 73 Venky Shankar
h3. 2022 Sep 19
478
479
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
480
481
* https://tracker.ceph.com/issues/52624
482
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
483
* https://tracker.ceph.com/issues/57594
484
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
485
486 71 Venky Shankar
h3. 2022 Sep 15
487
488
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
489
490
* https://tracker.ceph.com/issues/51282
491
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
492
* https://tracker.ceph.com/issues/52624
493
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
494
* https://tracker.ceph.com/issues/53360
495
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
496 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
497
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
498 71 Venky Shankar
499 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
500
501
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
502
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
503
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
504
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
505
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
506
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
507
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
508
509
510
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
511
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
512
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
513
514
515 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
516
517
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
518
* Most of the failures are passed in re-run. Please check rerun failures below.
519
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
520
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
521
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
522
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
523
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
524
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
525
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
526
527
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
528
* https://tracker.ceph.com/issues/52624
529
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
530
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
531
* https://tracker.ceph.com/issues/57083
532
* https://tracker.ceph.com/issues/53360
533
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
534
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
535
* https://tracker.ceph.com/issues/51183
536
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
537
* https://tracker.ceph.com/issues/56507
538
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
539
540 68 Kotresh Hiremath Ravishankar
541
h3. 2022 AUG 04
542
543
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
544
545
* https://tracker.ceph.com/issues/57087
546
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
547
* https://tracker.ceph.com/issues/52624
548
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
549
* https://tracker.ceph.com/issues/51267
550
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
551
* https://tracker.ceph.com/issues/53360
552
* https://tracker.ceph.com/issues/57083
553
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
554
* https://tracker.ceph.com/issues/56507
555
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
556
557
558 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
559
560
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
561
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
562
563
* https://tracker.ceph.com/issues/52624
564
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
565
* https://tracker.ceph.com/issues/57083
566
* https://tracker.ceph.com/issues/53360
567
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
568
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
569
* https://tracker.ceph.com/issues/51183
570
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
571
* https://tracker.ceph.com/issues/56507
572
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
573
574
575 66 Venky Shankar
h3. 2022 July 08
576
577
* https://tracker.ceph.com/issues/52624
578
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
579
* https://tracker.ceph.com/issues/53360
580
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
581
* https://tracker.ceph.com/issues/51183
582
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
583
* https://tracker.ceph.com/issues/56506
584
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
585
* https://tracker.ceph.com/issues/56507
586
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
587
588 65 Venky Shankar
h3. 2022 Jun 28
589
590
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
591
592
* https://tracker.ceph.com/issues/52624
593
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
594
* https://tracker.ceph.com/issues/53360
595
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
596
* https://tracker.ceph.com/issues/51183
597
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
598
599 64 Venky Shankar
h3. 2022 Jun 22
600
601
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
602
603
* https://tracker.ceph.com/issues/52624
604
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
605
* https://tracker.ceph.com/issues/53360
606
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
607
* https://tracker.ceph.com/issues/51183
608
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
609
610 63 Venky Shankar
h3. 2022 Jun 17
611
612
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
613
614
* https://tracker.ceph.com/issues/52624
615
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
616
* https://tracker.ceph.com/issues/53360
617
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
618
* https://tracker.ceph.com/issues/51183
619
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
620
621 62 Venky Shankar
h3. 2022 Jun 16
622
623
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
624
625
* https://tracker.ceph.com/issues/52624
626
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
627
* https://tracker.ceph.com/issues/53360
628
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
629
* https://tracker.ceph.com/issues/55449
630
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
631
* https://tracker.ceph.com/issues/51267
632
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
633
* https://tracker.ceph.com/issues/55332
634
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
635
636 61 Venky Shankar
h3. 2022 Jun 15
637
638
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
639
640
* https://tracker.ceph.com/issues/52624
641
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
642
* https://tracker.ceph.com/issues/53360
643
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
644
* https://tracker.ceph.com/issues/55449
645
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
646
647
648 60 Venky Shankar
h3. 2022 Jun 10
649
650
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
651
652
* https://tracker.ceph.com/issues/52624
653
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
654
* https://tracker.ceph.com/issues/53360
655
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
656
* https://tracker.ceph.com/issues/55449
657
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
658
659 59 Venky Shankar
h3. 2022 Jun 09
660
661
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
662
663
* https://tracker.ceph.com/issues/52624
664
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
665
* https://tracker.ceph.com/issues/53360
666
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
667
* https://tracker.ceph.com/issues/55449
668
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
669
670 58 Venky Shankar
h3. 2022 May 06
671
672
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
673
674
* https://tracker.ceph.com/issues/52624
675
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
676
* https://tracker.ceph.com/issues/53360
677
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
678
679 57 Venky Shankar
h3. 2022 April 18
680
681
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
682
(only mgr/snap_schedule backport pr)
683
684
* https://tracker.ceph.com/issues/52624
685
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
686 56 Venky Shankar
687
h3. 2022 March 28
688
689
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
690
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
691
692
* https://tracker.ceph.com/issues/52624
693
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
694
* https://tracker.ceph.com/issues/53360
695
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
696
* https://tracker.ceph.com/issues/54411
697
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
698
	33 daemons have recently crashed" during suites/fsstress.sh
699
700 55 Venky Shankar
h3. 2022 March 25
701
702
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
703
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
704
705
* https://tracker.ceph.com/issues/52624
706
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
707
* https://tracker.ceph.com/issues/52606
708
        qa: test_dirfrag_limit
709
* https://tracker.ceph.com/issues/51905
710
        qa: "error reading sessionmap 'mds1_sessionmap'"
711
* https://tracker.ceph.com/issues/53360
712
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
713
* https://tracker.ceph.com/issues/51183
714
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
715 47 Patrick Donnelly
716 54 Venky Shankar
h3. 2022 March 22
717
718
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
719
720
* https://tracker.ceph.com/issues/52624
721
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
722
* https://tracker.ceph.com/issues/52606
723
        qa: test_dirfrag_limit
724
* https://tracker.ceph.com/issues/51183
725
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
726
* https://tracker.ceph.com/issues/51905
727
        qa: "error reading sessionmap 'mds1_sessionmap'"
728
* https://tracker.ceph.com/issues/53360
729
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
730
* https://tracker.ceph.com/issues/54411
731
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
732
	33 daemons have recently crashed" during suites/fsstress.sh
733 47 Patrick Donnelly
734 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
735
736
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
737
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
738
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
739
740
741
* https://tracker.ceph.com/issues/53300
742
	qa: cluster [WRN] Scrub error on inode
743
* https://tracker.ceph.com/issues/53302
744
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
745
* https://tracker.ceph.com/issues/53314
746
	qa: fs/upgrade/mds_upgrade_sequence test timeout
747
* https://tracker.ceph.com/issues/53316
748
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
749
* https://tracker.ceph.com/issues/52624
750
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
751
* https://tracker.ceph.com/issues/52396
752
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
753
* https://tracker.ceph.com/issues/52875
754
	pacific: qa: test_dirfrag_limit
755
* https://tracker.ceph.com/issues/51705
756 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
757
* https://tracker.ceph.com/issues/39634
758
	qa: test_full_same_file timeout
759 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
760
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
761 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
762
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
763 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
764
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
765 48 Kotresh Hiremath Ravishankar
766 47 Patrick Donnelly
767
h3. 2021 November 20
768
769
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
770
771
* https://tracker.ceph.com/issues/53360
772
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
773 46 Kotresh Hiremath Ravishankar
774 41 Patrick Donnelly
h3. 2021 September 14 (QE)
775
776
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
777 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
778 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
779 41 Patrick Donnelly
780
* https://tracker.ceph.com/issues/52606
781
    qa: test_dirfrag_limit
782
* https://tracker.ceph.com/issues/52607
783
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
784 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
785
    qa: tasks.cephfs.fuse_mount:mount command failed
786 41 Patrick Donnelly
787 40 Ramana Raja
h3. 2021 Sep 7
788
789
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
790
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
791
792
793
* https://tracker.ceph.com/issues/52396
794
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
795
* https://tracker.ceph.com/issues/51705
796
    qa: tasks.cephfs.fuse_mount:mount command failed
797 4 Patrick Donnelly
798 34 Ramana Raja
h3. 2021 Aug 30
799
800
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
801
802
* https://tracker.ceph.com/issues/45434
803
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
804
* https://tracker.ceph.com/issues/51705
805
    qa: tasks.cephfs.fuse_mount:mount command failed
806
* https://tracker.ceph.com/issues/52396
807
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
808 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
809 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
810
* https://tracker.ceph.com/issues/51267
811 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
812
* https://tracker.ceph.com/issues/48772
813
   qa: pjd: not ok 9, 44, 80
814 35 Ramana Raja
815 34 Ramana Raja
816 31 Ramana Raja
h3. 2021 Aug 23
817
818
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
819
820
* https://tracker.ceph.com/issues/45434
821
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
822
* https://tracker.ceph.com/issues/51705
823
    qa: tasks.cephfs.fuse_mount:mount command failed
824 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
825 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
826
* https://tracker.ceph.com/issues/52397
827
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
828
829 31 Ramana Raja
830 29 Ramana Raja
h3. 2021 Aug 11
831
832
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
833
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
834
835
* https://tracker.ceph.com/issues/45434
836
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
837
* https://tracker.ceph.com/issues/51705
838
    qa: tasks.cephfs.fuse_mount:mount command failed
839 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
840
    osd: 5.2s0 deep-scrub : stat mismatch
841 29 Ramana Raja
842 19 Jos Collin
h3. 2021 July 15
843 20 Jos Collin
844 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
845
846 26 Jos Collin
* https://tracker.ceph.com/issues/45434
847
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
848
* https://tracker.ceph.com/issues/51705
849
    qa: tasks.cephfs.fuse_mount:mount command failed
850 27 Jos Collin
* https://tracker.ceph.com/issues/51183
851
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
852 28 Jos Collin
* https://tracker.ceph.com/issues/50528
853
    qa: fs:thrash: pjd suite not ok 80
854
* https://tracker.ceph.com/issues/51706
855
    qa: osd deep-scrub stat mismatch
856 26 Jos Collin
857 19 Jos Collin
h3. 2021 July 13
858 20 Jos Collin
859 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
860
861 21 Jos Collin
* https://tracker.ceph.com/issues/51704
862
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
863 23 Jos Collin
* https://tracker.ceph.com/issues/45434
864
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
865 24 Jos Collin
* https://tracker.ceph.com/issues/51705
866 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
867
* https://tracker.ceph.com/issues/48640
868 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
869 21 Jos Collin
870 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
871
872
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
873
874
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
875
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
876
877
* https://tracker.ceph.com/issues/45434
878
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
879
* https://tracker.ceph.com/issues/50260
880
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
881
* https://tracker.ceph.com/issues/51183
882
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
883
884
885 16 Jeff Layton
h3. 2021 June 28
886
887
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
888
889
* https://tracker.ceph.com/issues/45434
890
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
891
* https://tracker.ceph.com/issues/51440
892 17 Jeff Layton
    fallocate fails with EACCES
893 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
894
    TestVolumeClient failure
895
* https://tracker.ceph.com/issues/51266
896
    test cleanup failure
897
* https://tracker.ceph.com/issues/51183
898
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
899
900 12 Jeff Layton
h3. 2021 June 14
901
902
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
903
 
904
* https://tracker.ceph.com/issues/45434
905
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
906
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
907
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
908
* https://tracker.ceph.com/issues/51263
909
    pjdfstest rename test 10.t failed with EACCES
910
* https://tracker.ceph.com/issues/51264
911
    TestVolumeClient failure
912 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
913
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
914 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
915
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
916 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
917
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
918 11 Patrick Donnelly
919
h3. 2021 June 07 (Integration Branch)
920
921
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
922
923
* https://tracker.ceph.com/issues/45434
924
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
925
* https://tracker.ceph.com/issues/50279
926
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
927
* https://tracker.ceph.com/issues/48773
928
    qa: scrub does not complete
929
* https://tracker.ceph.com/issues/51170
930
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
931
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
932
    qa: quota failure
933
934
935 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
936
937
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
938
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
939
940
* https://tracker.ceph.com/issues/45434
941
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
942
* https://tracker.ceph.com/issues/50258
943
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
944
* https://tracker.ceph.com/issues/50260
945
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
946
* https://tracker.ceph.com/issues/49962
947
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
948
* https://tracker.ceph.com/issues/50016
949
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
950
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
951
    qa: quota failure
952
* https://tracker.ceph.com/issues/50528
953
    pacific: qa: fs:thrash: pjd suite not ok 20
954
955
956 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
957
958
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
959
960
* https://tracker.ceph.com/issues/50527
961
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
962
* https://tracker.ceph.com/issues/50528
963
    pacific: qa: fs:thrash: pjd suite not ok 20
964
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
965
    qa: "Assertion `cb_done' failed."
966
* https://tracker.ceph.com/issues/49500
967
    qa: "Assertion `cb_done' failed."
968
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
969
    qa: quota failure
970
* https://tracker.ceph.com/issues/45434
971
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
972
* https://tracker.ceph.com/issues/50279
973
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
974
* https://tracker.ceph.com/issues/50258
975
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
976
* https://tracker.ceph.com/issues/49962
977
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
978
* https://tracker.ceph.com/issues/49962
979
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
980
* https://tracker.ceph.com/issues/50530
981
    pacific: client: abort after MDS blocklist
982
983 2 Patrick Donnelly
984
h3. 2021 Apr 21 (Integration Branch)
985
986
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
987
988
* https://tracker.ceph.com/issues/45434
989
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
990
* https://tracker.ceph.com/issues/50250
991
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
992
* https://tracker.ceph.com/issues/50258
993
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
994
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
995
    qa: quota failure
996
* https://tracker.ceph.com/issues/50016
997
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
998
* https://tracker.ceph.com/issues/50495
999
    pacific: client: shutdown race fails with status 141
1000
1001
1002 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
1003
1004
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
1005
1006
* https://tracker.ceph.com/issues/45434
1007
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
1008
* https://tracker.ceph.com/issues/48805
1009
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
1010
* https://tracker.ceph.com/issues/49500
1011
    qa: "Assertion `cb_done' failed."
1012
* https://tracker.ceph.com/issues/50258 (new)
1013
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
1014
* https://tracker.ceph.com/issues/49962
1015
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
1016
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
1017
    qa: quota failure
1018
* https://tracker.ceph.com/issues/50260
1019
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
1020
* https://tracker.ceph.com/issues/50016
1021
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"