Project

General

Profile

Pacific » History » Version 126

Rishabh Dave, 12/04/2023 06:31 PM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 98 Venky Shankar
* Jul: Venky
6
* Aug: Patrick
7 118 Jos Collin
* Sep: Jos Collin
8 98 Venky Shankar
* Oct: Xiubo
9
* Nov: Rishabh
10
* Dec: Kotresh
11
* Jan: Milind
12 81 Venky Shankar
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 119 Rishabh Dave
h3. ADD NEW ENTRY BELOW
16
17 126 Rishabh Dave
h3. 5 Dec 2023
18
19
https://pulpito.ceph.com/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/
20
21
* ior/mdtest failures because packages were missing from download.ceph.com
22
* test_acls failed because known distro wasn't detected
23
* https://tracker.ceph.com/issues/63539
24
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
25
* https://tracker.ceph.com/issues/52624
26
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
27
* https://tracker.ceph.com/issues/37808
28
  osd: osdmap cache weak_refs assert during shutdown
29
30 125 Kotresh Hiremath Ravishankar
31
h3. 04 Dec 2023
32
33
https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/
34
35
* ior package was missing because it was deleted from download.ceph.com
36
* Error re-imaging machines:
37
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472083
38
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472084
39
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472104
40
* https://tracker.ceph.com/issues/52624
41
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
42
* https://tracker.ceph.com/issues/51282
43
  cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
44
* https://tracker.ceph.com/issues/62501
45
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
46
* https://tracker.ceph.com/issues/58992
47
  test_acls (tasks.cephfs.test_acls.TestACLs)
48
* https://tracker.ceph.com/issues/54462
49
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
50
51
52 123 Rishabh Dave
h3. 22 Nov 2023
53
54
https://pulpito.ceph.com/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
55 124 Rishabh Dave
https://pulpito.ceph.com/yuriw-2023-11-21_15:54:56-smoke-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
56 123 Rishabh Dave
57
* https://tracker.ceph.com/issues/62501
58
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
59
* https://tracker.ceph.com/issues/50223
60
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
61
* ior/mdtest failures because packages were missing from download.ceph.com
62
* test_acls failed because known distro wasn't detected
63
* https://tracker.ceph.com/issues/52624
64
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
65
66 122 Rishabh Dave
h3. 15 Nov 2023
67
68
https://pulpito.ceph.com/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/
69
70
* https://tracker.ceph.com/issues/63539
71
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
72
* test_acls: distro name for RHEL 8.4 wasn't recognized one by xfstests_dev.py
73
* ior package was missing because it was deleted from download.ceph.com
74
* https://tracker.ceph.com/issues/52624
75
  qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
76
77 120 Rishabh Dave
h3. 8 Nov 2023
78 121 Rishabh Dave
79 120 Rishabh Dave
fs: https://pulpito.ceph.com/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
80 121 Rishabh Dave
smoke: https://pulpito.ceph.com/vshankar-2023-11-06_07:53:57-smoke-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
81 120 Rishabh Dave
82
* https://tracker.ceph.com/issues/51964
83
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
84
* https://tracker.ceph.com/issues/62501
85
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
86
* https://tracker.ceph.com/issues/52624
87
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
88
89 114 Jos Collin
h3. 2023 September 12
90
91 117 Jos Collin
https://pulpito.ceph.com/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi
92 115 Jos Collin
93 117 Jos Collin
  * https://tracker.ceph.com/issues/58992
94
    test_acls (tasks.cephfs.test_acls.TestACLs)
95
  * https://tracker.ceph.com/issues/62580
96
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
97 114 Jos Collin
98 111 Patrick Donnelly
h3. 2023 August 31
99
100 113 Patrick Donnelly
https://github.com/ceph/ceph/pull/53189
101
https://github.com/ceph/ceph/pull/53243
102
https://github.com/ceph/ceph/pull/53185
103
https://github.com/ceph/ceph/pull/52744
104
https://github.com/ceph/ceph/pull/51045
105
106 111 Patrick Donnelly
https://pulpito.ceph.com/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/
107
108 112 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
109
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
110
* https://tracker.ceph.com/issues/52624
111
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
112
* https://tracker.ceph.com/issues/54462
113
    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
114
* https://tracker.ceph.com/issues/50222
115
    osd: 5.2s0 deep-scrub : stat mismatch
116
* https://tracker.ceph.com/issues/50250
117
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" ("freshly-calculated rstats don't match existing ones")
118
119
Some spurious infrastructure / valgrind noise during cleanup.
120 111 Patrick Donnelly
121 107 Patrick Donnelly
h3. 2023 August 22
122
123
Pacific v16.2.14 QA
124
125
https://pulpito.ceph.com/yuriw-2023-08-22_14:48:56-fs-pacific-release-distro-default-smithi/
126
https://pulpito.ceph.com/yuriw-2023-08-22_23:49:19-fs-pacific-release-distro-default-smithi/
127
128
* https://tracker.ceph.com/issues/62578
129
    mon: osd pg-upmap-items command causes PG_DEGRADED warnings
130 109 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
131
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
132 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
133
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
134 107 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
135
    test_acls (tasks.cephfs.test_acls.TestACLs)
136 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62579
137
    client: evicted warning because client completes unmount before thrashed MDS comes back
138 110 Patrick Donnelly
* https://tracker.ceph.com/issues/62580
139
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
140 107 Patrick Donnelly
141 106 Patrick Donnelly
h3. 2023 August 16-2
142
143
https://trello.com/c/qRJogcXu/1827-wip-yuri2-testing-2023-08-16-1142-pacific
144
https://pulpito.ceph.com/?branch=wip-yuri2-testing-2023-08-16-1142-pacific
145
146
* https://tracker.ceph.com/issues/52624
147
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
148
* https://tracker.ceph.com/issues/58992
149
    test_acls (tasks.cephfs.test_acls.TestACLs)
150
* https://tracker.ceph.com/issues/62501
151
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
152
153 105 Patrick Donnelly
h3. 2023 August 16
154
155
https://trello.com/c/4TiiTR0k/1821-wip-yuri7-testing-2023-08-16-1309-pacific-old-wip-yuri7-testing-2023-08-16-0933-pacific-old-wip-yuri7-testing-2023-08-15-0741-pa
156
https://pulpito.ceph.com/?branch=wip-yuri7-testing-2023-08-16-1309-pacific
157
158
* https://tracker.ceph.com/issues/62499
159
    testing (?): deadlock ffsb task
160
* https://tracker.ceph.com/issues/62501
161
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
162
163 103 Patrick Donnelly
h3. 2023 August 11
164
165
https://trello.com/c/ONHeA3yz/1823-wip-yuri8-testing-2023-08-11-0834-pacific
166
https://pulpito.ceph.com/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/
167
168
Some infra noise causes dead job.
169
170
* https://tracker.ceph.com/issues/52624
171
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
172
* https://tracker.ceph.com/issues/58992
173
    test_acls (tasks.cephfs.test_acls.TestACLs)
174 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58340
175 107 Patrick Donnelly
    fsstress.sh failed with errno 124 
176 103 Patrick Donnelly
* https://tracker.ceph.com/issues/48773
177 107 Patrick Donnelly
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
178 103 Patrick Donnelly
* https://tracker.ceph.com/issues/50527
179
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
180
181 100 Venky Shankar
h3. 2023 August 8
182
183
https://pulpito.ceph.com/?branch=wip-yuri10-testing-2023-08-01-0753-pacific
184
185
* https://tracker.ceph.com/issues/52624
186
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
187 1 Patrick Donnelly
* https://tracker.ceph.com/issues/50223
188
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
189 101 Patrick Donnelly
* https://tracker.ceph.com/issues/62164
190
    qa: "cluster [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13..."
191
* https://tracker.ceph.com/issues/51964
192
    qa: test_cephfs_mirror_restart_sync_on_blocklist failure
193
* https://tracker.ceph.com/issues/58992
194
    test_acls (tasks.cephfs.test_acls.TestACLs)
195
* https://tracker.ceph.com/issues/62465
196
    pacific (?): LibCephFS.ShutdownRace segmentation fault
197 102 Patrick Donnelly
* "fs/full/subvolume_snapshot_rm.sh" failure caused by bluestore crash.
198 100 Venky Shankar
199 104 Patrick Donnelly
h3. 2023 August 03
200
201
https://trello.com/c/8HALLv9T/1813-wip-yuri6-testing-2023-08-03-0807-pacific-old-wip-yuri6-testing-2023-07-24-0819-pacific2-old-wip-yuri6-testing-2023-07-24-0819-p
202
https://pulpito.ceph.com/?branch=wip-yuri6-testing-2023-08-03-0807-pacific
203
204
* https://tracker.ceph.com/issues/52624
205
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
206
* https://tracker.ceph.com/issues/58992
207
    test_acls (tasks.cephfs.test_acls.TestACLs)
208
209 99 Venky Shankar
h3. 2023 July 25
210
211
https://pulpito.ceph.com/?branch=wip-yuri-testing-2023-07-19-1340-pacific
212
213
* https://tracker.ceph.com/issues/52624
214
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
215
* https://tracker.ceph.com/issues/58992
216
    test_acls (tasks.cephfs.test_acls.TestACLs)
217
* https://tracker.ceph.com/issues/50223
218
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
219
* https://tracker.ceph.com/issues/62160
220
    mds: MDS abort because newly corrupt dentry to be committed
221
* https://tracker.ceph.com/issues/61201
222
    qa: test_rebuild_moved_file (tasks/data-scan) fails because mds crashes in pacific (recovery thread crash)
223
224
225 94 Kotresh Hiremath Ravishankar
h3. 2023 May 17
226
227
https://pulpito.ceph.com/yuriw-2023-05-15_21:56:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/
228 97 Kotresh Hiremath Ravishankar
https://pulpito.ceph.com/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/ (fresh pkg and re-run because of package/installation issues)
229 94 Kotresh Hiremath Ravishankar
230
* https://tracker.ceph.com/issues/52624
231
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
232 96 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/61201 (NEW)
233 94 Kotresh Hiremath Ravishankar
  Test failure: test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan)
234
* https://tracker.ceph.com/issues/58340
235
  fsstress.sh failed with errno 124 
236 1 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
237 94 Kotresh Hiremath Ravishankar
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
238
* https://tracker.ceph.com/issues/58992
239
  test_acls (tasks.cephfs.test_acls.TestACLs)
240
* https://tracker.ceph.com/issues/54462
241 95 Kotresh Hiremath Ravishankar
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128 
242 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58674
243 95 Kotresh Hiremath Ravishankar
  teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds 
244 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/55446
245 95 Kotresh Hiremath Ravishankar
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
246
 
247 94 Kotresh Hiremath Ravishankar
248
249 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
250
251
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
252
253
* https://tracker.ceph.com/issues/52624
254
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
255
* https://tracker.ceph.com/issues/51964
256
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
257
* https://tracker.ceph.com/issues/48773
258
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
259
* https://tracker.ceph.com/issues/50223
260
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
261 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
262
  test_acls (tasks.cephfs.test_acls.TestACLs)
263 91 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58340
264
  fsstress.sh failed with errno 124
265 93 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
266
  Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
267
* https://tracker.ceph.com/issues/55446
268
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
269 91 Kotresh Hiremath Ravishankar
270 90 Rishabh Dave
h3. 2023 May 4
271
272
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
273
274
* https://tracker.ceph.com/issues/59560
275
  qa: RuntimeError: more than one file system available
276
* https://tracker.ceph.com/issues/59626
277
  FSMissing: File system xxxx does not exist in the map
278
* https://tracker.ceph.com/issues/58340
279
  fsstress.sh failed with errno 124
280
* https://tracker.ceph.com/issues/58992
281
  test_acls
282
* https://tracker.ceph.com/issues/48773
283
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
284
* https://tracker.ceph.com/issues/57676
285
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
286
287
288 86 Rishabh Dave
h3. 2023 Apr 13
289
290
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
291
292
https://tracker.ceph.com/issues/52624
293
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
294
* https://tracker.ceph.com/issues/57594
295
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
296
* https://tracker.ceph.com/issues/54108
297
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
298
* https://tracker.ceph.com/issues/58340
299
  fsstress.sh failed with errno 125
300
* https://tracker.ceph.com/issues/54462
301
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
302
* https://tracker.ceph.com/issues/49287     
303
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
304
* https://tracker.ceph.com/issues/58726
305
  test_acls: expected a yum based or a apt based system
306 40 Ramana Raja
307 84 Venky Shankar
h3. 2022 Dec 07
308
309
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
310
311
many transient git.ceph.com related timeouts
312
313
* https://tracker.ceph.com/issues/52624
314
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
315
* https://tracker.ceph.com/issues/50224
316
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
317
* https://tracker.ceph.com/issues/56644
318
    qa: test_rapid_creation fails with "No space left on device"
319
* https://tracker.ceph.com/issues/58221
320
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
321
322 83 Venky Shankar
h3. 2022 Dec 02
323
324
many transient git.ceph.com related timeouts
325
many transient 'Failed to connect to the host via ssh' failures
326
327
* https://tracker.ceph.com/issues/57723
328
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
329
* https://tracker.ceph.com/issues/52624
330
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
331
332 82 Venky Shankar
h3. 2022 Dec 01
333
334
many transient git.ceph.com related timeouts
335
336
* https://tracker.ceph.com/issues/57723
337
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
338
* https://tracker.ceph.com/issues/52624
339
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
340
341 80 Patrick Donnelly
h3. 2022 Nov 18
342
343
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
344
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
345
346
2 ansible dead failures.
347
12 transient git.ceph.com related timeouts
348
349
* https://tracker.ceph.com/issues/57723
350
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
351
* https://tracker.ceph.com/issues/52624
352
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
353
354 78 Milind Changire
h3. 2022 Oct 19
355
356
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
357
358
* https://tracker.ceph.com/issues/57723
359
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
360
* https://tracker.ceph.com/issues/52624
361
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
362
* https://tracker.ceph.com/issues/56644
363
  qa: test_rapid_creation fails with "No space left on device"
364
* https://tracker.ceph.com/issues/54460
365
  snaptest-multiple-capsnaps.sh test failure
366
* https://tracker.ceph.com/issues/57892
367
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
368
369
370
371 76 Venky Shankar
h3. 2022 Oct 06
372
373
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
374
375
* https://tracker.ceph.com/issues/52624
376
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
377
* https://tracker.ceph.com/issues/50223
378
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
379 77 Milind Changire
* https://tracker.ceph.com/issues/56507
380
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
381 76 Venky Shankar
382 75 Venky Shankar
h3. 2022 Sep 27
383
384
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
385
386
* https://tracker.ceph.com/issues/52624
387
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
388
* https://tracker.ceph.com/issues/48773
389
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
390
* https://tracker.ceph.com/issues/50224
391
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
392
* https://tracker.ceph.com/issues/56507
393
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
394
* https://tracker.ceph.com/issues/50223
395
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
396
397 74 Venky Shankar
h3. 2022 Sep 22
398
399
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
400
401
* https://tracker.ceph.com/issues/52624
402
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
403
* https://tracker.ceph.com/issues/51282
404
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
405
* https://tracker.ceph.com/issues/53360
406
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
407
408 73 Venky Shankar
h3. 2022 Sep 19
409
410
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
411
412
* https://tracker.ceph.com/issues/52624
413
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
414
* https://tracker.ceph.com/issues/57594
415
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
416
417 71 Venky Shankar
h3. 2022 Sep 15
418
419
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
420
421
* https://tracker.ceph.com/issues/51282
422
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
423
* https://tracker.ceph.com/issues/52624
424
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
425
* https://tracker.ceph.com/issues/53360
426
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
427 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
428
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
429 71 Venky Shankar
430 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
431
432
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
433
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
434
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
435
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
436
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
437
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
438
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
439
440
441
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
442
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
443
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
444
445
446 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
447
448
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
449
* Most of the failures are passed in re-run. Please check rerun failures below.
450
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
451
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
452
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
453
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
454
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
455
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
456
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
457
458
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
459
* https://tracker.ceph.com/issues/52624
460
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
461
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
462
* https://tracker.ceph.com/issues/57083
463
* https://tracker.ceph.com/issues/53360
464
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
465
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
466
* https://tracker.ceph.com/issues/51183
467
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
468
* https://tracker.ceph.com/issues/56507
469
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
470
471 68 Kotresh Hiremath Ravishankar
472
h3. 2022 AUG 04
473
474
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
475
476
* https://tracker.ceph.com/issues/57087
477
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
478
* https://tracker.ceph.com/issues/52624
479
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
480
* https://tracker.ceph.com/issues/51267
481
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
482
* https://tracker.ceph.com/issues/53360
483
* https://tracker.ceph.com/issues/57083
484
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
485
* https://tracker.ceph.com/issues/56507
486
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
487
488
489 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
490
491
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
492
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
493
494
* https://tracker.ceph.com/issues/52624
495
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
496
* https://tracker.ceph.com/issues/57083
497
* https://tracker.ceph.com/issues/53360
498
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
499
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
500
* https://tracker.ceph.com/issues/51183
501
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
502
* https://tracker.ceph.com/issues/56507
503
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
504
505
506 66 Venky Shankar
h3. 2022 July 08
507
508
* https://tracker.ceph.com/issues/52624
509
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
510
* https://tracker.ceph.com/issues/53360
511
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
512
* https://tracker.ceph.com/issues/51183
513
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
514
* https://tracker.ceph.com/issues/56506
515
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
516
* https://tracker.ceph.com/issues/56507
517
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
518
519 65 Venky Shankar
h3. 2022 Jun 28
520
521
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
522
523
* https://tracker.ceph.com/issues/52624
524
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
525
* https://tracker.ceph.com/issues/53360
526
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
527
* https://tracker.ceph.com/issues/51183
528
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
529
530 64 Venky Shankar
h3. 2022 Jun 22
531
532
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
533
534
* https://tracker.ceph.com/issues/52624
535
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
536
* https://tracker.ceph.com/issues/53360
537
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
538
* https://tracker.ceph.com/issues/51183
539
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
540
541 63 Venky Shankar
h3. 2022 Jun 17
542
543
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
544
545
* https://tracker.ceph.com/issues/52624
546
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
547
* https://tracker.ceph.com/issues/53360
548
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
549
* https://tracker.ceph.com/issues/51183
550
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
551
552 62 Venky Shankar
h3. 2022 Jun 16
553
554
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
555
556
* https://tracker.ceph.com/issues/52624
557
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
558
* https://tracker.ceph.com/issues/53360
559
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
560
* https://tracker.ceph.com/issues/55449
561
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
562
* https://tracker.ceph.com/issues/51267
563
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
564
* https://tracker.ceph.com/issues/55332
565
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
566
567 61 Venky Shankar
h3. 2022 Jun 15
568
569
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
570
571
* https://tracker.ceph.com/issues/52624
572
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
573
* https://tracker.ceph.com/issues/53360
574
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
575
* https://tracker.ceph.com/issues/55449
576
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
577
578
579 60 Venky Shankar
h3. 2022 Jun 10
580
581
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
582
583
* https://tracker.ceph.com/issues/52624
584
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
585
* https://tracker.ceph.com/issues/53360
586
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
587
* https://tracker.ceph.com/issues/55449
588
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
589
590 59 Venky Shankar
h3. 2022 Jun 09
591
592
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
593
594
* https://tracker.ceph.com/issues/52624
595
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
596
* https://tracker.ceph.com/issues/53360
597
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
598
* https://tracker.ceph.com/issues/55449
599
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
600
601 58 Venky Shankar
h3. 2022 May 06
602
603
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
604
605
* https://tracker.ceph.com/issues/52624
606
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
607
* https://tracker.ceph.com/issues/53360
608
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
609
610 57 Venky Shankar
h3. 2022 April 18
611
612
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
613
(only mgr/snap_schedule backport pr)
614
615
* https://tracker.ceph.com/issues/52624
616
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
617 56 Venky Shankar
618
h3. 2022 March 28
619
620
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
621
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
622
623
* https://tracker.ceph.com/issues/52624
624
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
625
* https://tracker.ceph.com/issues/53360
626
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
627
* https://tracker.ceph.com/issues/54411
628
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
629
	33 daemons have recently crashed" during suites/fsstress.sh
630
631 55 Venky Shankar
h3. 2022 March 25
632
633
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
634
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
635
636
* https://tracker.ceph.com/issues/52624
637
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
638
* https://tracker.ceph.com/issues/52606
639
        qa: test_dirfrag_limit
640
* https://tracker.ceph.com/issues/51905
641
        qa: "error reading sessionmap 'mds1_sessionmap'"
642
* https://tracker.ceph.com/issues/53360
643
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
644
* https://tracker.ceph.com/issues/51183
645
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
646 47 Patrick Donnelly
647 54 Venky Shankar
h3. 2022 March 22
648
649
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
650
651
* https://tracker.ceph.com/issues/52624
652
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
653
* https://tracker.ceph.com/issues/52606
654
        qa: test_dirfrag_limit
655
* https://tracker.ceph.com/issues/51183
656
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
657
* https://tracker.ceph.com/issues/51905
658
        qa: "error reading sessionmap 'mds1_sessionmap'"
659
* https://tracker.ceph.com/issues/53360
660
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
661
* https://tracker.ceph.com/issues/54411
662
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
663
	33 daemons have recently crashed" during suites/fsstress.sh
664 47 Patrick Donnelly
665 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
666
667
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
668
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
669
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
670
671
672
* https://tracker.ceph.com/issues/53300
673
	qa: cluster [WRN] Scrub error on inode
674
* https://tracker.ceph.com/issues/53302
675
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
676
* https://tracker.ceph.com/issues/53314
677
	qa: fs/upgrade/mds_upgrade_sequence test timeout
678
* https://tracker.ceph.com/issues/53316
679
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
680
* https://tracker.ceph.com/issues/52624
681
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
682
* https://tracker.ceph.com/issues/52396
683
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
684
* https://tracker.ceph.com/issues/52875
685
	pacific: qa: test_dirfrag_limit
686
* https://tracker.ceph.com/issues/51705
687 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
688
* https://tracker.ceph.com/issues/39634
689
	qa: test_full_same_file timeout
690 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
691
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
692 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
693
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
694 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
695
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
696 48 Kotresh Hiremath Ravishankar
697 47 Patrick Donnelly
698
h3. 2021 November 20
699
700
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
701
702
* https://tracker.ceph.com/issues/53360
703
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
704 46 Kotresh Hiremath Ravishankar
705 41 Patrick Donnelly
h3. 2021 September 14 (QE)
706
707
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
708 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
709 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
710 41 Patrick Donnelly
711
* https://tracker.ceph.com/issues/52606
712
    qa: test_dirfrag_limit
713
* https://tracker.ceph.com/issues/52607
714
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
715 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
716
    qa: tasks.cephfs.fuse_mount:mount command failed
717 41 Patrick Donnelly
718 40 Ramana Raja
h3. 2021 Sep 7
719
720
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
721
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
722
723
724
* https://tracker.ceph.com/issues/52396
725
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
726
* https://tracker.ceph.com/issues/51705
727
    qa: tasks.cephfs.fuse_mount:mount command failed
728 4 Patrick Donnelly
729 34 Ramana Raja
h3. 2021 Aug 30
730
731
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
732
733
* https://tracker.ceph.com/issues/45434
734
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
735
* https://tracker.ceph.com/issues/51705
736
    qa: tasks.cephfs.fuse_mount:mount command failed
737
* https://tracker.ceph.com/issues/52396
738
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
739 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
740 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
741
* https://tracker.ceph.com/issues/51267
742 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
743
* https://tracker.ceph.com/issues/48772
744
   qa: pjd: not ok 9, 44, 80
745 35 Ramana Raja
746 34 Ramana Raja
747 31 Ramana Raja
h3. 2021 Aug 23
748
749
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
750
751
* https://tracker.ceph.com/issues/45434
752
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
753
* https://tracker.ceph.com/issues/51705
754
    qa: tasks.cephfs.fuse_mount:mount command failed
755 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
756 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
757
* https://tracker.ceph.com/issues/52397
758
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
759
760 31 Ramana Raja
761 29 Ramana Raja
h3. 2021 Aug 11
762
763
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
764
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
765
766
* https://tracker.ceph.com/issues/45434
767
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
768
* https://tracker.ceph.com/issues/51705
769
    qa: tasks.cephfs.fuse_mount:mount command failed
770 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
771
    osd: 5.2s0 deep-scrub : stat mismatch
772 29 Ramana Raja
773 19 Jos Collin
h3. 2021 July 15
774 20 Jos Collin
775 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
776
777 26 Jos Collin
* https://tracker.ceph.com/issues/45434
778
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
779
* https://tracker.ceph.com/issues/51705
780
    qa: tasks.cephfs.fuse_mount:mount command failed
781 27 Jos Collin
* https://tracker.ceph.com/issues/51183
782
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
783 28 Jos Collin
* https://tracker.ceph.com/issues/50528
784
    qa: fs:thrash: pjd suite not ok 80
785
* https://tracker.ceph.com/issues/51706
786
    qa: osd deep-scrub stat mismatch
787 26 Jos Collin
788 19 Jos Collin
h3. 2021 July 13
789 20 Jos Collin
790 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
791
792 21 Jos Collin
* https://tracker.ceph.com/issues/51704
793
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
794 23 Jos Collin
* https://tracker.ceph.com/issues/45434
795
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
796 24 Jos Collin
* https://tracker.ceph.com/issues/51705
797 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
798
* https://tracker.ceph.com/issues/48640
799 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
800 21 Jos Collin
801 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
802
803
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
804
805
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
806
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
807
808
* https://tracker.ceph.com/issues/45434
809
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
810
* https://tracker.ceph.com/issues/50260
811
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
812
* https://tracker.ceph.com/issues/51183
813
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
814
815
816 16 Jeff Layton
h3. 2021 June 28
817
818
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
819
820
* https://tracker.ceph.com/issues/45434
821
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
822
* https://tracker.ceph.com/issues/51440
823 17 Jeff Layton
    fallocate fails with EACCES
824 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
825
    TestVolumeClient failure
826
* https://tracker.ceph.com/issues/51266
827
    test cleanup failure
828
* https://tracker.ceph.com/issues/51183
829
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
830
831 12 Jeff Layton
h3. 2021 June 14
832
833
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
834
 
835
* https://tracker.ceph.com/issues/45434
836
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
837
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
838
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
839
* https://tracker.ceph.com/issues/51263
840
    pjdfstest rename test 10.t failed with EACCES
841
* https://tracker.ceph.com/issues/51264
842
    TestVolumeClient failure
843 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
844
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
845 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
846
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
847 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
848
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
849 11 Patrick Donnelly
850
h3. 2021 June 07 (Integration Branch)
851
852
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
853
854
* https://tracker.ceph.com/issues/45434
855
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
856
* https://tracker.ceph.com/issues/50279
857
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
858
* https://tracker.ceph.com/issues/48773
859
    qa: scrub does not complete
860
* https://tracker.ceph.com/issues/51170
861
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
862
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
863
    qa: quota failure
864
865
866 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
867
868
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
869
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
870
871
* https://tracker.ceph.com/issues/45434
872
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
873
* https://tracker.ceph.com/issues/50258
874
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
875
* https://tracker.ceph.com/issues/50260
876
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
877
* https://tracker.ceph.com/issues/49962
878
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
879
* https://tracker.ceph.com/issues/50016
880
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
881
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
882
    qa: quota failure
883
* https://tracker.ceph.com/issues/50528
884
    pacific: qa: fs:thrash: pjd suite not ok 20
885
886
887 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
888
889
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
890
891
* https://tracker.ceph.com/issues/50527
892
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
893
* https://tracker.ceph.com/issues/50528
894
    pacific: qa: fs:thrash: pjd suite not ok 20
895
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
896
    qa: "Assertion `cb_done' failed."
897
* https://tracker.ceph.com/issues/49500
898
    qa: "Assertion `cb_done' failed."
899
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
900
    qa: quota failure
901
* https://tracker.ceph.com/issues/45434
902
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
903
* https://tracker.ceph.com/issues/50279
904
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
905
* https://tracker.ceph.com/issues/50258
906
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
907
* https://tracker.ceph.com/issues/49962
908
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
909
* https://tracker.ceph.com/issues/49962
910
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
911
* https://tracker.ceph.com/issues/50530
912
    pacific: client: abort after MDS blocklist
913
914 2 Patrick Donnelly
915
h3. 2021 Apr 21 (Integration Branch)
916
917
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
918
919
* https://tracker.ceph.com/issues/45434
920
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
921
* https://tracker.ceph.com/issues/50250
922
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
923
* https://tracker.ceph.com/issues/50258
924
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
925
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
926
    qa: quota failure
927
* https://tracker.ceph.com/issues/50016
928
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
929
* https://tracker.ceph.com/issues/50495
930
    pacific: client: shutdown race fails with status 141
931
932
933 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
934
935
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
936
937
* https://tracker.ceph.com/issues/45434
938
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
939
* https://tracker.ceph.com/issues/48805
940
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
941
* https://tracker.ceph.com/issues/49500
942
    qa: "Assertion `cb_done' failed."
943
* https://tracker.ceph.com/issues/50258 (new)
944
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
945
* https://tracker.ceph.com/issues/49962
946
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
947
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
948
    qa: quota failure
949
* https://tracker.ceph.com/issues/50260
950
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
951
* https://tracker.ceph.com/issues/50016
952
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"