Project

General

Profile

Pacific » History » Version 127

Rishabh Dave, 12/04/2023 06:33 PM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 98 Venky Shankar
* Jul: Venky
6
* Aug: Patrick
7 118 Jos Collin
* Sep: Jos Collin
8 98 Venky Shankar
* Oct: Xiubo
9
* Nov: Rishabh
10
* Dec: Kotresh
11
* Jan: Milind
12 81 Venky Shankar
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 119 Rishabh Dave
h3. ADD NEW ENTRY BELOW
16
17 127 Rishabh Dave
h3. 4 Dec 2023 2
18 126 Rishabh Dave
19
https://pulpito.ceph.com/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/
20
21
* ior/mdtest failures because packages were missing from download.ceph.com
22
* test_acls failed because known distro wasn't detected
23
* https://tracker.ceph.com/issues/63539
24
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
25
* https://tracker.ceph.com/issues/52624
26
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
27
* https://tracker.ceph.com/issues/37808
28
  osd: osdmap cache weak_refs assert during shutdown
29 125 Kotresh Hiremath Ravishankar
30
h3. 04 Dec 2023
31
32
https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/
33
34
* ior package was missing because it was deleted from download.ceph.com
35
* Error re-imaging machines:
36
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472083
37
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472084
38
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472104
39
* https://tracker.ceph.com/issues/52624
40
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
41
* https://tracker.ceph.com/issues/51282
42
  cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
43
* https://tracker.ceph.com/issues/62501
44
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
45
* https://tracker.ceph.com/issues/58992
46
  test_acls (tasks.cephfs.test_acls.TestACLs)
47
* https://tracker.ceph.com/issues/54462
48
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
49
50
51 123 Rishabh Dave
h3. 22 Nov 2023
52
53
https://pulpito.ceph.com/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
54 124 Rishabh Dave
https://pulpito.ceph.com/yuriw-2023-11-21_15:54:56-smoke-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
55 123 Rishabh Dave
56
* https://tracker.ceph.com/issues/62501
57
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
58
* https://tracker.ceph.com/issues/50223
59
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
60
* ior/mdtest failures because packages were missing from download.ceph.com
61
* test_acls failed because known distro wasn't detected
62
* https://tracker.ceph.com/issues/52624
63
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
64
65 122 Rishabh Dave
h3. 15 Nov 2023
66
67
https://pulpito.ceph.com/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/
68
69
* https://tracker.ceph.com/issues/63539
70
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
71
* test_acls: distro name for RHEL 8.4 wasn't recognized one by xfstests_dev.py
72
* ior package was missing because it was deleted from download.ceph.com
73
* https://tracker.ceph.com/issues/52624
74
  qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
75
76 120 Rishabh Dave
h3. 8 Nov 2023
77 121 Rishabh Dave
78 120 Rishabh Dave
fs: https://pulpito.ceph.com/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
79 121 Rishabh Dave
smoke: https://pulpito.ceph.com/vshankar-2023-11-06_07:53:57-smoke-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
80 120 Rishabh Dave
81
* https://tracker.ceph.com/issues/51964
82
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
83
* https://tracker.ceph.com/issues/62501
84
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
85
* https://tracker.ceph.com/issues/52624
86
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
87
88 114 Jos Collin
h3. 2023 September 12
89
90 117 Jos Collin
https://pulpito.ceph.com/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi
91 115 Jos Collin
92 117 Jos Collin
  * https://tracker.ceph.com/issues/58992
93
    test_acls (tasks.cephfs.test_acls.TestACLs)
94
  * https://tracker.ceph.com/issues/62580
95
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
96 114 Jos Collin
97 111 Patrick Donnelly
h3. 2023 August 31
98
99 113 Patrick Donnelly
https://github.com/ceph/ceph/pull/53189
100
https://github.com/ceph/ceph/pull/53243
101
https://github.com/ceph/ceph/pull/53185
102
https://github.com/ceph/ceph/pull/52744
103
https://github.com/ceph/ceph/pull/51045
104
105 111 Patrick Donnelly
https://pulpito.ceph.com/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/
106
107 112 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
108
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
109
* https://tracker.ceph.com/issues/52624
110
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
111
* https://tracker.ceph.com/issues/54462
112
    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
113
* https://tracker.ceph.com/issues/50222
114
    osd: 5.2s0 deep-scrub : stat mismatch
115
* https://tracker.ceph.com/issues/50250
116
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" ("freshly-calculated rstats don't match existing ones")
117
118
Some spurious infrastructure / valgrind noise during cleanup.
119 111 Patrick Donnelly
120 107 Patrick Donnelly
h3. 2023 August 22
121
122
Pacific v16.2.14 QA
123
124
https://pulpito.ceph.com/yuriw-2023-08-22_14:48:56-fs-pacific-release-distro-default-smithi/
125
https://pulpito.ceph.com/yuriw-2023-08-22_23:49:19-fs-pacific-release-distro-default-smithi/
126
127
* https://tracker.ceph.com/issues/62578
128
    mon: osd pg-upmap-items command causes PG_DEGRADED warnings
129 109 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
130
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
131 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
132
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
133 107 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
134
    test_acls (tasks.cephfs.test_acls.TestACLs)
135 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62579
136
    client: evicted warning because client completes unmount before thrashed MDS comes back
137 110 Patrick Donnelly
* https://tracker.ceph.com/issues/62580
138
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
139 107 Patrick Donnelly
140 106 Patrick Donnelly
h3. 2023 August 16-2
141
142
https://trello.com/c/qRJogcXu/1827-wip-yuri2-testing-2023-08-16-1142-pacific
143
https://pulpito.ceph.com/?branch=wip-yuri2-testing-2023-08-16-1142-pacific
144
145
* https://tracker.ceph.com/issues/52624
146
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
147
* https://tracker.ceph.com/issues/58992
148
    test_acls (tasks.cephfs.test_acls.TestACLs)
149
* https://tracker.ceph.com/issues/62501
150
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
151
152 105 Patrick Donnelly
h3. 2023 August 16
153
154
https://trello.com/c/4TiiTR0k/1821-wip-yuri7-testing-2023-08-16-1309-pacific-old-wip-yuri7-testing-2023-08-16-0933-pacific-old-wip-yuri7-testing-2023-08-15-0741-pa
155
https://pulpito.ceph.com/?branch=wip-yuri7-testing-2023-08-16-1309-pacific
156
157
* https://tracker.ceph.com/issues/62499
158
    testing (?): deadlock ffsb task
159
* https://tracker.ceph.com/issues/62501
160
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
161
162 103 Patrick Donnelly
h3. 2023 August 11
163
164
https://trello.com/c/ONHeA3yz/1823-wip-yuri8-testing-2023-08-11-0834-pacific
165
https://pulpito.ceph.com/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/
166
167
Some infra noise causes dead job.
168
169
* https://tracker.ceph.com/issues/52624
170
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
171
* https://tracker.ceph.com/issues/58992
172
    test_acls (tasks.cephfs.test_acls.TestACLs)
173 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58340
174 107 Patrick Donnelly
    fsstress.sh failed with errno 124 
175 103 Patrick Donnelly
* https://tracker.ceph.com/issues/48773
176 107 Patrick Donnelly
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
177 103 Patrick Donnelly
* https://tracker.ceph.com/issues/50527
178
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
179
180 100 Venky Shankar
h3. 2023 August 8
181
182
https://pulpito.ceph.com/?branch=wip-yuri10-testing-2023-08-01-0753-pacific
183
184
* https://tracker.ceph.com/issues/52624
185
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
186 1 Patrick Donnelly
* https://tracker.ceph.com/issues/50223
187
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
188 101 Patrick Donnelly
* https://tracker.ceph.com/issues/62164
189
    qa: "cluster [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13..."
190
* https://tracker.ceph.com/issues/51964
191
    qa: test_cephfs_mirror_restart_sync_on_blocklist failure
192
* https://tracker.ceph.com/issues/58992
193
    test_acls (tasks.cephfs.test_acls.TestACLs)
194
* https://tracker.ceph.com/issues/62465
195
    pacific (?): LibCephFS.ShutdownRace segmentation fault
196 102 Patrick Donnelly
* "fs/full/subvolume_snapshot_rm.sh" failure caused by bluestore crash.
197 100 Venky Shankar
198 104 Patrick Donnelly
h3. 2023 August 03
199
200
https://trello.com/c/8HALLv9T/1813-wip-yuri6-testing-2023-08-03-0807-pacific-old-wip-yuri6-testing-2023-07-24-0819-pacific2-old-wip-yuri6-testing-2023-07-24-0819-p
201
https://pulpito.ceph.com/?branch=wip-yuri6-testing-2023-08-03-0807-pacific
202
203
* https://tracker.ceph.com/issues/52624
204
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
205
* https://tracker.ceph.com/issues/58992
206
    test_acls (tasks.cephfs.test_acls.TestACLs)
207
208 99 Venky Shankar
h3. 2023 July 25
209
210
https://pulpito.ceph.com/?branch=wip-yuri-testing-2023-07-19-1340-pacific
211
212
* https://tracker.ceph.com/issues/52624
213
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
214
* https://tracker.ceph.com/issues/58992
215
    test_acls (tasks.cephfs.test_acls.TestACLs)
216
* https://tracker.ceph.com/issues/50223
217
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
218
* https://tracker.ceph.com/issues/62160
219
    mds: MDS abort because newly corrupt dentry to be committed
220
* https://tracker.ceph.com/issues/61201
221
    qa: test_rebuild_moved_file (tasks/data-scan) fails because mds crashes in pacific (recovery thread crash)
222
223
224 94 Kotresh Hiremath Ravishankar
h3. 2023 May 17
225
226
https://pulpito.ceph.com/yuriw-2023-05-15_21:56:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/
227 97 Kotresh Hiremath Ravishankar
https://pulpito.ceph.com/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/ (fresh pkg and re-run because of package/installation issues)
228 94 Kotresh Hiremath Ravishankar
229
* https://tracker.ceph.com/issues/52624
230
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
231 96 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/61201 (NEW)
232 94 Kotresh Hiremath Ravishankar
  Test failure: test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan)
233
* https://tracker.ceph.com/issues/58340
234
  fsstress.sh failed with errno 124 
235 1 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
236 94 Kotresh Hiremath Ravishankar
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
237
* https://tracker.ceph.com/issues/58992
238
  test_acls (tasks.cephfs.test_acls.TestACLs)
239
* https://tracker.ceph.com/issues/54462
240 95 Kotresh Hiremath Ravishankar
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128 
241 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58674
242 95 Kotresh Hiremath Ravishankar
  teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds 
243 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/55446
244 95 Kotresh Hiremath Ravishankar
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
245
 
246 94 Kotresh Hiremath Ravishankar
247
248 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
249
250
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
251
252
* https://tracker.ceph.com/issues/52624
253
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
254
* https://tracker.ceph.com/issues/51964
255
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
256
* https://tracker.ceph.com/issues/48773
257
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
258
* https://tracker.ceph.com/issues/50223
259
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
260 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
261
  test_acls (tasks.cephfs.test_acls.TestACLs)
262 91 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58340
263
  fsstress.sh failed with errno 124
264 93 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
265
  Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
266
* https://tracker.ceph.com/issues/55446
267
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
268 91 Kotresh Hiremath Ravishankar
269 90 Rishabh Dave
h3. 2023 May 4
270
271
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
272
273
* https://tracker.ceph.com/issues/59560
274
  qa: RuntimeError: more than one file system available
275
* https://tracker.ceph.com/issues/59626
276
  FSMissing: File system xxxx does not exist in the map
277
* https://tracker.ceph.com/issues/58340
278
  fsstress.sh failed with errno 124
279
* https://tracker.ceph.com/issues/58992
280
  test_acls
281
* https://tracker.ceph.com/issues/48773
282
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
283
* https://tracker.ceph.com/issues/57676
284
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
285
286
287 86 Rishabh Dave
h3. 2023 Apr 13
288
289
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
290
291
https://tracker.ceph.com/issues/52624
292
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
293
* https://tracker.ceph.com/issues/57594
294
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
295
* https://tracker.ceph.com/issues/54108
296
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
297
* https://tracker.ceph.com/issues/58340
298
  fsstress.sh failed with errno 125
299
* https://tracker.ceph.com/issues/54462
300
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
301
* https://tracker.ceph.com/issues/49287     
302
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
303
* https://tracker.ceph.com/issues/58726
304
  test_acls: expected a yum based or a apt based system
305 40 Ramana Raja
306 84 Venky Shankar
h3. 2022 Dec 07
307
308
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
309
310
many transient git.ceph.com related timeouts
311
312
* https://tracker.ceph.com/issues/52624
313
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
314
* https://tracker.ceph.com/issues/50224
315
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
316
* https://tracker.ceph.com/issues/56644
317
    qa: test_rapid_creation fails with "No space left on device"
318
* https://tracker.ceph.com/issues/58221
319
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
320
321 83 Venky Shankar
h3. 2022 Dec 02
322
323
many transient git.ceph.com related timeouts
324
many transient 'Failed to connect to the host via ssh' failures
325
326
* https://tracker.ceph.com/issues/57723
327
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
328
* https://tracker.ceph.com/issues/52624
329
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
330
331 82 Venky Shankar
h3. 2022 Dec 01
332
333
many transient git.ceph.com related timeouts
334
335
* https://tracker.ceph.com/issues/57723
336
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
337
* https://tracker.ceph.com/issues/52624
338
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
339
340 80 Patrick Donnelly
h3. 2022 Nov 18
341
342
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
343
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
344
345
2 ansible dead failures.
346
12 transient git.ceph.com related timeouts
347
348
* https://tracker.ceph.com/issues/57723
349
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
350
* https://tracker.ceph.com/issues/52624
351
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
352
353 78 Milind Changire
h3. 2022 Oct 19
354
355
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
356
357
* https://tracker.ceph.com/issues/57723
358
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
359
* https://tracker.ceph.com/issues/52624
360
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
361
* https://tracker.ceph.com/issues/56644
362
  qa: test_rapid_creation fails with "No space left on device"
363
* https://tracker.ceph.com/issues/54460
364
  snaptest-multiple-capsnaps.sh test failure
365
* https://tracker.ceph.com/issues/57892
366
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
367
368
369
370 76 Venky Shankar
h3. 2022 Oct 06
371
372
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
373
374
* https://tracker.ceph.com/issues/52624
375
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
376
* https://tracker.ceph.com/issues/50223
377
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
378 77 Milind Changire
* https://tracker.ceph.com/issues/56507
379
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
380 76 Venky Shankar
381 75 Venky Shankar
h3. 2022 Sep 27
382
383
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
384
385
* https://tracker.ceph.com/issues/52624
386
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
387
* https://tracker.ceph.com/issues/48773
388
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
389
* https://tracker.ceph.com/issues/50224
390
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
391
* https://tracker.ceph.com/issues/56507
392
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
393
* https://tracker.ceph.com/issues/50223
394
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
395
396 74 Venky Shankar
h3. 2022 Sep 22
397
398
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
399
400
* https://tracker.ceph.com/issues/52624
401
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
402
* https://tracker.ceph.com/issues/51282
403
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
404
* https://tracker.ceph.com/issues/53360
405
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
406
407 73 Venky Shankar
h3. 2022 Sep 19
408
409
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
410
411
* https://tracker.ceph.com/issues/52624
412
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
413
* https://tracker.ceph.com/issues/57594
414
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
415
416 71 Venky Shankar
h3. 2022 Sep 15
417
418
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
419
420
* https://tracker.ceph.com/issues/51282
421
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
422
* https://tracker.ceph.com/issues/52624
423
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
424
* https://tracker.ceph.com/issues/53360
425
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
426 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
427
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
428 71 Venky Shankar
429 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
430
431
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
432
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
433
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
434
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
435
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
436
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
437
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
438
439
440
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
441
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
442
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
443
444
445 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
446
447
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
448
* Most of the failures are passed in re-run. Please check rerun failures below.
449
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
450
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
451
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
452
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
453
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
454
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
455
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
456
457
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
458
* https://tracker.ceph.com/issues/52624
459
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
460
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
461
* https://tracker.ceph.com/issues/57083
462
* https://tracker.ceph.com/issues/53360
463
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
464
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
465
* https://tracker.ceph.com/issues/51183
466
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
467
* https://tracker.ceph.com/issues/56507
468
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
469
470 68 Kotresh Hiremath Ravishankar
471
h3. 2022 AUG 04
472
473
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
474
475
* https://tracker.ceph.com/issues/57087
476
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
477
* https://tracker.ceph.com/issues/52624
478
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
479
* https://tracker.ceph.com/issues/51267
480
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
481
* https://tracker.ceph.com/issues/53360
482
* https://tracker.ceph.com/issues/57083
483
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
484
* https://tracker.ceph.com/issues/56507
485
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
486
487
488 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
489
490
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
491
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
492
493
* https://tracker.ceph.com/issues/52624
494
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
495
* https://tracker.ceph.com/issues/57083
496
* https://tracker.ceph.com/issues/53360
497
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
498
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
499
* https://tracker.ceph.com/issues/51183
500
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
501
* https://tracker.ceph.com/issues/56507
502
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
503
504
505 66 Venky Shankar
h3. 2022 July 08
506
507
* https://tracker.ceph.com/issues/52624
508
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
509
* https://tracker.ceph.com/issues/53360
510
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
511
* https://tracker.ceph.com/issues/51183
512
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
513
* https://tracker.ceph.com/issues/56506
514
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
515
* https://tracker.ceph.com/issues/56507
516
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
517
518 65 Venky Shankar
h3. 2022 Jun 28
519
520
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
521
522
* https://tracker.ceph.com/issues/52624
523
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
524
* https://tracker.ceph.com/issues/53360
525
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
526
* https://tracker.ceph.com/issues/51183
527
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
528
529 64 Venky Shankar
h3. 2022 Jun 22
530
531
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
532
533
* https://tracker.ceph.com/issues/52624
534
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
535
* https://tracker.ceph.com/issues/53360
536
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
537
* https://tracker.ceph.com/issues/51183
538
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
539
540 63 Venky Shankar
h3. 2022 Jun 17
541
542
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
543
544
* https://tracker.ceph.com/issues/52624
545
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
546
* https://tracker.ceph.com/issues/53360
547
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
548
* https://tracker.ceph.com/issues/51183
549
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
550
551 62 Venky Shankar
h3. 2022 Jun 16
552
553
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
554
555
* https://tracker.ceph.com/issues/52624
556
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
557
* https://tracker.ceph.com/issues/53360
558
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
559
* https://tracker.ceph.com/issues/55449
560
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
561
* https://tracker.ceph.com/issues/51267
562
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
563
* https://tracker.ceph.com/issues/55332
564
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
565
566 61 Venky Shankar
h3. 2022 Jun 15
567
568
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
569
570
* https://tracker.ceph.com/issues/52624
571
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
572
* https://tracker.ceph.com/issues/53360
573
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
574
* https://tracker.ceph.com/issues/55449
575
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
576
577
578 60 Venky Shankar
h3. 2022 Jun 10
579
580
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
581
582
* https://tracker.ceph.com/issues/52624
583
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
584
* https://tracker.ceph.com/issues/53360
585
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
586
* https://tracker.ceph.com/issues/55449
587
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
588
589 59 Venky Shankar
h3. 2022 Jun 09
590
591
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
592
593
* https://tracker.ceph.com/issues/52624
594
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
595
* https://tracker.ceph.com/issues/53360
596
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
597
* https://tracker.ceph.com/issues/55449
598
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
599
600 58 Venky Shankar
h3. 2022 May 06
601
602
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
603
604
* https://tracker.ceph.com/issues/52624
605
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
606
* https://tracker.ceph.com/issues/53360
607
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
608
609 57 Venky Shankar
h3. 2022 April 18
610
611
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
612
(only mgr/snap_schedule backport pr)
613
614
* https://tracker.ceph.com/issues/52624
615
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
616 56 Venky Shankar
617
h3. 2022 March 28
618
619
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
620
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
621
622
* https://tracker.ceph.com/issues/52624
623
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
624
* https://tracker.ceph.com/issues/53360
625
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
626
* https://tracker.ceph.com/issues/54411
627
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
628
	33 daemons have recently crashed" during suites/fsstress.sh
629
630 55 Venky Shankar
h3. 2022 March 25
631
632
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
633
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
634
635
* https://tracker.ceph.com/issues/52624
636
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
637
* https://tracker.ceph.com/issues/52606
638
        qa: test_dirfrag_limit
639
* https://tracker.ceph.com/issues/51905
640
        qa: "error reading sessionmap 'mds1_sessionmap'"
641
* https://tracker.ceph.com/issues/53360
642
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
643
* https://tracker.ceph.com/issues/51183
644
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
645 47 Patrick Donnelly
646 54 Venky Shankar
h3. 2022 March 22
647
648
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
649
650
* https://tracker.ceph.com/issues/52624
651
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
652
* https://tracker.ceph.com/issues/52606
653
        qa: test_dirfrag_limit
654
* https://tracker.ceph.com/issues/51183
655
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
656
* https://tracker.ceph.com/issues/51905
657
        qa: "error reading sessionmap 'mds1_sessionmap'"
658
* https://tracker.ceph.com/issues/53360
659
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
660
* https://tracker.ceph.com/issues/54411
661
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
662
	33 daemons have recently crashed" during suites/fsstress.sh
663 47 Patrick Donnelly
664 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
665
666
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
667
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
668
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
669
670
671
* https://tracker.ceph.com/issues/53300
672
	qa: cluster [WRN] Scrub error on inode
673
* https://tracker.ceph.com/issues/53302
674
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
675
* https://tracker.ceph.com/issues/53314
676
	qa: fs/upgrade/mds_upgrade_sequence test timeout
677
* https://tracker.ceph.com/issues/53316
678
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
679
* https://tracker.ceph.com/issues/52624
680
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
681
* https://tracker.ceph.com/issues/52396
682
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
683
* https://tracker.ceph.com/issues/52875
684
	pacific: qa: test_dirfrag_limit
685
* https://tracker.ceph.com/issues/51705
686 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
687
* https://tracker.ceph.com/issues/39634
688
	qa: test_full_same_file timeout
689 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
690
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
691 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
692
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
693 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
694
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
695 48 Kotresh Hiremath Ravishankar
696 47 Patrick Donnelly
697
h3. 2021 November 20
698
699
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
700
701
* https://tracker.ceph.com/issues/53360
702
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
703 46 Kotresh Hiremath Ravishankar
704 41 Patrick Donnelly
h3. 2021 September 14 (QE)
705
706
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
707 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
708 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
709 41 Patrick Donnelly
710
* https://tracker.ceph.com/issues/52606
711
    qa: test_dirfrag_limit
712
* https://tracker.ceph.com/issues/52607
713
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
714 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
715
    qa: tasks.cephfs.fuse_mount:mount command failed
716 41 Patrick Donnelly
717 40 Ramana Raja
h3. 2021 Sep 7
718
719
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
720
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
721
722
723
* https://tracker.ceph.com/issues/52396
724
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
725
* https://tracker.ceph.com/issues/51705
726
    qa: tasks.cephfs.fuse_mount:mount command failed
727 4 Patrick Donnelly
728 34 Ramana Raja
h3. 2021 Aug 30
729
730
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
731
732
* https://tracker.ceph.com/issues/45434
733
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
734
* https://tracker.ceph.com/issues/51705
735
    qa: tasks.cephfs.fuse_mount:mount command failed
736
* https://tracker.ceph.com/issues/52396
737
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
738 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
739 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
740
* https://tracker.ceph.com/issues/51267
741 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
742
* https://tracker.ceph.com/issues/48772
743
   qa: pjd: not ok 9, 44, 80
744 35 Ramana Raja
745 34 Ramana Raja
746 31 Ramana Raja
h3. 2021 Aug 23
747
748
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
749
750
* https://tracker.ceph.com/issues/45434
751
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
752
* https://tracker.ceph.com/issues/51705
753
    qa: tasks.cephfs.fuse_mount:mount command failed
754 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
755 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
756
* https://tracker.ceph.com/issues/52397
757
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
758
759 31 Ramana Raja
760 29 Ramana Raja
h3. 2021 Aug 11
761
762
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
763
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
764
765
* https://tracker.ceph.com/issues/45434
766
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
767
* https://tracker.ceph.com/issues/51705
768
    qa: tasks.cephfs.fuse_mount:mount command failed
769 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
770
    osd: 5.2s0 deep-scrub : stat mismatch
771 29 Ramana Raja
772 19 Jos Collin
h3. 2021 July 15
773 20 Jos Collin
774 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
775
776 26 Jos Collin
* https://tracker.ceph.com/issues/45434
777
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
778
* https://tracker.ceph.com/issues/51705
779
    qa: tasks.cephfs.fuse_mount:mount command failed
780 27 Jos Collin
* https://tracker.ceph.com/issues/51183
781
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
782 28 Jos Collin
* https://tracker.ceph.com/issues/50528
783
    qa: fs:thrash: pjd suite not ok 80
784
* https://tracker.ceph.com/issues/51706
785
    qa: osd deep-scrub stat mismatch
786 26 Jos Collin
787 19 Jos Collin
h3. 2021 July 13
788 20 Jos Collin
789 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
790
791 21 Jos Collin
* https://tracker.ceph.com/issues/51704
792
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
793 23 Jos Collin
* https://tracker.ceph.com/issues/45434
794
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
795 24 Jos Collin
* https://tracker.ceph.com/issues/51705
796 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
797
* https://tracker.ceph.com/issues/48640
798 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
799 21 Jos Collin
800 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
801
802
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
803
804
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
805
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
806
807
* https://tracker.ceph.com/issues/45434
808
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
809
* https://tracker.ceph.com/issues/50260
810
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
811
* https://tracker.ceph.com/issues/51183
812
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
813
814
815 16 Jeff Layton
h3. 2021 June 28
816
817
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
818
819
* https://tracker.ceph.com/issues/45434
820
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
821
* https://tracker.ceph.com/issues/51440
822 17 Jeff Layton
    fallocate fails with EACCES
823 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
824
    TestVolumeClient failure
825
* https://tracker.ceph.com/issues/51266
826
    test cleanup failure
827
* https://tracker.ceph.com/issues/51183
828
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
829
830 12 Jeff Layton
h3. 2021 June 14
831
832
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
833
 
834
* https://tracker.ceph.com/issues/45434
835
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
836
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
837
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
838
* https://tracker.ceph.com/issues/51263
839
    pjdfstest rename test 10.t failed with EACCES
840
* https://tracker.ceph.com/issues/51264
841
    TestVolumeClient failure
842 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
843
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
844 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
845
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
846 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
847
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
848 11 Patrick Donnelly
849
h3. 2021 June 07 (Integration Branch)
850
851
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
852
853
* https://tracker.ceph.com/issues/45434
854
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
855
* https://tracker.ceph.com/issues/50279
856
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
857
* https://tracker.ceph.com/issues/48773
858
    qa: scrub does not complete
859
* https://tracker.ceph.com/issues/51170
860
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
861
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
862
    qa: quota failure
863
864
865 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
866
867
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
868
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
869
870
* https://tracker.ceph.com/issues/45434
871
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
872
* https://tracker.ceph.com/issues/50258
873
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
874
* https://tracker.ceph.com/issues/50260
875
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
876
* https://tracker.ceph.com/issues/49962
877
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
878
* https://tracker.ceph.com/issues/50016
879
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
880
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
881
    qa: quota failure
882
* https://tracker.ceph.com/issues/50528
883
    pacific: qa: fs:thrash: pjd suite not ok 20
884
885
886 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
887
888
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
889
890
* https://tracker.ceph.com/issues/50527
891
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
892
* https://tracker.ceph.com/issues/50528
893
    pacific: qa: fs:thrash: pjd suite not ok 20
894
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
895
    qa: "Assertion `cb_done' failed."
896
* https://tracker.ceph.com/issues/49500
897
    qa: "Assertion `cb_done' failed."
898
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
899
    qa: quota failure
900
* https://tracker.ceph.com/issues/45434
901
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
902
* https://tracker.ceph.com/issues/50279
903
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
904
* https://tracker.ceph.com/issues/50258
905
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
906
* https://tracker.ceph.com/issues/49962
907
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
908
* https://tracker.ceph.com/issues/49962
909
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
910
* https://tracker.ceph.com/issues/50530
911
    pacific: client: abort after MDS blocklist
912
913 2 Patrick Donnelly
914
h3. 2021 Apr 21 (Integration Branch)
915
916
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
917
918
* https://tracker.ceph.com/issues/45434
919
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
920
* https://tracker.ceph.com/issues/50250
921
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
922
* https://tracker.ceph.com/issues/50258
923
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
924
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
925
    qa: quota failure
926
* https://tracker.ceph.com/issues/50016
927
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
928
* https://tracker.ceph.com/issues/50495
929
    pacific: client: shutdown race fails with status 141
930
931
932 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
933
934
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
935
936
* https://tracker.ceph.com/issues/45434
937
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
938
* https://tracker.ceph.com/issues/48805
939
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
940
* https://tracker.ceph.com/issues/49500
941
    qa: "Assertion `cb_done' failed."
942
* https://tracker.ceph.com/issues/50258 (new)
943
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
944
* https://tracker.ceph.com/issues/49962
945
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
946
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
947
    qa: quota failure
948
* https://tracker.ceph.com/issues/50260
949
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
950
* https://tracker.ceph.com/issues/50016
951
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"