Project

General

Profile

Pacific » History » Version 130

Venky Shankar, 12/21/2023 10:32 AM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 98 Venky Shankar
* Jul: Venky
6
* Aug: Patrick
7 118 Jos Collin
* Sep: Jos Collin
8 98 Venky Shankar
* Oct: Xiubo
9
* Nov: Rishabh
10
* Dec: Kotresh
11
* Jan: Milind
12 81 Venky Shankar
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 119 Rishabh Dave
h3. ADD NEW ENTRY BELOW
16
17 128 Venky Shankar
h3. 21 Dec 2023
18
19
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2023-12-14-1107-pacific
20
21
* https://tracker.ceph.com/issues/52624
22
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
23
* https://tracker.ceph.com/issues/63539
24
    fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
25
* test_acls failed because known distro wasn't detected
26 129 Venky Shankar
* https://tracker.ceph.com/issues/50223
27
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
28 128 Venky Shankar
29 127 Rishabh Dave
h3. 4 Dec 2023 2
30 126 Rishabh Dave
31
https://pulpito.ceph.com/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/
32
33
* ior/mdtest failures because packages were missing from download.ceph.com
34
* test_acls failed because known distro wasn't detected
35
* https://tracker.ceph.com/issues/63539
36
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
37
* https://tracker.ceph.com/issues/52624
38
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
39
* https://tracker.ceph.com/issues/37808
40
  osd: osdmap cache weak_refs assert during shutdown
41 125 Kotresh Hiremath Ravishankar
42
h3. 04 Dec 2023
43
44
https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/
45
46
* ior package was missing because it was deleted from download.ceph.com
47
* Error re-imaging machines:
48
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472083
49
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472084
50
  https://pulpito.ceph.com/yuriw-2023-11-30_15:46:13-fs-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7472104
51
* https://tracker.ceph.com/issues/52624
52
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
53
* https://tracker.ceph.com/issues/51282
54
  cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
55
* https://tracker.ceph.com/issues/62501
56
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
57
* https://tracker.ceph.com/issues/58992
58
  test_acls (tasks.cephfs.test_acls.TestACLs)
59
* https://tracker.ceph.com/issues/54462
60
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
61
62
63 123 Rishabh Dave
h3. 22 Nov 2023
64
65
https://pulpito.ceph.com/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
66 124 Rishabh Dave
https://pulpito.ceph.com/yuriw-2023-11-21_15:54:56-smoke-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/
67 123 Rishabh Dave
68
* https://tracker.ceph.com/issues/62501
69
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
70
* https://tracker.ceph.com/issues/50223
71
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
72
* ior/mdtest failures because packages were missing from download.ceph.com
73
* test_acls failed because known distro wasn't detected
74
* https://tracker.ceph.com/issues/52624
75
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
76
77 122 Rishabh Dave
h3. 15 Nov 2023
78
79
https://pulpito.ceph.com/yuriw-2023-10-24_00:02:48-fs-wip-yuri7-testing-2023-10-23-1230-pacific-distro-default-smithi/
80
81
* https://tracker.ceph.com/issues/63539
82
  fs/full/subvolume_clone.sh: Health check failed: 1 full osd(s) (OSD_FULL)
83
* test_acls: distro name for RHEL 8.4 wasn't recognized one by xfstests_dev.py
84
* ior package was missing because it was deleted from download.ceph.com
85
* https://tracker.ceph.com/issues/52624
86
  qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
87
88 120 Rishabh Dave
h3. 8 Nov 2023
89 121 Rishabh Dave
90 120 Rishabh Dave
fs: https://pulpito.ceph.com/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
91 121 Rishabh Dave
smoke: https://pulpito.ceph.com/vshankar-2023-11-06_07:53:57-smoke-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/
92 120 Rishabh Dave
93
* https://tracker.ceph.com/issues/51964
94
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
95
* https://tracker.ceph.com/issues/62501
96
  pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
97
* https://tracker.ceph.com/issues/52624
98
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
99
100 114 Jos Collin
h3. 2023 September 12
101
102 117 Jos Collin
https://pulpito.ceph.com/yuriw-2023-08-21_21:30:15-fs-wip-yuri2-testing-2023-08-21-0910-pacific-distro-default-smithi
103 115 Jos Collin
104 117 Jos Collin
  * https://tracker.ceph.com/issues/58992
105
    test_acls (tasks.cephfs.test_acls.TestACLs)
106
  * https://tracker.ceph.com/issues/62580
107
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
108 114 Jos Collin
109 111 Patrick Donnelly
h3. 2023 August 31
110
111 113 Patrick Donnelly
https://github.com/ceph/ceph/pull/53189
112
https://github.com/ceph/ceph/pull/53243
113
https://github.com/ceph/ceph/pull/53185
114
https://github.com/ceph/ceph/pull/52744
115
https://github.com/ceph/ceph/pull/51045
116
117 111 Patrick Donnelly
https://pulpito.ceph.com/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/
118
119 112 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
120
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
121
* https://tracker.ceph.com/issues/52624
122
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
123
* https://tracker.ceph.com/issues/54462
124
    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
125
* https://tracker.ceph.com/issues/50222
126
    osd: 5.2s0 deep-scrub : stat mismatch
127
* https://tracker.ceph.com/issues/50250
128
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" ("freshly-calculated rstats don't match existing ones")
129
130
Some spurious infrastructure / valgrind noise during cleanup.
131 111 Patrick Donnelly
132 107 Patrick Donnelly
h3. 2023 August 22
133
134
Pacific v16.2.14 QA
135
136
https://pulpito.ceph.com/yuriw-2023-08-22_14:48:56-fs-pacific-release-distro-default-smithi/
137
https://pulpito.ceph.com/yuriw-2023-08-22_23:49:19-fs-pacific-release-distro-default-smithi/
138
139
* https://tracker.ceph.com/issues/62578
140
    mon: osd pg-upmap-items command causes PG_DEGRADED warnings
141 109 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
142
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
143 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
144
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
145 107 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
146
    test_acls (tasks.cephfs.test_acls.TestACLs)
147 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62579
148
    client: evicted warning because client completes unmount before thrashed MDS comes back
149 110 Patrick Donnelly
* https://tracker.ceph.com/issues/62580
150
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
151 107 Patrick Donnelly
152 106 Patrick Donnelly
h3. 2023 August 16-2
153
154
https://trello.com/c/qRJogcXu/1827-wip-yuri2-testing-2023-08-16-1142-pacific
155
https://pulpito.ceph.com/?branch=wip-yuri2-testing-2023-08-16-1142-pacific
156
157
* https://tracker.ceph.com/issues/52624
158
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
159
* https://tracker.ceph.com/issues/58992
160
    test_acls (tasks.cephfs.test_acls.TestACLs)
161
* https://tracker.ceph.com/issues/62501
162
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
163
164 105 Patrick Donnelly
h3. 2023 August 16
165
166
https://trello.com/c/4TiiTR0k/1821-wip-yuri7-testing-2023-08-16-1309-pacific-old-wip-yuri7-testing-2023-08-16-0933-pacific-old-wip-yuri7-testing-2023-08-15-0741-pa
167
https://pulpito.ceph.com/?branch=wip-yuri7-testing-2023-08-16-1309-pacific
168
169
* https://tracker.ceph.com/issues/62499
170
    testing (?): deadlock ffsb task
171
* https://tracker.ceph.com/issues/62501
172
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
173
174 103 Patrick Donnelly
h3. 2023 August 11
175
176
https://trello.com/c/ONHeA3yz/1823-wip-yuri8-testing-2023-08-11-0834-pacific
177
https://pulpito.ceph.com/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/
178
179
Some infra noise causes dead job.
180
181
* https://tracker.ceph.com/issues/52624
182
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
183
* https://tracker.ceph.com/issues/58992
184
    test_acls (tasks.cephfs.test_acls.TestACLs)
185 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58340
186 107 Patrick Donnelly
    fsstress.sh failed with errno 124 
187 103 Patrick Donnelly
* https://tracker.ceph.com/issues/48773
188 107 Patrick Donnelly
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
189 103 Patrick Donnelly
* https://tracker.ceph.com/issues/50527
190
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
191
192 100 Venky Shankar
h3. 2023 August 8
193
194
https://pulpito.ceph.com/?branch=wip-yuri10-testing-2023-08-01-0753-pacific
195
196
* https://tracker.ceph.com/issues/52624
197
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
198 1 Patrick Donnelly
* https://tracker.ceph.com/issues/50223
199
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
200 101 Patrick Donnelly
* https://tracker.ceph.com/issues/62164
201
    qa: "cluster [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13..."
202
* https://tracker.ceph.com/issues/51964
203
    qa: test_cephfs_mirror_restart_sync_on_blocklist failure
204
* https://tracker.ceph.com/issues/58992
205
    test_acls (tasks.cephfs.test_acls.TestACLs)
206
* https://tracker.ceph.com/issues/62465
207
    pacific (?): LibCephFS.ShutdownRace segmentation fault
208 102 Patrick Donnelly
* "fs/full/subvolume_snapshot_rm.sh" failure caused by bluestore crash.
209 100 Venky Shankar
210 104 Patrick Donnelly
h3. 2023 August 03
211
212
https://trello.com/c/8HALLv9T/1813-wip-yuri6-testing-2023-08-03-0807-pacific-old-wip-yuri6-testing-2023-07-24-0819-pacific2-old-wip-yuri6-testing-2023-07-24-0819-p
213
https://pulpito.ceph.com/?branch=wip-yuri6-testing-2023-08-03-0807-pacific
214
215
* https://tracker.ceph.com/issues/52624
216
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
217
* https://tracker.ceph.com/issues/58992
218
    test_acls (tasks.cephfs.test_acls.TestACLs)
219
220 99 Venky Shankar
h3. 2023 July 25
221
222
https://pulpito.ceph.com/?branch=wip-yuri-testing-2023-07-19-1340-pacific
223
224
* https://tracker.ceph.com/issues/52624
225
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
226
* https://tracker.ceph.com/issues/58992
227
    test_acls (tasks.cephfs.test_acls.TestACLs)
228
* https://tracker.ceph.com/issues/50223
229
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
230
* https://tracker.ceph.com/issues/62160
231
    mds: MDS abort because newly corrupt dentry to be committed
232
* https://tracker.ceph.com/issues/61201
233
    qa: test_rebuild_moved_file (tasks/data-scan) fails because mds crashes in pacific (recovery thread crash)
234
235
236 94 Kotresh Hiremath Ravishankar
h3. 2023 May 17
237
238
https://pulpito.ceph.com/yuriw-2023-05-15_21:56:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/
239 97 Kotresh Hiremath Ravishankar
https://pulpito.ceph.com/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/ (fresh pkg and re-run because of package/installation issues)
240 94 Kotresh Hiremath Ravishankar
241
* https://tracker.ceph.com/issues/52624
242
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
243 96 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/61201 (NEW)
244 94 Kotresh Hiremath Ravishankar
  Test failure: test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan)
245
* https://tracker.ceph.com/issues/58340
246
  fsstress.sh failed with errno 124 
247 1 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
248 94 Kotresh Hiremath Ravishankar
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
249
* https://tracker.ceph.com/issues/58992
250
  test_acls (tasks.cephfs.test_acls.TestACLs)
251
* https://tracker.ceph.com/issues/54462
252 95 Kotresh Hiremath Ravishankar
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128 
253 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58674
254 95 Kotresh Hiremath Ravishankar
  teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds 
255 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/55446
256 95 Kotresh Hiremath Ravishankar
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
257
 
258 94 Kotresh Hiremath Ravishankar
259
260 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
261
262
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
263
264
* https://tracker.ceph.com/issues/52624
265
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
266
* https://tracker.ceph.com/issues/51964
267
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
268
* https://tracker.ceph.com/issues/48773
269
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
270
* https://tracker.ceph.com/issues/50223
271
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
272 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
273
  test_acls (tasks.cephfs.test_acls.TestACLs)
274 91 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58340
275
  fsstress.sh failed with errno 124
276 93 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
277
  Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
278
* https://tracker.ceph.com/issues/55446
279
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
280 91 Kotresh Hiremath Ravishankar
281 90 Rishabh Dave
h3. 2023 May 4
282
283
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
284
285
* https://tracker.ceph.com/issues/59560
286
  qa: RuntimeError: more than one file system available
287
* https://tracker.ceph.com/issues/59626
288
  FSMissing: File system xxxx does not exist in the map
289
* https://tracker.ceph.com/issues/58340
290
  fsstress.sh failed with errno 124
291
* https://tracker.ceph.com/issues/58992
292
  test_acls
293
* https://tracker.ceph.com/issues/48773
294
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
295
* https://tracker.ceph.com/issues/57676
296
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
297
298
299 86 Rishabh Dave
h3. 2023 Apr 13
300
301
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
302
303
https://tracker.ceph.com/issues/52624
304
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
305
* https://tracker.ceph.com/issues/57594
306
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
307
* https://tracker.ceph.com/issues/54108
308
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
309
* https://tracker.ceph.com/issues/58340
310
  fsstress.sh failed with errno 125
311
* https://tracker.ceph.com/issues/54462
312
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
313
* https://tracker.ceph.com/issues/49287     
314
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
315
* https://tracker.ceph.com/issues/58726
316
  test_acls: expected a yum based or a apt based system
317 40 Ramana Raja
318 84 Venky Shankar
h3. 2022 Dec 07
319
320
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
321
322
many transient git.ceph.com related timeouts
323
324
* https://tracker.ceph.com/issues/52624
325
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
326
* https://tracker.ceph.com/issues/50224
327
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
328
* https://tracker.ceph.com/issues/56644
329
    qa: test_rapid_creation fails with "No space left on device"
330
* https://tracker.ceph.com/issues/58221
331
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
332
333 83 Venky Shankar
h3. 2022 Dec 02
334
335
many transient git.ceph.com related timeouts
336
many transient 'Failed to connect to the host via ssh' failures
337
338
* https://tracker.ceph.com/issues/57723
339
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
340
* https://tracker.ceph.com/issues/52624
341
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
342
343 82 Venky Shankar
h3. 2022 Dec 01
344
345
many transient git.ceph.com related timeouts
346
347
* https://tracker.ceph.com/issues/57723
348
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
349
* https://tracker.ceph.com/issues/52624
350
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
351
352 80 Patrick Donnelly
h3. 2022 Nov 18
353
354
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
355
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
356
357
2 ansible dead failures.
358
12 transient git.ceph.com related timeouts
359
360
* https://tracker.ceph.com/issues/57723
361
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
362
* https://tracker.ceph.com/issues/52624
363
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
364
365 78 Milind Changire
h3. 2022 Oct 19
366
367
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
368
369
* https://tracker.ceph.com/issues/57723
370
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
371
* https://tracker.ceph.com/issues/52624
372
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
373
* https://tracker.ceph.com/issues/56644
374
  qa: test_rapid_creation fails with "No space left on device"
375
* https://tracker.ceph.com/issues/54460
376
  snaptest-multiple-capsnaps.sh test failure
377
* https://tracker.ceph.com/issues/57892
378
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
379
380
381
382 76 Venky Shankar
h3. 2022 Oct 06
383
384
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
385
386
* https://tracker.ceph.com/issues/52624
387
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
388
* https://tracker.ceph.com/issues/50223
389
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
390 77 Milind Changire
* https://tracker.ceph.com/issues/56507
391
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
392 76 Venky Shankar
393 75 Venky Shankar
h3. 2022 Sep 27
394
395
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
396
397
* https://tracker.ceph.com/issues/52624
398
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
399
* https://tracker.ceph.com/issues/48773
400
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
401
* https://tracker.ceph.com/issues/50224
402
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
403
* https://tracker.ceph.com/issues/56507
404
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
405
* https://tracker.ceph.com/issues/50223
406
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
407
408 74 Venky Shankar
h3. 2022 Sep 22
409
410
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
411
412
* https://tracker.ceph.com/issues/52624
413
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
414
* https://tracker.ceph.com/issues/51282
415
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
416
* https://tracker.ceph.com/issues/53360
417
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
418
419 73 Venky Shankar
h3. 2022 Sep 19
420
421
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
422
423
* https://tracker.ceph.com/issues/52624
424
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
425
* https://tracker.ceph.com/issues/57594
426
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
427
428 71 Venky Shankar
h3. 2022 Sep 15
429
430
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
431
432
* https://tracker.ceph.com/issues/51282
433
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
434
* https://tracker.ceph.com/issues/52624
435
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
436
* https://tracker.ceph.com/issues/53360
437
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
438 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
439
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
440 71 Venky Shankar
441 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
442
443
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
444
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
445
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
446
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
447
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
448
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
449
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
450
451
452
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
453
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
454
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
455
456
457 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
458
459
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
460
* Most of the failures are passed in re-run. Please check rerun failures below.
461
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
462
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
463
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
464
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
465
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
466
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
467
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
468
469
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
470
* https://tracker.ceph.com/issues/52624
471
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
472
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
473
* https://tracker.ceph.com/issues/57083
474
* https://tracker.ceph.com/issues/53360
475
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
476
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
477
* https://tracker.ceph.com/issues/51183
478
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
479
* https://tracker.ceph.com/issues/56507
480
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
481
482 68 Kotresh Hiremath Ravishankar
483
h3. 2022 AUG 04
484
485
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
486
487
* https://tracker.ceph.com/issues/57087
488
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
489
* https://tracker.ceph.com/issues/52624
490
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
491
* https://tracker.ceph.com/issues/51267
492
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
493
* https://tracker.ceph.com/issues/53360
494
* https://tracker.ceph.com/issues/57083
495
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
496
* https://tracker.ceph.com/issues/56507
497
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
498
499
500 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
501
502
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
503
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
504
505
* https://tracker.ceph.com/issues/52624
506
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
507
* https://tracker.ceph.com/issues/57083
508
* https://tracker.ceph.com/issues/53360
509
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
510
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
511
* https://tracker.ceph.com/issues/51183
512
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
513
* https://tracker.ceph.com/issues/56507
514
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
515
516
517 66 Venky Shankar
h3. 2022 July 08
518
519
* https://tracker.ceph.com/issues/52624
520
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
521
* https://tracker.ceph.com/issues/53360
522
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
523
* https://tracker.ceph.com/issues/51183
524
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
525
* https://tracker.ceph.com/issues/56506
526
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
527
* https://tracker.ceph.com/issues/56507
528
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
529
530 65 Venky Shankar
h3. 2022 Jun 28
531
532
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
533
534
* https://tracker.ceph.com/issues/52624
535
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
536
* https://tracker.ceph.com/issues/53360
537
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
538
* https://tracker.ceph.com/issues/51183
539
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
540
541 64 Venky Shankar
h3. 2022 Jun 22
542
543
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
544
545
* https://tracker.ceph.com/issues/52624
546
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
547
* https://tracker.ceph.com/issues/53360
548
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
549
* https://tracker.ceph.com/issues/51183
550
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
551
552 63 Venky Shankar
h3. 2022 Jun 17
553
554
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
555
556
* https://tracker.ceph.com/issues/52624
557
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
558
* https://tracker.ceph.com/issues/53360
559
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
560
* https://tracker.ceph.com/issues/51183
561
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
562
563 62 Venky Shankar
h3. 2022 Jun 16
564
565
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
566
567
* https://tracker.ceph.com/issues/52624
568
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
569
* https://tracker.ceph.com/issues/53360
570
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
571
* https://tracker.ceph.com/issues/55449
572
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
573
* https://tracker.ceph.com/issues/51267
574
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
575
* https://tracker.ceph.com/issues/55332
576
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
577
578 61 Venky Shankar
h3. 2022 Jun 15
579
580
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
581
582
* https://tracker.ceph.com/issues/52624
583
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
584
* https://tracker.ceph.com/issues/53360
585
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
586
* https://tracker.ceph.com/issues/55449
587
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
588
589
590 60 Venky Shankar
h3. 2022 Jun 10
591
592
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
593
594
* https://tracker.ceph.com/issues/52624
595
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
596
* https://tracker.ceph.com/issues/53360
597
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
598
* https://tracker.ceph.com/issues/55449
599
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
600
601 59 Venky Shankar
h3. 2022 Jun 09
602
603
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
604
605
* https://tracker.ceph.com/issues/52624
606
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
607
* https://tracker.ceph.com/issues/53360
608
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
609
* https://tracker.ceph.com/issues/55449
610
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
611
612 58 Venky Shankar
h3. 2022 May 06
613
614
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
615
616
* https://tracker.ceph.com/issues/52624
617
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
618
* https://tracker.ceph.com/issues/53360
619
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
620
621 57 Venky Shankar
h3. 2022 April 18
622
623
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
624
(only mgr/snap_schedule backport pr)
625
626
* https://tracker.ceph.com/issues/52624
627
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
628 56 Venky Shankar
629
h3. 2022 March 28
630
631
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
632
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
633
634
* https://tracker.ceph.com/issues/52624
635
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
636
* https://tracker.ceph.com/issues/53360
637
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
638
* https://tracker.ceph.com/issues/54411
639
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
640
	33 daemons have recently crashed" during suites/fsstress.sh
641
642 55 Venky Shankar
h3. 2022 March 25
643
644
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
645
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
646
647
* https://tracker.ceph.com/issues/52624
648
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
649
* https://tracker.ceph.com/issues/52606
650
        qa: test_dirfrag_limit
651
* https://tracker.ceph.com/issues/51905
652
        qa: "error reading sessionmap 'mds1_sessionmap'"
653
* https://tracker.ceph.com/issues/53360
654
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
655
* https://tracker.ceph.com/issues/51183
656
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
657 47 Patrick Donnelly
658 54 Venky Shankar
h3. 2022 March 22
659
660
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
661
662
* https://tracker.ceph.com/issues/52624
663
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
664
* https://tracker.ceph.com/issues/52606
665
        qa: test_dirfrag_limit
666
* https://tracker.ceph.com/issues/51183
667
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
668
* https://tracker.ceph.com/issues/51905
669
        qa: "error reading sessionmap 'mds1_sessionmap'"
670
* https://tracker.ceph.com/issues/53360
671
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
672
* https://tracker.ceph.com/issues/54411
673
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
674
	33 daemons have recently crashed" during suites/fsstress.sh
675 47 Patrick Donnelly
676 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
677
678
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
679
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
680
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
681
682
683
* https://tracker.ceph.com/issues/53300
684
	qa: cluster [WRN] Scrub error on inode
685
* https://tracker.ceph.com/issues/53302
686
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
687
* https://tracker.ceph.com/issues/53314
688
	qa: fs/upgrade/mds_upgrade_sequence test timeout
689
* https://tracker.ceph.com/issues/53316
690
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
691
* https://tracker.ceph.com/issues/52624
692
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
693
* https://tracker.ceph.com/issues/52396
694
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
695
* https://tracker.ceph.com/issues/52875
696
	pacific: qa: test_dirfrag_limit
697
* https://tracker.ceph.com/issues/51705
698 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
699
* https://tracker.ceph.com/issues/39634
700
	qa: test_full_same_file timeout
701 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
702
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
703 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
704
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
705 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
706
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
707 48 Kotresh Hiremath Ravishankar
708 47 Patrick Donnelly
709
h3. 2021 November 20
710
711
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
712
713
* https://tracker.ceph.com/issues/53360
714
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
715 46 Kotresh Hiremath Ravishankar
716 41 Patrick Donnelly
h3. 2021 September 14 (QE)
717
718
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
719 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
720 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
721 41 Patrick Donnelly
722
* https://tracker.ceph.com/issues/52606
723
    qa: test_dirfrag_limit
724
* https://tracker.ceph.com/issues/52607
725
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
726 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
727
    qa: tasks.cephfs.fuse_mount:mount command failed
728 41 Patrick Donnelly
729 40 Ramana Raja
h3. 2021 Sep 7
730
731
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
732
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
733
734
735
* https://tracker.ceph.com/issues/52396
736
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
737
* https://tracker.ceph.com/issues/51705
738
    qa: tasks.cephfs.fuse_mount:mount command failed
739 4 Patrick Donnelly
740 34 Ramana Raja
h3. 2021 Aug 30
741
742
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
743
744
* https://tracker.ceph.com/issues/45434
745
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
746
* https://tracker.ceph.com/issues/51705
747
    qa: tasks.cephfs.fuse_mount:mount command failed
748
* https://tracker.ceph.com/issues/52396
749
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
750 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
751 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
752
* https://tracker.ceph.com/issues/51267
753 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
754
* https://tracker.ceph.com/issues/48772
755
   qa: pjd: not ok 9, 44, 80
756 35 Ramana Raja
757 34 Ramana Raja
758 31 Ramana Raja
h3. 2021 Aug 23
759
760
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
761
762
* https://tracker.ceph.com/issues/45434
763
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
764
* https://tracker.ceph.com/issues/51705
765
    qa: tasks.cephfs.fuse_mount:mount command failed
766 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
767 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
768
* https://tracker.ceph.com/issues/52397
769
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
770
771 31 Ramana Raja
772 29 Ramana Raja
h3. 2021 Aug 11
773
774
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
775
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
776
777
* https://tracker.ceph.com/issues/45434
778
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
779
* https://tracker.ceph.com/issues/51705
780
    qa: tasks.cephfs.fuse_mount:mount command failed
781 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
782
    osd: 5.2s0 deep-scrub : stat mismatch
783 29 Ramana Raja
784 19 Jos Collin
h3. 2021 July 15
785 20 Jos Collin
786 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
787
788 26 Jos Collin
* https://tracker.ceph.com/issues/45434
789
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
790
* https://tracker.ceph.com/issues/51705
791
    qa: tasks.cephfs.fuse_mount:mount command failed
792 27 Jos Collin
* https://tracker.ceph.com/issues/51183
793
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
794 28 Jos Collin
* https://tracker.ceph.com/issues/50528
795
    qa: fs:thrash: pjd suite not ok 80
796
* https://tracker.ceph.com/issues/51706
797
    qa: osd deep-scrub stat mismatch
798 26 Jos Collin
799 19 Jos Collin
h3. 2021 July 13
800 20 Jos Collin
801 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
802
803 21 Jos Collin
* https://tracker.ceph.com/issues/51704
804
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
805 23 Jos Collin
* https://tracker.ceph.com/issues/45434
806
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
807 24 Jos Collin
* https://tracker.ceph.com/issues/51705
808 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
809
* https://tracker.ceph.com/issues/48640
810 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
811 21 Jos Collin
812 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
813
814
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
815
816
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
817
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
818
819
* https://tracker.ceph.com/issues/45434
820
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
821
* https://tracker.ceph.com/issues/50260
822
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
823
* https://tracker.ceph.com/issues/51183
824
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
825
826
827 16 Jeff Layton
h3. 2021 June 28
828
829
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
830
831
* https://tracker.ceph.com/issues/45434
832
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
833
* https://tracker.ceph.com/issues/51440
834 17 Jeff Layton
    fallocate fails with EACCES
835 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
836
    TestVolumeClient failure
837
* https://tracker.ceph.com/issues/51266
838
    test cleanup failure
839
* https://tracker.ceph.com/issues/51183
840
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
841
842 12 Jeff Layton
h3. 2021 June 14
843
844
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
845
 
846
* https://tracker.ceph.com/issues/45434
847
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
848
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
849
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
850
* https://tracker.ceph.com/issues/51263
851
    pjdfstest rename test 10.t failed with EACCES
852
* https://tracker.ceph.com/issues/51264
853
    TestVolumeClient failure
854 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
855
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
856 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
857
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
858 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
859
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
860 11 Patrick Donnelly
861
h3. 2021 June 07 (Integration Branch)
862
863
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
864
865
* https://tracker.ceph.com/issues/45434
866
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
867
* https://tracker.ceph.com/issues/50279
868
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
869
* https://tracker.ceph.com/issues/48773
870
    qa: scrub does not complete
871
* https://tracker.ceph.com/issues/51170
872
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
873
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
874
    qa: quota failure
875
876
877 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
878
879
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
880
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
881
882
* https://tracker.ceph.com/issues/45434
883
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
884
* https://tracker.ceph.com/issues/50258
885
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
886
* https://tracker.ceph.com/issues/50260
887
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
888
* https://tracker.ceph.com/issues/49962
889
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
890
* https://tracker.ceph.com/issues/50016
891
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
892
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
893
    qa: quota failure
894
* https://tracker.ceph.com/issues/50528
895
    pacific: qa: fs:thrash: pjd suite not ok 20
896
897
898 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
899
900
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
901
902
* https://tracker.ceph.com/issues/50527
903
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
904
* https://tracker.ceph.com/issues/50528
905
    pacific: qa: fs:thrash: pjd suite not ok 20
906
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
907
    qa: "Assertion `cb_done' failed."
908
* https://tracker.ceph.com/issues/49500
909
    qa: "Assertion `cb_done' failed."
910
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
911
    qa: quota failure
912
* https://tracker.ceph.com/issues/45434
913
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
914
* https://tracker.ceph.com/issues/50279
915
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
916
* https://tracker.ceph.com/issues/50258
917
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
918
* https://tracker.ceph.com/issues/49962
919
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
920
* https://tracker.ceph.com/issues/49962
921
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
922
* https://tracker.ceph.com/issues/50530
923
    pacific: client: abort after MDS blocklist
924
925 2 Patrick Donnelly
926
h3. 2021 Apr 21 (Integration Branch)
927
928
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
929
930
* https://tracker.ceph.com/issues/45434
931
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
932
* https://tracker.ceph.com/issues/50250
933
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
934
* https://tracker.ceph.com/issues/50258
935
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
936
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
937
    qa: quota failure
938
* https://tracker.ceph.com/issues/50016
939
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
940
* https://tracker.ceph.com/issues/50495
941
    pacific: client: shutdown race fails with status 141
942
943
944 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
945
946
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
947
948
* https://tracker.ceph.com/issues/45434
949
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
950
* https://tracker.ceph.com/issues/48805
951
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
952
* https://tracker.ceph.com/issues/49500
953
    qa: "Assertion `cb_done' failed."
954
* https://tracker.ceph.com/issues/50258 (new)
955
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
956
* https://tracker.ceph.com/issues/49962
957
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
958
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
959
    qa: quota failure
960
* https://tracker.ceph.com/issues/50260
961
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
962
* https://tracker.ceph.com/issues/50016
963
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"