Project

General

Profile

Pacific » History » Version 113

Patrick Donnelly, 09/01/2023 07:08 PM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 98 Venky Shankar
* Jul: Venky
6
* Aug: Patrick
7
* Sep: Jos
8
* Oct: Xiubo
9
* Nov: Rishabh
10
* Dec: Kotresh
11
* Jan: Milind
12 81 Venky Shankar
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 111 Patrick Donnelly
h3. 2023 August 31
16
17 113 Patrick Donnelly
https://github.com/ceph/ceph/pull/53189
18
https://github.com/ceph/ceph/pull/53243
19
https://github.com/ceph/ceph/pull/53185
20
https://github.com/ceph/ceph/pull/52744
21
https://github.com/ceph/ceph/pull/51045
22
23 111 Patrick Donnelly
https://pulpito.ceph.com/pdonnell-2023-08-31_15:31:51-fs-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/
24
25 112 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
26
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
27
* https://tracker.ceph.com/issues/52624
28
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
29
* https://tracker.ceph.com/issues/54462
30
    Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
31
* https://tracker.ceph.com/issues/50222
32
    osd: 5.2s0 deep-scrub : stat mismatch
33
* https://tracker.ceph.com/issues/50250
34
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details" ("freshly-calculated rstats don't match existing ones")
35
36
Some spurious infrastructure / valgrind noise during cleanup.
37 111 Patrick Donnelly
38 107 Patrick Donnelly
h3. 2023 August 22
39
40
Pacific v16.2.14 QA
41
42
https://pulpito.ceph.com/yuriw-2023-08-22_14:48:56-fs-pacific-release-distro-default-smithi/
43
https://pulpito.ceph.com/yuriw-2023-08-22_23:49:19-fs-pacific-release-distro-default-smithi/
44
45
* https://tracker.ceph.com/issues/62578
46
    mon: osd pg-upmap-items command causes PG_DEGRADED warnings
47 109 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
48
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
49 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62501
50
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC (fs/full/subvolume_snapshot_rm.sh)
51 107 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
52
    test_acls (tasks.cephfs.test_acls.TestACLs)
53 108 Patrick Donnelly
* https://tracker.ceph.com/issues/62579
54
    client: evicted warning because client completes unmount before thrashed MDS comes back
55 110 Patrick Donnelly
* https://tracker.ceph.com/issues/62580
56
    testing: Test failure: test_snapshot_remove (tasks.cephfs.test_strays.TestStrays)
57 107 Patrick Donnelly
58 106 Patrick Donnelly
h3. 2023 August 16-2
59
60
https://trello.com/c/qRJogcXu/1827-wip-yuri2-testing-2023-08-16-1142-pacific
61
https://pulpito.ceph.com/?branch=wip-yuri2-testing-2023-08-16-1142-pacific
62
63
* https://tracker.ceph.com/issues/52624
64
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
65
* https://tracker.ceph.com/issues/58992
66
    test_acls (tasks.cephfs.test_acls.TestACLs)
67
* https://tracker.ceph.com/issues/62501
68
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
69
70 105 Patrick Donnelly
h3. 2023 August 16
71
72
https://trello.com/c/4TiiTR0k/1821-wip-yuri7-testing-2023-08-16-1309-pacific-old-wip-yuri7-testing-2023-08-16-0933-pacific-old-wip-yuri7-testing-2023-08-15-0741-pa
73
https://pulpito.ceph.com/?branch=wip-yuri7-testing-2023-08-16-1309-pacific
74
75
* https://tracker.ceph.com/issues/62499
76
    testing (?): deadlock ffsb task
77
* https://tracker.ceph.com/issues/62501
78
    pacific(?): qa: mgr-osd-full causes OSD aborts due to ENOSPC
79
80 103 Patrick Donnelly
h3. 2023 August 11
81
82
https://trello.com/c/ONHeA3yz/1823-wip-yuri8-testing-2023-08-11-0834-pacific
83
https://pulpito.ceph.com/yuriw-2023-08-15_01:22:18-fs-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/
84
85
Some infra noise causes dead job.
86
87
* https://tracker.ceph.com/issues/52624
88
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
89
* https://tracker.ceph.com/issues/58992
90
    test_acls (tasks.cephfs.test_acls.TestACLs)
91 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58340
92 107 Patrick Donnelly
    fsstress.sh failed with errno 124 
93 103 Patrick Donnelly
* https://tracker.ceph.com/issues/48773
94 107 Patrick Donnelly
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
95 103 Patrick Donnelly
* https://tracker.ceph.com/issues/50527
96
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
97
98 100 Venky Shankar
h3. 2023 August 8
99
100
https://pulpito.ceph.com/?branch=wip-yuri10-testing-2023-08-01-0753-pacific
101
102
* https://tracker.ceph.com/issues/52624
103
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
104 1 Patrick Donnelly
* https://tracker.ceph.com/issues/50223
105
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
106 101 Patrick Donnelly
* https://tracker.ceph.com/issues/62164
107
    qa: "cluster [ERR] MDS abort because newly corrupt dentry to be committed: [dentry #0x1/a [fffffffffffffff6,head] auth (dversion lock) v=13..."
108
* https://tracker.ceph.com/issues/51964
109
    qa: test_cephfs_mirror_restart_sync_on_blocklist failure
110
* https://tracker.ceph.com/issues/58992
111
    test_acls (tasks.cephfs.test_acls.TestACLs)
112
* https://tracker.ceph.com/issues/62465
113
    pacific (?): LibCephFS.ShutdownRace segmentation fault
114 102 Patrick Donnelly
* "fs/full/subvolume_snapshot_rm.sh" failure caused by bluestore crash.
115 100 Venky Shankar
116 104 Patrick Donnelly
h3. 2023 August 03
117
118
https://trello.com/c/8HALLv9T/1813-wip-yuri6-testing-2023-08-03-0807-pacific-old-wip-yuri6-testing-2023-07-24-0819-pacific2-old-wip-yuri6-testing-2023-07-24-0819-p
119
https://pulpito.ceph.com/?branch=wip-yuri6-testing-2023-08-03-0807-pacific
120
121
* https://tracker.ceph.com/issues/52624
122
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
123
* https://tracker.ceph.com/issues/58992
124
    test_acls (tasks.cephfs.test_acls.TestACLs)
125
126 99 Venky Shankar
h3. 2023 July 25
127
128
https://pulpito.ceph.com/?branch=wip-yuri-testing-2023-07-19-1340-pacific
129
130
* https://tracker.ceph.com/issues/52624
131
    cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
132
* https://tracker.ceph.com/issues/58992
133
    test_acls (tasks.cephfs.test_acls.TestACLs)
134
* https://tracker.ceph.com/issues/50223
135
    qa: "client.4737 isn't responding to mclientcaps(revoke)"
136
* https://tracker.ceph.com/issues/62160
137
    mds: MDS abort because newly corrupt dentry to be committed
138
* https://tracker.ceph.com/issues/61201
139
    qa: test_rebuild_moved_file (tasks/data-scan) fails because mds crashes in pacific (recovery thread crash)
140
141
142 94 Kotresh Hiremath Ravishankar
h3. 2023 May 17
143
144
https://pulpito.ceph.com/yuriw-2023-05-15_21:56:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/
145 97 Kotresh Hiremath Ravishankar
https://pulpito.ceph.com/yuriw-2023-05-17_14:20:33-fs-wip-yuri2-testing-2023-05-15-0810-pacific_2-distro-default-smithi/ (fresh pkg and re-run because of package/installation issues)
146 94 Kotresh Hiremath Ravishankar
147
* https://tracker.ceph.com/issues/52624
148
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
149 96 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/61201 (NEW)
150 94 Kotresh Hiremath Ravishankar
  Test failure: test_rebuild_moved_file (tasks.cephfs.test_data_scan.TestDataScan)
151
* https://tracker.ceph.com/issues/58340
152
  fsstress.sh failed with errno 124 
153 1 Patrick Donnelly
* https://tracker.ceph.com/issues/52624
154 94 Kotresh Hiremath Ravishankar
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
155
* https://tracker.ceph.com/issues/58992
156
  test_acls (tasks.cephfs.test_acls.TestACLs)
157
* https://tracker.ceph.com/issues/54462
158 95 Kotresh Hiremath Ravishankar
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128 
159 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58674
160 95 Kotresh Hiremath Ravishankar
  teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds 
161 94 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/55446
162 95 Kotresh Hiremath Ravishankar
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
163
 
164 94 Kotresh Hiremath Ravishankar
165
166 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
167
168
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
169
170
* https://tracker.ceph.com/issues/52624
171
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
172
* https://tracker.ceph.com/issues/51964
173
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
174
* https://tracker.ceph.com/issues/48773
175
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
176
* https://tracker.ceph.com/issues/50223
177
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
178 1 Patrick Donnelly
* https://tracker.ceph.com/issues/58992
179
  test_acls (tasks.cephfs.test_acls.TestACLs)
180 91 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/58340
181
  fsstress.sh failed with errno 124
182 93 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
183
  Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
184
* https://tracker.ceph.com/issues/55446
185
  fs/upgrade/mds_upgrade_sequence - hit max job timeout
186 91 Kotresh Hiremath Ravishankar
187 90 Rishabh Dave
h3. 2023 May 4
188
189
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
190
191
* https://tracker.ceph.com/issues/59560
192
  qa: RuntimeError: more than one file system available
193
* https://tracker.ceph.com/issues/59626
194
  FSMissing: File system xxxx does not exist in the map
195
* https://tracker.ceph.com/issues/58340
196
  fsstress.sh failed with errno 124
197
* https://tracker.ceph.com/issues/58992
198
  test_acls
199
* https://tracker.ceph.com/issues/48773
200
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
201
* https://tracker.ceph.com/issues/57676
202
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
203
204
205 86 Rishabh Dave
h3. 2023 Apr 13
206
207
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
208
209
https://tracker.ceph.com/issues/52624
210
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
211
* https://tracker.ceph.com/issues/57594
212
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
213
* https://tracker.ceph.com/issues/54108
214
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
215
* https://tracker.ceph.com/issues/58340
216
  fsstress.sh failed with errno 125
217
* https://tracker.ceph.com/issues/54462
218
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
219
* https://tracker.ceph.com/issues/49287     
220
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
221
* https://tracker.ceph.com/issues/58726
222
  test_acls: expected a yum based or a apt based system
223 40 Ramana Raja
224 84 Venky Shankar
h3. 2022 Dec 07
225
226
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
227
228
many transient git.ceph.com related timeouts
229
230
* https://tracker.ceph.com/issues/52624
231
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
232
* https://tracker.ceph.com/issues/50224
233
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
234
* https://tracker.ceph.com/issues/56644
235
    qa: test_rapid_creation fails with "No space left on device"
236
* https://tracker.ceph.com/issues/58221
237
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
238
239 83 Venky Shankar
h3. 2022 Dec 02
240
241
many transient git.ceph.com related timeouts
242
many transient 'Failed to connect to the host via ssh' failures
243
244
* https://tracker.ceph.com/issues/57723
245
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
246
* https://tracker.ceph.com/issues/52624
247
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
248
249 82 Venky Shankar
h3. 2022 Dec 01
250
251
many transient git.ceph.com related timeouts
252
253
* https://tracker.ceph.com/issues/57723
254
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
255
* https://tracker.ceph.com/issues/52624
256
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
257
258 80 Patrick Donnelly
h3. 2022 Nov 18
259
260
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
261
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
262
263
2 ansible dead failures.
264
12 transient git.ceph.com related timeouts
265
266
* https://tracker.ceph.com/issues/57723
267
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
268
* https://tracker.ceph.com/issues/52624
269
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
270
271 78 Milind Changire
h3. 2022 Oct 19
272
273
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
274
275
* https://tracker.ceph.com/issues/57723
276
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
277
* https://tracker.ceph.com/issues/52624
278
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
279
* https://tracker.ceph.com/issues/56644
280
  qa: test_rapid_creation fails with "No space left on device"
281
* https://tracker.ceph.com/issues/54460
282
  snaptest-multiple-capsnaps.sh test failure
283
* https://tracker.ceph.com/issues/57892
284
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
285
286
287
288 76 Venky Shankar
h3. 2022 Oct 06
289
290
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
291
292
* https://tracker.ceph.com/issues/52624
293
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
294
* https://tracker.ceph.com/issues/50223
295
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
296 77 Milind Changire
* https://tracker.ceph.com/issues/56507
297
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
298 76 Venky Shankar
299 75 Venky Shankar
h3. 2022 Sep 27
300
301
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
302
303
* https://tracker.ceph.com/issues/52624
304
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
305
* https://tracker.ceph.com/issues/48773
306
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
307
* https://tracker.ceph.com/issues/50224
308
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
309
* https://tracker.ceph.com/issues/56507
310
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
311
* https://tracker.ceph.com/issues/50223
312
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
313
314 74 Venky Shankar
h3. 2022 Sep 22
315
316
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
317
318
* https://tracker.ceph.com/issues/52624
319
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
320
* https://tracker.ceph.com/issues/51282
321
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
322
* https://tracker.ceph.com/issues/53360
323
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
324
325 73 Venky Shankar
h3. 2022 Sep 19
326
327
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
328
329
* https://tracker.ceph.com/issues/52624
330
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
331
* https://tracker.ceph.com/issues/57594
332
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
333
334 71 Venky Shankar
h3. 2022 Sep 15
335
336
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
337
338
* https://tracker.ceph.com/issues/51282
339
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
340
* https://tracker.ceph.com/issues/52624
341
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
342
* https://tracker.ceph.com/issues/53360
343
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
344 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
345
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
346 71 Venky Shankar
347 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
348
349
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
350
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
351
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
352
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
353
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
354
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
355
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
356
357
358
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
359
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
360
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
361
362
363 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
364
365
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
366
* Most of the failures are passed in re-run. Please check rerun failures below.
367
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
368
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
369
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
370
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
371
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
372
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
373
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
374
375
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
376
* https://tracker.ceph.com/issues/52624
377
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
378
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
379
* https://tracker.ceph.com/issues/57083
380
* https://tracker.ceph.com/issues/53360
381
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
382
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
383
* https://tracker.ceph.com/issues/51183
384
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
385
* https://tracker.ceph.com/issues/56507
386
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
387
388 68 Kotresh Hiremath Ravishankar
389
h3. 2022 AUG 04
390
391
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
392
393
* https://tracker.ceph.com/issues/57087
394
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
395
* https://tracker.ceph.com/issues/52624
396
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
397
* https://tracker.ceph.com/issues/51267
398
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
399
* https://tracker.ceph.com/issues/53360
400
* https://tracker.ceph.com/issues/57083
401
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
402
* https://tracker.ceph.com/issues/56507
403
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
404
405
406 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
407
408
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
409
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
410
411
* https://tracker.ceph.com/issues/52624
412
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
413
* https://tracker.ceph.com/issues/57083
414
* https://tracker.ceph.com/issues/53360
415
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
416
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
417
* https://tracker.ceph.com/issues/51183
418
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
419
* https://tracker.ceph.com/issues/56507
420
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
421
422
423 66 Venky Shankar
h3. 2022 July 08
424
425
* https://tracker.ceph.com/issues/52624
426
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
427
* https://tracker.ceph.com/issues/53360
428
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
429
* https://tracker.ceph.com/issues/51183
430
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
431
* https://tracker.ceph.com/issues/56506
432
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
433
* https://tracker.ceph.com/issues/56507
434
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
435
436 65 Venky Shankar
h3. 2022 Jun 28
437
438
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
439
440
* https://tracker.ceph.com/issues/52624
441
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
442
* https://tracker.ceph.com/issues/53360
443
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
444
* https://tracker.ceph.com/issues/51183
445
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
446
447 64 Venky Shankar
h3. 2022 Jun 22
448
449
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
450
451
* https://tracker.ceph.com/issues/52624
452
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
453
* https://tracker.ceph.com/issues/53360
454
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
455
* https://tracker.ceph.com/issues/51183
456
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
457
458 63 Venky Shankar
h3. 2022 Jun 17
459
460
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
461
462
* https://tracker.ceph.com/issues/52624
463
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
464
* https://tracker.ceph.com/issues/53360
465
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
466
* https://tracker.ceph.com/issues/51183
467
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
468
469 62 Venky Shankar
h3. 2022 Jun 16
470
471
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
472
473
* https://tracker.ceph.com/issues/52624
474
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
475
* https://tracker.ceph.com/issues/53360
476
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
477
* https://tracker.ceph.com/issues/55449
478
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
479
* https://tracker.ceph.com/issues/51267
480
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
481
* https://tracker.ceph.com/issues/55332
482
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
483
484 61 Venky Shankar
h3. 2022 Jun 15
485
486
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
487
488
* https://tracker.ceph.com/issues/52624
489
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
490
* https://tracker.ceph.com/issues/53360
491
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
492
* https://tracker.ceph.com/issues/55449
493
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
494
495
496 60 Venky Shankar
h3. 2022 Jun 10
497
498
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
499
500
* https://tracker.ceph.com/issues/52624
501
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
502
* https://tracker.ceph.com/issues/53360
503
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
504
* https://tracker.ceph.com/issues/55449
505
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
506
507 59 Venky Shankar
h3. 2022 Jun 09
508
509
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
510
511
* https://tracker.ceph.com/issues/52624
512
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
513
* https://tracker.ceph.com/issues/53360
514
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
515
* https://tracker.ceph.com/issues/55449
516
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
517
518 58 Venky Shankar
h3. 2022 May 06
519
520
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
521
522
* https://tracker.ceph.com/issues/52624
523
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
524
* https://tracker.ceph.com/issues/53360
525
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
526
527 57 Venky Shankar
h3. 2022 April 18
528
529
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
530
(only mgr/snap_schedule backport pr)
531
532
* https://tracker.ceph.com/issues/52624
533
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
534 56 Venky Shankar
535
h3. 2022 March 28
536
537
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
538
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
539
540
* https://tracker.ceph.com/issues/52624
541
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
542
* https://tracker.ceph.com/issues/53360
543
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
544
* https://tracker.ceph.com/issues/54411
545
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
546
	33 daemons have recently crashed" during suites/fsstress.sh
547
548 55 Venky Shankar
h3. 2022 March 25
549
550
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
551
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
552
553
* https://tracker.ceph.com/issues/52624
554
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
555
* https://tracker.ceph.com/issues/52606
556
        qa: test_dirfrag_limit
557
* https://tracker.ceph.com/issues/51905
558
        qa: "error reading sessionmap 'mds1_sessionmap'"
559
* https://tracker.ceph.com/issues/53360
560
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
561
* https://tracker.ceph.com/issues/51183
562
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
563 47 Patrick Donnelly
564 54 Venky Shankar
h3. 2022 March 22
565
566
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
567
568
* https://tracker.ceph.com/issues/52624
569
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
570
* https://tracker.ceph.com/issues/52606
571
        qa: test_dirfrag_limit
572
* https://tracker.ceph.com/issues/51183
573
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
574
* https://tracker.ceph.com/issues/51905
575
        qa: "error reading sessionmap 'mds1_sessionmap'"
576
* https://tracker.ceph.com/issues/53360
577
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
578
* https://tracker.ceph.com/issues/54411
579
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
580
	33 daemons have recently crashed" during suites/fsstress.sh
581 47 Patrick Donnelly
582 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
583
584
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
585
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
586
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
587
588
589
* https://tracker.ceph.com/issues/53300
590
	qa: cluster [WRN] Scrub error on inode
591
* https://tracker.ceph.com/issues/53302
592
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
593
* https://tracker.ceph.com/issues/53314
594
	qa: fs/upgrade/mds_upgrade_sequence test timeout
595
* https://tracker.ceph.com/issues/53316
596
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
597
* https://tracker.ceph.com/issues/52624
598
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
599
* https://tracker.ceph.com/issues/52396
600
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
601
* https://tracker.ceph.com/issues/52875
602
	pacific: qa: test_dirfrag_limit
603
* https://tracker.ceph.com/issues/51705
604 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
605
* https://tracker.ceph.com/issues/39634
606
	qa: test_full_same_file timeout
607 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
608
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
609 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
610
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
611 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
612
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
613 48 Kotresh Hiremath Ravishankar
614 47 Patrick Donnelly
615
h3. 2021 November 20
616
617
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
618
619
* https://tracker.ceph.com/issues/53360
620
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
621 46 Kotresh Hiremath Ravishankar
622 41 Patrick Donnelly
h3. 2021 September 14 (QE)
623
624
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
625 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
626 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
627 41 Patrick Donnelly
628
* https://tracker.ceph.com/issues/52606
629
    qa: test_dirfrag_limit
630
* https://tracker.ceph.com/issues/52607
631
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
632 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
633
    qa: tasks.cephfs.fuse_mount:mount command failed
634 41 Patrick Donnelly
635 40 Ramana Raja
h3. 2021 Sep 7
636
637
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
638
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
639
640
641
* https://tracker.ceph.com/issues/52396
642
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
643
* https://tracker.ceph.com/issues/51705
644
    qa: tasks.cephfs.fuse_mount:mount command failed
645 4 Patrick Donnelly
646 34 Ramana Raja
h3. 2021 Aug 30
647
648
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
649
650
* https://tracker.ceph.com/issues/45434
651
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
652
* https://tracker.ceph.com/issues/51705
653
    qa: tasks.cephfs.fuse_mount:mount command failed
654
* https://tracker.ceph.com/issues/52396
655
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
656 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
657 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
658
* https://tracker.ceph.com/issues/51267
659 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
660
* https://tracker.ceph.com/issues/48772
661
   qa: pjd: not ok 9, 44, 80
662 35 Ramana Raja
663 34 Ramana Raja
664 31 Ramana Raja
h3. 2021 Aug 23
665
666
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
667
668
* https://tracker.ceph.com/issues/45434
669
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
670
* https://tracker.ceph.com/issues/51705
671
    qa: tasks.cephfs.fuse_mount:mount command failed
672 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
673 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
674
* https://tracker.ceph.com/issues/52397
675
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
676
677 31 Ramana Raja
678 29 Ramana Raja
h3. 2021 Aug 11
679
680
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
681
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
682
683
* https://tracker.ceph.com/issues/45434
684
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
685
* https://tracker.ceph.com/issues/51705
686
    qa: tasks.cephfs.fuse_mount:mount command failed
687 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
688
    osd: 5.2s0 deep-scrub : stat mismatch
689 29 Ramana Raja
690 19 Jos Collin
h3. 2021 July 15
691 20 Jos Collin
692 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
693
694 26 Jos Collin
* https://tracker.ceph.com/issues/45434
695
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
696
* https://tracker.ceph.com/issues/51705
697
    qa: tasks.cephfs.fuse_mount:mount command failed
698 27 Jos Collin
* https://tracker.ceph.com/issues/51183
699
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
700 28 Jos Collin
* https://tracker.ceph.com/issues/50528
701
    qa: fs:thrash: pjd suite not ok 80
702
* https://tracker.ceph.com/issues/51706
703
    qa: osd deep-scrub stat mismatch
704 26 Jos Collin
705 19 Jos Collin
h3. 2021 July 13
706 20 Jos Collin
707 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
708
709 21 Jos Collin
* https://tracker.ceph.com/issues/51704
710
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
711 23 Jos Collin
* https://tracker.ceph.com/issues/45434
712
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
713 24 Jos Collin
* https://tracker.ceph.com/issues/51705
714 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
715
* https://tracker.ceph.com/issues/48640
716 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
717 21 Jos Collin
718 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
719
720
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
721
722
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
723
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
724
725
* https://tracker.ceph.com/issues/45434
726
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
727
* https://tracker.ceph.com/issues/50260
728
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
729
* https://tracker.ceph.com/issues/51183
730
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
731
732
733 16 Jeff Layton
h3. 2021 June 28
734
735
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
736
737
* https://tracker.ceph.com/issues/45434
738
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
739
* https://tracker.ceph.com/issues/51440
740 17 Jeff Layton
    fallocate fails with EACCES
741 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
742
    TestVolumeClient failure
743
* https://tracker.ceph.com/issues/51266
744
    test cleanup failure
745
* https://tracker.ceph.com/issues/51183
746
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
747
748 12 Jeff Layton
h3. 2021 June 14
749
750
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
751
 
752
* https://tracker.ceph.com/issues/45434
753
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
754
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
755
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
756
* https://tracker.ceph.com/issues/51263
757
    pjdfstest rename test 10.t failed with EACCES
758
* https://tracker.ceph.com/issues/51264
759
    TestVolumeClient failure
760 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
761
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
762 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
763
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
764 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
765
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
766 11 Patrick Donnelly
767
h3. 2021 June 07 (Integration Branch)
768
769
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
770
771
* https://tracker.ceph.com/issues/45434
772
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
773
* https://tracker.ceph.com/issues/50279
774
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
775
* https://tracker.ceph.com/issues/48773
776
    qa: scrub does not complete
777
* https://tracker.ceph.com/issues/51170
778
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
779
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
780
    qa: quota failure
781
782
783 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
784
785
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
786
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
787
788
* https://tracker.ceph.com/issues/45434
789
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
790
* https://tracker.ceph.com/issues/50258
791
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
792
* https://tracker.ceph.com/issues/50260
793
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
794
* https://tracker.ceph.com/issues/49962
795
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
796
* https://tracker.ceph.com/issues/50016
797
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
798
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
799
    qa: quota failure
800
* https://tracker.ceph.com/issues/50528
801
    pacific: qa: fs:thrash: pjd suite not ok 20
802
803
804 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
805
806
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
807
808
* https://tracker.ceph.com/issues/50527
809
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
810
* https://tracker.ceph.com/issues/50528
811
    pacific: qa: fs:thrash: pjd suite not ok 20
812
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
813
    qa: "Assertion `cb_done' failed."
814
* https://tracker.ceph.com/issues/49500
815
    qa: "Assertion `cb_done' failed."
816
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
817
    qa: quota failure
818
* https://tracker.ceph.com/issues/45434
819
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
820
* https://tracker.ceph.com/issues/50279
821
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
822
* https://tracker.ceph.com/issues/50258
823
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
824
* https://tracker.ceph.com/issues/49962
825
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
826
* https://tracker.ceph.com/issues/49962
827
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
828
* https://tracker.ceph.com/issues/50530
829
    pacific: client: abort after MDS blocklist
830
831 2 Patrick Donnelly
832
h3. 2021 Apr 21 (Integration Branch)
833
834
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
835
836
* https://tracker.ceph.com/issues/45434
837
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
838
* https://tracker.ceph.com/issues/50250
839
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
840
* https://tracker.ceph.com/issues/50258
841
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
842
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
843
    qa: quota failure
844
* https://tracker.ceph.com/issues/50016
845
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
846
* https://tracker.ceph.com/issues/50495
847
    pacific: client: shutdown race fails with status 141
848
849
850 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
851
852
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
853
854
* https://tracker.ceph.com/issues/45434
855
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
856
* https://tracker.ceph.com/issues/48805
857
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
858
* https://tracker.ceph.com/issues/49500
859
    qa: "Assertion `cb_done' failed."
860
* https://tracker.ceph.com/issues/50258 (new)
861
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
862
* https://tracker.ceph.com/issues/49962
863
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
864
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
865
    qa: quota failure
866
* https://tracker.ceph.com/issues/50260
867
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
868
* https://tracker.ceph.com/issues/50016
869
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"