Project

General

Profile

Pacific » History » Version 91

Kotresh Hiremath Ravishankar, 05/11/2023 10:40 AM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 81 Venky Shankar
* Dec: Venky
6
* Jan: Patrick
7
* Feb: Jos
8 79 Venky Shankar
* Mar: Xiubo
9
* Apr: Rishabh
10
* May: Kotresh
11 81 Venky Shankar
* Jun: Milind
12
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 87 Rishabh Dave
h3. NEW ENTRY
16
17 91 Kotresh Hiremath Ravishankar
h3. 2023 May 11
18
19
https://pulpito.ceph.com/yuriw-2023-05-09_19:39:46-fs-wip-yuri4-testing-2023-05-08-0846-pacific-distro-default-smithi
20
21
* https://tracker.ceph.com/issues/52624
22
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
23
24
* https://tracker.ceph.com/issues/51964
25
  qa: test_cephfs_mirror_restart_sync_on_blocklist failure
26
27
* https://tracker.ceph.com/issues/48773
28
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
29
30
* https://tracker.ceph.com/issues/50223
31
  qa: "client.4737 isn't responding to mclientcaps(revoke)"
32
33
* https://tracker.ceph.com/issues/58992
34
  test_acls (tasks.cephfs.test_acls.TestACLs)
35
36
* https://tracker.ceph.com/issues/58340
37
  fsstress.sh failed with errno 124
38
39 90 Rishabh Dave
h3. 2023 May 4
40
41
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
42
43
* https://tracker.ceph.com/issues/59560
44
  qa: RuntimeError: more than one file system available
45
* https://tracker.ceph.com/issues/59626
46
  FSMissing: File system xxxx does not exist in the map
47
* https://tracker.ceph.com/issues/58340
48
  fsstress.sh failed with errno 124
49
* https://tracker.ceph.com/issues/58992
50
  test_acls
51
* https://tracker.ceph.com/issues/48773
52
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
53
* https://tracker.ceph.com/issues/57676
54
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
55
56
57 86 Rishabh Dave
h3. 2023 Apr 13
58
59
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
60
61
https://tracker.ceph.com/issues/52624
62
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
63
* https://tracker.ceph.com/issues/57594
64
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
65
* https://tracker.ceph.com/issues/54108
66
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
67
* https://tracker.ceph.com/issues/58340
68
  fsstress.sh failed with errno 125
69
* https://tracker.ceph.com/issues/54462
70
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
71
* https://tracker.ceph.com/issues/49287     
72
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
73
* https://tracker.ceph.com/issues/58726
74
  test_acls: expected a yum based or a apt based system
75 40 Ramana Raja
76 84 Venky Shankar
h3. 2022 Dec 07
77
78
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
79
80
many transient git.ceph.com related timeouts
81
82
* https://tracker.ceph.com/issues/52624
83
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
84
* https://tracker.ceph.com/issues/50224
85
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
86
* https://tracker.ceph.com/issues/56644
87
    qa: test_rapid_creation fails with "No space left on device"
88
* https://tracker.ceph.com/issues/58221
89
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
90
91 83 Venky Shankar
h3. 2022 Dec 02
92
93
many transient git.ceph.com related timeouts
94
many transient 'Failed to connect to the host via ssh' failures
95
96
* https://tracker.ceph.com/issues/57723
97
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
98
* https://tracker.ceph.com/issues/52624
99
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
100
101 82 Venky Shankar
h3. 2022 Dec 01
102
103
many transient git.ceph.com related timeouts
104
105
* https://tracker.ceph.com/issues/57723
106
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
107
* https://tracker.ceph.com/issues/52624
108
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
109
110 80 Patrick Donnelly
h3. 2022 Nov 18
111
112
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
113
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
114
115
2 ansible dead failures.
116
12 transient git.ceph.com related timeouts
117
118
* https://tracker.ceph.com/issues/57723
119
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
120
* https://tracker.ceph.com/issues/52624
121
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
122
123 78 Milind Changire
h3. 2022 Oct 19
124
125
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
126
127
* https://tracker.ceph.com/issues/57723
128
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
129
* https://tracker.ceph.com/issues/52624
130
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
131
* https://tracker.ceph.com/issues/56644
132
  qa: test_rapid_creation fails with "No space left on device"
133
* https://tracker.ceph.com/issues/54460
134
  snaptest-multiple-capsnaps.sh test failure
135
* https://tracker.ceph.com/issues/57892
136
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
137
138
139
140 76 Venky Shankar
h3. 2022 Oct 06
141
142
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
143
144
* https://tracker.ceph.com/issues/52624
145
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
146
* https://tracker.ceph.com/issues/50223
147
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
148 77 Milind Changire
* https://tracker.ceph.com/issues/56507
149
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
150 76 Venky Shankar
151 75 Venky Shankar
h3. 2022 Sep 27
152
153
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
154
155
* https://tracker.ceph.com/issues/52624
156
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
157
* https://tracker.ceph.com/issues/48773
158
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
159
* https://tracker.ceph.com/issues/50224
160
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
161
* https://tracker.ceph.com/issues/56507
162
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
163
* https://tracker.ceph.com/issues/50223
164
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
165
166 74 Venky Shankar
h3. 2022 Sep 22
167
168
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
169
170
* https://tracker.ceph.com/issues/52624
171
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
172
* https://tracker.ceph.com/issues/51282
173
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
174
* https://tracker.ceph.com/issues/53360
175
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
176
177 73 Venky Shankar
h3. 2022 Sep 19
178
179
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
180
181
* https://tracker.ceph.com/issues/52624
182
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
183
* https://tracker.ceph.com/issues/57594
184
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
185
186 71 Venky Shankar
h3. 2022 Sep 15
187
188
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
189
190
* https://tracker.ceph.com/issues/51282
191
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
192
* https://tracker.ceph.com/issues/52624
193
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
194
* https://tracker.ceph.com/issues/53360
195
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
196 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
197
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
198 71 Venky Shankar
199 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
200
201
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
202
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
203
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
204
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
205
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
206
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
207
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
208
209
210
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
211
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
212
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
213
214
215 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
216
217
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
218
* Most of the failures are passed in re-run. Please check rerun failures below.
219
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
220
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
221
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
222
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
223
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
224
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
225
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
226
227
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
228
* https://tracker.ceph.com/issues/52624
229
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
230
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
231
* https://tracker.ceph.com/issues/57083
232
* https://tracker.ceph.com/issues/53360
233
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
234
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
235
* https://tracker.ceph.com/issues/51183
236
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
237
* https://tracker.ceph.com/issues/56507
238
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
239
240 68 Kotresh Hiremath Ravishankar
241
h3. 2022 AUG 04
242
243
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
244
245
* https://tracker.ceph.com/issues/57087
246
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
247
* https://tracker.ceph.com/issues/52624
248
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
249
* https://tracker.ceph.com/issues/51267
250
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
251
* https://tracker.ceph.com/issues/53360
252
* https://tracker.ceph.com/issues/57083
253
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
254
* https://tracker.ceph.com/issues/56507
255
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
256
257
258 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
259
260
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
261
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
262
263
* https://tracker.ceph.com/issues/52624
264
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
265
* https://tracker.ceph.com/issues/57083
266
* https://tracker.ceph.com/issues/53360
267
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
268
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
269
* https://tracker.ceph.com/issues/51183
270
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
271
* https://tracker.ceph.com/issues/56507
272
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
273
274
275 66 Venky Shankar
h3. 2022 July 08
276
277
* https://tracker.ceph.com/issues/52624
278
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
279
* https://tracker.ceph.com/issues/53360
280
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
281
* https://tracker.ceph.com/issues/51183
282
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
283
* https://tracker.ceph.com/issues/56506
284
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
285
* https://tracker.ceph.com/issues/56507
286
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
287
288 65 Venky Shankar
h3. 2022 Jun 28
289
290
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
291
292
* https://tracker.ceph.com/issues/52624
293
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
294
* https://tracker.ceph.com/issues/53360
295
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
296
* https://tracker.ceph.com/issues/51183
297
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
298
299 64 Venky Shankar
h3. 2022 Jun 22
300
301
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
302
303
* https://tracker.ceph.com/issues/52624
304
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
305
* https://tracker.ceph.com/issues/53360
306
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
307
* https://tracker.ceph.com/issues/51183
308
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
309
310 63 Venky Shankar
h3. 2022 Jun 17
311
312
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
313
314
* https://tracker.ceph.com/issues/52624
315
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
316
* https://tracker.ceph.com/issues/53360
317
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
318
* https://tracker.ceph.com/issues/51183
319
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
320
321 62 Venky Shankar
h3. 2022 Jun 16
322
323
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
324
325
* https://tracker.ceph.com/issues/52624
326
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
327
* https://tracker.ceph.com/issues/53360
328
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
329
* https://tracker.ceph.com/issues/55449
330
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
331
* https://tracker.ceph.com/issues/51267
332
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
333
* https://tracker.ceph.com/issues/55332
334
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
335
336 61 Venky Shankar
h3. 2022 Jun 15
337
338
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
339
340
* https://tracker.ceph.com/issues/52624
341
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
342
* https://tracker.ceph.com/issues/53360
343
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
344
* https://tracker.ceph.com/issues/55449
345
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
346
347
348 60 Venky Shankar
h3. 2022 Jun 10
349
350
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
351
352
* https://tracker.ceph.com/issues/52624
353
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
354
* https://tracker.ceph.com/issues/53360
355
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
356
* https://tracker.ceph.com/issues/55449
357
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
358
359 59 Venky Shankar
h3. 2022 Jun 09
360
361
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
362
363
* https://tracker.ceph.com/issues/52624
364
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
365
* https://tracker.ceph.com/issues/53360
366
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
367
* https://tracker.ceph.com/issues/55449
368
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
369
370 58 Venky Shankar
h3. 2022 May 06
371
372
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
373
374
* https://tracker.ceph.com/issues/52624
375
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
376
* https://tracker.ceph.com/issues/53360
377
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
378
379 57 Venky Shankar
h3. 2022 April 18
380
381
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
382
(only mgr/snap_schedule backport pr)
383
384
* https://tracker.ceph.com/issues/52624
385
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
386 56 Venky Shankar
387
h3. 2022 March 28
388
389
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
390
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
391
392
* https://tracker.ceph.com/issues/52624
393
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
394
* https://tracker.ceph.com/issues/53360
395
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
396
* https://tracker.ceph.com/issues/54411
397
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
398
	33 daemons have recently crashed" during suites/fsstress.sh
399
400 55 Venky Shankar
h3. 2022 March 25
401
402
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
403
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
404
405
* https://tracker.ceph.com/issues/52624
406
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
407
* https://tracker.ceph.com/issues/52606
408
        qa: test_dirfrag_limit
409
* https://tracker.ceph.com/issues/51905
410
        qa: "error reading sessionmap 'mds1_sessionmap'"
411
* https://tracker.ceph.com/issues/53360
412
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
413
* https://tracker.ceph.com/issues/51183
414
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
415 47 Patrick Donnelly
416 54 Venky Shankar
h3. 2022 March 22
417
418
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
419
420
* https://tracker.ceph.com/issues/52624
421
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
422
* https://tracker.ceph.com/issues/52606
423
        qa: test_dirfrag_limit
424
* https://tracker.ceph.com/issues/51183
425
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
426
* https://tracker.ceph.com/issues/51905
427
        qa: "error reading sessionmap 'mds1_sessionmap'"
428
* https://tracker.ceph.com/issues/53360
429
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
430
* https://tracker.ceph.com/issues/54411
431
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
432
	33 daemons have recently crashed" during suites/fsstress.sh
433 47 Patrick Donnelly
434 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
435
436
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
437
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
438
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
439
440
441
* https://tracker.ceph.com/issues/53300
442
	qa: cluster [WRN] Scrub error on inode
443
* https://tracker.ceph.com/issues/53302
444
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
445
* https://tracker.ceph.com/issues/53314
446
	qa: fs/upgrade/mds_upgrade_sequence test timeout
447
* https://tracker.ceph.com/issues/53316
448
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
449
* https://tracker.ceph.com/issues/52624
450
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
451
* https://tracker.ceph.com/issues/52396
452
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
453
* https://tracker.ceph.com/issues/52875
454
	pacific: qa: test_dirfrag_limit
455
* https://tracker.ceph.com/issues/51705
456 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
457
* https://tracker.ceph.com/issues/39634
458
	qa: test_full_same_file timeout
459 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
460
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
461 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
462
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
463 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
464
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
465 48 Kotresh Hiremath Ravishankar
466 47 Patrick Donnelly
467
h3. 2021 November 20
468
469
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
470
471
* https://tracker.ceph.com/issues/53360
472
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
473 46 Kotresh Hiremath Ravishankar
474 41 Patrick Donnelly
h3. 2021 September 14 (QE)
475
476
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
477 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
478 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
479 41 Patrick Donnelly
480
* https://tracker.ceph.com/issues/52606
481
    qa: test_dirfrag_limit
482
* https://tracker.ceph.com/issues/52607
483
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
484 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
485
    qa: tasks.cephfs.fuse_mount:mount command failed
486 41 Patrick Donnelly
487 40 Ramana Raja
h3. 2021 Sep 7
488
489
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
490
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
491
492
493
* https://tracker.ceph.com/issues/52396
494
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
495
* https://tracker.ceph.com/issues/51705
496
    qa: tasks.cephfs.fuse_mount:mount command failed
497 4 Patrick Donnelly
498 34 Ramana Raja
h3. 2021 Aug 30
499
500
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
501
502
* https://tracker.ceph.com/issues/45434
503
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
504
* https://tracker.ceph.com/issues/51705
505
    qa: tasks.cephfs.fuse_mount:mount command failed
506
* https://tracker.ceph.com/issues/52396
507
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
508 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
509 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
510
* https://tracker.ceph.com/issues/51267
511 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
512
* https://tracker.ceph.com/issues/48772
513
   qa: pjd: not ok 9, 44, 80
514 35 Ramana Raja
515 34 Ramana Raja
516 31 Ramana Raja
h3. 2021 Aug 23
517
518
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
519
520
* https://tracker.ceph.com/issues/45434
521
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
522
* https://tracker.ceph.com/issues/51705
523
    qa: tasks.cephfs.fuse_mount:mount command failed
524 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
525 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
526
* https://tracker.ceph.com/issues/52397
527
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
528
529 31 Ramana Raja
530 29 Ramana Raja
h3. 2021 Aug 11
531
532
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
533
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
534
535
* https://tracker.ceph.com/issues/45434
536
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
537
* https://tracker.ceph.com/issues/51705
538
    qa: tasks.cephfs.fuse_mount:mount command failed
539 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
540
    osd: 5.2s0 deep-scrub : stat mismatch
541 29 Ramana Raja
542 19 Jos Collin
h3. 2021 July 15
543 20 Jos Collin
544 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
545
546 26 Jos Collin
* https://tracker.ceph.com/issues/45434
547
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
548
* https://tracker.ceph.com/issues/51705
549
    qa: tasks.cephfs.fuse_mount:mount command failed
550 27 Jos Collin
* https://tracker.ceph.com/issues/51183
551
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
552 28 Jos Collin
* https://tracker.ceph.com/issues/50528
553
    qa: fs:thrash: pjd suite not ok 80
554
* https://tracker.ceph.com/issues/51706
555
    qa: osd deep-scrub stat mismatch
556 26 Jos Collin
557 19 Jos Collin
h3. 2021 July 13
558 20 Jos Collin
559 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
560
561 21 Jos Collin
* https://tracker.ceph.com/issues/51704
562
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
563 23 Jos Collin
* https://tracker.ceph.com/issues/45434
564
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
565 24 Jos Collin
* https://tracker.ceph.com/issues/51705
566 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
567
* https://tracker.ceph.com/issues/48640
568 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
569 21 Jos Collin
570 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
571
572
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
573
574
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
575
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
576
577
* https://tracker.ceph.com/issues/45434
578
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
579
* https://tracker.ceph.com/issues/50260
580
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
581
* https://tracker.ceph.com/issues/51183
582
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
583
584
585 16 Jeff Layton
h3. 2021 June 28
586
587
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
588
589
* https://tracker.ceph.com/issues/45434
590
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
591
* https://tracker.ceph.com/issues/51440
592 17 Jeff Layton
    fallocate fails with EACCES
593 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
594
    TestVolumeClient failure
595
* https://tracker.ceph.com/issues/51266
596
    test cleanup failure
597
* https://tracker.ceph.com/issues/51183
598
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
599
600 12 Jeff Layton
h3. 2021 June 14
601
602
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
603
 
604
* https://tracker.ceph.com/issues/45434
605
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
606
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
607
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
608
* https://tracker.ceph.com/issues/51263
609
    pjdfstest rename test 10.t failed with EACCES
610
* https://tracker.ceph.com/issues/51264
611
    TestVolumeClient failure
612 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
613
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
614 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
615
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
616 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
617
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
618 11 Patrick Donnelly
619
h3. 2021 June 07 (Integration Branch)
620
621
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
622
623
* https://tracker.ceph.com/issues/45434
624
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
625
* https://tracker.ceph.com/issues/50279
626
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
627
* https://tracker.ceph.com/issues/48773
628
    qa: scrub does not complete
629
* https://tracker.ceph.com/issues/51170
630
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
631
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
632
    qa: quota failure
633
634
635 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
636
637
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
638
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
639
640
* https://tracker.ceph.com/issues/45434
641
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
642
* https://tracker.ceph.com/issues/50258
643
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
644
* https://tracker.ceph.com/issues/50260
645
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
646
* https://tracker.ceph.com/issues/49962
647
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
648
* https://tracker.ceph.com/issues/50016
649
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
650
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
651
    qa: quota failure
652
* https://tracker.ceph.com/issues/50528
653
    pacific: qa: fs:thrash: pjd suite not ok 20
654
655
656 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
657
658
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
659
660
* https://tracker.ceph.com/issues/50527
661
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
662
* https://tracker.ceph.com/issues/50528
663
    pacific: qa: fs:thrash: pjd suite not ok 20
664
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
665
    qa: "Assertion `cb_done' failed."
666
* https://tracker.ceph.com/issues/49500
667
    qa: "Assertion `cb_done' failed."
668
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
669
    qa: quota failure
670
* https://tracker.ceph.com/issues/45434
671
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
672
* https://tracker.ceph.com/issues/50279
673
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
674
* https://tracker.ceph.com/issues/50258
675
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
676
* https://tracker.ceph.com/issues/49962
677
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
678
* https://tracker.ceph.com/issues/49962
679
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
680
* https://tracker.ceph.com/issues/50530
681
    pacific: client: abort after MDS blocklist
682
683 2 Patrick Donnelly
684
h3. 2021 Apr 21 (Integration Branch)
685
686
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
687
688
* https://tracker.ceph.com/issues/45434
689
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
690
* https://tracker.ceph.com/issues/50250
691
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
692
* https://tracker.ceph.com/issues/50258
693
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
694
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
695
    qa: quota failure
696
* https://tracker.ceph.com/issues/50016
697
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
698
* https://tracker.ceph.com/issues/50495
699
    pacific: client: shutdown race fails with status 141
700
701
702 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
703
704
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
705
706
* https://tracker.ceph.com/issues/45434
707
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
708
* https://tracker.ceph.com/issues/48805
709
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
710
* https://tracker.ceph.com/issues/49500
711
    qa: "Assertion `cb_done' failed."
712
* https://tracker.ceph.com/issues/50258 (new)
713
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
714
* https://tracker.ceph.com/issues/49962
715
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
716
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
717
    qa: quota failure
718
* https://tracker.ceph.com/issues/50260
719
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
720
* https://tracker.ceph.com/issues/50016
721
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"