Project

General

Profile

Pacific » History » Version 86

Rishabh Dave, 04/13/2023 09:48 AM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 81 Venky Shankar
* Dec: Venky
6
* Jan: Patrick
7
* Feb: Jos
8 79 Venky Shankar
* Mar: Xiubo
9
* Apr: Rishabh
10
* May: Kotresh
11 81 Venky Shankar
* Jun: Milind
12
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 86 Rishabh Dave
h3. 2023 Apr 13
16
17
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
18
19
https://tracker.ceph.com/issues/52624
20
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
21
* https://tracker.ceph.com/issues/57594
22
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
23
* https://tracker.ceph.com/issues/54108
24
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
25
* https://tracker.ceph.com/issues/58340
26
  fsstress.sh failed with errno 125
27
* https://tracker.ceph.com/issues/54462
28
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
29
* https://tracker.ceph.com/issues/49287     
30
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
31
* https://tracker.ceph.com/issues/58726
32
  test_acls: expected a yum based or a apt based system
33
34 40 Ramana Raja
35 84 Venky Shankar
h3. 2022 Dec 07
36
37
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
38
39
many transient git.ceph.com related timeouts
40
41
* https://tracker.ceph.com/issues/52624
42
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
43
* https://tracker.ceph.com/issues/50224
44
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
45
* https://tracker.ceph.com/issues/56644
46
    qa: test_rapid_creation fails with "No space left on device"
47
* https://tracker.ceph.com/issues/58221
48
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
49
50 83 Venky Shankar
h3. 2022 Dec 02
51
52
many transient git.ceph.com related timeouts
53
many transient 'Failed to connect to the host via ssh' failures
54
55
* https://tracker.ceph.com/issues/57723
56
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
57
* https://tracker.ceph.com/issues/52624
58
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
59
60 82 Venky Shankar
h3. 2022 Dec 01
61
62
many transient git.ceph.com related timeouts
63
64
* https://tracker.ceph.com/issues/57723
65
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
66
* https://tracker.ceph.com/issues/52624
67
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
68
69 80 Patrick Donnelly
h3. 2022 Nov 18
70
71
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
72
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
73
74
2 ansible dead failures.
75
12 transient git.ceph.com related timeouts
76
77
* https://tracker.ceph.com/issues/57723
78
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
79
* https://tracker.ceph.com/issues/52624
80
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
81
82 78 Milind Changire
h3. 2022 Oct 19
83
84
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
85
86
* https://tracker.ceph.com/issues/57723
87
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
88
* https://tracker.ceph.com/issues/52624
89
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
90
* https://tracker.ceph.com/issues/56644
91
  qa: test_rapid_creation fails with "No space left on device"
92
* https://tracker.ceph.com/issues/54460
93
  snaptest-multiple-capsnaps.sh test failure
94
* https://tracker.ceph.com/issues/57892
95
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
96
97
98
99 76 Venky Shankar
h3. 2022 Oct 06
100
101
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
102
103
* https://tracker.ceph.com/issues/52624
104
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
105
* https://tracker.ceph.com/issues/50223
106
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
107 77 Milind Changire
* https://tracker.ceph.com/issues/56507
108
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
109 76 Venky Shankar
110 75 Venky Shankar
h3. 2022 Sep 27
111
112
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
113
114
* https://tracker.ceph.com/issues/52624
115
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
116
* https://tracker.ceph.com/issues/48773
117
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
118
* https://tracker.ceph.com/issues/50224
119
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
120
* https://tracker.ceph.com/issues/56507
121
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
122
* https://tracker.ceph.com/issues/50223
123
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
124
125 74 Venky Shankar
h3. 2022 Sep 22
126
127
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
128
129
* https://tracker.ceph.com/issues/52624
130
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
131
* https://tracker.ceph.com/issues/51282
132
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
133
* https://tracker.ceph.com/issues/53360
134
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
135
136 73 Venky Shankar
h3. 2022 Sep 19
137
138
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
139
140
* https://tracker.ceph.com/issues/52624
141
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
142
* https://tracker.ceph.com/issues/57594
143
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
144
145 71 Venky Shankar
h3. 2022 Sep 15
146
147
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
148
149
* https://tracker.ceph.com/issues/51282
150
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
151
* https://tracker.ceph.com/issues/52624
152
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
153
* https://tracker.ceph.com/issues/53360
154
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
155 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
156
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
157 71 Venky Shankar
158 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
159
160
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
161
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
162
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
163
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
164
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
165
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
166
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
167
168
169
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
170
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
171
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
172
173
174 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
175
176
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
177
* Most of the failures are passed in re-run. Please check rerun failures below.
178
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
179
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
180
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
181
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
182
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
183
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
184
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
185
186
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
187
* https://tracker.ceph.com/issues/52624
188
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
189
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
190
* https://tracker.ceph.com/issues/57083
191
* https://tracker.ceph.com/issues/53360
192
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
193
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
194
* https://tracker.ceph.com/issues/51183
195
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
196
* https://tracker.ceph.com/issues/56507
197
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
198
199 68 Kotresh Hiremath Ravishankar
200
h3. 2022 AUG 04
201
202
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
203
204
* https://tracker.ceph.com/issues/57087
205
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
206
* https://tracker.ceph.com/issues/52624
207
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
208
* https://tracker.ceph.com/issues/51267
209
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
210
* https://tracker.ceph.com/issues/53360
211
* https://tracker.ceph.com/issues/57083
212
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
213
* https://tracker.ceph.com/issues/56507
214
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
215
216
217 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
218
219
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
220
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
221
222
* https://tracker.ceph.com/issues/52624
223
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
224
* https://tracker.ceph.com/issues/57083
225
* https://tracker.ceph.com/issues/53360
226
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
227
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
228
* https://tracker.ceph.com/issues/51183
229
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
230
* https://tracker.ceph.com/issues/56507
231
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
232
233
234 66 Venky Shankar
h3. 2022 July 08
235
236
* https://tracker.ceph.com/issues/52624
237
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
238
* https://tracker.ceph.com/issues/53360
239
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
240
* https://tracker.ceph.com/issues/51183
241
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
242
* https://tracker.ceph.com/issues/56506
243
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
244
* https://tracker.ceph.com/issues/56507
245
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
246
247 65 Venky Shankar
h3. 2022 Jun 28
248
249
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
250
251
* https://tracker.ceph.com/issues/52624
252
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
253
* https://tracker.ceph.com/issues/53360
254
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
255
* https://tracker.ceph.com/issues/51183
256
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
257
258 64 Venky Shankar
h3. 2022 Jun 22
259
260
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
261
262
* https://tracker.ceph.com/issues/52624
263
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
264
* https://tracker.ceph.com/issues/53360
265
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
266
* https://tracker.ceph.com/issues/51183
267
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
268
269 63 Venky Shankar
h3. 2022 Jun 17
270
271
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
272
273
* https://tracker.ceph.com/issues/52624
274
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
275
* https://tracker.ceph.com/issues/53360
276
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
277
* https://tracker.ceph.com/issues/51183
278
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
279
280 62 Venky Shankar
h3. 2022 Jun 16
281
282
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
283
284
* https://tracker.ceph.com/issues/52624
285
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
286
* https://tracker.ceph.com/issues/53360
287
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
288
* https://tracker.ceph.com/issues/55449
289
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
290
* https://tracker.ceph.com/issues/51267
291
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
292
* https://tracker.ceph.com/issues/55332
293
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
294
295 61 Venky Shankar
h3. 2022 Jun 15
296
297
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
298
299
* https://tracker.ceph.com/issues/52624
300
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
301
* https://tracker.ceph.com/issues/53360
302
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
303
* https://tracker.ceph.com/issues/55449
304
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
305
306
307 60 Venky Shankar
h3. 2022 Jun 10
308
309
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
310
311
* https://tracker.ceph.com/issues/52624
312
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
313
* https://tracker.ceph.com/issues/53360
314
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
315
* https://tracker.ceph.com/issues/55449
316
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
317
318 59 Venky Shankar
h3. 2022 Jun 09
319
320
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
321
322
* https://tracker.ceph.com/issues/52624
323
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
324
* https://tracker.ceph.com/issues/53360
325
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
326
* https://tracker.ceph.com/issues/55449
327
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
328
329 58 Venky Shankar
h3. 2022 May 06
330
331
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
332
333
* https://tracker.ceph.com/issues/52624
334
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
335
* https://tracker.ceph.com/issues/53360
336
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
337
338 57 Venky Shankar
h3. 2022 April 18
339
340
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
341
(only mgr/snap_schedule backport pr)
342
343
* https://tracker.ceph.com/issues/52624
344
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
345 56 Venky Shankar
346
h3. 2022 March 28
347
348
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
349
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
350
351
* https://tracker.ceph.com/issues/52624
352
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
353
* https://tracker.ceph.com/issues/53360
354
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
355
* https://tracker.ceph.com/issues/54411
356
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
357
	33 daemons have recently crashed" during suites/fsstress.sh
358
359 55 Venky Shankar
h3. 2022 March 25
360
361
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
362
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
363
364
* https://tracker.ceph.com/issues/52624
365
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
366
* https://tracker.ceph.com/issues/52606
367
        qa: test_dirfrag_limit
368
* https://tracker.ceph.com/issues/51905
369
        qa: "error reading sessionmap 'mds1_sessionmap'"
370
* https://tracker.ceph.com/issues/53360
371
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
372
* https://tracker.ceph.com/issues/51183
373
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
374 47 Patrick Donnelly
375 54 Venky Shankar
h3. 2022 March 22
376
377
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
378
379
* https://tracker.ceph.com/issues/52624
380
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
381
* https://tracker.ceph.com/issues/52606
382
        qa: test_dirfrag_limit
383
* https://tracker.ceph.com/issues/51183
384
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
385
* https://tracker.ceph.com/issues/51905
386
        qa: "error reading sessionmap 'mds1_sessionmap'"
387
* https://tracker.ceph.com/issues/53360
388
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
389
* https://tracker.ceph.com/issues/54411
390
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
391
	33 daemons have recently crashed" during suites/fsstress.sh
392 47 Patrick Donnelly
393 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
394
395
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
396
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
397
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
398
399
400
* https://tracker.ceph.com/issues/53300
401
	qa: cluster [WRN] Scrub error on inode
402
* https://tracker.ceph.com/issues/53302
403
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
404
* https://tracker.ceph.com/issues/53314
405
	qa: fs/upgrade/mds_upgrade_sequence test timeout
406
* https://tracker.ceph.com/issues/53316
407
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
408
* https://tracker.ceph.com/issues/52624
409
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
410
* https://tracker.ceph.com/issues/52396
411
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
412
* https://tracker.ceph.com/issues/52875
413
	pacific: qa: test_dirfrag_limit
414
* https://tracker.ceph.com/issues/51705
415 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
416
* https://tracker.ceph.com/issues/39634
417
	qa: test_full_same_file timeout
418 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
419
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
420 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
421
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
422 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
423
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
424 48 Kotresh Hiremath Ravishankar
425 47 Patrick Donnelly
426
h3. 2021 November 20
427
428
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
429
430
* https://tracker.ceph.com/issues/53360
431
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
432 46 Kotresh Hiremath Ravishankar
433 41 Patrick Donnelly
h3. 2021 September 14 (QE)
434
435
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
436 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
437 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
438 41 Patrick Donnelly
439
* https://tracker.ceph.com/issues/52606
440
    qa: test_dirfrag_limit
441
* https://tracker.ceph.com/issues/52607
442
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
443 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
444
    qa: tasks.cephfs.fuse_mount:mount command failed
445 41 Patrick Donnelly
446 40 Ramana Raja
h3. 2021 Sep 7
447
448
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
449
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
450
451
452
* https://tracker.ceph.com/issues/52396
453
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
454
* https://tracker.ceph.com/issues/51705
455
    qa: tasks.cephfs.fuse_mount:mount command failed
456 4 Patrick Donnelly
457 34 Ramana Raja
h3. 2021 Aug 30
458
459
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
460
461
* https://tracker.ceph.com/issues/45434
462
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
463
* https://tracker.ceph.com/issues/51705
464
    qa: tasks.cephfs.fuse_mount:mount command failed
465
* https://tracker.ceph.com/issues/52396
466
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
467 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
468 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
469
* https://tracker.ceph.com/issues/51267
470 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
471
* https://tracker.ceph.com/issues/48772
472
   qa: pjd: not ok 9, 44, 80
473 35 Ramana Raja
474 34 Ramana Raja
475 31 Ramana Raja
h3. 2021 Aug 23
476
477
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
478
479
* https://tracker.ceph.com/issues/45434
480
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
481
* https://tracker.ceph.com/issues/51705
482
    qa: tasks.cephfs.fuse_mount:mount command failed
483 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
484 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
485
* https://tracker.ceph.com/issues/52397
486
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
487
488 31 Ramana Raja
489 29 Ramana Raja
h3. 2021 Aug 11
490
491
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
492
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
493
494
* https://tracker.ceph.com/issues/45434
495
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
496
* https://tracker.ceph.com/issues/51705
497
    qa: tasks.cephfs.fuse_mount:mount command failed
498 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
499
    osd: 5.2s0 deep-scrub : stat mismatch
500 29 Ramana Raja
501 19 Jos Collin
h3. 2021 July 15
502 20 Jos Collin
503 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
504
505 26 Jos Collin
* https://tracker.ceph.com/issues/45434
506
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
507
* https://tracker.ceph.com/issues/51705
508
    qa: tasks.cephfs.fuse_mount:mount command failed
509 27 Jos Collin
* https://tracker.ceph.com/issues/51183
510
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
511 28 Jos Collin
* https://tracker.ceph.com/issues/50528
512
    qa: fs:thrash: pjd suite not ok 80
513
* https://tracker.ceph.com/issues/51706
514
    qa: osd deep-scrub stat mismatch
515 26 Jos Collin
516 19 Jos Collin
h3. 2021 July 13
517 20 Jos Collin
518 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
519
520 21 Jos Collin
* https://tracker.ceph.com/issues/51704
521
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
522 23 Jos Collin
* https://tracker.ceph.com/issues/45434
523
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
524 24 Jos Collin
* https://tracker.ceph.com/issues/51705
525 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
526
* https://tracker.ceph.com/issues/48640
527 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
528 21 Jos Collin
529 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
530
531
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
532
533
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
534
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
535
536
* https://tracker.ceph.com/issues/45434
537
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
538
* https://tracker.ceph.com/issues/50260
539
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
540
* https://tracker.ceph.com/issues/51183
541
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
542
543
544 16 Jeff Layton
h3. 2021 June 28
545
546
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
547
548
* https://tracker.ceph.com/issues/45434
549
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
550
* https://tracker.ceph.com/issues/51440
551 17 Jeff Layton
    fallocate fails with EACCES
552 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
553
    TestVolumeClient failure
554
* https://tracker.ceph.com/issues/51266
555
    test cleanup failure
556
* https://tracker.ceph.com/issues/51183
557
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
558
559 12 Jeff Layton
h3. 2021 June 14
560
561
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
562
 
563
* https://tracker.ceph.com/issues/45434
564
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
565
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
566
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
567
* https://tracker.ceph.com/issues/51263
568
    pjdfstest rename test 10.t failed with EACCES
569
* https://tracker.ceph.com/issues/51264
570
    TestVolumeClient failure
571 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
572
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
573 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
574
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
575 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
576
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
577 11 Patrick Donnelly
578
h3. 2021 June 07 (Integration Branch)
579
580
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
581
582
* https://tracker.ceph.com/issues/45434
583
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
584
* https://tracker.ceph.com/issues/50279
585
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
586
* https://tracker.ceph.com/issues/48773
587
    qa: scrub does not complete
588
* https://tracker.ceph.com/issues/51170
589
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
590
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
591
    qa: quota failure
592
593
594 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
595
596
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
597
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
598
599
* https://tracker.ceph.com/issues/45434
600
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
601
* https://tracker.ceph.com/issues/50258
602
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
603
* https://tracker.ceph.com/issues/50260
604
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
605
* https://tracker.ceph.com/issues/49962
606
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
607
* https://tracker.ceph.com/issues/50016
608
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
609
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
610
    qa: quota failure
611
* https://tracker.ceph.com/issues/50528
612
    pacific: qa: fs:thrash: pjd suite not ok 20
613
614
615 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
616
617
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
618
619
* https://tracker.ceph.com/issues/50527
620
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
621
* https://tracker.ceph.com/issues/50528
622
    pacific: qa: fs:thrash: pjd suite not ok 20
623
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
624
    qa: "Assertion `cb_done' failed."
625
* https://tracker.ceph.com/issues/49500
626
    qa: "Assertion `cb_done' failed."
627
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
628
    qa: quota failure
629
* https://tracker.ceph.com/issues/45434
630
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
631
* https://tracker.ceph.com/issues/50279
632
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
633
* https://tracker.ceph.com/issues/50258
634
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
635
* https://tracker.ceph.com/issues/49962
636
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
637
* https://tracker.ceph.com/issues/49962
638
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
639
* https://tracker.ceph.com/issues/50530
640
    pacific: client: abort after MDS blocklist
641
642 2 Patrick Donnelly
643
h3. 2021 Apr 21 (Integration Branch)
644
645
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
646
647
* https://tracker.ceph.com/issues/45434
648
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
649
* https://tracker.ceph.com/issues/50250
650
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
651
* https://tracker.ceph.com/issues/50258
652
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
653
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
654
    qa: quota failure
655
* https://tracker.ceph.com/issues/50016
656
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
657
* https://tracker.ceph.com/issues/50495
658
    pacific: client: shutdown race fails with status 141
659
660
661 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
662
663
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
664
665
* https://tracker.ceph.com/issues/45434
666
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
667
* https://tracker.ceph.com/issues/48805
668
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
669
* https://tracker.ceph.com/issues/49500
670
    qa: "Assertion `cb_done' failed."
671
* https://tracker.ceph.com/issues/50258 (new)
672
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
673
* https://tracker.ceph.com/issues/49962
674
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
675
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
676
    qa: quota failure
677
* https://tracker.ceph.com/issues/50260
678
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
679
* https://tracker.ceph.com/issues/50016
680
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"