Project

General

Profile

Pacific » History » Version 84

Venky Shankar, 12/08/2022 02:36 PM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 81 Venky Shankar
* Dec: Venky
6
* Jan: Patrick
7
* Feb: Jos
8 79 Venky Shankar
* Mar: Xiubo
9
* Apr: Rishabh
10
* May: Kotresh
11 81 Venky Shankar
* Jun: Milind
12
13 38 Ramana Raja
14 1 Patrick Donnelly
h2. Reviews
15 40 Ramana Raja
16 84 Venky Shankar
h3. 2022 Dec 07
17
18
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
19
20
many transient git.ceph.com related timeouts
21
22
* https://tracker.ceph.com/issues/52624
23
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
24
* https://tracker.ceph.com/issues/50224
25
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
26
* https://tracker.ceph.com/issues/56644
27
    qa: test_rapid_creation fails with "No space left on device"
28
* https://tracker.ceph.com/issues/58221
29
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
30
31 83 Venky Shankar
h3. 2022 Dec 02
32
33
many transient git.ceph.com related timeouts
34
many transient 'Failed to connect to the host via ssh' failures
35
36
* https://tracker.ceph.com/issues/57723
37
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
38
* https://tracker.ceph.com/issues/52624
39
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
40
41 82 Venky Shankar
h3. 2022 Dec 01
42
43
many transient git.ceph.com related timeouts
44
45
* https://tracker.ceph.com/issues/57723
46
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
47
* https://tracker.ceph.com/issues/52624
48
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
49
50 80 Patrick Donnelly
h3. 2022 Nov 18
51
52
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
53
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
54
55
2 ansible dead failures.
56
12 transient git.ceph.com related timeouts
57
58
* https://tracker.ceph.com/issues/57723
59
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
60
* https://tracker.ceph.com/issues/52624
61
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
62
63 78 Milind Changire
h3. 2022 Oct 19
64
65
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
66
67
* https://tracker.ceph.com/issues/57723
68
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
69
* https://tracker.ceph.com/issues/52624
70
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
71
* https://tracker.ceph.com/issues/56644
72
  qa: test_rapid_creation fails with "No space left on device"
73
* https://tracker.ceph.com/issues/54460
74
  snaptest-multiple-capsnaps.sh test failure
75
* https://tracker.ceph.com/issues/57892
76
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
77
78
79
80 76 Venky Shankar
h3. 2022 Oct 06
81
82
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
83
84
* https://tracker.ceph.com/issues/52624
85
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
86
* https://tracker.ceph.com/issues/50223
87
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
88 77 Milind Changire
* https://tracker.ceph.com/issues/56507
89
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
90 76 Venky Shankar
91 75 Venky Shankar
h3. 2022 Sep 27
92
93
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
94
95
* https://tracker.ceph.com/issues/52624
96
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
97
* https://tracker.ceph.com/issues/48773
98
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
99
* https://tracker.ceph.com/issues/50224
100
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
101
* https://tracker.ceph.com/issues/56507
102
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
103
* https://tracker.ceph.com/issues/50223
104
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
105
106 74 Venky Shankar
h3. 2022 Sep 22
107
108
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
109
110
* https://tracker.ceph.com/issues/52624
111
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
112
* https://tracker.ceph.com/issues/51282
113
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
114
* https://tracker.ceph.com/issues/53360
115
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
116
117 73 Venky Shankar
h3. 2022 Sep 19
118
119
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
120
121
* https://tracker.ceph.com/issues/52624
122
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
123
* https://tracker.ceph.com/issues/57594
124
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
125
126 71 Venky Shankar
h3. 2022 Sep 15
127
128
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
129
130
* https://tracker.ceph.com/issues/51282
131
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
132
* https://tracker.ceph.com/issues/52624
133
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
134
* https://tracker.ceph.com/issues/53360
135
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
136 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
137
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
138 71 Venky Shankar
139 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
140
141
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
142
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
143
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
144
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
145
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
146
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
147
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
148
149
150
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
151
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
152
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
153
154
155 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
156
157
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
158
* Most of the failures are passed in re-run. Please check rerun failures below.
159
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
160
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
161
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
162
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
163
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
164
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
165
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
166
167
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
168
* https://tracker.ceph.com/issues/52624
169
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
170
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
171
* https://tracker.ceph.com/issues/57083
172
* https://tracker.ceph.com/issues/53360
173
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
174
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
175
* https://tracker.ceph.com/issues/51183
176
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
177
* https://tracker.ceph.com/issues/56507
178
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
179
180 68 Kotresh Hiremath Ravishankar
181
h3. 2022 AUG 04
182
183
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
184
185
* https://tracker.ceph.com/issues/57087
186
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
187
* https://tracker.ceph.com/issues/52624
188
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
189
* https://tracker.ceph.com/issues/51267
190
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
191
* https://tracker.ceph.com/issues/53360
192
* https://tracker.ceph.com/issues/57083
193
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
194
* https://tracker.ceph.com/issues/56507
195
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
196
197
198 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
199
200
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
201
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
202
203
* https://tracker.ceph.com/issues/52624
204
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
205
* https://tracker.ceph.com/issues/57083
206
* https://tracker.ceph.com/issues/53360
207
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
208
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
209
* https://tracker.ceph.com/issues/51183
210
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
211
* https://tracker.ceph.com/issues/56507
212
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
213
214
215 66 Venky Shankar
h3. 2022 July 08
216
217
* https://tracker.ceph.com/issues/52624
218
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
219
* https://tracker.ceph.com/issues/53360
220
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
221
* https://tracker.ceph.com/issues/51183
222
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
223
* https://tracker.ceph.com/issues/56506
224
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
225
* https://tracker.ceph.com/issues/56507
226
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
227
228 65 Venky Shankar
h3. 2022 Jun 28
229
230
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
231
232
* https://tracker.ceph.com/issues/52624
233
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
234
* https://tracker.ceph.com/issues/53360
235
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
236
* https://tracker.ceph.com/issues/51183
237
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
238
239 64 Venky Shankar
h3. 2022 Jun 22
240
241
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
242
243
* https://tracker.ceph.com/issues/52624
244
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
245
* https://tracker.ceph.com/issues/53360
246
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
247
* https://tracker.ceph.com/issues/51183
248
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
249
250 63 Venky Shankar
h3. 2022 Jun 17
251
252
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
253
254
* https://tracker.ceph.com/issues/52624
255
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
256
* https://tracker.ceph.com/issues/53360
257
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
258
* https://tracker.ceph.com/issues/51183
259
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
260
261 62 Venky Shankar
h3. 2022 Jun 16
262
263
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
264
265
* https://tracker.ceph.com/issues/52624
266
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
267
* https://tracker.ceph.com/issues/53360
268
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
269
* https://tracker.ceph.com/issues/55449
270
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
271
* https://tracker.ceph.com/issues/51267
272
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
273
* https://tracker.ceph.com/issues/55332
274
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
275
276 61 Venky Shankar
h3. 2022 Jun 15
277
278
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
279
280
* https://tracker.ceph.com/issues/52624
281
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
282
* https://tracker.ceph.com/issues/53360
283
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
284
* https://tracker.ceph.com/issues/55449
285
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
286
287
288 60 Venky Shankar
h3. 2022 Jun 10
289
290
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
291
292
* https://tracker.ceph.com/issues/52624
293
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
294
* https://tracker.ceph.com/issues/53360
295
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
296
* https://tracker.ceph.com/issues/55449
297
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
298
299 59 Venky Shankar
h3. 2022 Jun 09
300
301
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
302
303
* https://tracker.ceph.com/issues/52624
304
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
305
* https://tracker.ceph.com/issues/53360
306
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
307
* https://tracker.ceph.com/issues/55449
308
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
309
310 58 Venky Shankar
h3. 2022 May 06
311
312
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
313
314
* https://tracker.ceph.com/issues/52624
315
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
316
* https://tracker.ceph.com/issues/53360
317
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
318
319 57 Venky Shankar
h3. 2022 April 18
320
321
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
322
(only mgr/snap_schedule backport pr)
323
324
* https://tracker.ceph.com/issues/52624
325
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
326 56 Venky Shankar
327
h3. 2022 March 28
328
329
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
330
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
331
332
* https://tracker.ceph.com/issues/52624
333
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
334
* https://tracker.ceph.com/issues/53360
335
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
336
* https://tracker.ceph.com/issues/54411
337
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
338
	33 daemons have recently crashed" during suites/fsstress.sh
339
340 55 Venky Shankar
h3. 2022 March 25
341
342
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
343
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
344
345
* https://tracker.ceph.com/issues/52624
346
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
347
* https://tracker.ceph.com/issues/52606
348
        qa: test_dirfrag_limit
349
* https://tracker.ceph.com/issues/51905
350
        qa: "error reading sessionmap 'mds1_sessionmap'"
351
* https://tracker.ceph.com/issues/53360
352
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
353
* https://tracker.ceph.com/issues/51183
354
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
355 47 Patrick Donnelly
356 54 Venky Shankar
h3. 2022 March 22
357
358
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
359
360
* https://tracker.ceph.com/issues/52624
361
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
362
* https://tracker.ceph.com/issues/52606
363
        qa: test_dirfrag_limit
364
* https://tracker.ceph.com/issues/51183
365
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
366
* https://tracker.ceph.com/issues/51905
367
        qa: "error reading sessionmap 'mds1_sessionmap'"
368
* https://tracker.ceph.com/issues/53360
369
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
370
* https://tracker.ceph.com/issues/54411
371
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
372
	33 daemons have recently crashed" during suites/fsstress.sh
373 47 Patrick Donnelly
374 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
375
376
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
377
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
378
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
379
380
381
* https://tracker.ceph.com/issues/53300
382
	qa: cluster [WRN] Scrub error on inode
383
* https://tracker.ceph.com/issues/53302
384
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
385
* https://tracker.ceph.com/issues/53314
386
	qa: fs/upgrade/mds_upgrade_sequence test timeout
387
* https://tracker.ceph.com/issues/53316
388
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
389
* https://tracker.ceph.com/issues/52624
390
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
391
* https://tracker.ceph.com/issues/52396
392
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
393
* https://tracker.ceph.com/issues/52875
394
	pacific: qa: test_dirfrag_limit
395
* https://tracker.ceph.com/issues/51705
396 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
397
* https://tracker.ceph.com/issues/39634
398
	qa: test_full_same_file timeout
399 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
400
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
401 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
402
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
403 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
404
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
405 48 Kotresh Hiremath Ravishankar
406 47 Patrick Donnelly
407
h3. 2021 November 20
408
409
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
410
411
* https://tracker.ceph.com/issues/53360
412
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
413 46 Kotresh Hiremath Ravishankar
414 41 Patrick Donnelly
h3. 2021 September 14 (QE)
415
416
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
417 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
418 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
419 41 Patrick Donnelly
420
* https://tracker.ceph.com/issues/52606
421
    qa: test_dirfrag_limit
422
* https://tracker.ceph.com/issues/52607
423
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
424 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
425
    qa: tasks.cephfs.fuse_mount:mount command failed
426 41 Patrick Donnelly
427 40 Ramana Raja
h3. 2021 Sep 7
428
429
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
430
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
431
432
433
* https://tracker.ceph.com/issues/52396
434
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
435
* https://tracker.ceph.com/issues/51705
436
    qa: tasks.cephfs.fuse_mount:mount command failed
437 4 Patrick Donnelly
438 34 Ramana Raja
h3. 2021 Aug 30
439
440
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
441
442
* https://tracker.ceph.com/issues/45434
443
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
444
* https://tracker.ceph.com/issues/51705
445
    qa: tasks.cephfs.fuse_mount:mount command failed
446
* https://tracker.ceph.com/issues/52396
447
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
448 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
449 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
450
* https://tracker.ceph.com/issues/51267
451 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
452
* https://tracker.ceph.com/issues/48772
453
   qa: pjd: not ok 9, 44, 80
454 35 Ramana Raja
455 34 Ramana Raja
456 31 Ramana Raja
h3. 2021 Aug 23
457
458
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
459
460
* https://tracker.ceph.com/issues/45434
461
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
462
* https://tracker.ceph.com/issues/51705
463
    qa: tasks.cephfs.fuse_mount:mount command failed
464 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
465 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
466
* https://tracker.ceph.com/issues/52397
467
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
468
469 31 Ramana Raja
470 29 Ramana Raja
h3. 2021 Aug 11
471
472
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
473
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
474
475
* https://tracker.ceph.com/issues/45434
476
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
477
* https://tracker.ceph.com/issues/51705
478
    qa: tasks.cephfs.fuse_mount:mount command failed
479 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
480
    osd: 5.2s0 deep-scrub : stat mismatch
481 29 Ramana Raja
482 19 Jos Collin
h3. 2021 July 15
483 20 Jos Collin
484 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
485
486 26 Jos Collin
* https://tracker.ceph.com/issues/45434
487
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
488
* https://tracker.ceph.com/issues/51705
489
    qa: tasks.cephfs.fuse_mount:mount command failed
490 27 Jos Collin
* https://tracker.ceph.com/issues/51183
491
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
492 28 Jos Collin
* https://tracker.ceph.com/issues/50528
493
    qa: fs:thrash: pjd suite not ok 80
494
* https://tracker.ceph.com/issues/51706
495
    qa: osd deep-scrub stat mismatch
496 26 Jos Collin
497 19 Jos Collin
h3. 2021 July 13
498 20 Jos Collin
499 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
500
501 21 Jos Collin
* https://tracker.ceph.com/issues/51704
502
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
503 23 Jos Collin
* https://tracker.ceph.com/issues/45434
504
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
505 24 Jos Collin
* https://tracker.ceph.com/issues/51705
506 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
507
* https://tracker.ceph.com/issues/48640
508 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
509 21 Jos Collin
510 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
511
512
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
513
514
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
515
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
516
517
* https://tracker.ceph.com/issues/45434
518
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
519
* https://tracker.ceph.com/issues/50260
520
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
521
* https://tracker.ceph.com/issues/51183
522
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
523
524
525 16 Jeff Layton
h3. 2021 June 28
526
527
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
528
529
* https://tracker.ceph.com/issues/45434
530
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
531
* https://tracker.ceph.com/issues/51440
532 17 Jeff Layton
    fallocate fails with EACCES
533 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
534
    TestVolumeClient failure
535
* https://tracker.ceph.com/issues/51266
536
    test cleanup failure
537
* https://tracker.ceph.com/issues/51183
538
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
539
540 12 Jeff Layton
h3. 2021 June 14
541
542
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
543
 
544
* https://tracker.ceph.com/issues/45434
545
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
546
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
547
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
548
* https://tracker.ceph.com/issues/51263
549
    pjdfstest rename test 10.t failed with EACCES
550
* https://tracker.ceph.com/issues/51264
551
    TestVolumeClient failure
552 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
553
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
554 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
555
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
556 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
557
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
558 11 Patrick Donnelly
559
h3. 2021 June 07 (Integration Branch)
560
561
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
562
563
* https://tracker.ceph.com/issues/45434
564
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
565
* https://tracker.ceph.com/issues/50279
566
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
567
* https://tracker.ceph.com/issues/48773
568
    qa: scrub does not complete
569
* https://tracker.ceph.com/issues/51170
570
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
571
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
572
    qa: quota failure
573
574
575 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
576
577
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
578
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
579
580
* https://tracker.ceph.com/issues/45434
581
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
582
* https://tracker.ceph.com/issues/50258
583
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
584
* https://tracker.ceph.com/issues/50260
585
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
586
* https://tracker.ceph.com/issues/49962
587
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
588
* https://tracker.ceph.com/issues/50016
589
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
590
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
591
    qa: quota failure
592
* https://tracker.ceph.com/issues/50528
593
    pacific: qa: fs:thrash: pjd suite not ok 20
594
595
596 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
597
598
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
599
600
* https://tracker.ceph.com/issues/50527
601
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
602
* https://tracker.ceph.com/issues/50528
603
    pacific: qa: fs:thrash: pjd suite not ok 20
604
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
605
    qa: "Assertion `cb_done' failed."
606
* https://tracker.ceph.com/issues/49500
607
    qa: "Assertion `cb_done' failed."
608
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
609
    qa: quota failure
610
* https://tracker.ceph.com/issues/45434
611
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
612
* https://tracker.ceph.com/issues/50279
613
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
614
* https://tracker.ceph.com/issues/50258
615
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
616
* https://tracker.ceph.com/issues/49962
617
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
618
* https://tracker.ceph.com/issues/49962
619
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
620
* https://tracker.ceph.com/issues/50530
621
    pacific: client: abort after MDS blocklist
622
623 2 Patrick Donnelly
624
h3. 2021 Apr 21 (Integration Branch)
625
626
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
627
628
* https://tracker.ceph.com/issues/45434
629
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
630
* https://tracker.ceph.com/issues/50250
631
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
632
* https://tracker.ceph.com/issues/50258
633
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
634
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
635
    qa: quota failure
636
* https://tracker.ceph.com/issues/50016
637
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
638
* https://tracker.ceph.com/issues/50495
639
    pacific: client: shutdown race fails with status 141
640
641
642 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
643
644
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
645
646
* https://tracker.ceph.com/issues/45434
647
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
648
* https://tracker.ceph.com/issues/48805
649
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
650
* https://tracker.ceph.com/issues/49500
651
    qa: "Assertion `cb_done' failed."
652
* https://tracker.ceph.com/issues/50258 (new)
653
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
654
* https://tracker.ceph.com/issues/49962
655
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
656
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
657
    qa: quota failure
658
* https://tracker.ceph.com/issues/50260
659
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
660
* https://tracker.ceph.com/issues/50016
661
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"