Project

General

Profile

Pacific » History » Version 82

Venky Shankar, 12/06/2022 10:52 AM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 81 Venky Shankar
* Dec: Venky
6
* Jan: Patrick
7
* Feb: Jos
8 79 Venky Shankar
* Mar: Xiubo
9
* Apr: Rishabh
10
* May: Kotresh
11 81 Venky Shankar
* Jun: Milind
12
13 38 Ramana Raja
14 1 Patrick Donnelly
h2. Reviews
15 40 Ramana Raja
16 82 Venky Shankar
h3. 2022 Dec 01
17
18
many transient git.ceph.com related timeouts
19
20
* https://tracker.ceph.com/issues/57723
21
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
22
* https://tracker.ceph.com/issues/52624
23
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
24
25 80 Patrick Donnelly
h3. 2022 Nov 18
26
27
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
28
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
29
30
2 ansible dead failures.
31
12 transient git.ceph.com related timeouts
32
33
* https://tracker.ceph.com/issues/57723
34
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
35
* https://tracker.ceph.com/issues/52624
36
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
37
38 78 Milind Changire
h3. 2022 Oct 19
39
40
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
41
42
* https://tracker.ceph.com/issues/57723
43
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
44
* https://tracker.ceph.com/issues/52624
45
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
46
* https://tracker.ceph.com/issues/56644
47
  qa: test_rapid_creation fails with "No space left on device"
48
* https://tracker.ceph.com/issues/54460
49
  snaptest-multiple-capsnaps.sh test failure
50
* https://tracker.ceph.com/issues/57892
51
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
52
53
54
55 76 Venky Shankar
h3. 2022 Oct 06
56
57
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
58
59
* https://tracker.ceph.com/issues/52624
60
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
61
* https://tracker.ceph.com/issues/50223
62
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
63 77 Milind Changire
* https://tracker.ceph.com/issues/56507
64
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
65 76 Venky Shankar
66 75 Venky Shankar
h3. 2022 Sep 27
67
68
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
69
70
* https://tracker.ceph.com/issues/52624
71
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
72
* https://tracker.ceph.com/issues/48773
73
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
74
* https://tracker.ceph.com/issues/50224
75
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
76
* https://tracker.ceph.com/issues/56507
77
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
78
* https://tracker.ceph.com/issues/50223
79
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
80
81 74 Venky Shankar
h3. 2022 Sep 22
82
83
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
84
85
* https://tracker.ceph.com/issues/52624
86
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
87
* https://tracker.ceph.com/issues/51282
88
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
89
* https://tracker.ceph.com/issues/53360
90
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
91
92 73 Venky Shankar
h3. 2022 Sep 19
93
94
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
95
96
* https://tracker.ceph.com/issues/52624
97
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
98
* https://tracker.ceph.com/issues/57594
99
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
100
101 71 Venky Shankar
h3. 2022 Sep 15
102
103
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
104
105
* https://tracker.ceph.com/issues/51282
106
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
107
* https://tracker.ceph.com/issues/52624
108
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
109
* https://tracker.ceph.com/issues/53360
110
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
111 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
112
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
113 71 Venky Shankar
114 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
115
116
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
117
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
118
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
119
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
120
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
121
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
122
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
123
124
125
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
126
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
127
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
128
129
130 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
131
132
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
133
* Most of the failures are passed in re-run. Please check rerun failures below.
134
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
135
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
136
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
137
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
138
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
139
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
140
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
141
142
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
143
* https://tracker.ceph.com/issues/52624
144
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
145
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
146
* https://tracker.ceph.com/issues/57083
147
* https://tracker.ceph.com/issues/53360
148
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
149
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
150
* https://tracker.ceph.com/issues/51183
151
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
152
* https://tracker.ceph.com/issues/56507
153
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
154
155 68 Kotresh Hiremath Ravishankar
156
h3. 2022 AUG 04
157
158
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
159
160
* https://tracker.ceph.com/issues/57087
161
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
162
* https://tracker.ceph.com/issues/52624
163
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
164
* https://tracker.ceph.com/issues/51267
165
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
166
* https://tracker.ceph.com/issues/53360
167
* https://tracker.ceph.com/issues/57083
168
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
169
* https://tracker.ceph.com/issues/56507
170
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
171
172
173 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
174
175
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
176
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
177
178
* https://tracker.ceph.com/issues/52624
179
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
180
* https://tracker.ceph.com/issues/57083
181
* https://tracker.ceph.com/issues/53360
182
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
183
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
184
* https://tracker.ceph.com/issues/51183
185
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
186
* https://tracker.ceph.com/issues/56507
187
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
188
189
190 66 Venky Shankar
h3. 2022 July 08
191
192
* https://tracker.ceph.com/issues/52624
193
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
194
* https://tracker.ceph.com/issues/53360
195
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
196
* https://tracker.ceph.com/issues/51183
197
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
198
* https://tracker.ceph.com/issues/56506
199
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
200
* https://tracker.ceph.com/issues/56507
201
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
202
203 65 Venky Shankar
h3. 2022 Jun 28
204
205
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
206
207
* https://tracker.ceph.com/issues/52624
208
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
209
* https://tracker.ceph.com/issues/53360
210
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
211
* https://tracker.ceph.com/issues/51183
212
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
213
214 64 Venky Shankar
h3. 2022 Jun 22
215
216
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
217
218
* https://tracker.ceph.com/issues/52624
219
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
220
* https://tracker.ceph.com/issues/53360
221
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
222
* https://tracker.ceph.com/issues/51183
223
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
224
225 63 Venky Shankar
h3. 2022 Jun 17
226
227
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
228
229
* https://tracker.ceph.com/issues/52624
230
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
231
* https://tracker.ceph.com/issues/53360
232
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
233
* https://tracker.ceph.com/issues/51183
234
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
235
236 62 Venky Shankar
h3. 2022 Jun 16
237
238
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
239
240
* https://tracker.ceph.com/issues/52624
241
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
242
* https://tracker.ceph.com/issues/53360
243
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
244
* https://tracker.ceph.com/issues/55449
245
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
246
* https://tracker.ceph.com/issues/51267
247
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
248
* https://tracker.ceph.com/issues/55332
249
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
250
251 61 Venky Shankar
h3. 2022 Jun 15
252
253
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
254
255
* https://tracker.ceph.com/issues/52624
256
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
257
* https://tracker.ceph.com/issues/53360
258
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
259
* https://tracker.ceph.com/issues/55449
260
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
261
262
263 60 Venky Shankar
h3. 2022 Jun 10
264
265
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
266
267
* https://tracker.ceph.com/issues/52624
268
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
269
* https://tracker.ceph.com/issues/53360
270
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
271
* https://tracker.ceph.com/issues/55449
272
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
273
274 59 Venky Shankar
h3. 2022 Jun 09
275
276
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
277
278
* https://tracker.ceph.com/issues/52624
279
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
280
* https://tracker.ceph.com/issues/53360
281
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
282
* https://tracker.ceph.com/issues/55449
283
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
284
285 58 Venky Shankar
h3. 2022 May 06
286
287
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
288
289
* https://tracker.ceph.com/issues/52624
290
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
291
* https://tracker.ceph.com/issues/53360
292
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
293
294 57 Venky Shankar
h3. 2022 April 18
295
296
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
297
(only mgr/snap_schedule backport pr)
298
299
* https://tracker.ceph.com/issues/52624
300
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
301 56 Venky Shankar
302
h3. 2022 March 28
303
304
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
305
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
306
307
* https://tracker.ceph.com/issues/52624
308
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
309
* https://tracker.ceph.com/issues/53360
310
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
311
* https://tracker.ceph.com/issues/54411
312
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
313
	33 daemons have recently crashed" during suites/fsstress.sh
314
315 55 Venky Shankar
h3. 2022 March 25
316
317
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
318
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
319
320
* https://tracker.ceph.com/issues/52624
321
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
322
* https://tracker.ceph.com/issues/52606
323
        qa: test_dirfrag_limit
324
* https://tracker.ceph.com/issues/51905
325
        qa: "error reading sessionmap 'mds1_sessionmap'"
326
* https://tracker.ceph.com/issues/53360
327
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
328
* https://tracker.ceph.com/issues/51183
329
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
330 47 Patrick Donnelly
331 54 Venky Shankar
h3. 2022 March 22
332
333
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
334
335
* https://tracker.ceph.com/issues/52624
336
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
337
* https://tracker.ceph.com/issues/52606
338
        qa: test_dirfrag_limit
339
* https://tracker.ceph.com/issues/51183
340
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
341
* https://tracker.ceph.com/issues/51905
342
        qa: "error reading sessionmap 'mds1_sessionmap'"
343
* https://tracker.ceph.com/issues/53360
344
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
345
* https://tracker.ceph.com/issues/54411
346
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
347
	33 daemons have recently crashed" during suites/fsstress.sh
348 47 Patrick Donnelly
349 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
350
351
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
352
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
353
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
354
355
356
* https://tracker.ceph.com/issues/53300
357
	qa: cluster [WRN] Scrub error on inode
358
* https://tracker.ceph.com/issues/53302
359
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
360
* https://tracker.ceph.com/issues/53314
361
	qa: fs/upgrade/mds_upgrade_sequence test timeout
362
* https://tracker.ceph.com/issues/53316
363
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
364
* https://tracker.ceph.com/issues/52624
365
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
366
* https://tracker.ceph.com/issues/52396
367
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
368
* https://tracker.ceph.com/issues/52875
369
	pacific: qa: test_dirfrag_limit
370
* https://tracker.ceph.com/issues/51705
371 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
372
* https://tracker.ceph.com/issues/39634
373
	qa: test_full_same_file timeout
374 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
375
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
376 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
377
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
378 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
379
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
380 48 Kotresh Hiremath Ravishankar
381 47 Patrick Donnelly
382
h3. 2021 November 20
383
384
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
385
386
* https://tracker.ceph.com/issues/53360
387
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
388 46 Kotresh Hiremath Ravishankar
389 41 Patrick Donnelly
h3. 2021 September 14 (QE)
390
391
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
392 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
393 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
394 41 Patrick Donnelly
395
* https://tracker.ceph.com/issues/52606
396
    qa: test_dirfrag_limit
397
* https://tracker.ceph.com/issues/52607
398
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
399 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
400
    qa: tasks.cephfs.fuse_mount:mount command failed
401 41 Patrick Donnelly
402 40 Ramana Raja
h3. 2021 Sep 7
403
404
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
405
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
406
407
408
* https://tracker.ceph.com/issues/52396
409
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
410
* https://tracker.ceph.com/issues/51705
411
    qa: tasks.cephfs.fuse_mount:mount command failed
412 4 Patrick Donnelly
413 34 Ramana Raja
h3. 2021 Aug 30
414
415
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
416
417
* https://tracker.ceph.com/issues/45434
418
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
419
* https://tracker.ceph.com/issues/51705
420
    qa: tasks.cephfs.fuse_mount:mount command failed
421
* https://tracker.ceph.com/issues/52396
422
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
423 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
424 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
425
* https://tracker.ceph.com/issues/51267
426 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
427
* https://tracker.ceph.com/issues/48772
428
   qa: pjd: not ok 9, 44, 80
429 35 Ramana Raja
430 34 Ramana Raja
431 31 Ramana Raja
h3. 2021 Aug 23
432
433
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
434
435
* https://tracker.ceph.com/issues/45434
436
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
437
* https://tracker.ceph.com/issues/51705
438
    qa: tasks.cephfs.fuse_mount:mount command failed
439 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
440 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
441
* https://tracker.ceph.com/issues/52397
442
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
443
444 31 Ramana Raja
445 29 Ramana Raja
h3. 2021 Aug 11
446
447
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
448
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
449
450
* https://tracker.ceph.com/issues/45434
451
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
452
* https://tracker.ceph.com/issues/51705
453
    qa: tasks.cephfs.fuse_mount:mount command failed
454 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
455
    osd: 5.2s0 deep-scrub : stat mismatch
456 29 Ramana Raja
457 19 Jos Collin
h3. 2021 July 15
458 20 Jos Collin
459 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
460
461 26 Jos Collin
* https://tracker.ceph.com/issues/45434
462
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
463
* https://tracker.ceph.com/issues/51705
464
    qa: tasks.cephfs.fuse_mount:mount command failed
465 27 Jos Collin
* https://tracker.ceph.com/issues/51183
466
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
467 28 Jos Collin
* https://tracker.ceph.com/issues/50528
468
    qa: fs:thrash: pjd suite not ok 80
469
* https://tracker.ceph.com/issues/51706
470
    qa: osd deep-scrub stat mismatch
471 26 Jos Collin
472 19 Jos Collin
h3. 2021 July 13
473 20 Jos Collin
474 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
475
476 21 Jos Collin
* https://tracker.ceph.com/issues/51704
477
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
478 23 Jos Collin
* https://tracker.ceph.com/issues/45434
479
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
480 24 Jos Collin
* https://tracker.ceph.com/issues/51705
481 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
482
* https://tracker.ceph.com/issues/48640
483 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
484 21 Jos Collin
485 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
486
487
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
488
489
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
490
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
491
492
* https://tracker.ceph.com/issues/45434
493
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
494
* https://tracker.ceph.com/issues/50260
495
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
496
* https://tracker.ceph.com/issues/51183
497
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
498
499
500 16 Jeff Layton
h3. 2021 June 28
501
502
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
503
504
* https://tracker.ceph.com/issues/45434
505
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
506
* https://tracker.ceph.com/issues/51440
507 17 Jeff Layton
    fallocate fails with EACCES
508 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
509
    TestVolumeClient failure
510
* https://tracker.ceph.com/issues/51266
511
    test cleanup failure
512
* https://tracker.ceph.com/issues/51183
513
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
514
515 12 Jeff Layton
h3. 2021 June 14
516
517
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
518
 
519
* https://tracker.ceph.com/issues/45434
520
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
521
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
522
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
523
* https://tracker.ceph.com/issues/51263
524
    pjdfstest rename test 10.t failed with EACCES
525
* https://tracker.ceph.com/issues/51264
526
    TestVolumeClient failure
527 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
528
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
529 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
530
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
531 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
532
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
533 11 Patrick Donnelly
534
h3. 2021 June 07 (Integration Branch)
535
536
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
537
538
* https://tracker.ceph.com/issues/45434
539
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
540
* https://tracker.ceph.com/issues/50279
541
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
542
* https://tracker.ceph.com/issues/48773
543
    qa: scrub does not complete
544
* https://tracker.ceph.com/issues/51170
545
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
546
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
547
    qa: quota failure
548
549
550 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
551
552
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
553
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
554
555
* https://tracker.ceph.com/issues/45434
556
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
557
* https://tracker.ceph.com/issues/50258
558
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
559
* https://tracker.ceph.com/issues/50260
560
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
561
* https://tracker.ceph.com/issues/49962
562
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
563
* https://tracker.ceph.com/issues/50016
564
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
565
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
566
    qa: quota failure
567
* https://tracker.ceph.com/issues/50528
568
    pacific: qa: fs:thrash: pjd suite not ok 20
569
570
571 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
572
573
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
574
575
* https://tracker.ceph.com/issues/50527
576
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
577
* https://tracker.ceph.com/issues/50528
578
    pacific: qa: fs:thrash: pjd suite not ok 20
579
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
580
    qa: "Assertion `cb_done' failed."
581
* https://tracker.ceph.com/issues/49500
582
    qa: "Assertion `cb_done' failed."
583
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
584
    qa: quota failure
585
* https://tracker.ceph.com/issues/45434
586
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
587
* https://tracker.ceph.com/issues/50279
588
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
589
* https://tracker.ceph.com/issues/50258
590
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
591
* https://tracker.ceph.com/issues/49962
592
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
593
* https://tracker.ceph.com/issues/49962
594
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
595
* https://tracker.ceph.com/issues/50530
596
    pacific: client: abort after MDS blocklist
597
598 2 Patrick Donnelly
599
h3. 2021 Apr 21 (Integration Branch)
600
601
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
602
603
* https://tracker.ceph.com/issues/45434
604
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
605
* https://tracker.ceph.com/issues/50250
606
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
607
* https://tracker.ceph.com/issues/50258
608
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
609
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
610
    qa: quota failure
611
* https://tracker.ceph.com/issues/50016
612
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
613
* https://tracker.ceph.com/issues/50495
614
    pacific: client: shutdown race fails with status 141
615
616
617 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
618
619
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
620
621
* https://tracker.ceph.com/issues/45434
622
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
623
* https://tracker.ceph.com/issues/48805
624
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
625
* https://tracker.ceph.com/issues/49500
626
    qa: "Assertion `cb_done' failed."
627
* https://tracker.ceph.com/issues/50258 (new)
628
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
629
* https://tracker.ceph.com/issues/49962
630
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
631
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
632
    qa: quota failure
633
* https://tracker.ceph.com/issues/50260
634
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
635
* https://tracker.ceph.com/issues/50016
636
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"