Project

General

Profile

Pacific » History » Version 88

Rishabh Dave, 05/04/2023 10:52 AM

1 1 Patrick Donnelly
h1. Pacific
2
3 4 Patrick Donnelly
h2. On-call Schedule
4
5 81 Venky Shankar
* Dec: Venky
6
* Jan: Patrick
7
* Feb: Jos
8 79 Venky Shankar
* Mar: Xiubo
9
* Apr: Rishabh
10
* May: Kotresh
11 81 Venky Shankar
* Jun: Milind
12
13 1 Patrick Donnelly
h2. Reviews
14 85 Rishabh Dave
15 87 Rishabh Dave
h3. NEW ENTRY
16
17 88 Rishabh Dave
h3. 2023 May 4
18
19
https://pulpito.ceph.com/yuriw-2023-04-25_19:03:49-fs-wip-yuri5-testing-2023-04-25-0837-pacific-distro-default-smithi/
20
21
* https://tracker.ceph.com/issues/57676
22
  qa: error during scrub thrashing: rank damage found: {'backtrace'}
23
* https://tracker.ceph.com/issues/58340
24
  fsstress.sh failed with errno 124
25
* https://tracker.ceph.com/issues/58992
26
  test_acls
27
* https://tracker.ceph.com/issues/48773
28
  Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
29
30
31 86 Rishabh Dave
h3. 2023 Apr 13
32
33
https://pulpito.ceph.com/yuriw-2023-04-04_15:06:57-fs-wip-yuri8-testing-2023-03-31-0812-pacific-distro-default-smithi/
34
35
https://tracker.ceph.com/issues/52624
36
cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
37
* https://tracker.ceph.com/issues/57594
38
  Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
39
* https://tracker.ceph.com/issues/54108
40
  qa: iogen workunit: "The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'}" 
41
* https://tracker.ceph.com/issues/58340
42
  fsstress.sh failed with errno 125
43
* https://tracker.ceph.com/issues/54462
44
  Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi055 with status 128
45
* https://tracker.ceph.com/issues/49287     
46
  cephadm: podman: setting cgroup config for procHooks process caused: Unit libpod-$hash.scope not found
47
* https://tracker.ceph.com/issues/58726
48
  test_acls: expected a yum based or a apt based system
49 40 Ramana Raja
50 84 Venky Shankar
h3. 2022 Dec 07
51
52
https://pulpito.ceph.com/yuriw-2022-12-07_15:45:30-fs-wip-yuri4-testing-2022-12-05-0921-pacific-distro-default-smithi/
53
54
many transient git.ceph.com related timeouts
55
56
* https://tracker.ceph.com/issues/52624
57
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
58
* https://tracker.ceph.com/issues/50224
59
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
60
* https://tracker.ceph.com/issues/56644
61
    qa: test_rapid_creation fails with "No space left on device"
62
* https://tracker.ceph.com/issues/58221
63
    pacific: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
64
65 83 Venky Shankar
h3. 2022 Dec 02
66
67
many transient git.ceph.com related timeouts
68
many transient 'Failed to connect to the host via ssh' failures
69
70
* https://tracker.ceph.com/issues/57723
71
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
72
* https://tracker.ceph.com/issues/52624
73
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
74
75 82 Venky Shankar
h3. 2022 Dec 01
76
77
many transient git.ceph.com related timeouts
78
79
* https://tracker.ceph.com/issues/57723
80
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
81
* https://tracker.ceph.com/issues/52624
82
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
83
84 80 Patrick Donnelly
h3. 2022 Nov 18
85
86
https://trello.com/c/ecysAxl6/1656-wip-yuri-testing-2022-11-18-1500-pacific-old-wip-yuri-testing-2022-10-23-0729-pacific-old-wip-yuri-testing-2022-10-21-0927-pacif
87
https://pulpito.ceph.com/yuriw-2022-11-28_16:28:56-fs-wip-yuri-testing-2022-11-18-1500-pacific-distro-default-smithi/
88
89
2 ansible dead failures.
90
12 transient git.ceph.com related timeouts
91
92
* https://tracker.ceph.com/issues/57723
93
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
94
* https://tracker.ceph.com/issues/52624
95
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
96
97 78 Milind Changire
h3. 2022 Oct 19
98
99
http://pulpito.front.sepia.ceph.com/yuriw-2022-10-10_17:18:40-fs-wip-yuri5-testing-2022-10-10-0837-pacific-distro-default-smithi/
100
101
* https://tracker.ceph.com/issues/57723
102
  pacific: qa: test_subvolume_snapshot_info_if_orphan_clone fails
103
* https://tracker.ceph.com/issues/52624
104
  cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log
105
* https://tracker.ceph.com/issues/56644
106
  qa: test_rapid_creation fails with "No space left on device"
107
* https://tracker.ceph.com/issues/54460
108
  snaptest-multiple-capsnaps.sh test failure
109
* https://tracker.ceph.com/issues/57892
110
  sudo dd of=/home/ubuntu/cephtest/valgrind.supp failure during node setup phase
111
112
113
114 76 Venky Shankar
h3. 2022 Oct 06
115
116
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-21_13:07:25-rados-wip-yuri5-testing-2022-09-20-1347-pacific-distro-default-smithi/
117
118
* https://tracker.ceph.com/issues/52624
119
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
120
* https://tracker.ceph.com/issues/50223
121
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
122 77 Milind Changire
* https://tracker.ceph.com/issues/56507
123
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
124 76 Venky Shankar
125 75 Venky Shankar
h3. 2022 Sep 27
126
127
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-22_22:35:04-fs-wip-yuri2-testing-2022-09-22-1400-pacific-distro-default-smithi/
128
129
* https://tracker.ceph.com/issues/52624
130
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
131
* https://tracker.ceph.com/issues/48773
132
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
133
* https://tracker.ceph.com/issues/50224
134
    test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
135
* https://tracker.ceph.com/issues/56507
136
    Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
137
* https://tracker.ceph.com/issues/50223
138
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
139
140 74 Venky Shankar
h3. 2022 Sep 22
141
142
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri2-testing-2022-09-06-1007-pacific
143
144
* https://tracker.ceph.com/issues/52624
145
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
146
* https://tracker.ceph.com/issues/51282
147
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
148
* https://tracker.ceph.com/issues/53360
149
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
150
151 73 Venky Shankar
h3. 2022 Sep 19
152
153
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-16_19:05:25-fs-wip-yuri11-testing-2022-09-16-0958-pacific-distro-default-smithi/
154
155
* https://tracker.ceph.com/issues/52624
156
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
157
* https://tracker.ceph.com/issues/57594
158
    pacific: Test failure: test_rebuild_moved_dir (tasks.cephfs.test_data_scan.TestDataScan)
159
160 71 Venky Shankar
h3. 2022 Sep 15
161
162
http://pulpito.front.sepia.ceph.com/yuriw-2022-09-13_14:22:44-fs-wip-yuri5-testing-2022-09-09-1109-pacific-distro-default-smithi/
163
164
* https://tracker.ceph.com/issues/51282
165
    cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
166
* https://tracker.ceph.com/issues/52624
167
    cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
168
* https://tracker.ceph.com/issues/53360
169
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
170 72 Venky Shankar
* https://tracker.ceph.com/issues/48773
171
    Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
172 71 Venky Shankar
173 70 Kotresh Hiremath Ravishankar
h3. 2022 AUG 18
174
175
https://pulpito.ceph.com/yuriw-2022-08-18_23:16:33-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
176
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
177
* https://tracker.ceph.com/issues/51267 - tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status
178
* https://tracker.ceph.com/issues/48773 - Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi103 with status 23: 'mkdir -p...' - qa: scrub does not complete
179
* https://tracker.ceph.com/issues/51964 - qa: test_cephfs_mirror_restart_sync_on_blocklist failure
180
* https://tracker.ceph.com/issues/57218 - qa: tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} fails
181
* https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
182
183
184
Re-run1: https://pulpito.ceph.com/yuriw-2022-08-19_21:01:11-fs-wip-yuri10-testing-2022-08-18-1400-pacific-distro-default-smithi/
185
* https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
186
* https://tracker.ceph.com/issues/57219 - mds crashed while running workunit test fs/misc/dirfrag.sh
187
188
189 69 Kotresh Hiremath Ravishankar
h3. 2022 AUG 11
190
191
https://pulpito.ceph.com/yuriw-2022-08-11_16:57:01-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
192
* Most of the failures are passed in re-run. Please check rerun failures below.
193
  - https://tracker.ceph.com/issues/57147 - test_full_fsync (tasks.cephfs.test_full.TestClusterFull) - mds stuck in up:creating state - osd crash
194
  - https://tracker.ceph.com/issues/52624 - cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
195
  - https://tracker.ceph.com/issues/51282 - cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED)" in cluster log
196
  - https://tracker.ceph.com/issues/50224 - test_mirroring_init_failure_with_recovery - (tasks.cephfs.test_mirroring.TestMirroring)
197
  - https://tracker.ceph.com/issues/57083 - https://tracker.ceph.com/issues/53360 - tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 
198
  - https://tracker.ceph.com/issues/51183 - Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
199
  - https://tracker.ceph.com/issues/56507 - Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)   
200
201
Re-run-1: https://pulpito.ceph.com/yuriw-2022-08-15_13:45:54-fs-wip-yuri3-testing-2022-08-11-0809-pacific-distro-default-smithi/
202
* https://tracker.ceph.com/issues/52624
203
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
204
* tasks/mirror - Command failed on smithi078 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 ..." - Asked for re-run.
205
* https://tracker.ceph.com/issues/57083
206
* https://tracker.ceph.com/issues/53360
207
  tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
208
  client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
209
* https://tracker.ceph.com/issues/51183
210
  Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
211
* https://tracker.ceph.com/issues/56507
212
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
213
214 68 Kotresh Hiremath Ravishankar
215
h3. 2022 AUG 04
216
217
https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/
218
219
* https://tracker.ceph.com/issues/57087
220
  test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
221
* https://tracker.ceph.com/issues/52624
222
  cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log
223
* https://tracker.ceph.com/issues/51267
224
  tasks/workunit/snaps failure - Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status      
225
* https://tracker.ceph.com/issues/53360
226
* https://tracker.ceph.com/issues/57083
227
  qa/import-legacy tasks.cephfs.fuse_mount:mount command failed - :ModuleNotFoundError: No module named 'ceph_volume_client'
228
* https://tracker.ceph.com/issues/56507
229
  Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
230
231
232 67 Kotresh Hiremath Ravishankar
h3. 2022 July 15
233
234
https://pulpito.ceph.com/yuriw-2022-07-21_22:57:30-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
235
Re-run: https://pulpito.ceph.com/yuriw-2022-07-24_15:34:38-fs-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi
236
237
* https://tracker.ceph.com/issues/52624
238
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
239
* https://tracker.ceph.com/issues/57083
240
* https://tracker.ceph.com/issues/53360
241
        tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} - tasks.cephfs.fuse_mount:mount command failed
242
        client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]" 
243
* https://tracker.ceph.com/issues/51183
244
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
245
* https://tracker.ceph.com/issues/56507
246
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
247
248
249 66 Venky Shankar
h3. 2022 July 08
250
251
* https://tracker.ceph.com/issues/52624
252
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
253
* https://tracker.ceph.com/issues/53360
254
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
255
* https://tracker.ceph.com/issues/51183
256
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
257
* https://tracker.ceph.com/issues/56506
258
        pacific: Test failure: test_rebuild_backtraceless (tasks.cephfs.test_data_scan.TestDataScan)
259
* https://tracker.ceph.com/issues/56507
260
        pacific: Test failure: test_rapid_creation (tasks.cephfs.test_fragment.TestFragmentation)
261
262 65 Venky Shankar
h3. 2022 Jun 28
263
264
https://pulpito.ceph.com/?branch=wip-yuri3-testing-2022-06-22-1121-pacific
265
266
* https://tracker.ceph.com/issues/52624
267
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
268
* https://tracker.ceph.com/issues/53360
269
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
270
* https://tracker.ceph.com/issues/51183
271
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
272
273 64 Venky Shankar
h3. 2022 Jun 22
274
275
https://pulpito.ceph.com/?branch=wip-yuri4-testing-2022-06-21-0704-pacific
276
277
* https://tracker.ceph.com/issues/52624
278
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
279
* https://tracker.ceph.com/issues/53360
280
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
281
* https://tracker.ceph.com/issues/51183
282
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
283
284 63 Venky Shankar
h3. 2022 Jun 17
285
286
https://pulpito.ceph.com/yuriw-2022-06-15_17:11:32-fs-wip-yuri10-testing-2022-06-15-0732-pacific-distro-default-smithi/
287
288
* https://tracker.ceph.com/issues/52624
289
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
290
* https://tracker.ceph.com/issues/53360
291
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
292
* https://tracker.ceph.com/issues/51183
293
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
294
295 62 Venky Shankar
h3. 2022 Jun 16
296
297
https://pulpito.ceph.com/yuriw-2022-06-15_17:08:32-fs-wip-yuri-testing-2022-06-14-0744-pacific-distro-default-smithi/
298
299
* https://tracker.ceph.com/issues/52624
300
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
301
* https://tracker.ceph.com/issues/53360
302
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
303
* https://tracker.ceph.com/issues/55449
304
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
305
* https://tracker.ceph.com/issues/51267
306
        CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1:...
307
* https://tracker.ceph.com/issues/55332
308
        Failure in snaptest-git-ceph.sh (it's an async unlink/create bug)
309
310 61 Venky Shankar
h3. 2022 Jun 15
311
312
http://pulpito.front.sepia.ceph.com/yuriw-2022-06-09_13:32:29-fs-wip-yuri10-testing-2022-06-08-0730-pacific-distro-default-smithi/
313
314
* https://tracker.ceph.com/issues/52624
315
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
316
* https://tracker.ceph.com/issues/53360
317
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
318
* https://tracker.ceph.com/issues/55449
319
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
320
321
322 60 Venky Shankar
h3. 2022 Jun 10
323
324
https://pulpito.ceph.com/?branch=wip-yuri5-testing-2022-06-07-1529-pacific
325
326
* https://tracker.ceph.com/issues/52624
327
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
328
* https://tracker.ceph.com/issues/53360
329
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
330
* https://tracker.ceph.com/issues/55449
331
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
332
333 59 Venky Shankar
h3. 2022 Jun 09
334
335
https://pulpito.ceph.com/yuriw-2022-06-07_16:05:25-fs-wip-yuri4-testing-2022-06-01-1350-pacific-distro-default-smithi/
336
337
* https://tracker.ceph.com/issues/52624
338
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
339
* https://tracker.ceph.com/issues/53360
340
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
341
* https://tracker.ceph.com/issues/55449
342
        pacific: mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available; 33 daemons have recently crashed" during suites/fsstress.sh
343
344 58 Venky Shankar
h3. 2022 May 06
345
346
https://pulpito.ceph.com/?sha1=73636a1b00037ff974bcdc969b009c5ecec626cc
347
348
* https://tracker.ceph.com/issues/52624
349
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
350
* https://tracker.ceph.com/issues/53360
351
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
352
353 57 Venky Shankar
h3. 2022 April 18
354
355
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2022-04-18-0609-pacific
356
(only mgr/snap_schedule backport pr)
357
358
* https://tracker.ceph.com/issues/52624
359
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
360 56 Venky Shankar
361
h3. 2022 March 28
362
363
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-25_20:52:40-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
364
http://pulpito.front.sepia.ceph.com/yuriw-2022-03-26_19:52:48-fs-wip-yuri4-testing-2022-03-25-1203-pacific-distro-default-smithi/
365
366
* https://tracker.ceph.com/issues/52624
367
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
368
* https://tracker.ceph.com/issues/53360
369
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
370
* https://tracker.ceph.com/issues/54411
371
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
372
	33 daemons have recently crashed" during suites/fsstress.sh
373
374 55 Venky Shankar
h3. 2022 March 25
375
376
https://pulpito.ceph.com/yuriw-2022-03-22_18:42:28-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
377
https://pulpito.ceph.com/yuriw-2022-03-23_14:04:56-fs-wip-yuri8-testing-2022-03-22-0910-pacific-distro-default-smithi/
378
379
* https://tracker.ceph.com/issues/52624
380
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
381
* https://tracker.ceph.com/issues/52606
382
        qa: test_dirfrag_limit
383
* https://tracker.ceph.com/issues/51905
384
        qa: "error reading sessionmap 'mds1_sessionmap'"
385
* https://tracker.ceph.com/issues/53360
386
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
387
* https://tracker.ceph.com/issues/51183
388
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
389 47 Patrick Donnelly
390 54 Venky Shankar
h3. 2022 March 22
391
392
https://pulpito.ceph.com/yuriw-2022-03-17_15:03:06-fs-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/
393
394
* https://tracker.ceph.com/issues/52624
395
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
396
* https://tracker.ceph.com/issues/52606
397
        qa: test_dirfrag_limit
398
* https://tracker.ceph.com/issues/51183
399
        Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
400
* https://tracker.ceph.com/issues/51905
401
        qa: "error reading sessionmap 'mds1_sessionmap'"
402
* https://tracker.ceph.com/issues/53360
403
        pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
404
* https://tracker.ceph.com/issues/54411
405
	mds_upgrade_sequence: "overall HEALTH_WARN 4 failed cephadm daemon(s); 1 filesystem is degraded; insufficient standby MDS daemons available;
406
	33 daemons have recently crashed" during suites/fsstress.sh
407 47 Patrick Donnelly
408 46 Kotresh Hiremath Ravishankar
h3. 2021 November 22
409
410
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-12_00:33:28-fs-wip-yuri7-testing-2021-11-11-1339-pacific-distro-basic-smithi
411
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_20:21:11-fs-wip-yuri5-testing-2021-11-08-1003-pacific-distro-basic-smithi
412
http://pulpito.front.sepia.ceph.com/yuriw-2021-11-08_15:19:37-fs-wip-yuri2-testing-2021-11-06-1322-pacific-distro-basic-smithi
413
414
415
* https://tracker.ceph.com/issues/53300
416
	qa: cluster [WRN] Scrub error on inode
417
* https://tracker.ceph.com/issues/53302
418
	qa: sudo logrotate /etc/logrotate.d/ceph-test.conf failed with status 1
419
* https://tracker.ceph.com/issues/53314
420
	qa: fs/upgrade/mds_upgrade_sequence test timeout
421
* https://tracker.ceph.com/issues/53316
422
	qa: (smithi150) slow request osd_op, currently waiting for sub ops warning
423
* https://tracker.ceph.com/issues/52624
424
	qa: "Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)"
425
* https://tracker.ceph.com/issues/52396
426
	pacific: qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
427
* https://tracker.ceph.com/issues/52875
428
	pacific: qa: test_dirfrag_limit
429
* https://tracker.ceph.com/issues/51705
430 1 Patrick Donnelly
	pacific: qa: tasks.cephfs.fuse_mount:mount command failed
431
* https://tracker.ceph.com/issues/39634
432
	qa: test_full_same_file timeout
433 46 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/49748
434
	gibba: Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds
435 48 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/51964
436
	qa: test_cephfs_mirror_restart_sync_on_blocklist failure
437 49 Kotresh Hiremath Ravishankar
* https://tracker.ceph.com/issues/50223
438
	qa: "client.4737 isn't responding to mclientcaps(revoke)"
439 48 Kotresh Hiremath Ravishankar
440 47 Patrick Donnelly
441
h3. 2021 November 20
442
443
https://pulpito.ceph.com/?branch=wip-pdonnell-testing-20211120.024903-pacific
444
445
* https://tracker.ceph.com/issues/53360
446
    pacific: client: "handle_auth_bad_method server allowed_methods [2] but i only support [2]"
447 46 Kotresh Hiremath Ravishankar
448 41 Patrick Donnelly
h3. 2021 September 14 (QE)
449
450
https://pulpito.ceph.com/yuriw-2021-09-10_15:01:12-fs-pacific-distro-basic-smithi/
451 1 Patrick Donnelly
http://pulpito.front.sepia.ceph.com/yuriw-2021-09-13_14:09:59-fs-pacific-distro-basic-smithi/
452 43 Ramana Raja
https://pulpito.ceph.com/yuriw-2021-09-14_15:09:45-fs-pacific-distro-basic-smithi/
453 41 Patrick Donnelly
454
* https://tracker.ceph.com/issues/52606
455
    qa: test_dirfrag_limit
456
* https://tracker.ceph.com/issues/52607
457
    qa: "mon.a (mon.0) 1022 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY)"
458 44 Ramana Raja
* https://tracker.ceph.com/issues/51705
459
    qa: tasks.cephfs.fuse_mount:mount command failed
460 41 Patrick Donnelly
461 40 Ramana Raja
h3. 2021 Sep 7
462
463
https://pulpito.ceph.com/yuriw-2021-09-07_17:38:38-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
464
https://pulpito.ceph.com/yuriw-2021-09-07_23:57:28-fs-wip-yuri-testing-2021-09-07-0905-pacific-distro-basic-smithi/
465
466
467
* https://tracker.ceph.com/issues/52396
468
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
469
* https://tracker.ceph.com/issues/51705
470
    qa: tasks.cephfs.fuse_mount:mount command failed
471 4 Patrick Donnelly
472 34 Ramana Raja
h3. 2021 Aug 30
473
474
https://pulpito.ceph.com/?branch=wip-yuri8-testing-2021-08-30-0930-pacific
475
476
* https://tracker.ceph.com/issues/45434
477
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
478
* https://tracker.ceph.com/issues/51705
479
    qa: tasks.cephfs.fuse_mount:mount command failed
480
* https://tracker.ceph.com/issues/52396
481
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
482 35 Ramana Raja
* https://tracker.ceph.com/issues/52487
483 36 Ramana Raja
    qa: Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)
484
* https://tracker.ceph.com/issues/51267
485 37 Ramana Raja
   Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh)
486
* https://tracker.ceph.com/issues/48772
487
   qa: pjd: not ok 9, 44, 80
488 35 Ramana Raja
489 34 Ramana Raja
490 31 Ramana Raja
h3. 2021 Aug 23
491
492
https://pulpito.ceph.com/yuriw-2021-08-23_19:33:26-fs-wip-yuri4-testing-2021-08-23-0812-pacific-distro-basic-smithi/
493
494
* https://tracker.ceph.com/issues/45434
495
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
496
* https://tracker.ceph.com/issues/51705
497
    qa: tasks.cephfs.fuse_mount:mount command failed
498 32 Ramana Raja
* https://tracker.ceph.com/issues/52396
499 33 Ramana Raja
    qa: ERROR: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable)
500
* https://tracker.ceph.com/issues/52397
501
    qa: test_acls (tasks.cephfs.test_acls.TestACLs) failed
502
503 31 Ramana Raja
504 29 Ramana Raja
h3. 2021 Aug 11
505
506
https://pulpito.ceph.com/yuriw-2021-08-11_14:28:23-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
507
https://pulpito.ceph.com/yuriw-2021-08-12_15:32:35-fs-wip-yuri8-testing-2021-08-09-0844-pacific-distro-basic-smithi/
508
509
* https://tracker.ceph.com/issues/45434
510
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
511
* https://tracker.ceph.com/issues/51705
512
    qa: tasks.cephfs.fuse_mount:mount command failed
513 30 Ramana Raja
* https://tracker.ceph.com/issues/50222
514
    osd: 5.2s0 deep-scrub : stat mismatch
515 29 Ramana Raja
516 19 Jos Collin
h3. 2021 July 15
517 20 Jos Collin
518 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/
519
520 26 Jos Collin
* https://tracker.ceph.com/issues/45434
521
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
522
* https://tracker.ceph.com/issues/51705
523
    qa: tasks.cephfs.fuse_mount:mount command failed
524 27 Jos Collin
* https://tracker.ceph.com/issues/51183
525
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead)
526 28 Jos Collin
* https://tracker.ceph.com/issues/50528
527
    qa: fs:thrash: pjd suite not ok 80
528
* https://tracker.ceph.com/issues/51706
529
    qa: osd deep-scrub stat mismatch
530 26 Jos Collin
531 19 Jos Collin
h3. 2021 July 13
532 20 Jos Collin
533 19 Jos Collin
https://pulpito.ceph.com/yuriw-2021-07-08_23:33:26-fs-wip-yuri2-testing-2021-07-08-1142-pacific-distro-basic-smithi/
534
535 21 Jos Collin
* https://tracker.ceph.com/issues/51704
536
    Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)
537 23 Jos Collin
* https://tracker.ceph.com/issues/45434
538
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
539 24 Jos Collin
* https://tracker.ceph.com/issues/51705
540 25 Jos Collin
    qa: tasks.cephfs.fuse_mount:mount command failed
541
* https://tracker.ceph.com/issues/48640
542 24 Jos Collin
    qa: snapshot mismatch during mds thrashing
543 21 Jos Collin
544 18 Patrick Donnelly
h3. 2021 June 29 (Integration Branch)
545
546
https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/
547
548
Some failures caused by incomplete backup of: https://github.com/ceph/ceph/pull/42065
549
Some package failures caused by nautilus missing package, like: https://pulpito.ceph.com/yuriw-2021-06-29_00:15:33-fs-wip-yuri3-testing-2021-06-28-1259-pacific-distro-basic-smithi/6241300/
550
551
* https://tracker.ceph.com/issues/45434
552
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
553
* https://tracker.ceph.com/issues/50260
554
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
555
* https://tracker.ceph.com/issues/51183
556
    qa: FileNotFoundError: [Errno 2] No such file or directory: '/sys/kernel/debug/ceph/3fab6bea-f243-47a4-a956-8c03a62b61b5.client4721/mds_sessions'
557
558
559 16 Jeff Layton
h3. 2021 June 28
560
561
https://pulpito.ceph.com/yuriw-2021-06-29_00:14:14-fs-wip-yuri-testing-2021-06-28-1259-pacific-distro-basic-smithi/
562
563
* https://tracker.ceph.com/issues/45434
564
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
565
* https://tracker.ceph.com/issues/51440
566 17 Jeff Layton
    fallocate fails with EACCES
567 16 Jeff Layton
* https://tracker.ceph.com/issues/51264
568
    TestVolumeClient failure
569
* https://tracker.ceph.com/issues/51266
570
    test cleanup failure
571
* https://tracker.ceph.com/issues/51183
572
    Test failure: test_flush (tasks.cephfs.test_readahead.TestReadahead) 
573
574 12 Jeff Layton
h3. 2021 June 14
575
576
https://pulpito.ceph.com/yuriw-2021-06-14_16:21:07-fs-wip-yuri2-testing-2021-06-14-0717-pacific-distro-basic-smithi/
577
 
578
* https://tracker.ceph.com/issues/45434
579
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
580
* https://bugzilla.redhat.com/show_bug.cgi?id=1973276
581
    Could not reconnect to ubuntu@smithi076.front.sepia.ceph.com
582
* https://tracker.ceph.com/issues/51263
583
    pjdfstest rename test 10.t failed with EACCES
584
* https://tracker.ceph.com/issues/51264
585
    TestVolumeClient failure
586 13 Jeff Layton
* https://tracker.ceph.com/issues/51266
587
    Command failed on smithi204 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 
588 14 Jeff Layton
* https://tracker.ceph.com/issues/50279
589
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
590 15 Jeff Layton
* https://tracker.ceph.com/issues/51267
591
    Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi096 with status 1
592 11 Patrick Donnelly
593
h3. 2021 June 07 (Integration Branch)
594
595
http://pulpito.front.sepia.ceph.com/?branch=wip-yuri4-testing-2021-06-07-0955-pacific
596
597
* https://tracker.ceph.com/issues/45434
598
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
599
* https://tracker.ceph.com/issues/50279
600
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
601
* https://tracker.ceph.com/issues/48773
602
    qa: scrub does not complete
603
* https://tracker.ceph.com/issues/51170
604
    pacific: qa: AttributeError: 'RemoteProcess' object has no attribute 'split'
605
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
606
    qa: quota failure
607
608
609 6 Patrick Donnelly
h3. 2021 Apr 28 (QE pre-release)
610
611
https://pulpito.ceph.com/yuriw-2021-04-28_19:27:30-fs-pacific-distro-basic-smithi/
612
https://pulpito.ceph.com/yuriw-2021-04-30_13:46:58-fs-pacific-distro-basic-smithi/
613
614
* https://tracker.ceph.com/issues/45434
615
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
616
* https://tracker.ceph.com/issues/50258
617
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
618
* https://tracker.ceph.com/issues/50260
619
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
620
* https://tracker.ceph.com/issues/49962
621
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
622
* https://tracker.ceph.com/issues/50016
623
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
624
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
625
    qa: quota failure
626
* https://tracker.ceph.com/issues/50528
627
    pacific: qa: fs:thrash: pjd suite not ok 20
628
629
630 3 Patrick Donnelly
h3. 2021 Apr 22 (Integration Branch)
631
632
https://pulpito.ceph.com/yuriw-2021-04-22_16:46:11-fs-wip-yuri5-testing-2021-04-20-0819-pacific-distro-basic-smithi/
633
634
* https://tracker.ceph.com/issues/50527
635
    pacific: qa: untar_snap_rm timeout during osd thrashing (ceph-fuse)
636
* https://tracker.ceph.com/issues/50528
637
    pacific: qa: fs:thrash: pjd suite not ok 20
638
* https://tracker.ceph.com/issues/49500 (fixed in another integration run)
639
    qa: "Assertion `cb_done' failed."
640
* https://tracker.ceph.com/issues/49500
641
    qa: "Assertion `cb_done' failed."
642
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
643
    qa: quota failure
644
* https://tracker.ceph.com/issues/45434
645
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
646
* https://tracker.ceph.com/issues/50279
647
    qa: "Replacing daemon mds.b as rank 0 with standby daemon mds.c"
648
* https://tracker.ceph.com/issues/50258
649
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
650
* https://tracker.ceph.com/issues/49962
651
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
652
* https://tracker.ceph.com/issues/49962
653
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
654
* https://tracker.ceph.com/issues/50530
655
    pacific: client: abort after MDS blocklist
656
657 2 Patrick Donnelly
658
h3. 2021 Apr 21 (Integration Branch)
659
660
https://pulpito.ceph.com/yuriw-2021-04-21_19:25:00-fs-wip-yuri3-testing-2021-04-21-0937-pacific-distro-basic-smithi/
661
662
* https://tracker.ceph.com/issues/45434
663
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
664
* https://tracker.ceph.com/issues/50250
665
    mds: "log [WRN] : Scrub error on inode 0x10000004506 (/client.0/tmp/clients/client3/~dmtmp/COREL) see mds.a log and `damage ls` output for details"
666
* https://tracker.ceph.com/issues/50258
667
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
668
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
669
    qa: quota failure
670
* https://tracker.ceph.com/issues/50016
671
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"
672
* https://tracker.ceph.com/issues/50495
673
    pacific: client: shutdown race fails with status 141
674
675
676 1 Patrick Donnelly
h3. 2021 Apr 07 (Integration Branch)
677
678
https://pulpito.ceph.com/yuriw-2021-04-07_17:37:43-fs-wip-yuri-testing-2021-04-07-0905-pacific-distro-basic-smithi/
679
680
* https://tracker.ceph.com/issues/45434
681
    qa: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) failed
682
* https://tracker.ceph.com/issues/48805
683
    mds: "cluster [WRN] Scrub error on inode 0x1000000039d (/client.0/tmp/blogbench-1.0/src/blogtest_in) see mds.a log and `damage ls` output for details"
684
* https://tracker.ceph.com/issues/49500
685
    qa: "Assertion `cb_done' failed."
686
* https://tracker.ceph.com/issues/50258 (new)
687
    pacific: qa: "run() got an unexpected keyword argument 'stdin_data'"
688
* https://tracker.ceph.com/issues/49962
689
    'sudo ceph --cluster ceph osd crush tunables default' fails due to valgrind: Unknown option: --exit-on-first-error=yes
690
* https://tracker.ceph.com/issues/48203 (stock kernel update required)
691
    qa: quota failure
692
* https://tracker.ceph.com/issues/50260
693
    pacific: qa: "rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty"
694
* https://tracker.ceph.com/issues/50016
695
    qa: test_damage: "RuntimeError: 2 mutations had unexpected outcomes"