Project

General

Profile

Actions

Tasks #64151

closed

pacific v16.2.15

Added by Yuri Weinstein 3 months ago. Updated 2 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Tags:
Reviewed:
Affected Versions:
Pull request ID:

Description

Workflow

  • Preparing the release DONE
  • Cutting the release
    • Yuri gets approval from all leads
      • Casey, rgw - DONE
      • Venky, fs - DONE
      • Ilya, Deepika rbd, krbd - DONE
      • Radek, Laura rados - DONE
    • Yuri preps the branch ready for testing - sha1:
      Current SHA1: see in note below
    • Yuri runs additional integration tests - DONE
      • If Yuri discovers new bugs that need to be backported urgently (i.e. their priority is set to Urgent or Immediate), the release goes back to being prepared; it was not ready after all
    • Yuri informs Neha, Josh that the branch is ready for release - DONE
    • Someone creates the packages and sets the release tag - Yuri DONE
    • Someone writes and commits the release notes - Yuri DONE
    • Someone sends out release announcement email - Yuri DONE
    • Someone posts release announcement on https://ceph.com/community/blog - Yuri DONE

Release information

  • branch to build from: pacific, commit:
  • version: v16.2.15
  • type of release: point release
  • where to publish the release: http://download.ceph.com/
Actions #1

Updated by Yuri Weinstein 3 months ago

QE VALIDATION (STARTED 1/25/24)

PRs list => https://pad.ceph.com/p/v16.2.15_QE_PRs_LIST

Release Notes - https://github.com/ceph/ceph/pull/55694
(Release Notes - RERUN NOTES SCRIPT WITH NEW PRs before release)

sepia ceph cluster upgrade - N/A

See details of approvals => https://lists.ceph.io/hyperkitty/list/dev@ceph.io/thread/NBXWJCXSU2TRBZBW5EUKUISZBR2LSBY2/#ZZZQVYBME5DVXA2AYHZ7RUCVHCFZY6PK

re-runs command lines and filters are captured in https://pad.ceph.com/p/v16.2.15_QE_validation_notes

Build 4 == Build 3 (rebased) + https://github.com/ceph/ceph/pull/55658 added (used only for run of ceph-volume)
https://shaman.ceph.com/builds/ceph/pacific-release/eb66ed921e744301e6863be6353618d63967ea59/

Build 3 (rebased)
Build 3 SHA1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1
https://shaman.ceph.com/builds/ceph/pacific-release/81bd20d634209c7cb82c18be12b4b5a05643ebf1/

PRs cherry-picked on top

Build 2 SHA1: 88fb4c6adb4bae6b1cdf34fca7eae2dacb06cc7b
https://shaman.ceph.com/builds/ceph/pacific-release/88fb4c6adb4bae6b1cdf34fca7eae2dacb06cc7b/
(https://github.com/ceph/ceph/pull/53157 merged)

Build 1 SHA1: a72a5dace2353a54147d37bd2699a2a482507966
https://shaman.ceph.com/builds/ceph/pacific-release/a72a5dace2353a54147d37bd2699a2a482507966/

Suite Runs/Reruns Notes/Issues
smoke https://pulpito.ceph.com/yuriw-2024-01-25_16:49:33-smoke-pacific-release-distro-default-smithi PASSED
https://pulpito.ceph.com/yuriw-2024-01-26_16:10:29-smoke-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-02-17_15:55:20-smoke-pacific-release-distro-default-smithi Build 3
rados https://pulpito.ceph.com/yuriw-2024-01-25_17:23:47-rados-pacific-release-distro-default-smithi FAILED
Approved Junior, Laura
Approved for Rook Travis?
Approved for cephadm Adam King
Approved for deshboard Nizamudeen
https://pulpito.ceph.com/yuriw-2024-01-26_16:10:31-rados-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-01-28_20:30:08-rados-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-19_19:25:49-rados-pacific-release-distro-default-smithi
rgw https://pulpito.ceph.com/yuriw-2024-01-25_17:30:29-rgw-pacific-release-distro-default-smithi FAILED Approved Casey
https://pulpito.ceph.com/yuriw-2024-01-26_17:09:47-rgw-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-02-17_16:10:27-rgw-pacific-release-distro-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-19_19:26:58-rgw-pacific-release-distro-default-smithi
rbd https://pulpito.ceph.com/yuriw-2024-01-25_17:27:10-rbd-pacific-release-distro-default-smithi FAILED Approved Ilya #64126
https://pulpito.ceph.com/yuriw-2024-01-26_17:05:20-rbd-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-02-17_16:07:08-rbd-pacific-release-distro-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-19_19:26:12-rbd-pacific-release-distro-default-smithi
krbd https://pulpito.ceph.com/yuriw-2024-01-29_16:19:35-krbd-pacific-release-testing-default-smithi FAILED Approved Ilya
https://pulpito.ceph.com/yuriw-2024-01-30_20:27:25-krbd-pacific-release-testing-default-smithi
https://pulpito.ceph.com/yuriw-2024-01-31_16:17:02-krbd-pacific-release-testing-default-smithi/
https://pulpito.ceph.com/yuriw-2024-02-17_15:56:11-krbd-pacific-release-testing-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-19_19:29:14-krbd-pacific-release-testing-default-smithi
fs https://pulpito.ceph.com/yuriw-2024-01-25_17:24:27-fs-pacific-release-distro-default-smithi FAILED Approved Venky
https://pulpito.ceph.com/yuriw-2024-01-26_16:10:31-fs-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-02-17_16:03:50-fs-pacific-release-distro-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-19_19:27:49-fs-pacific-release-distro-default-smithi
upgrade/nautilus-x (pacific) https://pulpito.ceph.com/yuriw-2024-01-25_17:26:39-upgrade:nautilus-x-pacific-release-distro-default-smithi/ PASSED fixed by https://github.com/ceph/ceph/pull/53157
https://pulpito.ceph.com/yuriw-2024-01-28_20:31:16-upgrade:nautilus-x-pacific-release-distro-default-smithi/
https://pulpito.ceph.com/yuriw-2024-01-31_03:01:02-upgrade:nautilus-x-pacific-release-distro-default-smithi on Build 2 regweed tests seem fixed
https://pulpito.ceph.com/yuriw-2024-01-31_16:12:44-upgrade:nautilus-x-pacific-release-distro-default-smithi/
https://pulpito.ceph.com/yuriw-2024-02-17_17:35:02-upgrade:nautilus-x-pacific-release-distro-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-19_19:29:47-upgrade:nautilus-x-pacific-release-distro-default-smithi
upgrade/octopus-x (pacific) https://pulpito.ceph.com/yuriw-2024-01-25_17:26:02-upgrade:octopus-x-pacific-release-distro-default-smithi FAILED Approved Adam King? #64279
https://pulpito.ceph.com/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-01-31_03:01:24-upgrade:octopus-x-pacific-release-distro-default-smithi on Build 2 regweed tests seem fixed 'ceph orch ps' is still open
https://pulpito.ceph.com/yuriw-2024-02-17_17:35:25-upgrade:octopus-x-pacific-release-distro-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-19_19:30:16-upgrade:octopus-x-pacific-release-distro-default-smithi

upgrade/pacific-x (quincy)
https://pulpito.ceph.com/yuriw-2024-01-29_16:28:13-upgrade:pacific-x-quincy-distro-default-smithi/ PASSED blocked by #64256
https://pulpito.ceph.com/yuriw-2024-02-19_19:23:30-upgrade:pacific-x-quincy-distro-default-smithi Build 3

upgrade/pacific-p2p
https://pulpito.ceph.com/yuriw-2024-01-25_17:26:56-upgrade:pacific-p2p-pacific-release-distro-default-smithi FAILED related to #52590 #63941
Approved Ilya, Casey
https://pulpito.ceph.com/yuriw-2024-02-17_17:36:02-upgrade:pacific-p2p-pacific-release-distro-default-smithi Build 3
https://pulpito.ceph.com/yuriw-2024-02-20_21:41:20-upgrade:pacific-p2p-pacific-release-distro-default-smithi/ PASSED on removed by Casey rgw tests https://github.com/ceph/ceph/pull/55651

upgrade-clients/client-upgrade-nautilus-pacific-pacific
https://pulpito.ceph.com/teuthology-2024-01-26_15:19:13-upgrade-clients:client-upgrade-nautilus-pacific-pacific-release-distro-default-smithi PASSED
https://pulpito.ceph.com/teuthology-2024-02-19_20:02:39-upgrade-clients:client-upgrade-nautilus-pacific-pacific-release-distro-default-smithi Build 3
upgrade-clients/client-upgrade-octopus-pacific-pacific https://pulpito.ceph.com/teuthology-2024-01-26_15:21:42-upgrade-clients:client-upgrade-octopus-pacific-pacific-release-distro-default-smithi PASSED
https://pulpito.ceph.com/teuthology-2024-02-19_20:02:59-upgrade-clients:client-upgrade-octopus-pacific-pacific-release-distro-default-smithi Build 3
upgrade-clients/client-upgrade-pacific-quincy-quincy https://pulpito.ceph.com/teuthology-2024-01-26_15:22:57-upgrade-clients:client-upgrade-pacific-quincy-quincy-distro-default-smithi/ PASSED
https://pulpito.ceph.com/teuthology-2024-02-19_20:04:08-upgrade-clients:client-upgrade-pacific-quincy-quincy-distro-default-smithi Build 3
powercycle https://pulpito.ceph.com/?sha1=a72a5dace2353a54147d37bd2699a2a482507966 PASSED
https://pulpito.ceph.com/yuriw-2024-01-26_17:10:36-powercycle-pacific-release-distro-default-smithi
https://pulpito.ceph.com/yuriw-2024-02-17_16:11:19-powercycle-pacific-release-distro-default-smithi Build 3
ceph-volume https://jenkins.ceph.com/job/ceph-volume-test/568/ FAILED
https://jenkins.ceph.com/job/ceph-volume-test/build?delay=0sec
must use CEPH_ANSIBLE_BRANCH = stable-6.0
Approved Guillaume? #64248
https://jenkins.ceph.com/job/ceph-volume-test/569/ Build 3
https://jenkins.ceph.com/job/ceph-volume-test/570/ PASSED fixed by https://github.com/ceph/ceph/pull/55658

===========

FAILED PASSED
Actions #2

Updated by Casey Bodley 3 months ago

Yuri Weinstein wrote:

upgrade/nautilus-x (pacific) https://pulpito.ceph.com/yuriw-2024-01-25_17:26:39-upgrade:nautilus-x-pacific-release-distro-default-smithi/ FAILED Approved Casey?
https://pulpito.ceph.com/yuriw-2024-01-28_20:31:16-upgrade:nautilus-x-pacific-release-distro-default-smithi/
upgrade/octopus-x (pacific) https://pulpito.ceph.com/yuriw-2024-01-25_17:26:02-upgrade:octopus-x-pacific-release-distro-default-smithi FAILED Approved Casey?
https://pulpito.ceph.com/yuriw-2024-01-26_17:07:13-upgrade:octopus-x-pacific-release-distro-default-smithi

in both nautilus-x and octopus-x upgrades, the ragweed tests are failing because they're running the ceph-pacific branch of ragweed tests against an old radosgw instance that hasn't been restarted

the 16.2.14 upgrades passed because the ragweed ceph-pacific branch didn't contain any new test cases

the 16.2.15 cycle included https://github.com/ceph/ceph/pull/53808 which required changes to ragweed in https://github.com/ceph/ragweed/pull/27#issuecomment-1758094008

we should be running against the ceph-nautilus and ceph-octopus branches instead. i pushed a fix to https://github.com/ceph/ceph/pull/55382 and added it to the v16.2.15 milestone

Actions #3

Updated by Yuri Weinstein 2 months ago

  • Status changed from New to Resolved
Actions #4

Updated by Yuri Weinstein 2 months ago

  • Description updated (diff)
Actions

Also available in: Atom PDF