Tasks #11090
Updated by Loïc Dachary almost 9 years ago
h3. Workflow
* "Preparing the release":http://ceph.com/docs/master/dev/development-workflow/#preparing-a-new-release *IN PROGRESS*
* "Cutting the release":http://ceph.com/docs/master/dev/development-workflow/#cutting-a-new-stable-release
** Loic asks Sage if a point release should be published *"IN PROGRESS":http://www.spinics.net/lists/ceph-devel/msg23657.html*
** Loic gets approval from all leads
*** Yehuda, rgw:
*** Gregory, CephFS:
*** Josh, RBD:
*** Sam, rados:
** Sage writes and commits the release notes
** Loic informs Yuri that the branch is ready for testing
** Yuri runs additional integration tests
** If Yuri discovers new bugs with severity Critical, the release goes back to being prepared, it was not ready after all
** Yuri informs Alfredo that the branch is ready for release
** Alfredo creates the packages and sets the release tag
h3. Release information
* branch to build from: firefly, commit:???
* version: v0.80.10
* type of release: point release
* where to publish the release: debian/rpm-$release
<code>git --no-pager log --format='%H %s' --graph tags/v0.80.9..ceph/firefly | perl -p -e 's/"/ /g; if (/\w+\s+Merge pull request #(\d+)/) { s|\w+\s+Merge pull request #(\d+).*|"Pull request $1":https://github.com/ceph/ceph/pull/$1|; } else { s|(\w+)\s+(.*)|"$2":https://github.com/ceph/ceph/commit/$1|; } s/\*/+/; s/^/* /;'</code>
h3. teuthology run commit:df053b86a89edf8f390400dad8c5e654e14df327 (wip-11622-firefly may 2015)
h4. rgw
From "Wip 11622 firefly":https://github.com/ceph/ceph/pull/4697
<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --ceph wip-11622-firefly</code>
* *green* http://pulpito.ceph.com/loic-2015-05-15_22:57:08-rgw-wip-11622-firefly---basic-multi/
h3. teuthology run commit:df053b86a89edf8f390400dad8c5e654e14df327 (integration branch may 2015)
<pre>
$ git --no-pager log --merges --oneline ceph/firefly..ceph/firefly-backports
2418cdb Merge 4597: objecter: can get stuck in redirect loop if osdmap epoch == last_force_op_resend
0c0e273 Merge 4584: RGW doesn't return 'x-timestamp' in header which is used by 'View Details' of OpenStack
28a84ac Merge 4583: Change variable length array of std::strings (not legal in C++) to std::vector<std::string>
a5d29d7 Merge 4582: ceph_argparse_flag has no regular 3rd parameter
3eb301f Merge 4556: OSD::load_pgs: we need to handle the case where an upgrade from earlier versions which ignored non-existent pgs resurrects a pg with a prehistoric osdmap
c31ead2 Merge 4535: rgw: use correct objv_tracker for bucket instance
8f3e82b Merge 4416: fix PG::all_unfound_are_queried_or_lost for non-existent osds
0f86f89 Merge 4415: cancel_pull: requeue waiters
c19dcd5 Merge 4414: rgw: keystone token cache does not work correctly
53b42b6 Merge 4379: rgw: use correct objv_tracker for bucket instance
</pre>
h4. rados
Note: -rados suite must run on "branch wip-11429-firefly":https://github.com/ceph/ceph-qa-suite/pull/435 because it is required by "OSD::load_pgs: we need to handle the case where an upgrade from earlier versions which ignored non-existent pgs resurrects a pg with a prehistoric osdmap":http://tracker.ceph.com/issues/11429-
<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rados --subset 0/7 --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --ceph firefly-backports</code>
* *red* http://pulpito.ceph.com/loic-2015-05-13_00:58:29-rados-firefly-backports---basic-multi/
** *can be ignored* "ceph-objectstore-tool: import failure with status 139":http://tracker.ceph.com/issues/11142
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/ec-readwrite.yaml}":http://pulpito.ceph.com/loic-2015-05-13_00:58:29-rados-firefly-backports---basic-multi/888125
h4. fs
<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite fs -k testing --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --ceph firefly-backports</code>
* *green* http://pulpito.ceph.com/loic-2015-05-07_14:50:26-fs-firefly-backports-testing-basic-multi/
h4. rgw
The four issues below have been fixed "by the #11180 firefly backport":https://github.com/ceph/ceph-qa-suite/pull/437#issuecomment-100304101
* *green* http://pulpito.ceph.com/loic-2015-05-08_12:17:16-rgw-firefly-backports---basic-multi/
<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --ceph firefly-backports</code>
* *red* http://pulpito.ceph.com/loic-2015-05-07_14:52:01-rgw-firefly-backports---basic-multi/
** *needs fixing* "rgwadmin tasks assumes non-regional output":http://tracker.ceph.com/issues/11180
*** "rgw/singleton/{all/radosgw-admin-multi-region.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-05-07_14:52:01-rgw-firefly-backports---basic-multi/878883
*** "rgw/singleton/{all/radosgw-admin-multi-region.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-05-07_14:52:01-rgw-firefly-backports---basic-multi/878882
*** "rgw/singleton/{all/radosgw-admin-data-sync.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-05-07_14:52:01-rgw-firefly-backports---basic-multi/878881
*** "rgw/singleton/{all/radosgw-admin-data-sync.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-05-07_14:52:01-rgw-firefly-backports---basic-multi/878880
h4. rbd
<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rbd --filter-out btrfs,ext4 --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --ceph firefly-backports</code>
* *green* http://pulpito.ceph.com/loic-2015-05-07_14:53:01-rbd-firefly-backports---basic-multi
h3. teuthology run commit:b91bbb434e6363a99a632cf3841f70f1f2549f79 (integration branch april 2015)
<pre>
$ git rev-parse ceph/firefly
12143ff9b25fdd96f8d1a9cecb1329c7f354d414
$ git rev-parse ceph/firefly-backports
b91bbb434e6363a99a632cf3841f70f1f2549f79
$ git log --no-merges --oneline 12143ff9b25fdd96f8d1a9cecb1329c7f354d414..b91bbb434e6363a99a632cf3841f70f1f2549f79
c0cfd6e osd: erasure-code-profile incremental rm before set
3fb97e2 ReplicatedPG: trim backfill intervals based on peer's last_backfill_started
29bc9e5 PG: set/clear CREATING in Primary state entry/exit
b9da6f1 librbd: snap_remove should ignore -ENOENT errors
b250b3c librbd: get_parent_info should protect against invalid parent
69d9339 PGLog: improve PGLog::check() debugging
73cbb6f PGLog::merge_log: in tail extend case, log.log might be empty
364563a librbd: acquire cache_lock before refreshing parent
110c354 ReplicatedPG::promote_object: check scrubber and block if necessary
5404fbf common: do not unlock rwlock on destruction
a73a4cb common/RWLock: track read/write locks via atomics for assertion checks
</pre>
h4. rados
<code>
run=loic-2015-04-21_10:20:06-rados-firefly-backports---basic-multi
eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=dead | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')
./virtualenv/bin/teuthology-suite --filter "$filter" --priority 1000 --suite rados --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --owner loic@dachary.org --ceph firefly-backports
</code>
* *green* http://pulpito.ceph.com/loic-2015-04-23_11:37:37-rados-firefly-backports---basic-multi/
<code>./virtualenv/bin/teuthology-suite --filter-out btrfs,ext4 --priority 1000 --suite rados --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --owner loic@dachary.org --ceph firefly-backports</code>
* *red* http://pulpito.ceph.com/loic-2015-04-21_10:20:06-rados-firefly-backports---basic-multi/
** *environmental noise* ConnectionLostError: SSH connection to burnupi58 was lost
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/radosbench.yaml}":http://pulpito.ceph.com/loic-2015-04-21_10:20:06-rados-firefly-backports---basic-multi/857271
** *environmental noise* SSH connection to plana58 was lost:
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/ec-small-objects.yaml}":http://pulpito.ceph.com/loic-2015-04-21_10:20:06-rados-firefly-backports---basic-multi/857268
h4. rbd
<code>
run=loic-2015-04-21_10:32:12-rbd-firefly-backports---basic-multi
eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')
./virtualenv/bin/teuthology-suite --filter "$filter" --priority 1000 --suite rbd --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --owner loic@dachary.org --ceph firefly-backports
</code>
* *green* http://pulpito.ceph.com/loic-2015-04-23_11:40:56-rbd-firefly-backports---basic-multi/
<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rbd --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email xinxin.shu@intel.com --owner loic@dachary.org --ceph firefly-backports</code>
* *red* http://pulpito.ceph.com/loic-2015-04-21_10:32:12-rbd-firefly-backports---basic-multi/
** *environmental noise* plana03.stderr:Could not access KVM kernel module: No such file or directory
*** "rbd/librbd/{cache/writethrough.yaml cachepool/small.yaml clusters/fixed-3.yaml fs/btrfs.yaml msgr-failures/few.yaml workloads/qemu_fsstress.yaml}":http://pulpito.ceph.com/loic-2015-04-21_10:32:12-rbd-firefly-backports---basic-multi/857458
h3. teuthology run commit:c2d5a327533cef8a4140a20e398891b4ce0026be (integration branch march 2015)
<pre>
$ git log --no-merges --oneline c844a68d591221034689afa98601d30c7ba9812a..c2d5a327533cef8a4140a20e398891b4ce0026be
110c354 ReplicatedPG::promote_object: check scrubber and block if necessary
43053fc ceph-objectstore-tool: Use exit status 11 for incompatible import attempt
9437cb1 ceph-objectstore-tool: Output only unsupported features when incomatible
3160e8d init-radosgw*: don't require rgw_socket_path to be defined
cddbff9 doc,tests: force checkout of submodules
63b39db osd: fix negative degraded objects during backfilling
7e85722 doc: Minor fixes to ceph command manpage
9ac488c doc: Fix ceph command manpage to match ceph -h (firefly)
5f1245e rados.py: keep reference to python callbacks
cf366fc doc: Changes format style in ceph to improve readability as html.
07fc9f6 mds: fix assertion caused by system clock backwards
8a25a51 rgw: fail s3 POST auth if keystone not configured
9074eb7 rgw: check for timestamp for s3 keystone auth
</pre>
h4. rados
<code>./virtualenv/bin/teuthology-suite --filter-out btrfs,ext4 --priority 101 --suite rados --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports</code>
h3. teuthology run commit:c844a68d591221034689afa98601d30c7ba9812a (integration branch march 2015)
h4. rados
<pre>
run=loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi
eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')
./virtualenv/bin/teuthology-suite --filter "$filter" --priority 101 --suite rados --suite-branch wip-cot-firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports
</pre>
* *green* http://pulpito.ceph.com/loic-2015-03-16_11:42:07-rados-firefly-backports---basic-multi/
<code>./virtualenv/bin/teuthology-suite --filter-out btrfs,ext4 --priority 101 --suite rados --suite-branch wip-cot-firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports</code>
* *red* http://pulpito.ceph.com/loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi/
** *environmental noise* wget \-O- 'http://ceph.com/git/?p=ceph-qa-chef.git;a=blob_plain;f=solo/solo-from-scratch;hb=HEAD' | sh -x
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml}":http://pulpito.ceph.com/loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi/800459
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache.yaml}":http://pulpito.ceph.com/loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi/800433
*** "rados/monthrash/{ceph/ceph.yaml clusters/9-mons.yaml fs/xfs.yaml msgr-failures/mon-delay.yaml thrashers/sync.yaml workloads/snaps-few-objects.yaml}":http://pulpito.ceph.com/loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi/800270
** *can be ignored* [ERR] 3.10s0 shard 1(0) missing 55d1f050/benchmark_data_plana61_15181_object460/head//3 "whitelist shard missing errors":https://github.com/ceph/ceph-qa-suite/pull/368
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/ec-radosbench.yaml}":http://pulpito.ceph.com/loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi/800322
** *known bug* "unreadable ceph-osd core dump (firefly)":http://tracker.ceph.com/issues/10485
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/ec-snaps-few-objects.yaml}":http://pulpito.ceph.com/loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi/800465
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/ec-snaps-few-objects.yaml}":http://pulpito.ceph.com/loic-2015-03-11_18:54:32-rados-firefly-backports---basic-multi/800325
h4. rgw
Re-run with ceph-qa-suite patch "create a new get_acl helper to ensure proper xml is compared":https://github.com/ceph/ceph-qa-suite/pull/369
<pre>
run=loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi
eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')
./virtualenv/bin/teuthology-suite --filter="$filter" --priority 101 --suite rgw --suite-branch wip-rgw-acl --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports
</pre>
* *green* http://pulpito.ceph.com/loic-2015-03-16_15:12:53-rgw-firefly-backports---basic-multi/
<pre>
run=loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi
eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')
./virtualenv/bin/teuthology-suite --filter="$filter" --priority 101 --suite rgw --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports
</pre>
* *red* http://pulpito.ceph.com/loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi/
** *needs fixing* "create a new get_acl helper to ensure proper xml is compared":https://github.com/ceph/ceph-qa-suite/pull/369
*** "rgw/singleton/{all/radosgw-admin.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi/806291
*** "rgw/singleton/{all/radosgw-admin.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi/806290
*** "rgw/singleton/{all/radosgw-admin-multi-region.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi/806289
*** "rgw/singleton/{all/radosgw-admin-multi-region.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi/806288
*** "rgw/singleton/{all/radosgw-admin-data-sync.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi/806287
*** "rgw/singleton/{all/radosgw-admin-data-sync.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-03-16_12:57:30-rgw-firefly-backports---basic-multi/806286
<code>./virtualenv/bin/teuthology-suite --priority 101 --suite rgw --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports</code>
* *red* http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/
** *needs fixing* "create a new get_acl helper to ensure proper xml is compared":https://github.com/ceph/ceph-qa-suite/pull/369
*** "rgw/singleton/{all/radosgw-admin.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800519
*** "rgw/singleton/{all/radosgw-admin.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800518
*** "rgw/singleton/{all/radosgw-admin-multi-region.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800517
*** "rgw/singleton/{all/radosgw-admin-data-sync.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800515
*** "rgw/singleton/{all/radosgw-admin-data-sync.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800514
** *environmental noise* BotoServerError: 500 Internal Server Error really was plana10 file system turned read-only
*** "rgw/singleton/{all/radosgw-admin-multi-region.yaml rgw_pool_type/erasure-coded.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800516
** *environmental noise* wget -O- 'http://ceph.com/git/?p=ceph-qa-chef.git;a=blob_plain;f=solo/solo-from-scratch;hb=HEAD' | sh -x
*** "rgw/multifs/{clusters/fixed-2.yaml fs/xfs.yaml rgw_pool_type/replicated.yaml tasks/rgw_user_quota.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800513
*** "rgw/multifs/{clusters/fixed-2.yaml fs/btrfs.yaml rgw_pool_type/erasure-coded.yaml tasks/rgw_multipart_upload.yaml}":http://pulpito.ceph.com/loic-2015-03-11_19:06:39-rgw-firefly-backports---basic-multi/800473
h4. rbd
<code>./virtualenv/bin/teuthology-suite --priority 101 --suite rbd --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports</code>
* *green* http://pulpito.ceph.com/loic-2015-03-11_19:09:57-rbd-firefly-backports---basic-multi/
h4. fs
<code>./virtualenv/bin/teuthology-suite -k testing --priority 101 --suite fs --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports</code>
* *green* http://pulpito.ceph.com/loic-2015-03-11_19:13:19-fs-firefly-backports-testing-basic-multi/
h3. teuthology run commit:b0d9b862d7f1a9a98cf4b41ff7cb0eb428740633 (march 2015)
h4. rados
<code>./virtualenv/bin/teuthology-suite --filter-out btrfs,ext4 --priority 101 --suite rados --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph firefly-backports</code>
* *green* http://pulpito.ceph.com/loic-2015-03-10_22:52:26-rados-firefly-backports---basic-multi/