Tasks #11492
Updated by Loïc Dachary almost 9 years ago
h3. Workflow
* "Preparing the release":http://ceph.com/docs/master/dev/development-workflow/#preparing-a-new-release *IN PROGRESS*
* "Cutting the release":http://ceph.com/docs/master/dev/development-workflow/#cutting-a-new-stable-release
** Abhishek asks Sage if a point release should be published *YES*
** Abhishek gets approval from all leads
*** Yehuda, rgw:
*** Gregory, CephFS:
*** Josh, RBD:
*** Sam, rados:
** Sage writes and commits the release notes
** Abhishek informs Yuri that the branch is ready for testing
** Yuri runs additional integration tests
** If Yuri discovers new bugs with severity Critical, the relase goes back to being prepared, it was not ready after all
** Yuri informs Alfredo that the branch is ready for release
** Alfredo creates the packages and sets the release tag
h3. Release information
** branch to build from: hammer, commit:???
** version: v0.94.2
** type of release: point release
** where to publish the release: debian/rpm-$release
h3. Teuthology run commit commit:a79146fc3cae28bf4c07478fb4566b06942da60d (hammer-backports branch May 2015)
Note: rados suite must run on "branch wip-11429-hammer":https://github.com/ceph/ceph-qa-suite/pull/432 because it is required by "OSD::load_pgs: we need to handle the case where an upgrade from earlier versions which ignored non-existent pgs resurrects a pg with a prehistoric osdmap":http://tracker.ceph.com/issues/11429
<code>git --no-pager log --format='%H %s' --graph ceph/hammer..ceph/hammer-backports | perl -p -e 's/"/ /g; if (/\w+\s+Merge pull request #(\d+)/) { s|\w+\s+Merge pull request #(\d+).*|"Pull request $1":https://github.com/ceph/ceph/pull/$1|; } else { s|(\w+)\s+(.*)|"$2":https://github.com/ceph/ceph/commit/$1|; } s/\*/+/; s/^/* /;'</code>
* + "Merge 4502: objecter: can get stuck in redirect loop if osdmap epoch == last_force_op_resend":https://github.com/ceph/ceph/commit/a79146fc3cae28bf4c07478fb4566b06942da60d
* |\
* | + "osdc: add epoch_t last_force_resend in Op/LingerOp.":https://github.com/ceph/ceph/commit/8d9f4d4eb546e26eeb3911811bdeb166d06cb1d1
* + "Merge 4585: A retransmit of proxied flatten request can result in -EINVAL":https://github.com/ceph/ceph/commit/e13c4229aadb5c2de647311d0512ba3eaef5e13d
* |\
* | + "librbd: flatten should return -EROFS if image is read-only":https://github.com/ceph/ceph/commit/02a3813a6a4f9c8ce14f64fc7f378030e7ea6f93
* | + "librbd: allow snapshots to be created when snapshot is active":https://github.com/ceph/ceph/commit/af8939be80310e234745fe81e67244ab52c6add5
* | + "librbd: better handling for duplicate flatten requests":https://github.com/ceph/ceph/commit/d21c0c00d2bed282677d2063a3fb6f5346641286
* | + "librbd: use generic helper for issuing async requests":https://github.com/ceph/ceph/commit/ec0bd1dea526e04333d8059421666dcd2a59044e
* + "Merge 4581: rgw: quota not respected in POST object":https://github.com/ceph/ceph/commit/7ad5d543045fbbd127924ae86ce55cc202847984
* |\
* | + "rgw: quota not respected in POST object":https://github.com/ceph/ceph/commit/d164d8004feddb3e2238b26e3360a905e209d117
* + "Merge 4580: RGW Swift API: wrong handling of empty metadata on Swift container":https://github.com/ceph/ceph/commit/0570349f73ac4324c72261dc1474714807d15144
* |\
* | + "rgw: fix handling empty metadata items on Swift container.":https://github.com/ceph/ceph/commit/7f2a9ed7a986145d4b34517a1a1bb44799ebf621
* + "Merge 4579: RGW Swift API: response for PUT on /container does not contain the mandatory Content-Length header when FCGI is used":https://github.com/ceph/ceph/commit/34d45019e32922e3728bbba039ad301ec8a3c008
* |\
* | + "rgw: send Content-Length in response for HEAD on Swift account.":https://github.com/ceph/ceph/commit/f4a0dabfe8debc7b54afa5da179d51db891f5bc0
* | + "rgw: send Content-Length in response for DELETE on Swift container.":https://github.com/ceph/ceph/commit/32f4a7439d1e0ce6aab1c1e39407b14e124d03bf
* | + "rgw: send Content-Length in response for PUT on Swift container.":https://github.com/ceph/ceph/commit/d39a66007fa7211c00a67f9cd898e55551f5ae62
* | + "rgw: send Content-Length in response for GET on Swift container.":https://github.com/ceph/ceph/commit/8e6efdbcb0f820b2ab3728662efbfb4bc45495af
* | + "rgw: enable end_header() to handle proposal of Content-Length.":https://github.com/ceph/ceph/commit/54b62904a4cc3913be23803734fa68741a3c33cc
* + "Merge 4577: RGW swift API: Response header of GET request for container does not contain X-Container-Object-Count, X-Container-Bytes-Used and x-trans-id headers":https://github.com/ceph/ceph/commit/43fa17617ca88eed74013e8b614e9a13aa606c6e
* |\
* | + "rgw: Swift API. Complement the response to show container details ":https://github.com/ceph/ceph/commit/c87aa110bd224ae3220c5486fbd2486ebdfb8b8e
* + "Merge 4576: RGW swift API: Response header of POST request for object does not contain content-length and x-trans-id headers":https://github.com/ceph/ceph/commit/ffbd4511acb602926599748e957cc3323ac813b3
* |\
* | + "rgw: enforce Content-Length in response for POST on Swift cont/obj.":https://github.com/ceph/ceph/commit/2cb5d600699085fe0e996b91cf85603be3da230e
* + "Merge 4575: Response header of swift API PUT /container/object returned by RGW does not contain last-modified, content-length, x-trans-id headers. But Swift returns these headers.":https://github.com/ceph/ceph/commit/f5028725f29ec40e4df2dc4c48a3817668870c91
* |\
* | + "rgw: send Last-Modified header in response for PUT on Swift object.":https://github.com/ceph/ceph/commit/d2043a5f3b8d7a3ce50c4e84aa88481c8912ae25
* + "Merge 4574: rgw: shouldn't need to disable rgw_socket_path if frontend is configured":https://github.com/ceph/ceph/commit/68a6715e773a9791e648a2d55d7f6c8fd7edba39
* |\
* | + "rgw: don't use rgw_socket_path if frontend is configured":https://github.com/ceph/ceph/commit/4d1f3f03ef8809693c8ea2bcbc4d24fd41ae1842
* + "Merge 4573: rgw: keystone token cache does not work correctly":https://github.com/ceph/ceph/commit/a2debb1cfe84f7fb9a9cb2c1e4268e4a92da7f1f
* |\
* | + "rgw: update keystone cache with token info":https://github.com/ceph/ceph/commit/3aef0f2bb6f88bb17c460a3cef0d3503550f716c
* + "Merge 4570: civetweb is hitting a limit (number of threads 1024)":https://github.com/ceph/ceph/commit/17ff290d18edd61e8c3339f3f850abc1add40518
* |\
* | + "civetweb: update max num of threads":https://github.com/ceph/ceph/commit/3edb1964fe9e8574aafcb758d170007f0e43a324
* + "Merge 4568: RGW swift API: Response header of COPY request for object does not contain x-copied-from, custom metadata, x-copied-from-last-modified, X-Copied-From-Account headers":https://github.com/ceph/ceph/commit/c5d2297d5c1ad6bdf06e86210d647516e8f453d8
* |\
* | + "rgw: improve metadata handling on copy operation of Swift API.":https://github.com/ceph/ceph/commit/efbfe6fced72d07309ccf1f1a219c037b7f535fa
* | + "rgw: improve code formatting ONLY.":https://github.com/ceph/ceph/commit/bc6eb8d5f0a66aec3fbda0b794d008a3157a8154
* | + "rgw: send X-Copied-From-Last-Modified header of Swift API.":https://github.com/ceph/ceph/commit/7aa1ae60cea17e0bd140c0cf2313d82f2f64554f
* | + "rgw: dump object metadata in response for COPY request of Swift API.":https://github.com/ceph/ceph/commit/150b9e2b85a72dc247da4ba1ab770e6af053acb7
* | + "rgw: refactor dumping metadata of Swift objects.":https://github.com/ceph/ceph/commit/e749701be5368a22cad1630f8202e48f5d980409
* | + "rgw: add support for X-Copied-From{-Account} headers of Swift API.":https://github.com/ceph/ceph/commit/b034511fa79996415640b4aca3e8747340f2a127
* | + "rgw: send ETag, Last-Modified in response for copying Swift cobject.":https://github.com/ceph/ceph/commit/c9e6a0bf8c601c4fd9065c1f3a8ea445bd652a52
* | + "rgw: Swift API. Allows setting attributes with COPY object operation.":https://github.com/ceph/ceph/commit/7f41ff0a6577b0784c6719b9d705f32921b1c40e
* + "Merge 4567: RGW Swift API: response for GET/HEAD on container does not contain the X-Timestamp header":https://github.com/ceph/ceph/commit/f564be4b8b220fc4617fe385c89fffd93b2973f8
* |\
* | + "rgw: improve format of X-Timestamp on Swift objects.":https://github.com/ceph/ceph/commit/2f869959ffe1adbcfef7d26ae2d022d23d982673
* | + "rgw: add support for X-Timestamp on Swift containers.":https://github.com/ceph/ceph/commit/48b19810a9860f6fccbf8d9b8a2fadfb37f598dd
* + "Merge 4566: Queued AIO reference counters not properly updated":https://github.com/ceph/ceph/commit/fae5d905bdade74eaa94a6eb019049d86e03c12f
* |\
* | + "tests: AioCompletion incorrectly freed":https://github.com/ceph/ceph/commit/893ffd3767678ab881c4bc44ecfe1801cb9f9704
* | + "librbd: update ref count when queueing AioCompletion":https://github.com/ceph/ceph/commit/96b0db5decfad452964750cff92a63007433e519
* + "Merge 4564: Periodic failure of TestLibRBD.DiffIterateStress":https://github.com/ceph/ceph/commit/e3cfe6997731bf98ebb110409b1fd0238be8f1d2
* |\
* | + "librbd: failure to update the object map should always return success":https://github.com/ceph/ceph/commit/094405171bdead0ce09055d4acc6445274992a01
* | + "tests: librados_test_stub reads should deep-copy":https://github.com/ceph/ceph/commit/7ee7dcfd609731d3c7f51b74c1d99fb3fa51c413
* + "Merge 4563: mon: Total size of OSDs is a maginitude less than it is supposed to be.":https://github.com/ceph/ceph/commit/faeaf5ef2b8fd2b18594a9e68be657a357a65872
* |\
* | + "mon: Total size of OSDs is a maginitude less than it is supposed to be.":https://github.com/ceph/ceph/commit/113f3b14ec8631d57bbbc2931e242ac96cf9e6fc
* + "Merge 4562: ceph-objectstore-tool should be in the ceph server package":https://github.com/ceph/ceph/commit/2ddffc75633f8ab3ed188e67d8ec3dc5390718f5
* |\
* | + "packaging: mv ceph-objectstore-tool to main ceph pkg":https://github.com/ceph/ceph/commit/d747567e2164719dc76f3064a2167dad9f27b3e7
* + "Merge 4561: src/ceph-disk : disk zap sgdisk invocation":https://github.com/ceph/ceph/commit/a496169cd1d0bae89c69e9d0667e951732b53c17
* |\
* | + "Fix disk zap sgdisk invocation":https://github.com/ceph/ceph/commit/6a04b55df76faad9b1b0770fbe6038b3b8c7d645
* + "Merge 4560: object creation by write cannot use an offset on an erasure coded pool":https://github.com/ceph/ceph/commit/ad1f1390151667c53405cd002533abcb9a3b1278
* |\
* | + "osd: refuse to write a new erasure coded object with an offset > 0":https://github.com/ceph/ceph/commit/8996907e0a777320b505e74754f48a1a82308166
* + "Merge 4559: OSD::load_pgs: we need to handle the case where an upgrade from earlier versions which ignored non-existent pgs resurrects a pg with a prehistoric osdmap":https://github.com/ceph/ceph/commit/466d3ddfb08646622b4113716a13c1a21b8bf586
* + "OSD: handle the case where we resurrected an old, deleted pg":https://github.com/ceph/ceph/commit/8a6e6e4c107b03563b2e38aa24cc2067ce6a7350
h3. Teuthology run commit d7828f7a8dcff7ec5a1a8458e6a610c0a07867ca (hammer-backports branch May 2015)
<code>git --no-pager log --format='%H %s' --graph ceph/hammer..ceph/hammer-backports | perl -p -e 's/"/ /g; if (/\w+\s+Merge pull request #(\d+)/) { s|\w+\s+Merge pull request #(\d+).*|"Pull request $1":https://github.com/ceph/ceph/pull/$1|; } else { s|(\w+)\s+(.*)|"$2":https://github.com/ceph/ceph/commit/$1|; } s/\*/+/; s/^/* /;'</code>
* + "Merge 4515: rgw: critical fixes for hammer":https://github.com/ceph/ceph/commit/d7828f7a8dcff7ec5a1a8458e6a610c0a07867ca
* + "Merge 4496: librbd: deadlock in image refresh":https://github.com/ceph/ceph/commit/2ae10fe87dc40721705efe2050711cac157fb18b
* |\
* | + "librbd: acquire cache_lock before refreshing parent":https://github.com/ceph/ceph/commit/0cdc93fbdcf68a31e6aada38b0cb9d66efdc512d
* | + "librados_test_stub: AIO operation callbacks should be via Finisher":https://github.com/ceph/ceph/commit/a1b4aeb8e8c3a8d5c8284dcee8e03f501a77928c
* + "Merge 4497: Objectcacher setting max object counts too low":https://github.com/ceph/ceph/commit/a4c50f8d428c8e86479b6ebd21c9e8617561e32d
* |\
* | + "librbd: updated cache max objects calculation":https://github.com/ceph/ceph/commit/2864da86ca689472341e8a80f7ad6fcc5eb8321a
* + "Merge 4498: librbd notification race condition on snap_create":https://github.com/ceph/ceph/commit/080135810207759bb8008e97fb15f6c924fd9ba6
* |\
* | + "librbd: moved snap_create header update notification to initiator":https://github.com/ceph/ceph/commit/0e6a032c9e6ddae20be82df7500a0758d2cd8e74
* + "Merge 4499: ImageWatcher should cancel in-flight ops on watch error":https://github.com/ceph/ceph/commit/d93e440c8d9cb27d50c54d2e3d83999690c8f532
* |\
* | + "librbd: ImageWatcher should cancel in-flight ops on watch error":https://github.com/ceph/ceph/commit/c6159724f065731c41b2d29a48d0f0a3dc82340b
* + "Merge 4500: rgw : make quota/gc thread configurable for starting":https://github.com/ceph/ceph/commit/df7d55aa5649fe8c57d7be04990e2001f8771475
* |\
* | + "rgw - make starting quota/gc threads configurable":https://github.com/ceph/ceph/commit/c6edc16fee027f6cdefacba08f1edc436a7406c5
* + "Merge 4501: Improve rgw HEAD request by avoiding read the body of the first chunk":https://github.com/ceph/ceph/commit/5c71f68f15e250aae8f88011551d8da626ab7baf
* |\
* | + "rgw: do not pre-fetch data for HEAD requests":https://github.com/ceph/ceph/commit/2f34d2e73bb4bded4779af15a337c75eb2d1497f
* + "Merge 4502: objecter: can get stuck in redirect loop if osdmap epoch == last_force_op_resend":https://github.com/ceph/ceph/commit/293ecdfa47cbbd37f107fbddfd39c766111edb75
* |\
* | + "osdc: add epoch_t last_force_resend in Op/LingerOp.":https://github.com/ceph/ceph/commit/8d9f4d4eb546e26eeb3911811bdeb166d06cb1d1
* + "Merge 4503: use a new disk as journal disk,ceph-disk prepare fail":https://github.com/ceph/ceph/commit/6cecb3f64a35786848eb395c0d367dda33862339
* |\
* | + "ceph-disk: more robust parted output parser":https://github.com/ceph/ceph/commit/8709e34f931809f7129cdac1203ec4e774e3eb4c
* + "Merge 4504: ceph-dencoder links to libtcmalloc, and shouldn't":https://github.com/ceph/ceph/commit/5e0ef766320b1a9e4baa2c59d11b9f197a2da88c
* |\
* | + "Move ceph-dencoder build to client":https://github.com/ceph/ceph/commit/478968670caecd67f7995a09b60f6208729e3de3
* | + "Rework mds/Makefile.am to support a dencoder client build":https://github.com/ceph/ceph/commit/7eabb70b906e50901551ab96453f05fe662a8876
* | + "rgw/Makefile.am: Populate DENCODER_SOURCES properly":https://github.com/ceph/ceph/commit/b903ad28a68772fa0b7a88b4db2724f4d07565d5
* | + "Dencoder should never be built with tcmalloc":https://github.com/ceph/ceph/commit/f994483c0e3a60226c8fb6983380ef8400b0160e
* + "Merge 4505: rgw - improve performance for large object (multiple chunks) GET":https://github.com/ceph/ceph/commit/12b944a7a6635115838e71bb102eebd230a292d1
* |\
* | + "rgw : Issue AIO for next chunk first before flush the (cached) data.":https://github.com/ceph/ceph/commit/379ef714f7149a748891dafd41db80c247d35975
* + "Merge 4507: compilation error: No high-precision counter available (armhf, powerpc..)":https://github.com/ceph/ceph/commit/c1ae8feed1914585dc2b94867fc181a854ec682a
* + "Add support for PPC architecture, provide fallback":https://github.com/ceph/ceph/commit/da7f6835b15370ce0120a64f7ac3359f3ba4729b
h4. rgw
<pre>
./virtualenv/bin/teuthology-suite --priority 101 --suite rgw --filter-out btrfs,ext4,apache --suite-branch hammer --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph hammer-backports
</pre>
* *green* http://pulpito.ceph.com/loic-2015-05-03_14:50:25-rgw-hammer-backports---basic-multi/
h4. fs
<pre>
run=loic-2015-05-04_11:27:13-fs-hammer-backports---basic-multi
filter='fs/recovery/{clusters/2-remote-clients.yaml debug/mds_client.yaml mounts/ceph-fuse.yaml tasks/mds-flush.yaml}'
./virtualenv/bin/teuthology-suite --filter="$filter" -k testing --priority 101 --suite fs --suite-branch wip-10712-hammer --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner loic@dachary.org --ceph hammer-backports
</pre>
* *green* http://pulpito.ceph.com/loic-2015-05-05_11:54:53-fs-hammer-backports-testing-basic-multi/
<pre>
run=loic-2015-05-03_14:58:27-fs-hammer-backports---basic-multi
eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')
./virtualenv/bin/teuthology-suite --filter="$filter" --priority 101 --suite fs --suite-branch hammer --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner loic@dachary.org --ceph hammer-backports
</pre>
* *red* http://pulpito.ceph.com/loic-2015-05-04_11:27:13-fs-hammer-backports---basic-multi/
** "TestFlush intermittent failure on scatter_writebehind event":http://tracker.ceph.com/issues/10712 Test failure: test_flush (tasks.mds_flush.TestFlush)
*** "fs/recovery/{clusters/2-remote-clients.yaml debug/mds_client.yaml mounts/ceph-fuse.yaml tasks/mds-flush.yaml}":http://pulpito.ceph.com/loic-2015-05-04_11:27:13-fs-hammer-backports---basic-multi/874954
<pre>
./virtualenv/bin/teuthology-suite --priority 101 --suite fs --suite-branch hammer --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner loic@dachary.org --ceph hammer-backports
</pre>
* *red* http://pulpito.ceph.com/loic-2015-05-03_14:58:27-fs-hammer-backports---basic-multi/
** *Test failure: test_flush (tasks.mds_flush.TestFlush)*
*** "fs/recovery/{clusters/2-remote-clients.yaml debug/mds_client.yaml mounts/ceph-fuse.yaml tasks/mds-flush.yaml}":http://pulpito.ceph.com/loic-2015-05-03_14:58:27-fs-hammer-backports---basic-multi/873887
** *Test failure: test_client_pin (tasks.mds_client_limits.TestClientLimits)*
*** "fs/recovery/{clusters/2-remote-clients.yaml debug/mds_client.yaml mounts/ceph-fuse.yaml tasks/client-limits.yaml}":http://pulpito.ceph.com/loic-2015-05-03_14:58:27-fs-hammer-backports---basic-multi/873885
h4. rbd
<pre>
./virtualenv/bin/teuthology-suite --priority 101 --suite rbd --filter-out btrfs,ext4 --suite-branch hammer --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner loic@dachary.org --ceph hammer-backports
</pre>
* *green* http://pulpito.ceph.com/loic-2015-05-03_14:55:24-rbd-hammer-backports---basic-multi/
h4. rados
<pre>
$ git ls-remote https://github.com/dachary/ceph-qa-suite.git wip-rados-no-thrash-hammer
8233eae8329d1ef80dece59a2fe0518c13e51135 refs/heads/wip-rados-no-thrash-hammer
$ git clone -b wip-rados-no-thrash-hammer https://github.com/dachary/ceph-qa-suite.git /tmp/ceph-qa-suite
$ ./virtualenv/bin/teuthology-suite --filter-out ext4,btrfs --priority 101 --suite rados --suite-dir /tmp/ceph-qa-suite --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner loic@dachary.org --ceph hammer-backports
</pre>
* *red* http://pulpito.ceph.com/loic-2015-05-04_11:18:05-rados-hammer-backports---basic-multi/
** *manager*
*** "rados/thrash-erasure-code/{clusters/fixed-2.yaml fs/xfs.yaml workloads/ec-small-objects.yaml}":http://pulpito.ceph.com/loic-2015-05-04_11:18:05-rados-hammer-backports---basic-multi/874949
*** "rados/thrash-erasure-code/{clusters/fixed-2.yaml fs/xfs.yaml workloads/ec-radosbench.yaml}":http://pulpito.ceph.com/loic-2015-05-04_11:18:05-rados-hammer-backports---basic-multi/874948
*** "rados/thrash-erasure-code/{clusters/fixed-2.yaml fs/xfs.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml}":http://pulpito.ceph.com/loic-2015-05-04_11:18:05-rados-hammer-backports---basic-multi/874947
*** "rados/thrash-erasure-code/{clusters/fixed-2.yaml fs/xfs.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml}":http://pulpito.ceph.com/loic-2015-05-04_11:18:05-rados-hammer-backports---basic-multi/874946