Project

General

Profile

Tasks #11644

Updated by Nathan Cutler over 8 years ago

h3. Workflow

* "Preparing the release":http://ceph.com/docs/master/dev/development-workflow/#preparing-a-new-release *IN PROGRESS*
* "Cutting the release":http://ceph.com/docs/master/dev/development-workflow/#cutting-a-new-stable-release
** Nathan asks Sage if a point release should be published
** Nathan gets approval from all leads
*** Yehuda, rgw:
*** Gregory, CephFS:
*** Josh, RBD:
*** Sam, rados:
** Sage writes and commits the release notes
** Nathan informs Yuri that the branch is ready for testing
** Yuri runs additional integration tests
** If Yuri discovers new bugs with severity Critical, the release goes back to being prepared, it was not ready after all
** Yuri informs Alfredo that the branch is ready for release
** Alfredo creates the packages and sets the release tag

h3. Release information

* branch to build from: firefly, commit:???
* version: v0.80.11
* type of release: point release
* where to publish the release: http://ceph.com/debian-firefly and http://ceph.com/rpm-firefly

<code>git --no-pager log --format='%H %s' --graph tags/v0.80.10..ceph/firefly | perl -p -e 's/"/ /g; if (/\w+\s+Merge pull request #(\d+)/) { s|\w+\s+Merge pull request #(\d+).*|"Pull request $1":https://github.com/ceph/ceph/pull/$1|; } else { s|(\w+)\s+(.*)|"$2":https://github.com/ceph/ceph/commit/$1|; } s/\*/+/; s/^/* /;'</code>

* + "Pull request 4960":https://github.com/ceph/ceph/pull/4960
* + "osd,mon: explicitly specify OSD features in MOSDBoot":https://github.com/ceph/ceph/commit/254676b63b559fa0117520edb5dcbfe067a76747

h3. teuthology run commit:b2aaddd3a06ac13c46df659e1f2b3119f5675802 (firefly-backports july 2015)

<code>git --no-pager log --format='%H %s' --graph ceph/firefly..ceph/firefly-backports | perl -p -e 's/"/ /g; if (/\w+\s+Merge (\d+)/) { s|\w+\s+Merge (\d+).*|"Pull request $1":https://github.com/ceph/ceph/pull/$1|; } else { s|(\w+)\s+(.*)|"$2":https://github.com/ceph/ceph/commit/$1|; } s/\*/+/; s/^/* /;'</code>

* + "Pull request 4535":https://github.com/ceph/ceph/pull/4535
* |\
* | + "rgw: use correct objv_tracker for bucket instance":https://github.com/ceph/ceph/commit/f6022639758ec13b9a25b03cd831882db0b517b3
* + "Pull request 4582":https://github.com/ceph/ceph/pull/4582
* |\
* | + "ceph_argparse_flag has no regular 3rd parameter.":https://github.com/ceph/ceph/commit/2cb2333ecdf2106925d74e024697f73ad947f378
* + "Pull request 4583":https://github.com/ceph/ceph/pull/4583
* |\
* | + "Variable length array of std::strings (not legal in C++) changed to std::vector<std::string>":https://github.com/ceph/ceph/commit/9614e4dc5be745dab367d17f29a07377e348b2ca
* + "Pull request 4584":https://github.com/ceph/ceph/pull/4584
* |\
* | + "rgw: swift GET / HEAD object returns X-Timestamp field":https://github.com/ceph/ceph/commit/8c573c8826096d90dc7dfb9fd0126b9983bc15eb
* + "Pull request 4597":https://github.com/ceph/ceph/pull/4597
* |\
* | + "osdc: add epoch_t last_force_resend in Op/LingerOp.":https://github.com/ceph/ceph/commit/b1ff7396c8e9668c0be1a4023e0ffa292067cf64
* + "Pull request 4630":https://github.com/ceph/ceph/pull/4630
* |\
* | + "ceph-disk: more robust parted output parser":https://github.com/ceph/ceph/commit/909096713dcef5dc4fdbb22a9971609554688e23
* + "Pull request 4631":https://github.com/ceph/ceph/pull/4631
* + "Pull request 4632":https://github.com/ceph/ceph/pull/4632
* |\
* | + "osd: refuse to write a new erasure coded object with an offset > 0":https://github.com/ceph/ceph/commit/8372f1d53b847224bf4c61894d18851e84ccd357
* + "Pull request 4633":https://github.com/ceph/ceph/pull/4633
* + "Pull request 4635":https://github.com/ceph/ceph/pull/4635
* |\
* | + "json_sprit: fix the FTBFS on old gcc":https://github.com/ceph/ceph/commit/424289dc4ee8fb09dd00d507b5a9d1fecc786937
* | + "json_spirit: use utf8 intenally when parsing \uHHHH":https://github.com/ceph/ceph/commit/84b00f189554fc37413c990ac4011079bb5cdb60
* + "Pull request 4636":https://github.com/ceph/ceph/pull/4636
* |\
* | + "Fix disk zap sgdisk invocation":https://github.com/ceph/ceph/commit/10d85e1126768f6c72f7d2a301ea7ca9ba59f8e0
* + "Pull request 4639":https://github.com/ceph/ceph/pull/4639
* |\
* | + "librbd: updated cache max objects calculation":https://github.com/ceph/ceph/commit/9845258f184c823d1e48da1dcb97bdde97220bb6
* + "Pull request 4641":https://github.com/ceph/ceph/pull/4641
* |\
* | + "rgw: remove meta file after deleting bucket The meta file is deleted only if the bucket meta data is not synced":https://github.com/ceph/ceph/commit/177ef55d61c9b08783ae746aa521d2535324d6ba
* + "Pull request 4642":https://github.com/ceph/ceph/pull/4642
* |\
* | + "rgw: quota not respected in POST object":https://github.com/ceph/ceph/commit/d78e31f005756700e15d26d187c6cef6d5d24a7a
* + "Pull request 4762":https://github.com/ceph/ceph/pull/4762
* |\
* | + "rgw: Use attrs from source bucket on copy":https://github.com/ceph/ceph/commit/2d5d8da35f627840ee57a8fa071147943b890d0c
* + "Pull request 4765":https://github.com/ceph/ceph/pull/4765
* |\
* | + "rgw: always check if token is expired":https://github.com/ceph/ceph/commit/d4ef5566e6b1b2ac73925660a1d627dbb6cc7632
* + "Pull request 4769":https://github.com/ceph/ceph/pull/4769
* |\
* | + "mon: prevent bucket deletion when referenced by a rule":https://github.com/ceph/ceph/commit/f93eadd793f9f4fded30df5589f98ccfc0e1839f
* + "Pull request 4771":https://github.com/ceph/ceph/pull/4771
* |\
* | + "ceph-disk: support NVMe device partitions":https://github.com/ceph/ceph/commit/90a1a7587fcb567e2cc6e9188fdd56ec1255a881
* + "Pull request 4867":https://github.com/ceph/ceph/pull/4867
* |\
* | + "Always provide summary for non-healthy cluster.":https://github.com/ceph/ceph/commit/dd547aa458d3d687acba90d8ff321abeb68414a5
* + "Pull request 5037":https://github.com/ceph/ceph/pull/5037
* |\
* | + "Makefile: install ceph-post-file keys with mode 600":https://github.com/ceph/ceph/commit/a62c720dc783b40377dcd34d4e53aa778ac1a84b
* | + "ceph-post-file: improve check for a source install":https://github.com/ceph/ceph/commit/fc59ca391f639b2ef1b5c9dda202a3d7d718cf25
* | + "ceph-post-file: behave when sftp doesn't take -i":https://github.com/ceph/ceph/commit/50bfb354d0648162f94c2659e8b915d69f27bf73
* + "Pull request 5039":https://github.com/ceph/ceph/pull/5039
* |\
* | + "osd: Cleanup boost optionals":https://github.com/ceph/ceph/commit/fcac7ab6305dc3215fdcb46951fa9ee4cbf68ce3
* + "Pull request 5044":https://github.com/ceph/ceph/pull/5044
* |\
* | + "The fix for issue 9614 was not completed, as a result, for those erasure coded PGs with one OSD down, the state was wrongly marked as active+clean+degraded. This patch makes sure the clean flag is not set for such PG. Signed-off-by: Guang Yang <yguang@yahoo-inc.com>":https://github.com/ceph/ceph/commit/6793d504b5b622a7a6f69ffb30d6822167b557a3
* + "Pull request 5051":https://github.com/ceph/ceph/pull/5051
* |\
* | + "osd: cache pool: flush object ignoring cache min flush age when cache pool is full Signed-off-by: Xinze Chi <xmdxcxz@gmail.com>":https://github.com/ceph/ceph/commit/3f2fb8a996820843d0287a9337d38d80c7cb616b
* | + "osd: add local_mtime to struct object_info_t":https://github.com/ceph/ceph/commit/9969ae5710bc66e1e96125f22593ea1e0ba381af
* + "Pull request 5056":https://github.com/ceph/ceph/pull/5056
* |\
* | + "rgw/logrotate.conf: Rename service name":https://github.com/ceph/ceph/commit/00c94897368dc93a852ef6e6277e70405e7513ad
* + "Pull request 5062":https://github.com/ceph/ceph/pull/5062
* |\
* | + "Objecter: resend linger ops on any interval change":https://github.com/ceph/ceph/commit/d296120c144a62794483338fd696ca8089778e84
* | + "osd_types: factor out is_new_interval from check_new_interval":https://github.com/ceph/ceph/commit/a44b7b4bd870cc72e50a49900cd81fde6d40845b
* + "Pull request 5129":https://github.com/ceph/ceph/pull/5129
* |\
* | + "mon: remove unused variable":https://github.com/ceph/ceph/commit/1d2af55f8c69b4a382eb516d8f90a8316fd3bc02
* + "Pull request 5170":https://github.com/ceph/ceph/pull/5170
* |\
* | + "rgw: send Content-Length in response for HEAD on Swift account.":https://github.com/ceph/ceph/commit/2ee6e9a0cc6513097d6c9f9e40787a1c60c09796
* | + "rgw: send Content-Length in response for DELETE on Swift container.":https://github.com/ceph/ceph/commit/1b4536aa47fd6d2440fbd30b64b5b46eaa21215a
* | + "rgw: send Content-Length in response for PUT on Swift container.":https://github.com/ceph/ceph/commit/177324ced968b254458a450f8e348c96cbd10931
* | + "rgw: send Content-Length in response for GET on Swift container.":https://github.com/ceph/ceph/commit/0a580c4a23b985ede28cdfc751eed2a368473e09
* | + "rgw: enable end_header() to handle proposal of Content-Length.":https://github.com/ceph/ceph/commit/84525806a057054dca295f860e0a31d6936d4985
* + "Pull request 5171":https://github.com/ceph/ceph/pull/5171
* + "librbd: assertion failure race condition if watch disconnected":https://github.com/ceph/ceph/commit/3223bd604117b0b302b1e3e235ff9bced8e986bc

h4. rados

<code>./virtualenv/bin/teuthology-suite --priority 1000 --subset 1/18 --suite rados --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *green* http://pulpito.ceph.com/loic-2015-07-09_21:09:04-rados-firefly-backports---basic-multi

h4. rgw

<code>run=loic-2015-07-15_14:21:51-rgw-firefly-backports---basic-multi</code>
<code>eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/ | jq '.jobs[] | select(.status == "dead" or .status == "fail") | .description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')</code>
<code>./virtualenv/bin/teuthology-suite --priority 1000 --filter="$filter" --suite rgw --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *green* http://pulpito.ceph.com/smithfarm-2015-07-21_02:21:52-rgw-firefly-backports---basic-multi/

<pre>
run=loic-2015-07-09_21:11:18-rgw-firefly-backports---basic-multi
eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/ | jq '.jobs[] | select(.status == "dead" or .status == "fail") | .description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')
./virtualenv/bin/teuthology-suite --priority 1000 --filter="$filter" --suite rgw --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports
</pre>

* *red* http://pulpito.ceph.com/loic-2015-07-15_14:21:51-rgw-firefly-backports---basic-multi/
** *environmental noise* "skipping: no hosts matched":http://qa-proxy.ceph.com/teuthology/loic-2015-07-15_14:21:51-rgw-firefly-backports---basic-multi/974648/teuthology.log
** *environmental noise* "FATAL: all hosts have already failed -- aborting":http://qa-proxy.ceph.com/teuthology/loic-2015-07-15_14:21:51-rgw-firefly-backports---basic-multi/974651/teuthology.log

<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rgw --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *red* http://pulpito.ceph.com/loic-2015-07-09_21:11:18-rgw-firefly-backports---basic-multi
** *known bug* "Couldn't find index page for 'boto'":http://tracker.ceph.com/issues/12302

h4. fs

<code>run="loic-2015-07-16_13:13:38-fs-firefly-backports-testing-basic-multi"</code>
<code>eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/ | jq '.jobs[] | select(.status == "dead") | .description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')</code>
<code>./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite fs -k testing --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *green* *running* http://pulpito.ceph.com/smithfarm-2015-07-21_02:16:37-fs-firefly-backports-testing-basic-multi/

<code>eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/ | jq '.jobs[] | select(.status == "fail") | .description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')</code>
<code>./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite fs -k testing --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *one dead, otherwise green* http://pulpito.ceph.com/loic-2015-07-16_13:13:38-fs-firefly-backports-testing-basic-multi/

<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite fs -k testing --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *red* http://pulpito.ceph.com/loic-2015-07-09_21:07:09-fs-firefly-backports-testing-basic-multi
** *environmental problem* http://pulpito.ceph.com/loic-2015-07-09_21:07:09-fs-firefly-backports-testing-basic-multi/967283/
<pre>
2015-07-14T02:20:26.544 INFO:teuthology.misc:trying to connect to ubuntu@plana79.front.sepia.ceph.com
2015-07-14T02:20:26.544 INFO:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'plana79.front.sepia.ceph.com', 'timeout': 60}
2015-07-14T02:20:28.542 DEBUG:teuthology.orchestra.remote:[Errno 113] No route to host
</pre>
** *environmental problem* http://pulpito.ceph.com/loic-2015-07-09_21:07:09-fs-firefly-backports-testing-basic-multi/967319/
<pre>
2015-07-14T04:31:29.497 DEBUG:teuthology.misc:waited 63.8534479141
2015-07-14T04:31:30.498 INFO:teuthology.misc:trying to connect to ubuntu@plana69.front.sepia.ceph.com
2015-07-14T04:31:30.498 INFO:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'plana69.front.sepia.ceph.com', 'timeout': 60}
2015-07-14T04:32:30.498 DEBUG:teuthology.orchestra.remote:timed out
</pre>

h4. rbd

<code>run=loic-2015-07-09_16:57:58-rbd-firefly-backports---basic-multi</code>
<code>eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/ | jq '.jobs[] | select(.status == "dead" or .status == "fail") | .description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')</code>
<code>./virtualenv/bin/teuthology-suite --priority 1000 --filter="$filter" --suite rbd --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *green* http://pulpito.ceph.com/smithfarm-2015-07-21_02:28:01-rbd-firefly-backports---basic-multi/

<code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rbd --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *red* http://pulpito.ceph.com/loic-2015-07-09_16:57:58-rbd-firefly-backports---basic-multi
** *new bug* "adjust-ulimits ceph-coverage command fails in two different ways":http://tracker.ceph.com/issues/12336
<pre>
2015-07-14T02:59:32.995 INFO:tasks.qemu:starting qemu...
2015-07-14T02:59:32.995 INFO:teuthology.orchestra.run.mira077:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term qemu-system-x86_64 -enable-kvm -nographic -m 4096 -drive file=/home/ubuntu/cephtest/qemu/base.client.0.qcow2,format=qcow2,if=virtio -cdrom /home/ubuntu/cephtest/qemu/client.0.iso -drive file=rbd:rbd/client.0.0:id=0,format=raw,if=virtio,cache=none'
2015-07-14T02:59:32.997 DEBUG:teuthology.run_tasks:Unwinding manager qemu
2015-07-14T02:59:32.998 INFO:tasks.qemu:waiting for qemu tests to finish...
2015-07-14T02:59:33.096 INFO:tasks.qemu.client.0.mira077.stderr:Traceback (most recent call last):
2015-07-14T02:59:33.096 INFO:tasks.qemu.client.0.mira077.stderr: File "/usr/bin/daemon-helper", line 66, in <module>
2015-07-14T02:59:33.096 INFO:tasks.qemu.client.0.mira077.stderr: preexec_fn=os.setsid,
</pre>

h4. powercyle

<code>../virtualenv/bin/teuthology-suite -l2 -v -c firefly-backports -k testing -m plana,burnupi,mira -s powercycle -p 1000 --email ncutler@suse.cz</code>

* *green* http://pulpito.ceph.com/loic-2015-07-09_21:15:54-powercycle-firefly-backports-testing-basic-multi

h4. upgrade

<code>run=loic-2015-07-09_21:20:15-upgrade:firefly-x-firefly-backports-distro-basic-multi/</code>
<code>eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/ | jq '.jobs[] | select(.status == "dead" or .status == "fail") | .description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//')</code>
<code>./virtualenv/bin/teuthology-suite -v -c firefly-backports -k distro -m plana,burnupi,mira -s upgrade/firefly-x --filter "$filter" --email ncutler@suse.cz</code>

* *running* http://pulpito.ceph.com/smithfarm-2015-07-21_02:41:32-upgrade:firefly-x-firefly-backports-distro-basic-multi/

<code>./virtualenv/bin/teuthology-suite -v -c firefly-backports -k distro -m plana,burnupi,mira -s upgrade/firefly-x --filter ubuntu_14.04 --email ncutler@suse.cz</code>

* *red* http://pulpito.ceph.com/loic-2015-07-09_21:20:15-upgrade:firefly-x-firefly-backports-distro-basic-multi/
** *new bug* "adjust-ulimits ceph-coverage command fails in two different ways":http://tracker.ceph.com/issues/12336

h3. teuthology run commit:73cad63e89ebeb9de47c7f2a2187deff8c39d590 (firefly-backports may 2015)

h4. rados

<code>./virtualenv/bin/teuthology-suite --priority 1000 --subset 1/18 --suite rados --suite-branch firefly --machine-type plana,burnupi,mira --distro ubuntu --email ncutler@suse.cz --ceph firefly-backports</code>

* *red* http://pulpito.ceph.com/loic-2015-05-29_16:20:09-rados-firefly-backports---basic-multi/
** *known bug* "ceph-objectstore-tool: import failure with status 139":http://tracker.ceph.com/issues/11142
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/ec-small-objects.yaml}":http://pulpito.ceph.com/loic-2015-05-29_16:20:09-rados-firefly-backports---basic-multi/914831
** *environmental problem* "sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart":http://tracker.ceph.com/issues/11126
*** "rados/verify/{1thrash/default.yaml clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/few.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml}":http://pulpito.ceph.com/loic-2015-05-29_16:20:09-rados-firefly-backports---basic-multi/914814
*** "rados/thrash/{clusters/fixed-2.yaml fs/btrfs.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/radosbench.yaml}":http://pulpito.ceph.com/loic-2015-05-29_16:20:09-rados-firefly-backports---basic-multi/914794
** *known bug* "[ERR] 3.0s0 scrub stat mismatch, got 2005/2009 objects, 0/0 clones, 2005/2009 dirty, 0/0 omap, 0/0 hit_set_archive, 0/0 whiteouts, 3981889330/3988381157 bytes. in cluster log":http://tracker.ceph.com/issues/8752
*** "rados/thrash/{clusters/fixed-2.yaml fs/xfs.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml}":http://pulpito.ceph.com/loic-2015-05-29_16:20:09-rados-firefly-backports---basic-multi/914811

Back