Tasks #11153
Updated by Loïc Dachary about 9 years ago
h3. Workflow * "Preparing the release":http://ceph.com/docs/master/dev/development-workflow/#preparing-a-new-release * "Cutting the release":http://ceph.com/docs/master/dev/development-workflow/#cutting-a-new-stable-release ** Abhishek asks Sage if a point release should be published ** Abhishek gets approval from all leads *IN PROGRESS* *** Yehuda, rgw: "OK":http://www.spinics.net/lists/ceph-devel/msg23573.html *** Gregory, CephFS: "OK":http://www.spinics.net/lists/ceph-devel/msg23572.html *** Josh, RBD: "OK":http://www.spinics.net/lists/ceph-devel/msg23575.html *** Sam, rados: "OK":http://www.spinics.net/lists/ceph-devel/msg23574.html "waiting":http://www.spinics.net/lists/ceph-devel/msg23574.html ** Sage writes and commits the release notes *IN PROGRESS* ** Abhishek informs Yuri that the branch is ready for testing *IN PROGRESS* ** Yuri runs additional integration tests ** If Yuri discovers new bugs with severity Critical, the relase goes back to being prepared, it was not ready after all ** Yuri informs Alfredo that the branch is ready for release ** Alfredo creates the packages and sets the release tag h3. Release information * branch to build from: giant, commit:??? * version: v0.87.2 * type of release: point release * where to publish the release: debian/rpm-$release <code>git --no-pager log --format='%H %s' --graph tags/v0.87.1..ceph/giant | perl -p -e 's/"/ /g; if (/\w+\s+Merge pull request #(\d+)/) { s|\w+\s+Merge pull request #(\d+).*|"Pull request $1":https://github.com/ceph/ceph/pull/$1|; } else { s|(\w+)\s+(.*)|"$2":https://github.com/ceph/ceph/commit/$1|; } s/\*/+/; s/^/* /;'</code> * + "Pull request 4214":https://github.com/ceph/ceph/pull/4214 * |\ * | + "osd: Get pgid ancestor from last_map when building past intervals":https://github.com/ceph/ceph/commit/9e9c3c652339d85863af01cac621228f04eb4f18 * + | "Pull request 4258":https://github.com/ceph/ceph/pull/4258 * |\ \ * | + | "mon: MDSMonitor: wait for osdmon to be writable when requesting proposal":https://github.com/ceph/ceph/commit/5f4e62f382767ee69e5b0c701b1a01d9e4132237 * | + | "mon: MDSMonitor: have management_command() returning int instead of bool":https://github.com/ceph/ceph/commit/257bd17db6470ca050403b1c8ff8daa94a4b80b5 * | |/ * + | "Pull request 4261":https://github.com/ceph/ceph/pull/4261 * |\ \ * | |/ * |/| * | + "allow -L to disable lttng. Enable it by default":https://github.com/ceph/ceph/commit/7684ee25ac21810153a44bdc4fc00b36e39eb12f * |/ * + "Pull request 4175":https://github.com/ceph/ceph/pull/4175 * |\ * | + "Objecter: failed assert(tick_event==NULL) at osdc/Objecter.cc":https://github.com/ceph/ceph/commit/9f1f35546e00e8f1ecbce0697d59b64f3537facf * |/ * + "Pull request 4127":https://github.com/ceph/ceph/pull/4127 * |\ * | + "ceph-objectstore-tool: Output only unsupported features when incomatible":https://github.com/ceph/ceph/commit/de4b08704172ac31b511dde50e5c11d58d811ca2 * + | "Pull request 4097":https://github.com/ceph/ceph/pull/4097 * |\ \ * | + | "librados: Translate operation flags from C APIs":https://github.com/ceph/ceph/commit/fc43d8c2c54ec9e9cb6ef4d19cca695eb2fb3aab * + | | "Pull request 4096":https://github.com/ceph/ceph/pull/4096 * |\ \ \ * | + | | "Objecter: check the 'initialized' atomic_t safely":https://github.com/ceph/ceph/commit/d790833cb84d6f6349146e4f9abdcdffb4db2ee0 * | + | | "Objecter: init with a constant of the correct type":https://github.com/ceph/ceph/commit/ce436a33e0f720ea4b8cf0363bcac1126be3c28b * | |/ / * + | | "Pull request 4095":https://github.com/ceph/ceph/pull/4095 * |\ \ \ * | + | | "CrushWrapper: pick a ruleset same as rule_id":https://github.com/ceph/ceph/commit/970a79753dc52d82d2abf29ffe6f88adac678eb0 * | |/ / * + | | "Pull request 4094":https://github.com/ceph/ceph/pull/4094 * |\ \ \ * | + | | "DBObjectMap: lock header_lock on sync()":https://github.com/ceph/ceph/commit/76535116823f02f0392226e5725fbfef14c277ba * | |/ / * + | | "Pull request 4093":https://github.com/ceph/ceph/pull/4093 * |\ \ \ * | + | | "osd: cache tiering: fix the atime logic of the eviction":https://github.com/ceph/ceph/commit/13b01473c5c1a116d6cd6acbbb6cbe08ee6e9433 * | |/ / * + | | "Pull request 4092":https://github.com/ceph/ceph/pull/4092 * |\ \ \ * | + | | "osd/ReplicatedPG: fix compile error":https://github.com/ceph/ceph/commit/13b8364dc869b2eefcb6646cff1e18c31126ce7d * | + | | "Get the currently atime of the object in cache pool for eviction":https://github.com/ceph/ceph/commit/55541b90db0a6d6c26c1fae6a4958fa5a320f82c * | |/ / * + | | "Pull request 4091":https://github.com/ceph/ceph/pull/4091 * |\ \ \ * | + | | "osdc/Objecter: Fix a bug of dead looping in Objecter::handle_osd_map":https://github.com/ceph/ceph/commit/5550cdd876db913b152edad17a4de16bded31627 * | + | | "osdc/Objecter: e shouldn't be zero in Objecter::handle_osd_map":https://github.com/ceph/ceph/commit/7c5056f5cf77065e0e5a920f525f0a3be6b4b299 * | |/ / * + | | "Pull request 4090":https://github.com/ceph/ceph/pull/4090 * |\ \ \ * | + | | "PG: always clear_primary_state on new interval, but only clear pg temp if not primary":https://github.com/ceph/ceph/commit/21f81b85de652aede51e88b87bdff71f2e411da3 * | + | | "PG: always clear_primary_state when leaving Primary":https://github.com/ceph/ceph/commit/0c3f7637d8cf2146a4268330d8c0506ad38c354d * | |/ / * + | | "Pull request 4089":https://github.com/ceph/ceph/pull/4089 * |\ \ \ * | + | | "SimpleMessenger: allow RESETSESSION whenever we forget an endpoint":https://github.com/ceph/ceph/commit/1ccf58355d0796172935938572cf68ceb31a6801 * | |/ / * + | | "Pull request 4088":https://github.com/ceph/ceph/pull/4088 * |\ \ \ * | + | | "FileJournal: fix journalq population in do_read_entry()":https://github.com/ceph/ceph/commit/3e875ab108de8d2aa3717f76a3fe48ede286abb7 * | |/ / * + | | "Pull request 4082":https://github.com/ceph/ceph/pull/4082 * |\ \ \ * | + | | "rgw: flush xml header on get acl request":https://github.com/ceph/ceph/commit/96a5c67121dde0d4d4cd13793bb131414b64cc28 * | |/ / * + | | "Pull request 4078":https://github.com/ceph/ceph/pull/4078 * |\ \ \ * | + | | "doc,tests: force checkout of submodules":https://github.com/ceph/ceph/commit/c7b02f5a7347ea8688c5214f85bb9f612925a586 * | |/ / * + | | "Pull request 4077":https://github.com/ceph/ceph/pull/4077 * |\ \ \ * | + | | "ReplicatedPG::scan_range: an object can disappear between the list and the attr get":https://github.com/ceph/ceph/commit/4d4eb9faf1871c4469b78a7ee75d527ce5cc67ad * | |/ / * + | | "Pull request 4076":https://github.com/ceph/ceph/pull/4076 * |\ \ \ * | + | | "common: do not unlock rwlock on destruction":https://github.com/ceph/ceph/commit/499d94f573e78f6545bd5a12ade6b5ba5a75bbca * | |/ / * + | | "Pull request 4074":https://github.com/ceph/ceph/pull/4074 * |\ \ \ * | + | | "mon: Paxos: reset accept timeout before submiting work to the store":https://github.com/ceph/ceph/commit/b79852f3ab0643bbb3f6b71a56b15e5a4b5fc1f5 * | + | | "mon: MonitorDBStore: allow randomly injecting random delays on writes":https://github.com/ceph/ceph/commit/e997c9fed5feb3e877dfe07ffac1327b85d09ea2 * | |/ / * + | | "Pull request 3548":https://github.com/ceph/ceph/pull/3548 * |\ \ \ * | + | | "mon: MDSMonitor: don't return -EINVAL if function is bool":https://github.com/ceph/ceph/commit/b318e2ffc3faedf6b02908429eb4ce79147d3471 * | + | | "mon: MDSMonitor: check all conditions are met *before* osdmon proposal":https://github.com/ceph/ceph/commit/a1a7d856f5409280b6345afbbd961bcd8ee8d046 * | + | | "mon: MDSMonitor: return if fs exists on 'fs new'":https://github.com/ceph/ceph/commit/0df7cf1e58bc4d77c69354f2a7160e3d9e6d1fc1 * | / / * + | | "Pull request 4053":https://github.com/ceph/ceph/pull/4053 * |\ \ \ * | + | | "ReplicatedPG: fail a non-blocking flush if the object is being scrubbed":https://github.com/ceph/ceph/commit/681c99fe12cfa6318f8cf06f4e825805635bcc07 * + | | | "Pull request 4052":https://github.com/ceph/ceph/pull/4052 * |\ \ \ \ * | + | | | "mon: MonCap: take EntityName instead when expanding profiles":https://github.com/ceph/ceph/commit/4427358bb556d902b01df27fd097cc3eefa561da * | + | | | "mon: Monitor: stash auth entity name in session":https://github.com/ceph/ceph/commit/8902279dd4b52516d59db712bd59e8d9372611a6 * | | |/ / * | |/| | * + | | | "Pull request 4050":https://github.com/ceph/ceph/pull/4050 * |\ \ \ \ * | + | | | "ShardedThreadPool: make wait timeout on empty queue configurable":https://github.com/ceph/ceph/commit/1d4ffbe1d233de555c1ecb0a33eebe2391b29f33 * | + | | | "WorkQueue: make wait timeout on empty queue configurable":https://github.com/ceph/ceph/commit/292c4339c064968c2aa05eec701fbc2a8d82dab0 * | |/ / / * + | | | "Pull request 4049":https://github.com/ceph/ceph/pull/4049 * |\ \ \ \ * | + | | | "mon/OSDMonitor: do not trust small values in osd epoch cache":https://github.com/ceph/ceph/commit/92c352d047c84035478e71828e32f554d9f507fc * | | |/ / * | |/| | * + | | | "Pull request 4048":https://github.com/ceph/ceph/pull/4048 * |\ \ \ \ * | + | | | "rgw: send appropriate op to cancel bucket index pending operation":https://github.com/ceph/ceph/commit/25fcaca19c76765284787c61584d25efd105a0ca * | |/ / / * + | | | "Pull request 4046":https://github.com/ceph/ceph/pull/4046 * |\ \ \ \ * | + | | | "rados.py: keep reference to python callbacks":https://github.com/ceph/ceph/commit/28583276254ba6121b93688a6c6d8fab6588c864 * | + | | | "Fix memory leak in python rados bindings":https://github.com/ceph/ceph/commit/1b5fb51a995d5d672a46176240d5887354c12967 * | |/ / / * + | | | "Pull request 4044":https://github.com/ceph/ceph/pull/4044 * |\ \ \ \ * | + | | | "osd: do not ignore deleted pgs on startup":https://github.com/ceph/ceph/commit/d5b1b7e52242e082820e0cdd76dc59e9aea7f284 * | |/ / / * + | | | "Pull request 4034":https://github.com/ceph/ceph/pull/4034 * |\ \ \ \ * | + | | | "rgw: Swift API. Support for X-Remove-Container-Meta-{key} header.":https://github.com/ceph/ceph/commit/c3d998e4c3c9d90b50c3f6c0af7d48785616e032 * | | |/ / * | |/| | * + | | | "Pull request 4033":https://github.com/ceph/ceph/pull/4033 * |\ \ \ \ * | |_|_|/ * |/| | | * | + | | "rgw: index swift keys appropriately":https://github.com/ceph/ceph/commit/fa8d45423e22f7b916a345024a9f70283fc3097d * | | |/ * | |/| * + | | "Pull request 3971":https://github.com/ceph/ceph/pull/3971 * |\ \ \ * | + | | "mds: fix assertion caused by system clock backwards":https://github.com/ceph/ceph/commit/61d600687ae6887a2edea0e79d582b1353558a83 * | |/ / * + | | "PGLog: include rollback_info_trimmed_to in (read|write)_log":https://github.com/ceph/ceph/commit/fea29b1bcbd17b3d1f642398ec70dbe258bbc98f * | |/ * |/| * + | "Pull request 4042":https://github.com/ceph/ceph/pull/4042 * |\ \ * | + | "mon: Monitor: fix timecheck rounds period":https://github.com/ceph/ceph/commit/fe7d4ca17dacf4419be7bdc50010115cee36517b * | |/ * + | "Pull request 4047":https://github.com/ceph/ceph/pull/4047 * |\ \ * | + | "mon: ignore osd failures from before up_from":https://github.com/ceph/ceph/commit/e7af52a147cc6e1a578d51193a2d5a425cee8a20 * | |/ * + | "Pull request 4041":https://github.com/ceph/ceph/pull/4041 * |\ \ * | + | "osd: requeue blocked op before flush it was blocked on":https://github.com/ceph/ceph/commit/5771f57af731e61bf70f630cf85f5b94dcfd1edb * | |/ * + | "Pull request 4031":https://github.com/ceph/ceph/pull/4031 * |\ \ * | + | "crush: set_choose_tries = 100 for erasure code rulesets":https://github.com/ceph/ceph/commit/5fca232080c0bde50b5c65c60c133bf81311e8d3 * | |/ * + | "Pull request 4029":https://github.com/ceph/ceph/pull/4029 * |\ \ * | + | "msg/Pipe: discard delay queue before incoming queue":https://github.com/ceph/ceph/commit/30a17441f5030ac5c1227a9672811f88e580b4b2 * | |/ * + | "Pull request 4030":https://github.com/ceph/ceph/pull/4030 * |\ \ * | + | "mount.ceph: avoid spurious error message":https://github.com/ceph/ceph/commit/4bd523744cefb4a5e6b0d4440b9829b0e19dc012 * | |/ * + | "Pull request 4028":https://github.com/ceph/ceph/pull/4028 * |\ \ * | + | "osd_types: op_queue_age_hist and fs_perf_stat should be in osd_stat_t::operator==":https://github.com/ceph/ceph/commit/8307318cdf9487dde3231aa4a00fca6079379738 * | |/ * + | "Pull request 4027":https://github.com/ceph/ceph/pull/4027 * |\ \ * | + | "mon: PGMonitor: skip zeroed osd stats on get_rule_avail()":https://github.com/ceph/ceph/commit/a5a76f81ae9242a54d6ef150fa0ac32b31e90c25 * | + | "mon: PGMonitor: available size 0 if no osds on pool's ruleset":https://github.com/ceph/ceph/commit/95ec68505ce4a26ea707716791cfb1e46a75ed25 * | + | "mon: PGMonitor: fix division by zero on stats dump":https://github.com/ceph/ceph/commit/1c480b39acc184018d976beddc55187f86dfff1a * | |/ * + | "Pull request 3998":https://github.com/ceph/ceph/pull/3998 * |\ \ * | + | "doc: Fix ceph command manpage to match ceph -h (giant)":https://github.com/ceph/ceph/commit/640986fdef3543c7469e43853900b63d7b2f6f36 * | + | "doc: Minor fixes to ceph command manpage":https://github.com/ceph/ceph/commit/ec4c8997a67397e3ba5f335e444586f6f1a7864c * | + | "doc: Fix ceph command manpage to match ceph -h (firefly)":https://github.com/ceph/ceph/commit/15e1c6fb3a0e2e191025f96df33feaf115c1411d * | + | "doc: Changes format style in ceph to improve readability as html.":https://github.com/ceph/ceph/commit/17d03e8e8b055ed50b1abb679a0dd1edf4ec3f30 * | + | "doc: Adds man page for ceph.":https://github.com/ceph/ceph/commit/f1c9c71fd6d566687db05e1d8f15b04a9f793005 * | |/ * + | "Pull request 3921":https://github.com/ceph/ceph/pull/3921 * |\ \ * | + | "Fix libstriprados::stat, use strtoll insdead of strtol":https://github.com/ceph/ceph/commit/8a5a3c7a20517c7482dc9f5f2783a3da54bd4f23 * | + | "Fix libstriprados::remove, use strtoll insdead of strtol":https://github.com/ceph/ceph/commit/5d423a5188c62650eaa39077eb99a84085f5f3e2 * | |/ * + | "Pull request 3819":https://github.com/ceph/ceph/pull/3819 * |\ \ * | + | "osd: fix PG leak in SnapTrimWQ._clear()":https://github.com/ceph/ceph/commit/984df3b865f295ecf77b041a69d1d59384d80671 * | / * + | "Pull request 3771":https://github.com/ceph/ceph/pull/3771 * |\ \ * | + | "osd: Fix FileJournal wrap to get header out first":https://github.com/ceph/ceph/commit/c5c6fcd6ad7a0317301970bc25419727ee3192fa * | / * + | "Pull request 3637":https://github.com/ceph/ceph/pull/3637 * |\ \ * | |/ * |/| * | + "libradosstriper: fixed write_full when ENOENT":https://github.com/ceph/ceph/commit/37f196e80906d6b855ca0a7ce7344d1f8f50ae7f * + "Objecter::_op_submit_with_budget: add timeout before call":https://github.com/ceph/ceph/commit/938e03630e075af03780da139ae879b5b0377734 h3. Synchronized pull requests * -"rgw acl response should start with <?xml version...":http://tracker.ceph.com/issues/10106 https://github.com/ceph/ceph-qa-suite/pull/370 https://github.com/ceph/ceph/pull/4082- h3. Inventory * http://workbench.dachary.org/ceph/ceph-backports/wikis/giant h3. teuthology run commit:538d012a30361d7fb33ee19632103a1ff242dee3 (giant-backports branch april 2015) Commits added after the commit on which the previous tests were done: <pre> $ git log --no-merges --oneline 02f9cdbf889071ca6fe3811d9b9a92a0b630fa55..ceph/giant-backports 5f4e62f mon: MDSMonitor: wait for osdmon to be writable when requesting proposal 257bd17 mon: MDSMonitor: have management_command() returning int instead of bool 9e9c3c6 osd: Get pgid ancestor from last_map when building past intervals 9f1f355 Objecter: failed assert(tick_event==NULL) at osdc/Objecter.cc de4b087 ceph-objectstore-tool: Output only unsupported features when incomatible </pre> It does not seem necessary to run the rbd and rgw suites again. h4. rados <pre> ./virtualenv/bin/teuthology-suite --filter-out btrfs,ext4 --priority 1000 --suite rados --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner abhishek.lekshmanan@gmail.com --ceph giant-backports </pre> * *green* http://pulpito.ceph.com/abhi-2015-04-03_10:47:06-rados-giant-backports---basic-multi/ *** *dead* "fs/thrash/{ceph/base.yaml ceph-thrash/default.yaml clusters/mds-1active-1standby.yaml debug/mds_client.yaml fs/btrfs.yaml msgr-failures/osd-mds-delay.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_suites_pjd.yaml}":http://pulpito.ceph.com/abhi-2015-04-03_10:40:03-fs-giant-backports-testing-basic-multi/835540 All the other suites are green Rescheduled as <pre> eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=dead | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter "$filter" --priority 1000 --suite rados --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner abhishek.lekshmanan@gmail.com --ceph giant-backports </pre> * *green* http://pulpito.ceph.com/abhi-2015-04-06_16:02:21-rados-giant-backports---basic-multi/ h4. fs <pre> ./virtualenv/bin/teuthology-suite -k testing --priority 1000 --suite fs --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner abhishek.lekshmanan@gmail.com --ceph giant-backports </pre> * *green* http://pulpito.ceph.com/abhi-2015-04-03_10:40:03-fs-giant-backports-testing-basic-multi/ ** *dead* http://pulpito.ceph.com/abhi-2015-04-03_10:40:03-fs-giant-backports-testing-basic-multi/835540/ Rescheduled as <pre> eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=dead | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite -k testing --filter "$filter" --p riority 1000 --suite fs --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email abhishek.lekshmanan@gmail.com --owner abhishek.lekshmanan@gmail.com --ceph giant-backports </pre> ** *green* http://pulpito.ceph.com/abhi-2015-04-05_11:40:04-fs-giant-backports-testing-basic-multi/ h3. teuthology run commit:02f9cdbf889071ca6fe3811d9b9a92a0b630fa55 (giant branch march 2015) h4. rados <pre> run=loic-2015-03-23_01:09:31-rados-giant---basic-multi eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=dead | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter "$filter" --priority 1000 --suite rados --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter "$filter" --priority 1000 --suite rados --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant </pre> * *green* http://pulpito.ceph.com/loic-2015-03-27_09:01:25-rados-giant---basic-multi/ (dead from the previous run) * *green* http://pulpito.ceph.com/loic-2015-03-27_09:03:04-rados-giant---basic-multi/ (fail from the previous run) <pre> ./virtualenv/bin/teuthology-suite --filter-out btrfs,ext4 --priority 1000 --suite rados --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant </pre> * *aborted* http://pulpito.ceph.com/loic-2015-03-23_01:09:31-rados-giant---basic-multi/ (to not run against more important test suites) h4. rgw -Waiting on http://tracker.ceph.com/issues/11180- <pre> ./virtualenv/bin/teuthology-suite --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant </pre> * *green* http://pulpito.ceph.com/abhi-2015-03-29_17:16:17-rgw-giant---basic-multi/ Re run of the failed test suite to confirm we are not affected by environmental noise. The tests have passed this time, though, if we analyze the logs between the "failed run":http://pulpito.ceph.com/loic-2015-03-27_08:40:06-rgw-giant---basic-multi/824286 and this run, there is not much difference that indicates any network failure; primary differences that could be observed between the 2 runs are: in the failed run, as the test starts we can observe a: <pre> 2015-03-27T15:31:24.082 INFO:tasks.rgw.client.0.mira012.stdout:2015-03-27 15:31:24.082177 7f1bc0ff9700 -1 failed to list objects pool_iterate returned r=-2 </pre> which might probably indicate the cause of failure. This is not seen in the successful run, however in the successful run; at the beginning, apt update fails on one of the sources (though this shouldn't technically affect the test run) <pre> 2015-03-29T04:48:53.694 INFO:teuthology.orchestra.run.plana82.stderr:W: Failed to fetch http://apt-mirror.front.sepia.ceph.com/archive.ubuntu.com/ubuntu/dists/precise-backports/restricted/i18n/Index No sections in Release file /var/lib/apt/lists/partial/apt-mirror.front.sepia.ceph.com_archive.ubuntu.com_ubuntu_dists_precise-backports_restricted_i18n_Index 2015-03-29T04:48:53.694 INFO:teuthology.orchestra.run.plana82.stderr: 2015-03-29T04:48:53.694 INFO:teuthology.orchestra.run.plana82.stderr:E: Some index files failed to download. They have been ignored, or old ones used instead. </pre> * *red* http://pulpito.ceph.com/loic-2015-03-27_08:40:06-rgw-giant---basic-multi/ ** *new bug* potential regression, s3 bucket quota tests failed, reported issue http://tracker.ceph.com/issues/11259 <pre> 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=90b37d9bdcc044e26f978632cd68f19ece82d19a TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rgw/s3_bucket_quota.pl'* </pre> *** "rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/replicated.yaml tasks/rgw_bucket_quota.yaml}":http://pulpito.ceph.com/loic-2015-03-27_08:40:06-rgw-giant---basic-multi/824286 h4. rbd <pre> ./virtualenv/bin/teuthology-suite --priority 1000 --suite rbd --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant </pre> * *green* http://pulpito.ceph.com/loic-2015-03-23_01:04:10-rbd-giant---basic-multi/ h4. fs <pre> ./virtualenv/bin/teuthology-suite -k testing --priority 1000 --suite fs --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant </pre> * *green* http://pulpito.ceph.com/loic-2015-03-22_23:57:16-fs-giant-testing-basic-multi/ h3. teuthology run commit:b6bebbbc99540b76221aeccb3693784b414f607b (giant integration branch, march 2015) The is one potential regression (does not happen all the time but appears to be new) : "osdc/Objecter.cc: 405: FAILED assert(tick_event == __null)":http://tracker.ceph.com/issues/11183 h4. rados <pre> run=loic-2015-03-19_19:01:57-rados-giant-backports---basic-multi eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rados --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports </pre> * *green* http://pulpito.ceph.com/loic-2015-03-20_17:38:25-rados-giant-backports---basic-multi/ <code>./virtualenv/bin/teuthology-suite --filter-out btrfs,ext4 --priority 1000 --suite rados --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports</code> * *red* http://pulpito.ceph.com/loic-2015-03-19_19:01:57-rados-giant-backports---basic-multi ** *environmental noise* NTP problems : cluster [WRN] message from mon.1 was stamped 0.897801s in the future, clocks not synchronized" in cluster log *** "rados/thrash-erasure-code-isa/{clusters/fixed-2.yaml distros/rhel_7.0.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml}":http://pulpito.ceph.com/loic-2015-03-19_19:01:57-rados-giant-backports---basic-multi/811652 ** *new bug* "osdc/Objecter.cc: 405: FAILED assert(tick_event == __null)":http://tracker.ceph.com/issues/11183 *** "rados/monthrash/{ceph/ceph.yaml clusters/3-mons.yaml fs/xfs.yaml msgr-failures/few.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml}":http://pulpito.ceph.com/loic-2015-03-19_19:01:57-rados-giant-backports---basic-multi/811322 h4. rgw <pre> run=loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch wip-rgw-regional-summary --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports </pre> * *green* http://pulpito.ceph.com/loic-2015-03-22_20:48:29-rgw-giant-backports---basic-multi/ The previous run failed because of "ensure summary is looked for the user we need (part 2)":https://github.com/ceph/ceph-qa-suite/pull/375 which was also "backported to the giant branch":https://github.com/ceph/ceph-qa-suite/pull/376 <pre> run=loic-2015-03-20_00:17:55-rgw-giant-backports---basic-multi eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch wip-rgw-regional-summary --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports </pre> * *red* http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/ ** *environmental error* Download error on https://pypi.python.org/simple/ *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815909 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815907 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815905 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815903 ** *needs fixing* Remote branch wip-rgw-regional-summary not found in upstream origin, using HEAD instead, because the wip-rgw-regional-summary branch does not exist *** "rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815901 *** "rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/ec-cache.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815899 *** "rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/ec.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815897 *** "rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/ec-cache.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815895 ** *needs fixing* 'git clone -b wip-rgw-regional-summary git://ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests' because the wip-rgw-regional-summary branch does not exist *** "rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815902 *** "rgw/multifs/{clusters/fixed-2.yaml frontend/civetweb.yaml fs/xfs.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815900 *** "rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/replicated.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815898 *** "rgw/multifs/{clusters/fixed-2.yaml frontend/apache.yaml fs/xfs.yaml rgw_pool_type/ec-profile.yaml tasks/rgw_s3tests.yaml}":http://pulpito.ceph.com/loic-2015-03-22_19:18:01-rgw-giant-backports---basic-multi/815896 Before v0.87.1 was released 6b08a729540c61f3c8b15c5a3ce9382634bf800c was tested at http://tracker.ceph.com/issues/10501#rgw and came back ok. There was a few commits merged in between: <pre> git log --no-merges --oneline tags/v0.87.1 ^6b08a729540c61f3c8b15c5a3ce9382634bf800c^ 283c2e7 0.87.1 734e9af osd: tolerate sessionless con in fast dispatch path ccb0914 qa: use correct binary path on rpm-based systems df8285c fsync-tester: print info about PATH and locations of lsof lookup 91515e7 osdc: Constrain max number of in-flight read requests </pre> Later commit:ccb0914f76da23acdd7374233cd1939ab80ef3c8 was tested at http://pulpito.ceph.com/teuthology-2015-02-12_17:41:04-rgw-giant-distro-basic-multi/ and was green. Two commits were merged after that and before v0.87.1 was released: <pre> $ git log --oneline tags/v0.87.1 ^ccb0914f76da23acdd7374233cd1939ab80ef3c8^ 283c2e7 0.87.1 4178e32 Merge pull request #3731 from liewegas/wip-10834-giant 734e9af osd: tolerate sessionless con in fast dispatch path ccb0914 qa: use correct binary path on rpm-based systems </pre> <pre> filter='rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/replicated.yaml}' ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph v0.87.1 </pre> The problem seems to be related to "rgwadmin tasks assumes non-regional output":http://tracker.ceph.com/issues/11180 that was fixed two days ago. But why did it manifest itself all of a sudden and changes things for a branch that was otherwise unmodified ? * *red* http://pulpito.ceph.com/loic-2015-03-22_14:55:18-rgw-v0.87.1---basic-multi/ (v0.87.1) <pre> filter='rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/replicated.yaml}' ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant </pre> * *red* http://pulpito.ceph.com/loic-2015-03-22_12:55:06-rgw-giant---basic-multi/ (giant branch) <pre> run=loic-2015-03-20_00:17:55-rgw-giant-backports---basic-multi eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch wip-rgw-acl-giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports </pre> * *red* http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/ ** *???* tasks/radosgw_admin.py assert time.time() - timestamp <= (20 x 60) *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815807 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815806 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815805 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815803 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815802 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815801 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815798 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815797 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815796 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815795 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815794 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815792 ** *environmental noise* Command failed with status 1: 'cd /home/ubuntu/cephtest && cd radosgw-agent.client.0 && ./bootstrap' *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815800 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815793 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815799 ** *environmental noise* No route to host (113) plana59 is down *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-22_10:53:10-rgw-giant-backports---basic-multi/815804 <pre> run=loic-2015-03-20_00:17:55-rgw-giant-backports---basic-multi eval filter=$(curl --silent http://paddles.front.sepia.ceph.com/runs/$run/jobs/?status=fail | jq '.[].description' | while read description ; do echo -n $description, ; done | sed -e 's/,$//') ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch wip-rgw-acl-giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports </pre> * *red* http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/ ** the s3-tests referred to a branch wip-acl-giant which didn't exist in https://github.com/ceph/s3-tests, "pushed the wip-acl-giant branch":https://github.com/ceph/s3-tests/tree/wip-rgw-acl-giant and trying again ** *tasks/radosgw_admin.py assert time.time() - timestamp <= (20 x 60) * *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813491 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813490 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813489 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/civetweb.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813488 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813487 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813486 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813485 *** "rgw/singleton/{all/radosgw-admin-multi-region.yaml frontend/apache.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813484 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813483 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813482 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813481 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/civetweb.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813480 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/replicated.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813479 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813478 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec-profile.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813477 *** "rgw/singleton/{all/radosgw-admin-data-sync.yaml frontend/apache.yaml rgw_pool_type/ec-cache.yaml}":http://pulpito.ceph.com/loic-2015-03-20_17:58:01-rgw-giant-backports---basic-multi/813476 <code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rgw --filter-out btrfs,ext4 --suite-branch wip-rgw-acl-giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports</code> * *red* http://pulpito.ceph.com/loic-2015-03-19_18:55:59-rgw-giant-backports---basic-multi ** assuming that all 24 failed jobs are environmental noise h4. rbd <pre> filter='rbd/librbd/{cache/none.yaml cachepool/small.yaml clusters/fixed-3.yaml fs/btrfs.yaml msgr-failures/few.yaml workloads/qemu_xfstests.yaml}' ./virtualenv/bin/teuthology-suite --filter="$filter" --priority 1000 --suite rbd --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports </pre> * *green* http://pulpito.ceph.com/loic-2015-03-20_17:46:39-rbd-giant-backports---basic-multi/ <code>./virtualenv/bin/teuthology-suite --priority 1000 --suite rbd --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports</code> * *red* http://pulpito.ceph.com/loic-2015-03-19_18:53:40-rbd-giant-backports---basic-multi ** *environmental noise* plana34.stdout:[15188.076023] BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:0:12689] *** "rbd/librbd/{cache/none.yaml cachepool/small.yaml clusters/fixed-3.yaml fs/btrfs.yaml msgr-failures/few.yaml workloads/qemu_xfstests.yaml}":http://pulpito.ceph.com/loic-2015-03-19_18:53:40-rbd-giant-backports---basic-multi/811021/ h4. fs <code>./virtualenv/bin/teuthology-suite -k testing --priority 1000 --suite fs --suite-branch giant --machine-type plana,burnupi,mira --distro ubuntu --email loic@dachary.org --owner loic@dachary.org --ceph giant-backports</code> * *green* http://pulpito.ceph.com/loic-2015-03-19_18:52:05-fs-giant-backports-testing-basic-multi