Project

General

Profile

Activity

From 01/13/2015 to 02/11/2015

02/11/2015

10:35 PM Revision d79d4d7e (teuthology): Merge pull request #432 from ceph/pytest-stdout
Make pytest capture stdout when running the tests task Zack Cerza
10:23 PM Revision ed865477 (teuthology): Make pytest capture stdout when running the tests task
This makes the logs easier to read.
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Andrew Schoen
09:44 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
We really need to know if we're going to continue supporting both modules. If we're going to continue to support mod_... Zack Cerza
09:39 PM Feature #10551 (Need More Info): test RGW with mod_proxy_fcgi instead of mod_fastcgi
Andrew Schoen
09:17 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
Ken, thanks. Those configs are helpful. FastCgiIPCDir and FastCgiExternalServer are specific to mod_fastcgi so I assu... Andrew Schoen
08:33 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
Yehuda is telling me that we will in fact need to support both modules. Here's the breakdown as I understand it now:
...
Zack Cerza
06:19 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
Here's the sample configs that Yehuda gave to John and me a while back.
Note that there's a difference here depend...
Ken Dreyer
05:52 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
We're also setting a few things in the apache.conf for mod_fastcgi that we'll need mod_proxy_fcgi equivalents for.
...
Andrew Schoen
03:29 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
We'll need to add this config to the apache template in ceph-qa-suite to enable mod_proxy and mod_proxy_fcgi:
Load...
Andrew Schoen
09:35 PM Revision 30ff46f6 (teuthology): hadoop: 2x
Signed-off-by: Noah Watkins <noahwatkins@gmail.com> Noah Watkins
09:35 PM Revision 1dd91832 (teuthology): misc: create prepend_lines helper
Signed-off-by: Noah Watkins <noahwatkins@gmail.com> Noah Watkins
09:35 PM Revision 8e0d1437 (teuthology): hadoop: easier config creation
Signed-off-by: Noah Watkins <noahwatkins@gmail.com> Noah Watkins
09:35 PM Revision 10445429 (teuthology): hadoop: support cephfs
Signed-off-by: Noah Watkins <noahwatkins@gmail.com> Noah Watkins
09:35 PM Revision 4d1032ea (teuthology): hadoop: separate ceph/hdfs config actions
Signed-off-by: Noah Watkins <noahwatkins@gmail.com> Noah Watkins
09:34 PM Feature #10680: qemu task relies on virtio-9p, which is not available in centos/rhel
There's no need to keep virtio-9p around. Using the same mechanism on each platform would simplify things a bit. Josh Durgin
09:32 PM Feature #10680 (New): qemu task relies on virtio-9p, which is not available in centos/rhel
The main other option would be samba. Whichever is easier to configure in the host and via cloudinit (where the tests... Josh Durgin
08:27 PM Feature #10680 (Need More Info): qemu task relies on virtio-9p, which is not available in centos/...
Changing to a feature so we can plan for it as such.
We'll also want some more specific requirements. Is NFS defin...
Zack Cerza
08:32 PM Bug #10825 (Resolved): task.install: Removing ceph sources lists hangs forever
https://github.com/ceph/teuthology/commit/81dbfdfbca549b7c32ba89ebf60c1c5e40cc081e Zack Cerza
08:17 PM Bug #10825 (Fix Under Review): task.install: Removing ceph sources lists hangs forever
https://github.com/ceph/teuthology/pull/431 Zack Cerza
07:27 PM Bug #10825: task.install: Removing ceph sources lists hangs forever
My branch is https://github.com/ceph/teuthology/tree/wip-10825
Test run is http://pulpito.ceph.redhat.com/zack-2015-...
Zack Cerza
08:31 PM Revision 81dbfdfb (teuthology): Merge pull request #431 from ceph/wip-10825
Smarter sources.list/.repo removal Andrew Schoen
07:39 PM Revision d56e7bff (teuthology): Don't run two apt-get updates in parallel
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
07:39 PM Revision 73e67caa (teuthology): Tweak _remove_sources_list_{deb,rpm}()
Make their implementations more concise, their logging more verbose, and
avoid running apt-get update if no sources l...
Zack Cerza
06:56 PM Feature #10594 (Resolved): RHEL 7.1 support for chef
This mainly involved making the repos available so we aren't forced to just do this on octo and making sure they were... Sandon Van Ness
12:16 AM Bug #10814: downburst doesn't work on Fedora
I briefly looked at this just to see how much work it would be.
It appears like precise fedora20 does not include ...
Sandon Van Ness

02/10/2015

10:28 PM Bug #10825 (In Progress): task.install: Removing ceph sources lists hangs forever
This is being caused by this commit:
https://github.com/ceph/teuthology/commit/d71a87452f6450ba5d749630ee4ba476bce543c7
Zack Cerza
01:52 PM Bug #10825 (Resolved): task.install: Removing ceph sources lists hangs forever
http://pulpito.ceph.com/loic-2015-02-02_23:31:31-rados-giant-backports---basic-multi/736802/
was killed after >1d be...
Loïc Dachary
09:21 PM Bug #10404: thrashosds: failed to decode JSON
None of us have seen this recently; if it starts popping up again I suggest we have the author of the Thrasher class ... Zack Cerza
09:19 PM Bug #10622 (Resolved): kernel install failures on sha1 length checks
Forgot to mention I merged the debugging branch:
https://github.com/ceph/teuthology/pull/422
https://github.com/cep...
Zack Cerza
09:17 PM Bug #10777: ceph-deploy task doesnot create osd as per ctx.cluster.remotes
This does look like a bug, but it's not really problematic for us. I'd be happy to review patches, but can't justify ... Zack Cerza
09:02 PM Feature #10829 (New): better support for assertion errors
It is nice that we use plain asserts in tasks but those are a pain to debug because there is no repr/diff that would ... Alfredo Deza
07:14 PM Bug #10687 (Closed): chef failure: error downloading python-libs-2.6.6-52.el6.x86_64
Zack Cerza
07:11 PM Bug #10651 (Closed): stale pycs causing issues
Yeah, this was related to clock skew. Closing this now as we've resolved those issues for now. Andrew Schoen
06:40 PM Bug #10715 (Resolved): qemu not found on el7
Please re-open if this is still an issue Zack Cerza
06:39 PM Bug #10577 (Resolved): "Failure: ImportError" in upgrade:dumpling-firefly-x-next-distro-basic-mul...
Yuri Weinstein
05:52 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
Will we need issue #10808 for this to be considered completely resolved? I imagine so. Andrew Schoen
05:11 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
Another aspect of this is getting rid of our fork of apache and using the distro provided version. We've decided it'... Andrew Schoen
04:14 PM Bug #10816: "mds e5 Missing health data for MDS 4117" endless loop in upgrade:firefly-x-hammer-di...
I can't think of a reason why erasure code would cause failure in this situation. And even if it did, I can't hink of... Loïc Dachary
03:29 PM Revision 451b2f7e (teuthology): Merge pull request #430 from tchaikov/fix-readme
README: update with teuthology-suite Andrew Schoen
07:49 AM Bug #10821 (Resolved): failed mkfs.btrfs as part of OSD setup
http://pulpito.ceph.com/teuthology-2015-02-08_23:04:01-fs-hammer-testing-basic-multi/745187/
http://pulpito.ceph.com...
Greg Farnum
06:34 AM Bug #10600: PATH issues on RHEL7 nodes?
Well, I tried reproducing this in a VPS setup and was unable to do so. So I've given in and pushed a patch to master ... Greg Farnum
01:35 AM Revision b291e40e (teuthology): README: update with teuthology-suite
* replace sample usage of deprecated schedule_suite.sh with that of
teuthology-suite
* add a pointer to `teuthology...
Kefu Chai

02/09/2015

11:27 PM Bug #10816: "mds e5 Missing health data for MDS 4117" endless loop in upgrade:firefly-x-hammer-di...
Loic - it's coming from https://github.com/ceph/ceph-qa-suite/tree/hammer/suites/upgrade/firefly-x/stress-split-erasu... Yuri Weinstein
10:55 PM Bug #10816: "mds e5 Missing health data for MDS 4117" endless loop in upgrade:firefly-x-hammer-di...
At a guess, you've upgraded the monitors and the MDS has not been upgraded yet. (Or some but not all of the monitors?... Greg Farnum
10:43 PM Bug #10816 (Resolved): "mds e5 Missing health data for MDS 4117" endless loop in upgrade:firefly-...
Run: http://pulpito.ceph.com/teuthology-2015-02-08_17:13:01-upgrade:firefly-x-hammer-distro-basic-multi/
Job: 744272...
Yuri Weinstein
10:32 PM Bug #10814 (Won't Fix): downburst doesn't work on Fedora
I was trying to get this working last week and no matter what packages I installed the bootstrap script failed on bui... Greg Farnum
10:08 PM Revision 096f6f0a (teuthology): Merge pull request #429 from ceph/tests-task-cleanup
Adds a machine_type property to orchestra.remote.Remote Zack Cerza
06:49 PM Revision d2d68524 (teuthology): Adds a machine_type property to orchestra.remote.Remote
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
12:41 PM Bug #10797 (New): ceph.py fallback fails because mkfs.ext4 does not have -f option on trusty
https://github.com/ceph/ceph-qa-suite/blob/master/tasks/ceph.py#L530
will run mkfs once more after adding the \-f fl...
Loïc Dachary
07:46 AM Documentation #8678: missing documentation for schedule_suite.sh replacement
i also posted a PR at https://github.com/ceph/teuthology/pull/430 to address this. Kefu Chai

02/06/2015

08:06 PM Feature #10781 (Rejected): upgrade:hammer-x suite
well, there is no next branch :) Tamilarasi muthamizhan
06:59 PM Feature #10781: upgrade:hammer-x suite
well, i thought it might be a good idea to add upgrade suite from hammer to x[where x is next] Tamilarasi muthamizhan
06:46 PM Feature #10781 (Resolved): upgrade:hammer-x suite
Per Tamil's request added, the idea is to run hammer against next branch.
Sage, pls comment and assign to me if yo...
Yuri Weinstein
03:05 PM Feature #10736: teuthology testing task
The teuthology work is pretty much complete, https://github.com/ceph/teuthology/pull/426
Working on the qa suite n...
Andrew Schoen
06:09 AM Bug #10777 (New): ceph-deploy task doesnot create osd as per ctx.cluster.remotes
Have observerd while creating ceph cluster using ceph-deploy task,
the way osds are associated in ctx.cluster.remote...
Shambhu Rajak
05:26 AM Bug #10600 (In Progress): PATH issues on RHEL7 nodes?
I've got a branch to get path info and will run some tests once it's available for install. Greg Farnum

02/05/2015

11:19 PM Bug #10776 (Can't reproduce): paramiko: "Exception: Remote transport is ignoring rekey requests" ...
Run: http://pulpito.ceph.com/teuthology-2015-02-03_02:35:02-smoke-master-distro-basic-multi/
Job: 738480
Logs: http...
Yuri Weinstein
10:22 PM Bug #10774 (Resolved): teuthology unlocks VMs before destroying
https://github.com/ceph/teuthology/commit/bda9cb993f372116c804ea49daefda6b816650d5 Zack Cerza
09:59 PM Bug #10774 (Fix Under Review): teuthology unlocks VMs before destroying
https://github.com/ceph/teuthology/pull/428 Zack Cerza
09:12 PM Bug #10774 (Resolved): teuthology unlocks VMs before destroying
See https://github.com/ceph/teuthology/blob/02b7d28a5eb7e797ed9e39019a2cf03a51712761/teuthology/lock.py#L440
This ...
Zack Cerza
10:02 PM Revision bda9cb99 (teuthology): Merge pull request #428 from ceph/wip-10774
Don't unlock VMs before destroying them Andrew Schoen
09:58 PM Revision f4e47e98 (teuthology): Don't destroy a vps that is owned by someone else
This only affects the unlock_one() codepath at this point.
Signed-off-by: Zack Cerza <zack@redhat.com>
Zack Cerza
09:14 PM Revision 91d59805 (teuthology): Destroy VMs before unlocking, not after
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
09:02 PM Bug #10748: "ConnectionLostError: SSH connection to vpm" error
I guess I'm probably wrong about memory being the issue in this case. Wow, this is frustrating! Zack Cerza
06:36 PM Bug #10748: "ConnectionLostError: SSH connection to vpm" error
Running ceph-qa-chef manually I ran a free -m loop every 2 seconds and memory (after disk cache/buffers) got no where... Sandon Van Ness
04:47 AM Bug #10748: "ConnectionLostError: SSH connection to vpm" error
I have never seen a machine run out of memory on chef. Ram would definitely not cause the apt failures we have seen w... Sandon Van Ness
04:26 AM Bug #10748: "ConnectionLostError: SSH connection to vpm" error
I just manually locked a vps and ran chef on it. It got within 70MB of running out of RAM, with no swap, again just d... Zack Cerza
08:54 PM Revision 498c75e6 (teuthology): Merge pull request #426 from ceph/wip-10736
create a teuthology integration test task Zack Cerza
08:19 PM Revision 187803d3 (teuthology): Correctly pull the default machine_type if machine_type is not de...
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
08:19 PM Revision aaed783b (teuthology): Moved task.tests into it's own module and created tests.test_run
This sets up the basic structure for teuthology integration testing.
Any tests put in teuthology/task/tests will be a...
Andrew Schoen
08:19 PM Revision 594a3521 (teuthology): Added integration tests to ensure locking is working correctly
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
08:19 PM Revision 51114ffb (teuthology): Do not log skipped tests as failed
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
08:19 PM Revision 4f64f5f3 (teuthology): Use pytest to auto discover and run tests in task.tests
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
07:23 PM Revision 853228e4 (teuthology): install: include libcephfs-jni in .deb list as well as RPM one
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Zack Cerza <zack@redhat.com>
Greg Farnum
06:20 PM Revision 20bb34e3 (teuthology): add Travis CI integration
This will allow Travis CI to run tox to check for test failures. Ken Dreyer
05:16 PM Feature #10753 (Resolved): Use run()'s new label arg for a couple common task failures
Andrew Schoen
03:57 PM Feature #10767: simplify the ceph-deploy suite
All of these subcommands should get tested. Minimal cluster needed for all of these (whatever minimal means, I think ... Alfredo Deza
03:55 PM Feature #10767 (New): simplify the ceph-deploy suite
The current ceph-deploy suite requires 9 nodes to complete it's tests. Because of this it typically eats up a ton of... Andrew Schoen
02:00 AM Bug #10500: "HEALTH_WARN 18 pgs peering" in upgrade:firefly-firefly-distro-basic-multi run
Update - https://github.com/ceph/ceph-qa-suite/pull/323#issuecomment-72977621 Yuri Weinstein
12:57 AM Bug #10752 (Resolved): Move VPMs to static leases
This is completed. I sent out an email to the storage-eng list for people who might be effected by it (existing vms) Sandon Van Ness

02/04/2015

10:07 PM Revision c5da67b6 (teuthology): Merge pull request #425 from ceph/wip-10753
Add a label to the ceph-qa-chef run in task.internal Zack Cerza
10:07 PM Revision 967ea02c (teuthology): Add a label to the ceph-qa-chef run in task.internal
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
09:56 PM Feature #10753: Use run()'s new label arg for a couple common task failures
https://github.com/ceph/teuthology/pull/425
https://github.com/ceph/ceph-qa-suite/pull/322
Andrew Schoen
09:23 PM Feature #10753 (Resolved): Use run()'s new label arg for a couple common task failures
Following up from #10699, let's add labels to a couple of the more frequent and confusing CommandFailedErrors that we... Zack Cerza
09:44 PM Feature #10754 (Resolved): paddles: add percentage to queue_stats command
https://github.com/ceph/paddles/commit/172a7b926faa419773995d9921a50d512daa3ba2 Zack Cerza
09:38 PM Feature #10754 (Fix Under Review): paddles: add percentage to queue_stats command
https://github.com/ceph/paddles/pull/51 Zack Cerza
09:36 PM Feature #10754 (Resolved): paddles: add percentage to queue_stats command
Zack Cerza
08:56 PM Bug #10752 (Resolved): Move VPMs to static leases
Just to insure IP addresses never change and there isn't any DNS weirdness going on. This also means we can stop runn... Sandon Van Ness
05:50 PM Feature #10699 (Resolved): make teuthology failure reasons more clear
https://github.com/ceph/teuthology/commit/018cbc899f0c69d0409db3609c1a1f117dca9223 Andrew Schoen
05:15 PM Revision 018cbc89 (teuthology): Merge pull request #423 from ceph/teuth-testing
Add a label to run.run Zack Cerza
05:04 PM Bug #10748: "ConnectionLostError: SSH connection to vpm" error
The RepresenterErrors are a Sentry issue and I filed #10750 to track them.
Sandon, what's wrong with our VMs? :(
Zack Cerza
04:20 PM Bug #10748 (Resolved): "ConnectionLostError: SSH connection to vpm" error
Lots of dead runs in http://pulpito.front.sepia.ceph.com/teuthology-2015-02-02_18:18:01-upgrade:firefly-x-giant-distr... Yuri Weinstein
05:01 PM Bug #10749: "Could not get lock /var/lib/dpkg/lock" error
The RepresenterErrors are a Sentry issue and I filed #10750 to track them. The dpkg lock issue looks like a chef prob... Zack Cerza
04:24 PM Bug #10749 (Closed): "Could not get lock /var/lib/dpkg/lock" error
Many errors in run http://pulpito.front.sepia.ceph.com/teuthology-2015-02-02_18:18:01-upgrade:firefly-x-giant-distro-... Yuri Weinstein
05:00 PM Bug #10750 (Resolved): RepresenterError in sentry codepath
http://qa-proxy.ceph.com/teuthology/teuthology-2015-02-02_18:18:01-upgrade:firefly-x-giant-distro-basic-vps/737593/te... Zack Cerza
03:54 PM Revision 3ae8ed7d (teuthology): Added a 'tests' task that we can use to test teuthology features
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
03:54 PM Revision 2ad47537 (teuthology): Add a label kwarg to run.run
This can be used to label or annotate commands to remotes so we can
print a meaningful log message if the command fai...
Andrew Schoen

02/03/2015

10:38 PM Bug #10600: PATH issues on RHEL7 nodes?
I meant from the script Zack Cerza
10:00 PM Feature #10704 (In Progress): Implement "expand test coverage for the upgrade suites" for giant-x...
Yuri Weinstein
08:50 PM Feature #10736 (Resolved): teuthology testing task
We want to create a teuthology task that will act as a set of integration tests for teuthology itself. We'd run this... Andrew Schoen
05:57 PM Feature #10699: make teuthology failure reasons more clear
One option we discussed was adding a label kwarg to run.run so that we can print a descriptive label when a command f... Andrew Schoen
05:26 PM Revision 4aa2e937 (teuthology): Use pytest to auto discover and run tests in task.tests
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
03:03 PM Revision dcfcfdcb (teuthology): Added a 'tests' task that we can use to test teuthology features
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
02:51 PM Revision 29aeb42a (teuthology): Add a label kwarg to run.run
This can be used to label or annotate commands to remotes so we can
print a meaningful log message if the command fai...
Andrew Schoen

02/02/2015

10:46 PM Bug #10500: "HEALTH_WARN 18 pgs peering" in upgrade:firefly-firefly-distro-basic-multi run
This is the peering wq bug most likely. We need to disable the config option which makes that bug show up for these ... Samuel Just
10:34 PM Revision 9cdc3578 (teuthology): Make 'branch' a tag in Sentry
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
08:40 PM Bug #10715: qemu not found on el7
commit:05ce2aa1bf030ea225300b48e7914577a412b38c Josh Durgin
12:43 PM Bug #10715 (Resolved): qemu not found on el7
ubuntu@teuthology:/var/lib/teuthworker/archive/teuthology-2015-02-01_23:00:02-rbd-next-distro-basic-multi/735303
c...
Sage Weil
08:28 PM Revision ad51511a (teuthology): Add branch to Sentry info
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza

01/31/2015

01:13 AM Revision ec878e3f (teuthology): Fix bug in submitting Sentry events
It wasn't working for non-scheduled jobs
Signed-off-by: Zack Cerza <zack@redhat.com>
Zack Cerza

01/30/2015

08:04 PM Feature #10704 (Resolved): Implement "expand test coverage for the upgrade suites" for giant-x suite
See http://tracker.ceph.com/issues/10240 for details that are to be implemented for giant-x suite Yuri Weinstein
07:19 PM Bug #10600: PATH issues on RHEL7 nodes?
Ugh, I wasn't getting email notifications on this bug...watched now.
Anyway, that script is one of the ceph.git wo...
Greg Farnum
03:48 PM Feature #10699 (Resolved): make teuthology failure reasons more clear
Sometimes it's difficult to tell from the failure reason on a job if the command failed because of environment issues... Andrew Schoen
03:04 PM Bug #10622: kernel install failures on sha1 length checks
Lots of failures again last night related to this, with improved logging exposing the real issue.
http://pulpito.f...
Andrew Schoen

01/29/2015

10:25 PM Bug #10577: "Failure: ImportError" in upgrade:dumpling-firefly-x-next-distro-basic-multi run
Running suite - http://pulpito.front.sepia.ceph.com/teuthology-2015-01-28_17:10:02-upgrade:dumpling-firefly-x-next-di... Yuri Weinstein
10:19 PM Fix #7959 (Closed): locking: force all targest to have same os version/type (was: mpi ior test fa...
Andrew Schoen
10:04 PM Bug #10529 (Resolved): interactive-on-error drops to REPL once for each nested task and once for ...
Andrew Schoen
08:54 PM Feature #10625 (Resolved): Deprecate the use of the downburst config
https://github.com/ceph/teuthology/commit/2d47b1eece5cdba4f334fd05a41b95889f48fe9b Andrew Schoen
08:32 PM Feature #10160 (Resolved): Allow teuthology to use alternative gitbuilder URL via config yaml
https://github.com/ceph/teuthology/commit/b77af118bfd68194866090a20a8c0f06119d2b96
https://github.com/ceph/teutholog...
Zack Cerza
08:01 PM Feature #10656 (Resolved): paddles: API for filtering jobs by status
https://github.com/ceph/paddles/commit/8d21756edb3aabda8c25b111c99c43c022ebb07c Zack Cerza
06:47 PM Revision 977fed95 (teuthology): Merge pull request #422 from ceph/wip-10622
If the version file is empty, complain. Andrew Schoen
06:41 PM Revision 2bb39ac4 (teuthology): If the version file is empty, complain.
We *could* work around this, but I don't want to mask bugs in the build
system.
Signed-off-by: Zack Cerza <zack@redh...
Zack Cerza
06:38 PM Revision 2d47b1ee (teuthology): Merge pull request #420 from ceph/wip-10625
deprecate support for a custom downburst config Zack Cerza
06:37 PM Bug #10651 (Need More Info): stale pycs causing issues
This seems to have been related to ntp problems in the lab (#10675). The clock had drifted enough that python couldn... Andrew Schoen
05:30 PM Revision 009a6daf (teuthology): Removed downburst config support in get_distro and get_distro_ver...
We believe that nobody is using custom downburst configs anymore so
we're planning to deprecate this feature.
Signed...
Andrew Schoen
05:30 PM Revision 97c26b92 (teuthology): Remove support for a custom downburst config in teuthology.provision
Will log a warning message if a custom downburst config is found in
ctx.config. Removes unused --downburst-conf optio...
Andrew Schoen
04:19 PM Bug #10622: kernel install failures on sha1 length checks
If we gave the sha1 to need_version[role] here (https://github.com/ceph/teuthology/blob/master/teuthology/task/kernel... Andrew Schoen
04:01 PM Bug #10622: kernel install failures on sha1 length checks
After looking into this, the code path that gets the version to check for during reboots is returning an empty string... Andrew Schoen
03:44 PM Bug #10622: kernel install failures on sha1 length checks
Looks like this is happening again.
http://qa-proxy.ceph.com/teuthology/teuthology-2015-01-28_23:00:02-rbd-master-...
Andrew Schoen
03:35 PM Bug #10687 (Closed): chef failure: error downloading python-libs-2.6.6-52.el6.x86_64
I saw this on some runs overnight.... Andrew Schoen
12:50 AM Bug #10500 (New): "HEALTH_WARN 18 pgs peering" in upgrade:firefly-firefly-distro-basic-multi run
wrong one Samuel Just
12:50 AM Bug #10500 (Can't reproduce): "HEALTH_WARN 18 pgs peering" in upgrade:firefly-firefly-distro-basi...
Marking this as can't reproduce for now. Samuel Just

01/28/2015

11:15 PM Revision c93cccfe (teuthology): Merge pull request #421 from ceph/wip-tunables
ceph.conf: mon warn on legacy tunables = false Sage Weil
11:12 PM Revision 283de680 (teuthology): ceph.conf: mon warn on legacy tunables = false
so we can test legacy tunables
Signed-off-by: Sage Weil <sage@redhat.com>
Sage Weil
10:41 PM Feature #10625: Deprecate the use of the downburst config
https://github.com/ceph/teuthology/pull/420 Andrew Schoen
04:35 PM Feature #10625: Deprecate the use of the downburst config
The downburst config checks in misc.get_distro and misc.get_distro_version can definitely be removed as the checks ar... Andrew Schoen
10:04 PM Bug #10600: PATH issues on RHEL7 nodes?
I'd personally rather see something like an "@echo $PATH; which lsof@" to help us figure out if it is indeed a path i... Zack Cerza
09:54 PM Feature #10680 (Resolved): qemu task relies on virtio-9p, which is not available in centos/rhel
From the teuthology log:... Josh Durgin
09:39 PM Revision a1fb92f9 (teuthology): Fix typo in libvirt.conf path
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
04:31 PM Revision 4023eb97 (teuthology): Add error message when SMTP server is unreachable
This only happens when scheduling fails.
Signed-off-by: Zack Cerza <zack@redhat.com>
Zack Cerza
03:14 PM Bug #10651: stale pycs causing issues
This issue seemed to resolve itself. As a precaution we're going to set PYTHONDONTWRITEBYTECODE=1 in the teuthology ... Andrew Schoen
01:21 AM Revision e552cfa8 (teuthology): ceph.conf: ms die on skipped message = true (osd, mds, client; no...
Signed-off-by: Sage Weil <sage@redhat.com> Sage Weil

01/27/2015

10:35 PM Revision ff669699 (teuthology): Keep python from writing pyc files for running jobs
For context see: http://tracker.ceph.com/issues/10651
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Andrew Schoen
10:33 PM Bug #10600: PATH issues on RHEL7 nodes?
See also #10302. Sandon there suggests adding a "PATH=$PATH:/usr/sbin" to the script, though that seems wonky to me?
...
Greg Farnum
10:05 PM Bug #10600: PATH issues on RHEL7 nodes?
I just checked, and I don't see a place where teuthology could be affecting $PATH... Zack Cerza
07:23 PM Bug #10600: PATH issues on RHEL7 nodes?
I don't know, I'm just seeing intermittent failures. I somewhere saw from you a reference to paths getting stripped, ... Greg Farnum
07:15 PM Bug #10600: PATH issues on RHEL7 nodes?
We install lsof on our magna nodes. Its even in /usr/sbin which very commonly on the $PATH. is something stripping en... Sandon Van Ness
10:29 PM Bug #10622: kernel install failures on sha1 length checks
Hrm. So, at this point I need to be able to reproduce it; I have a branch that adds some debug output to help me figu... Zack Cerza
10:24 PM Bug #10653 (Duplicate): "[ FAILED ] TestClsRbd.get_mutable_metadata_features" in multi-version-...
Josh Durgin
05:31 PM Bug #10653 (Duplicate): "[ FAILED ] TestClsRbd.get_mutable_metadata_features" in multi-version-...
Run: http://pulpito.ceph.com/teuthology-2015-01-25_23:20:01-multi-version-next-distro-basic-multi/
Jobs: ['723089']
...
Yuri Weinstein
10:23 PM Feature #10656 (Fix Under Review): paddles: API for filtering jobs by status
https://github.com/ceph/paddles/pull/50 Zack Cerza
10:22 PM Feature #10656 (Resolved): paddles: API for filtering jobs by status
e.g.: /runs/RUN_NAME/jobs/?status=running Zack Cerza
09:47 PM Bug #10574 (Resolved): s3tests failed in upgrade:dumpling-dumpling-distro-basic-multi run
Yuri Weinstein
09:31 PM Bug #10574: s3tests failed in upgrade:dumpling-dumpling-distro-basic-multi run
these will fail on dumpling. It's running the wrong s3-tests branch again (previously failed on firefly). Yehuda Sadeh
08:20 PM Bug #9010: [paddles] `rollback()` is used incorrectly
Would you mind showing what you say Pecan was suggesting? The Paddles app uses a hook that should handle these
when ...
Alfredo Deza
07:36 PM Feature #10594 (New): RHEL 7.1 support for chef
Zack Cerza
07:03 PM Feature #10594: RHEL 7.1 support for chef
Do we plan to do a lot of testing on rhel 7.1 while it is still beta? If so we can get this done but depending on how... Sandon Van Ness
06:43 PM Feature #10594: RHEL 7.1 support for chef
Zack Cerza
07:16 PM Feature #10655 (New): Switch ubuntu user on labs to more generic 'qe' user
Pretty much the subject...
First we will want to go through and have ceph-qa-chef setup both. Also I will need to ...
Sandon Van Ness
07:00 PM Bug #10582 (Resolved): missing packages for trusty
This sha1 appeared to be half built in a weird state as if autobuild-ceph waa restarted. This is not a problem I have... Sandon Van Ness
06:55 PM Bug #10568 (Duplicate): apt-get update: "Unable to correct problems, you have held broken packages."
This is a duplicate of #10591 Sandon Van Ness
06:53 PM Bug #9036: teuthology-kill usage is not informative enough
Loïc Dachary
06:53 PM Bug #9036: teuthology-kill usage is not informative enough
I'm reopening as a mean to track the corresponding upstream bug https://github.com/docopt/docopt/issues/152 (I added ... Loïc Dachary
04:09 PM Bug #9036 (Resolved): teuthology-kill usage is not informative enough
https://github.com/ceph/teuthology/commit/e12e1608de1e82d1cf70bab218c0837505d2b7c0
A more specific error would hav...
Zack Cerza
03:59 PM Bug #9036: teuthology-kill usage is not informative enough
I'd like to re-open this one with a more specific request. It would be very usefull if teuthology-kill showed which o... Loïc Dachary
06:34 PM Bug #10481: "error: ceph-release-1-0.el7.noarch.rpm: not an rpm package (or package manifest)"
The problem was the ceph-release file was downloaded with wget and it some how got a 0 byte file created and since th... Sandon Van Ness
06:10 PM Bug #10510: must be able to install packages with varying names on distributions
That's correct Zack Cerza
06:58 AM Bug #10510: must be able to install packages with varying names on distributions
http://pulpito.ceph.redhat.com/teuthology-2015-01-24_02:04:01-fs-giant-distro-basic-magna/32956/
It's still failin...
Greg Farnum
04:38 PM Bug #10651 (Closed): stale pycs causing issues
We saw this failure after merging new code to master on this run and others: http://qa-proxy.ceph.com/teuthology/teut... Andrew Schoen
04:08 PM Revision e12e1608 (teuthology): Fix typo in --machine-type flag
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
02:53 PM Feature #10561 (Resolved): teuthology: ability to test kernel for RHEL
Andrew Schoen
02:52 PM Bug #10621 (Resolved): teuthology-lock doesn't respect --os-type
Andrew Schoen
12:13 AM Bug #10577: "Failure: ImportError" in upgrade:dumpling-firefly-x-next-distro-basic-multi run
Same issue
Run http://pulpito.ceph.com/teuthology-2015-01-25_17:10:02-upgrade:dumpling-firefly-x-next-distro-basic-...
Yuri Weinstein

01/26/2015

10:28 PM Revision 7cfb8493 (teuthology): Merge pull request #417 from ceph/wip-10561
Enable kernel installs from brew Zack Cerza
09:14 PM Revision a140bd5b (teuthology): Only install the kernel from koji if needed.
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
09:14 PM Revision 1a04bf37 (teuthology): Adding unit test coverage to teuthology.packaging
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
09:14 PM Revision 12acfc4f (teuthology): Move koji related functions into teuthology.packaging
We can now use these functions in other places in teuthology.
I've also made the urls for koji configurable with the...
Andrew Schoen
09:12 PM Revision ec81c6bd (teuthology): Enable kernel installs from koji
This enables a kernel to be installed from koji by putting the
following stanza under 'kernel' in your yaml config, '...
Andrew Schoen
08:19 PM Bug #10622: kernel install failures on sha1 length checks
Not quite:... Zack Cerza
08:00 PM Bug #10510: must be able to install packages with varying names on distributions
You mean cephfs-java doesn't exist? Can you point me to one of these failures? Zack Cerza
07:41 PM Bug #7930 (Resolved): teuthology-nuke with no args gives traceback instead of usage
https://github.com/ceph/teuthology/commit/d7faab7587ab16e392c5ed697dff21b854f41783 Zack Cerza
07:37 PM Revision d7faab75 (teuthology): Don't allow calling teuthology-nuke with no args
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
06:33 PM Revision 6fdf4d84 (teuthology): Merge pull request #419 from ceph/wip-wait
DaemonState: add wait() Zack Cerza
06:22 PM Feature #10561: teuthology: ability to test kernel for RHEL
We've decided to use 'koji' everywhere we used the term 'brew'. So, now the yaml config will need a 'koji: <build_id... Andrew Schoen
05:05 PM Revision 0680e7fb (teuthology): Merge pull request #418 from ceph/wip-10621
Make teuthology-lock respect --os-type Zack Cerza
03:13 PM Revision ba0fc250 (teuthology): Make teuthology-lock respect --os-type
This fixes the regression in issue #10621
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Andrew Schoen

01/24/2015

02:50 AM Feature #10480 (Resolved): qemu-kvm and qemu-img needs rbd support on rpm based systems
Since the 7.1 beta nightly may not be kosher to have at a publicly accessible repo for now I am just using the rhev p... Sandon Van Ness

01/23/2015

11:34 PM Revision c57040f1 (teuthology): DaemonState: add wait()
Signed-off-by: Sage Weil <sage@redhat.com> Sage Weil
11:15 PM Bug #9922: Some suites still use http://ceph.newdream.net
Thanks Armando! Ken Dreyer
10:59 AM Bug #9922: Some suites still use http://ceph.newdream.net
Solving this issue I found that it was present in the ceph-qa-suite and in the teuthology project. That's why I had t... Armando Segnini
11:12 PM Subtask #10610: Support non-ceph installs under RHEL-family OSes
This is blocked by the gitbuilder existing (and might be done already anyway?), low priority for now. Greg Farnum
11:07 PM Subtask #10610: Support non-ceph installs under RHEL-family OSes
Since apparently this is just for me, I'm taking it as a subtask of the real goal so I can keep track of it in the FS... Greg Farnum
05:37 PM Subtask #10610: Support non-ceph installs under RHEL-family OSes
https://github.com/ceph/teuthology/commit/5de79c6c9c62989d2fb793b970cc47216cd089ad Zack Cerza
05:11 PM Subtask #10610: Support non-ceph installs under RHEL-family OSes
The changes I'd made so far:
https://github.com/ceph/teuthology/pull/416
Zack Cerza
11:11 PM Bug #10577: "Failure: ImportError" in upgrade:dumpling-firefly-x-next-distro-basic-multi run
This is from using the master version of the workunit. Using a workunit that matches the installed version of librbd/... Josh Durgin
04:31 PM Bug #10577: "Failure: ImportError" in upgrade:dumpling-firefly-x-next-distro-basic-multi run
Same in run: http://pulpito.ceph.com/teuthology-2015-01-21_17:15:02-upgrade:dumpling-firefly-x-next-distro-basic-vps/... Yuri Weinstein
10:50 PM Bug #10626 (Duplicate): 'sudo rpm -i ceph-release-1-0.el7.noarch.rpm' in octo lab
See the discussion on run teuthology-2015-01-14_23:14:01-samba-master-testing-basic-multi (unfortunately the mail arc... Greg Farnum
10:41 PM Bug #10626 (Duplicate): 'sudo rpm -i ceph-release-1-0.el7.noarch.rpm' in octo lab
Run: http://pulpito.ceph.redhat.com/teuthology-2015-01-20_22:06:01-fs-dumpling-distro-basic-magna/
Jobs: http://pulp...
Yuri Weinstein
10:48 PM Bug #10621: teuthology-lock doesn't respect --os-type
https://github.com/ceph/teuthology/pull/418 Andrew Schoen
09:27 PM Bug #10621 (Resolved): teuthology-lock doesn't respect --os-type
When running teuthology-lock with the following options teuthology tries to lock an ubuntu 6.5 machine.
--lock-man...
Andrew Schoen
10:31 PM Feature #10625 (Resolved): Deprecate the use of the downburst config
We can't tell that we're using a custom downburst config anywhere anymore in ceph-qa-suite. If we're really not usin... Andrew Schoen
10:07 PM Feature #10561: teuthology: ability to test kernel for RHEL
https://github.com/ceph/teuthology/pull/417 Andrew Schoen
05:08 PM Feature #10561: teuthology: ability to test kernel for RHEL
Isn't that a DNS failure? We have a known issue with DNS in that lab. Zack Cerza
03:05 PM Feature #10561: teuthology: ability to test kernel for RHEL
I've been running into connection errors with brewhub.devel.redhat.com/brewhub often. I'm not sure if there is a dif... Andrew Schoen
09:42 PM Bug #10622 (Resolved): kernel install failures on sha1 length checks
http://qa-proxy.ceph.com/teuthology/teuthology-2015-01-20_23:04:03-fs-next-testing-basic-multi/715943/
Plus 3 more i...
Greg Farnum
09:28 PM Bug #10510: must be able to install packages with varying names on distributions
Hold up, I ran into another one of these (not from after you made the change) and it looks like the tests are going t... Greg Farnum
09:00 PM Feature #10480: qemu-kvm and qemu-img needs rbd support on rpm based systems
Sandon and I discussed this in the infrastructure standup today.
The qemu-kvm-1.5.3-82.el7 package that shipped in...
Ken Dreyer
05:33 PM Revision 5de79c6c (teuthology): Merge pull request #416 from ceph/wip-10610
rpm codepath cleanup Andrew Schoen

01/22/2015

11:17 PM Feature #9759: Teuthology suite needed for Calamari testing
So, FWIW, there is a suite currently present. I know Warren has ideas about how to modify it, but it's currently there. Dan Mick
11:16 PM Subtask #10610: Support non-ceph installs under RHEL-family OSes
Well, this is frustrating: there is no evidence that this ever worked. The rpm codepaths that would install non-ceph ... Zack Cerza
06:09 PM Subtask #10610 (In Progress): Support non-ceph installs under RHEL-family OSes
Zack Cerza
05:32 PM Subtask #10610 (In Progress): Support non-ceph installs under RHEL-family OSes
Example: http://pulpito.ceph.com/teuthology-2015-01-14_23:14:01-samba-master-testing-basic-multi/704612/
After see...
Zack Cerza
11:12 PM Revision 65d43117 (teuthology): Ensure yum repo file exists before tweaking it
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
11:12 PM Revision 932b7565 (teuthology): Less hardcoding of 'ceph' project in rpm codepath
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
09:17 PM Revision b8f563b9 (teuthology): Use yum localinstall to install ceph-release
Partly, do this so that if ceph-release is already installed, we don't
get an error.
Signed-off-by: Zack Cerza <zack...
Zack Cerza
08:29 PM Bug #9922: Some suites still use http://ceph.newdream.net
This bug is actually from the ceph-qa-suite project Armando Segnini
06:42 PM Bug #10593 (Resolved): s3tests branch defaults to master and cause tests fail
Final PR https://github.com/ceph/ceph-qa-suite/pull/309 Yuri Weinstein
06:14 PM Bug #10470 (Resolved): ENOENT starting ceph_test_rados on upgrade tests
Yuri Weinstein
06:13 PM Bug #10470: ENOENT starting ceph_test_rados on upgrade tests
It's fixed in yamls - http://pulpito.front.sepia.ceph.com/teuthology-2015-01-21_17:13:02-upgrade:firefly-x-next-distr... Yuri Weinstein
12:22 AM Bug #10470: ENOENT starting ceph_test_rados on upgrade tests
I think it's fixed, will double check Yuri Weinstein
05:02 PM Bug #7930: teuthology-nuke with no args gives traceback instead of usage
I will take a look at this bug Carlos Trabuco
04:06 PM Bug #10577: "Failure: ImportError" in upgrade:dumpling-firefly-x-next-distro-basic-multi run
Same issue
Run: http://pulpito.ceph.com/teuthology-2015-01-21_17:10:01-upgrade:dumpling-firefly-x-next-distro-basi...
Yuri Weinstein
05:25 AM Feature #8906 (Resolved): New task: Calamari nose tests
https://github.com/ceph/ceph-qa-suite/pull/263
https://github.com/ceph/ceph-qa-suite/commit/ac64ef7941d1b9e529411f23...
Dan Mick
12:03 AM Bug #10599 (Resolved): extra_packages is failing on samba installs
https://github.com/ceph/teuthology/commit/e3104ee391a38b3bc71af048f7b39289655b62b4 Zack Cerza
12:02 AM Revision e3104ee3 (teuthology): Fix regression in non-ceph project handling
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza

01/21/2015

11:31 PM Bug #10599: extra_packages is failing on samba installs
This is a regression and is my fault. I'm testing a fix right now. Zack Cerza
08:15 PM Bug #10599 (Resolved): extra_packages is failing on samba installs
http://magna002.ceph.redhat.com/teuthology-2015-01-20_02:14:02-samba-giant-distro-basic-magna/29974/teuthology.log
<...
Greg Farnum
10:27 PM Feature #10561: teuthology: ability to test kernel for RHEL
I reran the kernel task against magna074 with the sha1: "distro" removed from the kernel stanza in the config. This ... Andrew Schoen
09:59 PM Feature #10561: teuthology: ability to test kernel for RHEL
I was able to manually install a brew-sourced kernel (https://brewweb.devel.redhat.com/buildinfo?buildID=416058) onto... Andrew Schoen
08:18 PM Bug #10600 (Resolved): PATH issues on RHEL7 nodes?
http://pulpito.ceph.redhat.com/teuthology-2015-01-19_22:06:01-fs-dumpling-distro-basic-magna/29429/... Greg Farnum
05:01 PM Feature #10597 (New): automatically kill/abort a run after N failures
it would be nice to set a threshold of failures that would trigger an abort of a run once we rack of some number of f... Sage Weil
04:25 PM Revision fdc36e8d (teuthology): Merge pull request #413 from ceph/extras-doc-update
Added some comments clarifying functionality in the install task. Zack Cerza
04:01 PM Bug #10593: s3tests branch defaults to master and cause tests fail
Zack Cerza
04:01 PM Bug #10593: s3tests branch defaults to master and cause tests fail
I would encourage using 'branch:' and not 'force-branch:'.
Also, as Loic mentoined, there is a merge conflict in y...
Zack Cerza
03:21 PM Revision a9d85e6a (teuthology): Added some comments clarifying functionality in the install task.
I also put in a couple TODO comments for things to look at later.
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Andrew Schoen
07:49 AM Bug #10595 (Duplicate): Chef tasks are broken on RHEL 7.1
Whoops. accidentally resubmitted. Anonymous
07:47 AM Bug #10595 (Duplicate): Chef tasks are broken on RHEL 7.1
running teuthology on rhel 7.1 with the following yaml file:... Anonymous

01/20/2015

09:24 PM Revision 6a75edab (teuthology): Add cephfs-java to rpm packages
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
06:06 PM Bug #10593 (Fix Under Review): s3tests branch defaults to master and cause tests fail
It looks like we can cherrypick this commit 01b556afc148dd70d59260f7f4b0712deddbb844 Yuri Weinstein
05:27 PM Bug #10593: s3tests branch defaults to master and cause tests fail
It looks like we can cherrypick this commit 01b556afc148dd70d59260f7f4b0712deddbb844
Pls review https://github.com...
Yuri Weinstein
04:55 PM Bug #10593: s3tests branch defaults to master and cause tests fail
This is temporarily fixed by https://github.com/ceph/ceph-qa-suite/pull/305
We need to fix it in teuthology code, ...
Yuri Weinstein
03:52 PM Bug #10593 (In Progress): s3tests branch defaults to master and cause tests fail
See code https://github.com/ceph/ceph-qa-suite/blob/master/tasks/s3tests.py#L125
To fix - use @force-branch: dumpl...
Yuri Weinstein
03:49 PM Bug #10593 (Resolved): s3tests branch defaults to master and cause tests fail
Run http://pulpito.front.sepia.ceph.com/teuthology-2015-01-19_18:08:36-upgrade:dumpling-dumpling-distro-basic-multi/
...
Yuri Weinstein
05:59 PM Revision ec739987 (teuthology): Merge pull request #411 from ceph/wip-10580
Remove duplicate package list from install task Andrew Schoen
05:40 PM Revision 0ea598e9 (teuthology): Merge pull request #412 from ceph/wip-10578
Change default results_timeout to 12h Andrew Schoen
05:36 PM Revision 676db6d6 (teuthology): Remove unncessary 'global' declaration
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
05:33 PM Revision 29242971 (teuthology): Change default results_timeout to 12h
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
04:18 PM Feature #10594 (Resolved): RHEL 7.1 support for chef
running teuthology on rhel 7.1 with the following yaml file:... Anonymous
02:21 PM Feature #10561 (In Progress): teuthology: ability to test kernel for RHEL
I think we should be able to get the info we need to download packages from brew using koji.
Here's some terminal ...
Andrew Schoen
02:18 PM Bug #8949 (Resolved): No Proper Documentation or automation user guides available for teuthology
We thing http://ceph.com/teuthology/docs/ covers the concerns laid out here reasonably well. If you disagree, please ... Zack Cerza
01:53 PM Feature #10589 (New): replacement install task using ansible
Initially as a proof-of-concept; hopefully as a true replacement. Zack Cerza
01:51 PM Bug #10510 (Resolved): must be able to install packages with varying names on distributions
@libcephfs-java@ is already installed on @deb@ systems. The following commit installs @cephfs-java@ on @rpm@ systems ... Zack Cerza
01:22 PM Bug #10510 (In Progress): must be able to install packages with varying names on distributions
Zack Cerza
09:57 AM Bug #10510: must be able to install packages with varying names on distributions
This caused two failures in http://pulpito.ceph.redhat.com/teuthology-2015-01-17_02:04:01-fs-giant-distro-basic-magna/ Greg Farnum
12:49 PM Bug #10580 (Resolved): duplicate package lists in install task
https://github.com/ceph/teuthology/commit/ec739987e79e6fc1dd082d06bbf0bd3a26d7acce Zack Cerza
12:48 PM Feature #10578 (Resolved): Increase timeout for test results emails.
https://github.com/ceph/teuthology/commit/0ea598e9dde9696327ea2ad4bb85c8bb3cfc09e3 Zack Cerza
12:46 PM Feature #10357: Optionally, skip all task teardown/cleanup
Unfortunately, this really just isn't possible due to the way tasks are implemented as context managers. If they were... Zack Cerza
10:40 AM Feature #10233 (Resolved): Modify upgrade suites to run all workloads in parallel
RE: https://github.com/ceph/ceph-qa-suite/pull/259 Yuri Weinstein
10:29 AM Documentation #10466 (Resolved): Document site/client configuration options
https://github.com/ceph/teuthology/commit/661f0b8443cfe6a237f1b66d19afa799dcaf7def Zack Cerza
10:19 AM Feature #10538 (Resolved): Add v0.80.8 to firefly stable suites
Yuri Weinstein
09:39 AM Feature #10337: give jobs requiring more nodes a higher priority?
This struck with astounding clarity on http://pulpito.ceph.com/teuthology-2015-01-18_23:10:01-knfs-next-testing-basic... Greg Farnum
07:13 AM Bug #9922: Some suites still use http://ceph.newdream.net
Hi! I will be working on this! Regards! Armando Segnini
07:09 AM Bug #10582 (Resolved): missing packages for trusty
We seem to be missing packages for trusty.... Andrew Schoen

01/19/2015

07:27 PM Revision 850eedc8 (teuthology): Remove duplicate package list from install task
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
07:00 PM Revision 66be9841 (teuthology): Merge pull request #409 from ceph/wip-10573
Don't suppress stdout for most apt-get ops Zack Cerza
07:00 PM Revision eef76db8 (teuthology): Merge pull request #410 from ceph/print-teuth-command
Log the teuthology command being ran at the debug level Zack Cerza
06:51 PM Revision 7fbea9d9 (teuthology): Log the teuthology command being ran at the debug level
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
05:16 PM Revision 5f5129de (teuthology): Don't suppress stdout for most apt-get ops
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
05:05 PM Revision 07474f0f (teuthology): Merge pull request #408 from ceph/revert-407-wip-verbose
Revert "teuthology-suite: default -v" Zack Cerza
05:02 PM Revision d005b15f (teuthology): Revert "teuthology-suite: default -v"
Andrew Schoen
03:58 PM Feature #10578 (Fix Under Review): Increase timeout for test results emails.
https://github.com/ceph/teuthology/pull/412 Zack Cerza
09:49 AM Feature #10578 (Resolved): Increase timeout for test results emails.
Here is subject line for running suite that runs usually long time - "[Ceph-qa] 1 failed, 19 hung, 22 passed in teuth... Yuri Weinstein
03:57 PM Revision 16f316a1 (teuthology): Merge pull request #407 from ceph/wip-verbose
teuthology-suite: default -v Andrew Schoen
03:53 PM Revision 2c3832b0 (teuthology): teuthology-suite: default -v
Signed-off-by: Sage Weil <sage@redhat.com> Sage Weil
11:26 AM Bug #10580 (Fix Under Review): duplicate package lists in install task
https://github.com/ceph/teuthology/pull/411 Zack Cerza
11:16 AM Bug #10580 (Resolved): duplicate package lists in install task
Zack Cerza
11:01 AM Bug #10573 (Resolved): install task suppressing stdout unnecessarily
https://github.com/ceph/teuthology/commit/66be984167d01d8118cbda3c6115ddb8d9deb6e5 Zack Cerza
09:16 AM Bug #10573 (Fix Under Review): install task suppressing stdout unnecessarily
https://github.com/ceph/teuthology/pull/409 Zack Cerza
09:05 AM Bug #10573 (Resolved): install task suppressing stdout unnecessarily
See https://github.com/ceph/teuthology/blob/c0c8441559f4d314db1134a059acd5b46312f6f8/teuthology/task/install.py#L388
...
Zack Cerza
09:44 AM Bug #10577 (Resolved): "Failure: ImportError" in upgrade:dumpling-firefly-x-next-distro-basic-mul...
Run http://pulpito.ceph.com/teuthology-2015-01-18_17:10:01-upgrade:dumpling-firefly-x-next-distro-basic-multi/
Job...
Yuri Weinstein
09:29 AM Bug #10568: apt-get update: "Unable to correct problems, you have held broken packages."
Working on #10573 to debug this Zack Cerza
09:21 AM Bug #10568: apt-get update: "Unable to correct problems, you have held broken packages."
Same in http://pulpito.ceph.redhat.com/teuthology-2015-01-19_02:20:02-multi-version-giant-distro-basic-magna/
Jobs...
Yuri Weinstein
08:57 AM Bug #10568: apt-get update: "Unable to correct problems, you have held broken packages."
Same in run http://pulpito.ceph.redhat.com/teuthology-2015-01-16_18:21:03-upgrade:dumpling-dumpling-distro-basic-magn... Yuri Weinstein
06:57 AM Bug #10568 (Duplicate): apt-get update: "Unable to correct problems, you have held broken packages."
I've seen a couple of these recently in octo. Doesn't seemed to be related to the new caching proxy. The machines m... Andrew Schoen
09:06 AM Bug #10574 (Resolved): s3tests failed in upgrade:dumpling-dumpling-distro-basic-multi run
Run http://pulpito.ceph.com/teuthology-2015-01-16_15:09:46-upgrade:dumpling-dumpling-distro-basic-multi/
Jobs: ['7...
Yuri Weinstein

01/16/2015

06:40 PM Feature #10538: Add v0.80.8 to firefly stable suites
s3tests issue was fixed, see above, results - http://pulpito.front.sepia.ceph.com/teuthology-2015-01-16_15:51:27-upgr... Yuri Weinstein
11:28 AM Feature #10538 (Fix Under Review): Add v0.80.8 to firefly stable suites
Added v0.80.8 to
/newer
/singleton/versions-steps/
/singleton/versions-steps-x/
Corresponding PR https://git...
Yuri Weinstein
04:42 PM Feature #10562 (New): support ceph downgrades
wanted to file a ticket so keep track of where we are with this.
looks like, we may want to support ceph downgrade...
Tamilarasi muthamizhan
03:36 PM Feature #10561 (Resolved): teuthology: ability to test kernel for RHEL
as we discussed, the solution would be to add an option like "brew:buildId" to the teuthology command that schedules ... Tamilarasi muthamizhan
08:08 AM Bug #10540 (Resolved): yum install failures on magna067
This was an issue with the nginx cache proxy we setup for octo. Tweaking the nginx configs was needed so we can expi... Andrew Schoen
07:38 AM Feature #10467 (Resolved): gracefully fail jobs if packages are not found
Andrew Schoen
07:33 AM Bug #10404: thrashosds: failed to decode JSON
I was unable to reproduce this bug. My test run on octo passed.
Here's the log from that test:
http://magna002...
Andrew Schoen
07:00 AM Bug #10510: must be able to install packages with varying names on distributions
the simplest workaround is to just unconditionally install this with the rest of ceph in install.py.
we can worry ...
Sage Weil

01/15/2015

08:30 PM Revision 3117c735 (teuthology): Merge pull request #402 from ceph/wip-10467
Schedule jobs with missing packages, but fail them quickly Zack Cerza
08:18 PM Revision 0a8994a7 (teuthology): Allow runs that have jobs with missing packages to schedule.
Runs that have jobs with missing packages will now schedule successfully
instead of throwing an exception and sending...
Andrew Schoen
08:18 PM Revision 1747e685 (teuthology): New internal task to check packages and fail the job if any are m...
Introduces a new task, internal.check_packages, that checks gitbuilder
for ceph packages for the given os_type and sh...
Andrew Schoen
08:18 PM Revision b77af118 (teuthology): Make teuthology.suite.get_gitbuilder_host respect config.gitbuild...
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
08:18 PM Revision 6c783355 (teuthology): If a job was marked 'dead' by a task, retain that status on failure
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
08:18 PM Revision 05f53f3b (teuthology): Adding some more test coverage to teuthology.suite
This is about a 10% increase in coverage on teuthology.suite
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
Andrew Schoen
03:57 PM Revision 86c9c68c (teuthology): Respect gitbuilder_host in get_ceph_binary_url()
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
02:57 PM Bug #10510: must be able to install packages with varying names on distributions
I guess this means we need to be able to say "libcephfs-java" for Debian, and "cephfs-java" for RHEL. I don't think t... Greg Farnum
02:19 PM Feature #10551: test RGW with mod_proxy_fcgi instead of mod_fastcgi
Until mod_proxy_fcgi is available in EPEL-6 (https://bugzilla.redhat.com/1182770), there are EL6 packages here: http:... Ken Dreyer
10:51 AM Feature #10551 (Resolved): test RGW with mod_proxy_fcgi instead of mod_fastcgi
The switch from mod_fastcgi to mod_proxy_fcgi is described on ceph-devel, at http://thread.gmane.org/gmane.comp.file-... Ken Dreyer
01:32 PM Feature #10538 (In Progress): Add v0.80.8 to firefly stable suites
Yuri Weinstein
08:02 AM Bug #10548 (Resolved): teuthology.misc not respecting config.gitbuilder_host
https://github.com/ceph/teuthology/commit/86c9c68cc821e474f8124604d5ecd096a3cced4b Zack Cerza
08:01 AM Bug #10548 (Resolved): teuthology.misc not respecting config.gitbuilder_host
Zack Cerza
08:00 AM Bug #10495 (Resolved): install task not respecting gitbuilder_host setting
Zack Cerza
07:39 AM Bug #10495: install task not respecting gitbuilder_host setting
https://github.com/ceph/teuthology/commit/ad4725d3c36cca8333438f611b4446edc4fe07bb Zack Cerza

01/14/2015

10:46 PM Revision 8386e7cc (teuthology): Merge pull request #405 from ceph/docs-interactive
documentation updates for interactive and interactive-on-error Alfredo Deza
10:39 PM Revision cb272410 (teuthology): Additional information about the interative task in the README
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
10:26 PM Revision 0660f853 (teuthology): docs update, interactive-on-error does trigger between nested tas...
Signed-off-by: Andrew Schoen <aschoen@redhat.com> Andrew Schoen
08:05 PM Revision ae0f72e1 (teuthology): Merge pull request #403 from dmick/master
Two bugs: vps hostkeys and interactive-on-error multiple activation Andrew Schoen
05:42 PM Revision ad4725d3 (teuthology): Merge pull request #404 from ceph/mirror
Point yum repo at gitbuilder_host Zack Cerza
05:18 PM Revision c0c84415 (teuthology): Point yum repo at gitbuilder_host
Signed-off-by: Zack Cerza <zack@redhat.com> Zack Cerza
02:43 PM Bug #10540: yum install failures on magna067
This seems to be a problem with the new gitbuilder proxy we're trying out on manga002... Andrew Schoen
01:34 PM Bug #10540: yum install failures on magna067
full log here from another run with the same error: http://magna002.ceph.redhat.com/andrewschoen/thrash-test/teutholo... Andrew Schoen
01:17 PM Bug #10540 (Resolved): yum install failures on magna067
I believe this is a packaging problem. Teuthology is trying to install ceph-debuginfo-0.90, but I see ceph-debuginfo-... Andrew Schoen
10:39 AM Feature #10538 (Resolved): Add v0.80.8 to firefly stable suites
Yuri Weinstein
09:33 AM Bug #10404: thrashosds: failed to decode JSON
The log for this run:
http://qa-proxy.ceph.com/teuthology/sage-wn-d/671439/teuthology.log
Andrew Schoen
09:19 AM Bug #10495: install task not respecting gitbuilder_host setting
This one is for the yum repo:
https://github.com/ceph/teuthology/pull/404
Zack Cerza

01/13/2015

11:16 PM Revision d75c9075 (teuthology): Reset interactive-on-error the first time it triggers
This way one only drops into the REPL once. (It's possible
that it may be useful to configure this behavior, but I t...
Dan Mick
11:16 PM Revision 4f6b69b0 (teuthology): internal.vm_setup: call ssh with -o StrictHostKeyChecking=no
If one doesn't have this configured for ssh, the call to
ssh for vps'es in vm_setup will cause a tty prompt to accept...
Dan Mick
03:16 PM Bug #10529: interactive-on-error drops to REPL once for each nested task and once for overall task
https://github.com/ceph/teuthology/pull/403 Dan Mick
03:07 PM Bug #10529 (Resolved): interactive-on-error drops to REPL once for each nested task and once for ...
With the recent change to drop to interactive mode at the end of the first failing nested task, I've noticed that we ... Dan Mick
03:16 PM Bug #10530: internal.vm_setup calls ssh, may prompt to accept new host key
https://github.com/ceph/teuthology/pull/403
Dan Mick
03:12 PM Bug #10530 (Resolved): internal.vm_setup calls ssh, may prompt to accept new host key
vm_setup calls ssh -t -t <remote> sudo sh /tmp/edit_sudoers.sh (to edit /etc/sudoers to remove requiretty and set vis... Dan Mick
02:18 PM Feature #10240: expand test coverage for the upgrade suites
See https://github.com/ceph/ceph-qa-suite/pull/293
Note:
- added @test_cache-pool-snaps.yaml@ to both @sequenti...
Yuri Weinstein
01:32 PM Feature #10395 (Resolved): pulpito: allow table size to consume entire window
https://github.com/ceph/pulpito/pull/31 Andrew Schoen
01:05 PM Bug #10523: calamari_setup should populate and use a virtualenv when running ice-tools
https://github.com/ceph/ceph-qa-suite/pull/288 Dan Mick
01:05 PM Bug #10522: calamari_setup task leaves temporary files in cwd
https://github.com/ceph/ceph-qa-suite/pull/288 Dan Mick
01:04 PM Bug #10521: calamari-setup task can be confused by multiple ICEballs in cwd
https://github.com/ceph/ceph-qa-suite/pull/288 Dan Mick
01:01 PM Bug #10470: ENOENT starting ceph_test_rados on upgrade tests
- print: '**** done rados/load-gen-big.sh 2-workload parallel'
- exec:
client.0:
- ceph osd pool c...
Samuel Just
12:50 PM Bug #10404 (Need More Info): thrashosds: failed to decode JSON
Really looks like the Thrasher class needs to either be smarter, or more verbose, or both. Zack Cerza
11:12 AM Bug #10510 (New): must be able to install packages with varying names on distributions
So the problem is hard-coded package names in the yaml and then I realized its an deb vs rpm package naming differenc... Sandon Van Ness
09:54 AM Bug #10510 (Need More Info): must be able to install packages with varying names on distributions
The yaml has set for the install task to install extra_packages 'libcephfs-java' but when i look on the gitbuilder I ... Sandon Van Ness
10:58 AM Bug #10481 (Need More Info): "error: ceph-release-1-0.el7.noarch.rpm: not an rpm package (or pack...
Zack Cerza
10:56 AM Bug #10261 (Resolved): calamari-setup task only handles one mon
Fixed: SHA f36b171 Anonymous
10:34 AM Bug #10284 (Won't Fix): install task doesn't like to downgrade on rhel
Zack Cerza
10:33 AM Bug #10276 (Resolved): qemu-iotests workunit fails on rpm-based distros
Andrew Schoen
10:32 AM Bug #10275 (Resolved): qemu task fails on rpm-based distros
Andrew Schoen
06:50 AM Feature #10467 (In Progress): gracefully fail jobs if packages are not found
Andrew Schoen
 

Also available in: Atom