teuthology-suite -k option doesn't always override kernel
teuthology-suite doesn't currently respect the -k option, which is supposed to override the kernel used in testing. To reproduce:
teuthology-suite --machine-type smithi -p 50 --suite fs:thrash -k wip-fscrypt --force-priority -l 16
The resulting kernels used in the test will end up being a mix of the one specified via -k and distro kernels. Ilya mentioned this in a private email thread:
I think this is because the fs suite supplies overrides for the kernel task. I never liked that idea precisely because it makes any debugging harder than it should be. OTOH when everything works it results in all kernels being covered by a single test run.
I don't really care what happens when -k isn't specified to teuthology-suite, but when it is specified it should be used universally.