Project

General

Profile

Actions

Bug #24656

closed

Can't run a rados suite item in v13.0.1

Added by David Zafman almost 6 years ago. Updated over 2 years ago.

Status:
Won't Fix - EOL
Priority:
Urgent
Assignee:
-
Category:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

I can't get tethology to do a small rados suite run based on v13.0.1. It worked with v13.0.2.

Neither of these work:

teuthology-suite --machine-type smithi --suite rados/standalone --ceph wip-zafman-v13.0.1 --filter erasure-code
teuthology-suite -d ubuntu -D 16.04 --machine-type smithi --suite rados/standalone --ceph wip-zafman-v13.0.1 --filter erasure-code

See http://pulpito.ceph.com/dzafman-2018-06-25_10:33:45-rados:standalone-wip-zafman-v13.0.1-distro-basic-smithi/

2018-06-25T17:45:57.075 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists...
2018-06-25T17:45:57.116 INFO:teuthology.orchestra.run.smithi005:Running: u'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.0.1-1-g48ae27e-1xenial ceph-mds=13.0.1-1-g48ae27e-1xenial ceph-mgr=13.0.1-1-g48ae27e-1xenial ceph-common=13.0.1-1-g48ae27e-1xenial ceph-fuse=13.0.1-1-g48ae27e-1xenial ceph-test=13.0.1-1-g48ae27e-1xenial radosgw=13.0.1-1-g48ae27e-1xenial python-ceph=13.0.1-1-g48ae27e-1xenial libcephfs2=13.0.1-1-g48ae27e-1xenial libcephfs-dev=13.0.1-1-g48ae27e-1xenial libcephfs-java=13.0.1-1-g48ae27e-1xenial libcephfs-jni=13.0.1-1-g48ae27e-1xenial librados2=13.0.1-1-g48ae27e-1xenial librbd1=13.0.1-1-g48ae27e-1xenial rbd-fuse=13.0.1-1-g48ae27e-1xenial'
2018-06-25T17:45:57.179 INFO:teuthology.orchestra.run.smithi005.stdout:Reading package lists...
2018-06-25T17:45:57.432 INFO:teuthology.orchestra.run.smithi005.stdout:Building dependency tree...
2018-06-25T17:45:57.432 INFO:teuthology.orchestra.run.smithi005.stdout:Reading state information...
2018-06-25T17:45:57.513 INFO:teuthology.orchestra.run.smithi005.stdout:Some packages could not be installed. This may mean that you have
2018-06-25T17:45:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:requested an impossible situation or if you are using the unstable
2018-06-25T17:45:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:distribution that some required packages have not yet been created
2018-06-25T17:45:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:or been moved out of Incoming.
2018-06-25T17:45:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:The following information may help to resolve the situation:
2018-06-25T17:45:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:
2018-06-25T17:45:57.514 INFO:teuthology.orchestra.run.smithi005.stdout:The following packages have unmet dependencies:
2018-06-25T17:45:57.552 INFO:teuthology.orchestra.run.smithi005.stdout: ceph : Depends: ceph-mon (= 13.0.1-1-g48ae27e-1xenial) but it is not going to be installed
2018-06-25T17:45:57.552 INFO:teuthology.orchestra.run.smithi005.stdout:        Depends: ceph-osd (= 13.0.1-1-g48ae27e-1xenial) but it is not going to be installed
2018-06-25T17:45:57.553 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T17:45:57.553 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T17:45:57.553 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T17:45:57.553 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T17:45:57.553 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T17:45:57.570 INFO:teuthology.orchestra.run.smithi005.stderr:E: Unable to correct problems, you have held broken packages.

I can't test against Ubuntu bionic (18) because it doesn't build until v13.1.1

Actions #1

Updated by Yuri Weinstein almost 6 years ago

I had no problems scheduling

http://pulpito.ceph.com/yuriw-2018-06-25_19:24:09-rados:standalone-wip-zafman-v13.0.1-distro-basic-smithi

http://pulpito.ceph.com/yuriw-2018-06-25_19:23:42-rados:standalone-wip-zafman-v13.0.1-distro-basic-smithi

  yuriw@teuthology ~ [20:47:25]> CEPH_QA_MAIL="ceph-qa@ceph.com"; MACHINE_NAME=smithi; CEPH_BRANCH=wip-zafman-v13.0.1
  yuriw@teuthology ~ [19:23:30]> teuthology-suite --machine-type smithi --suite rados/standalone --ceph wip-zafman-v13.0.1 --filter erasure-code
2018-06-25 19:23:42,348.348 INFO:teuthology.suite:Using random seed=5594
2018-06-25 19:23:42,349.349 INFO:teuthology.suite.run:kernel sha1: distro
2018-06-25 19:23:42,699.699 INFO:teuthology.suite.run:ceph sha1: 48ae27ead8d6c0019611be8bc28e2b22dede5fe5
2018-06-25 19:23:43,030.030 INFO:teuthology.suite.run:ceph version: 13.0.1-1.g48ae27e
2018-06-25 19:23:43,030.030 INFO:teuthology.suite.run:teuthology branch: master
2018-06-25 19:23:43,424.424 INFO:teuthology.suite.run:ceph-ci branch: wip-zafman-v13.0.1 48ae27ead8d6c0019611be8bc28e2b22dede5fe5
2018-06-25 19:23:43,438.438 INFO:teuthology.repo_utils:Cloning git://git.ceph.com/ceph-ci.git wip-zafman-v13.0.1 from upstream
2018-06-25 19:23:46,989.989 INFO:teuthology.repo_utils:Resetting repo at /home/yuriw/src/git.ceph.com_ceph-c_wip-zafman-v13.0.1 to branch wip-zafman-v13.0.1
2018-06-25 19:23:47,573.573 INFO:teuthology.suite.run:Suite rados:standalone in /home/yuriw/src/git.ceph.com_ceph-c_wip-zafman-v13.0.1/qa/suites/rados/standalone generated 6 jobs (not yet filtered)
2018-06-25 19:23:47,845.845 INFO:teuthology.suite.run:Scheduling rados:standalone/erasure-code.yaml
Job scheduled with name yuriw-2018-06-25_19:23:42-rados:standalone-wip-zafman-v13.0.1-distro-basic-smithi and ID 2703823
2018-06-25 19:23:48,823.823 INFO:teuthology.suite.run:Suite rados:standalone in /home/yuriw/src/git.ceph.com_ceph-c_wip-zafman-v13.0.1/qa/suites/rados/standalone scheduled 1 jobs.
2018-06-25 19:23:48,824.824 INFO:teuthology.suite.run:5/6 jobs were filtered out.
  yuriw@teuthology ~ [19:23:48]> teuthology-suite -d ubuntu -D 16.04 --machine-type smithi --suite rados/standalone --ceph wip-zafman-v13.0.1 --filter erasure-code
2018-06-25 19:24:09,739.739 INFO:teuthology.suite:Using random seed=7238
2018-06-25 19:24:09,740.740 INFO:teuthology.suite.run:kernel sha1: distro
2018-06-25 19:24:10,058.058 INFO:teuthology.suite.run:ceph sha1: 48ae27ead8d6c0019611be8bc28e2b22dede5fe5
2018-06-25 19:24:10,375.375 INFO:teuthology.suite.run:ceph version: 13.0.1-1-g48ae27e-1xenial
2018-06-25 19:24:10,375.375 INFO:teuthology.suite.run:teuthology branch: master
2018-06-25 19:24:10,747.747 INFO:teuthology.suite.run:ceph-ci branch: wip-zafman-v13.0.1 48ae27ead8d6c0019611be8bc28e2b22dede5fe5
2018-06-25 19:24:10,757.757 INFO:teuthology.repo_utils:Fetching wip-zafman-v13.0.1 from upstream
2018-06-25 19:24:11,067.067 INFO:teuthology.repo_utils:Resetting repo at /home/yuriw/src/git.ceph.com_ceph-c_wip-zafman-v13.0.1 to branch wip-zafman-v13.0.1
2018-06-25 19:24:11,150.150 INFO:teuthology.suite.run:Suite rados:standalone in /home/yuriw/src/git.ceph.com_ceph-c_wip-zafman-v13.0.1/qa/suites/rados/standalone generated 6 jobs (not yet filtered)
2018-06-25 19:24:11,428.428 INFO:teuthology.suite.run:Scheduling rados:standalone/erasure-code.yaml
Job scheduled with name yuriw-2018-06-25_19:24:09-rados:standalone-wip-zafman-v13.0.1-distro-basic-smithi and ID 2703824
2018-06-25 19:24:12,401.401 INFO:teuthology.suite.run:Suite rados:standalone in /home/yuriw/src/git.ceph.com_ceph-c_wip-zafman-v13.0.1/qa/suites/rados/standalone scheduled 1 jobs.
2018-06-25 19:24:12,401.401 INFO:teuthology.suite.run:5/6 jobs were filtered out.

Actions #2

Updated by David Zafman almost 6 years ago

For comparison purposes I did a run against v13.0.0. It has more package problems listed than v13.0.1

teuthology-suite --machine-type smithi --suite rados/standalone --ceph wip-zafman-v13.0.0 --filter erasure-code -p 20

teuthology.log:

2018-06-25T23:43:38.947 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists...
2018-06-25T23:43:38.981 INFO:teuthology.orchestra.run.smithi114:Running: u'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=13.0.0-1-g501e601-1xenial ceph-mds=13.0.0-1-g501e601-1xenial ceph-mgr=13.0.0-1-g501e601-1xenial ceph-common=13.0.0-1-g501e601-1xenial ceph-fuse=13.0.0-1-g501e601-1xenial ceph-test=13.0.0-1-g501e601-1xenial radosgw=13.0.0-1-g501e601-1xenial python-ceph=13.0.0-1-g501e601-1xenial libcephfs2=13.0.0-1-g501e601-1xenial libcephfs-dev=13.0.0-1-g501e601-1xenial libcephfs-java=13.0.0-1-g501e601-1xenial libcephfs-jni=13.0.0-1-g501e601-1xenial librados2=13.0.0-1-g501e601-1xenial librbd1=13.0.0-1-g501e601-1xenial rbd-fuse=13.0.0-1-g501e601-1xenial'
2018-06-25T23:43:39.025 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists...
2018-06-25T23:43:39.264 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree...
2018-06-25T23:43:39.265 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information...
2018-06-25T23:43:39.330 INFO:teuthology.orchestra.run.smithi114.stdout:Some packages could not be installed. This may mean that you have
2018-06-25T23:43:39.331 INFO:teuthology.orchestra.run.smithi114.stdout:requested an impossible situation or if you are using the unstable
2018-06-25T23:43:39.331 INFO:teuthology.orchestra.run.smithi114.stdout:distribution that some required packages have not yet been created
2018-06-25T23:43:39.331 INFO:teuthology.orchestra.run.smithi114.stdout:or been moved out of Incoming.
2018-06-25T23:43:39.331 INFO:teuthology.orchestra.run.smithi114.stdout:The following information may help to resolve the situation:
2018-06-25T23:43:39.331 INFO:teuthology.orchestra.run.smithi114.stdout:
2018-06-25T23:43:39.332 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages have unmet dependencies:
2018-06-25T23:43:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: ceph : Depends: ceph-mon (= 13.0.0-1-g501e601-1xenial) but it is not going to be installed
2018-06-25T23:43:39.365 INFO:teuthology.orchestra.run.smithi114.stdout:        Depends: ceph-osd (= 13.0.0-1-g501e601-1xenial) but it is not going to be installed
2018-06-25T23:43:39.365 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common : Depends: python-rgw (= 13.0.0-1-g501e601-1xenial) but it is not going to be installed
2018-06-25T23:43:39.365 INFO:teuthology.orchestra.run.smithi114.stdout:               Depends: libradosstriper1 but it is not going to be installed
2018-06-25T23:43:39.366 INFO:teuthology.orchestra.run.smithi114.stdout:               Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.366 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test : Depends: libradosstriper1 but it is not going to be installed
2018-06-25T23:43:39.366 INFO:teuthology.orchestra.run.smithi114.stdout:             Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.371 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 : Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.372 INFO:teuthology.orchestra.run.smithi114.stdout: python-ceph : Depends: python-rgw (= 13.0.0-1-g501e601-1xenial) but it is not going to be installed
2018-06-25T23:43:39.376 INFO:teuthology.orchestra.run.smithi114.stdout: radosgw : Depends: librgw2 (= 13.0.0-1-g501e601-1xenial) but it is not going to be installed
2018-06-25T23:43:39.376 INFO:teuthology.orchestra.run.smithi114.stdout:           Depends: libstdc++6 (>= 6) but 5.4.0-6ubuntu1~16.04.9 is to be installed
2018-06-25T23:43:39.380 INFO:teuthology.orchestra.run.smithi114.stderr:E: Unable to correct problems, you have held broken packages.

Actions #3

Updated by David Zafman almost 6 years ago

The test was able to run using v12.2.4 a luminous tag.

Actions #4

Updated by David Zafman almost 6 years ago

  • Priority changed from Normal to Urgent
Actions #5

Updated by David Zafman almost 6 years ago

Trying to run the erasure-code yaml in the standalone suite failed against Centos using the v13.0.2 tag that worked under Ubuntu.

teuthology-suite -d centos --machine-type smithi --suite rados/standalone --ceph wip-zafman-v13.0.2 --filter erasure-code -p 20 --suite-branch wip-zafman-v13.0.2-nodistro --suite-dir /src/ceph

I had made a mistake before by adding a distro directory to qa/suites/rados/standalone like in master branch. The wip-zafman-v13.0.2-nodistro fixes but I still use the packages from wip-zafman-v13.0.2

teuthology.log

2018-06-26T18:40:00.889 INFO:tasks.workunit.client.0.smithi203.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:427: run_mon:  ceph-mon --id a --mkfs --mon-data=td/test-erasure-code-plugins/a --run-dir=td/test-erasure-code-plugins
2018-06-26T18:40:01.049 INFO:tasks.workunit.client.0.smithi203.stderr:src/tcmalloc.cc:284] Attempt to free invalid pointer 0x5559742c2540
2018-06-26T18:40:01.049 INFO:tasks.workunit.client.0.smithi203.stderr:*** Caught signal (Aborted) **
2018-06-26T18:40:01.049 INFO:tasks.workunit.client.0.smithi203.stderr: in thread 7f4f2845bec0 thread_name:ceph-mon
2018-06-26T18:40:01.051 INFO:tasks.workunit.client.0.smithi203.stderr: ceph version 13.0.2-2-g56b44e4 (56b44e4e6836f1919d8e424eb922a0efa67d647e) mimic (dev)
2018-06-26T18:40:01.052 INFO:tasks.workunit.client.0.smithi203.stderr: 1: (()+0x448360) [0x555971448360]
2018-06-26T18:40:01.052 INFO:tasks.workunit.client.0.smithi203.stderr: 2: (()+0xf6d0) [0x7f4f1ebf66d0]
2018-06-26T18:40:01.052 INFO:tasks.workunit.client.0.smithi203.stderr: 3: (gsignal()+0x37) [0x7f4f1bd2b277]
2018-06-26T18:40:01.052 INFO:tasks.workunit.client.0.smithi203.stderr: 4: (abort()+0x148) [0x7f4f1bd2c968]
2018-06-26T18:40:01.052 INFO:tasks.workunit.client.0.smithi203.stderr: 5: (tcmalloc::Log(tcmalloc::LogMode, char const*, int, tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem, tcmalloc::LogItem)+0x1e6) [0x7f4f1df7ba66]
2018-06-26T18:40:01.052 INFO:tasks.workunit.client.0.smithi203.stderr: 6: (()+0x17644) [0x7f4f1df70644]
2018-06-26T18:40:01.053 INFO:tasks.workunit.client.0.smithi203.stderr: 7: (rocksdb::LRUCache::~LRUCache()+0x65) [0x55597144a445]
2018-06-26T18:40:01.053 INFO:tasks.workunit.client.0.smithi203.stderr: 8: (std::_Sp_counted_ptr<rocksdb::BlockBasedTableFactory*, (__gnu_cxx::_Lock_policy)2>::_M_dispose()+0x25a) [0x55597152e0aa]
2018-06-26T18:40:01.053 INFO:tasks.workunit.client.0.smithi203.stderr: 9: (std::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release()+0x46) [0x555971225cf6]
2018-06-26T18:40:01.053 INFO:tasks.workunit.client.0.smithi203.stderr: 10: (rocksdb::ColumnFamilyOptions::~ColumnFamilyOptions()+0x1e) [0x55597134840e]
2018-06-26T18:40:01.053 INFO:tasks.workunit.client.0.smithi203.stderr: 11: (RocksDBStore::init(std::string)+0x75) [0x55597133eeb5]
2018-06-26T18:40:01.053 INFO:tasks.workunit.client.0.smithi203.stderr: 12: (MonitorDBStore::_open(std::string)+0x273) [0x5559712295d3]
2018-06-26T18:40:01.053 INFO:tasks.workunit.client.0.smithi203.stderr: 13: (MonitorDBStore::create_and_open(std::ostream&)+0x9b) [0x5559712299db]
2018-06-26T18:40:01.054 INFO:tasks.workunit.client.0.smithi203.stderr: 14: (main()+0x8e6) [0x55597113ab36]
2018-06-26T18:40:01.054 INFO:tasks.workunit.client.0.smithi203.stderr: 15: (__libc_start_main()+0xf5) [0x7f4f1bd17445]
2018-06-26T18:40:01.054 INFO:tasks.workunit.client.0.smithi203.stderr: 16: (()+0x220e40) [0x555971220e40]
2018-06-26T18:40:01.054 INFO:tasks.workunit.client.0.smithi203.stderr:2018-06-26 18:40:01.057 7f4f2845bec0 -1 *** Caught signal (Aborted) **
2018-06-26T18:40:01.054 INFO:tasks.workunit.client.0.smithi203.stderr: in thread 7f4f2845bec0 thread_name:ceph-mon

Actions #6

Updated by Josh Durgin over 2 years ago

  • Status changed from New to Won't Fix - EOL
Actions

Also available in: Atom PDF