Actions
Bug #3406
closedceph fuse crashed during blogbench test
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Logs: ubuntu@teuthology:/a/teuthology-2012-10-23_19:00:04-regression-master-testing-gcov/334
2012-10-23T20:18:56.692 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:*** Caught signal (Segmentation fault) ** 2012-10-23T20:18:56.692 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: in thread 7f62333b1700 2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: ceph version 0.53-441-g59839a8 (59839a8f9030c28391c7f99aa52a8c58a74c0066) 2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 1: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x71a23a] 2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 2: (()+0xfcb0) [0x7f6238116cb0] 2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 3: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned long, int)+0xeb) [0x7f62373c3e3b] 2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 4: (tcmalloc::ThreadCache::ListTooLong(tcmalloc::ThreadCache::FreeList*, unsigned long)+0x23) [0x7f62373c3ec3] 2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 5: (operator delete(void*)+0x28b) [0x7f62373d33ab] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 6: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::_M_erase(std::_Rb_tree_node<std::pair<int const, xlist<IncomingQueue*>*> >*)+0x4b) [0x5d06ab] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 7: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::erase(int const&)+0x230) [0x6cb9a0] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 8: (DispatchQueue::entry()+0x15c4) [0x6c8f24] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 9: (DispatchQueue::DispatchThread::entry()+0x15) [0x5cf865] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 10: (Thread::_entry_func(void*)+0x12) [0x5d3192] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 11: (()+0x7e9a) [0x7f623810ee9a] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 12: (clone()+0x6d) [0x7f62368c74bd] 2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:2012-10-23 13:18:55.847063 7f62333b1700 -1 *** Caught signal (Segmentation fault) ** 2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: in thread 7f62333b1700 2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: ceph version 0.53-441-g59839a8 (59839a8f9030c28391c7f99aa52a8c58a74c0066) 2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 1: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x71a23a] 2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 2: (()+0xfcb0) [0x7f6238116cb0] 2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 3: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned long, int)+0xeb) [0x7f62373c3e3b] 2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 4: (tcmalloc::ThreadCache::ListTooLong(tcmalloc::ThreadCache::FreeList*, unsigned long)+0x23) [0x7f62373c3ec3] 2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 5: (operator delete(void*)+0x28b) [0x7f62373d33ab] 2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 6: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::_M_erase(std::_Rb_tree_node<std::pair<int const, xlist<IncomingQueue*>*> >*)+0x4b) [0x5d06ab] 2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 7: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::erase(int const&)+0x230) [0x6cb9a0] 2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 8: (DispatchQueue::entry()+0x15c4) [0x6c8f24] 2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 9: (DispatchQueue::DispatchThread::entry()+0x15) [0x5cf865] 2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 10: (Thread::_entry_func(void*)+0x12) [0x5d3192] 2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 11: (()+0x7e9a) [0x7f623810ee9a] 2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 12: (clone()+0x6d) [0x7f62368c74bd] 2012-10-23T20:18:56.700 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. 2012-10-23T20:18:56.700 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: ubuntu@teuthology:/a/teuthology-2012-10-23_19:00:04-regression-master-testing-gcov/334$ cat summary.yaml ceph-sha1: 59839a8f9030c28391c7f99aa52a8c58a74c0066 client.0-kernel-sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d description: collection:fs-basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:cfuse_workunit_suites_blogbench.yaml duration: 196.24911308288574 failure_reason: 'Command failed with status 2: ''mkdir -- /tmp/cephtest/mnt.0/client.0/tmp && cd -- /tmp/cephtest/mnt.0/client.0/tmp && CEPH_REF=59839a8f9030c28391c7f99aa52a8c58a74c0066 PATH="$PATH:/tmp/cephtest/binary/usr/local/bin" LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/cephtest/binary/usr/local/lib" CEPH_CONF="/tmp/cephtest/ceph.conf" CEPH_SECRET_FILE="/tmp/cephtest/data/client.0.secret" CEPH_ID="0" PYTHONPATH="$PYTHONPATH:/tmp/cephtest/binary/usr/local/lib/python2.7/dist-packages:/tmp/cephtest/binary/usr/local/lib/python2.6/dist-packages" /tmp/cephtest/enable-coredump /tmp/cephtest/binary/usr/local/bin/ceph-coverage /tmp/cephtest/archive/coverage /tmp/cephtest/workunit.client.0/suites/blogbench.sh && rm -rf -- /tmp/cephtest/mnt.0/client.0/tmp''' flavor: gcov mon.a-kernel-sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d mon.b-kernel-sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d owner: scheduled_teuthology@teuthology success: false ubuntu@teuthology:/a/teuthology-2012-10-23_19:00:04-regression-master-testing-gcov/334$ cat config.yaml kernel: &id001 kdb: true sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d nuke-on-error: true overrides: ceph: coverage: true fs: btrfs log-whitelist: - slow request sha1: 59839a8f9030c28391c7f99aa52a8c58a74c0066 s3tests: branch: master workunit: sha1: 59839a8f9030c28391c7f99aa52a8c58a74c0066 roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mds.a - osd.3 - osd.4 - osd.5 - - client.0 targets: ubuntu@plana90.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnXSsUrbCT+Nj7+mYOuyc1zBE7sCWaPL+kUpoGXYyjGwELWr/HtSWaemD6vNJWaEiWm2sfVNkC3D28Ntcbdr1jetpBTcz5dog8jJr8bxahgovD4+K11xHpfXqb9K6KBUAeQLxnNzDaCVVDfqVRoy6Cr4JjrM5w4siPEgnlrAphpkChsrTtk5foXFw3KuAKy+F0UPdzGU3bOXgopKlyldG1eVQOK3v+5zhLsWzzEsUZzeIltG4wmr8Dd2e0nX8ai8P8pFTYN229Exi3kFHLL6UnIxTwgqYiviFiV5ZOyqgocUs6kc/YMuiDAc5YJhR6RFylVRQdG7XrLOUblUGX/s9/ ubuntu@plana91.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwq9PdHwBKUjNa86vjFTDwYcnXBXF81QqgOmXBN8NNbePIGhjY9Ji6IvvGwrywnCi9a46tY9hFPCvq6y+6tC7Pfjf248C7KYWAxqA4UPCkQQMvedJCk2RAH7oljHqXGuyfFgsveq11bWjTWRYZPpENwfjdB0okvr8TZrZePhJNYgMY2smiSDBQ96Cr211KnQk/cvGFC0u8x/R/MJaZBVD0GANH8xLpe8PpND3uuNIEox/CmXpC+XdXVGnm1AXpF8Bb4gDSgwF8NUyedj8c8GfC0iI1ISg96WYFfNgS4m9ulOlXl0SSdYQ3+DCr6aOz7Nk+2r84Vq8E5wpiKD9z+raJ ubuntu@plana95.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXTW5tgwuNkjMqMKrDzJKe/lgplU547LM8k4wC4FVg9/40whvasUDtBXrCKLvBqtyZTGTDJhS/GEgR3XPI010M84RKTJ0OPCE3IMwPMT0/gqetgGdaxPyQ2OdXwYMej8Iac5suWXTfSH4V0sakKBDvRtsmf54cSiM4Edwz8DKSJ46H1JPBdEd6iS/OQlsZIMxs94gCtaOpxGmLwJG4GSSqzx3JA5ydJmueZwh2CRJ6x9VYdad3J1hw4PKKHYwe0/SrPC1MtacOoQPZ14ov9uZ8kch8N+LwRX5N7Mr2UzW4G1+VsO+jfCoF9FtGZ6rIq7Gx0nH5oeqKExrZ2fp2HZgL tasks: - internal.lock_machines: 3 - internal.save_config: null - internal.check_lock: null - internal.connect: null - internal.check_conflict: null - kernel: *id001 - internal.base: null - internal.archive: null - internal.coredump: null - internal.syslog: null - internal.timer: null - chef: null - clock: null - ceph: null - ceph-fuse: null - workunit: clients: all: - suites/blogbench.sh
Actions