Project

General

Profile

Actions

Bug #3406

closed

ceph fuse crashed during blogbench test

Added by Tamilarasi muthamizhan over 11 years ago. Updated over 11 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs: ubuntu@teuthology:/a/teuthology-2012-10-23_19:00:04-regression-master-testing-gcov/334

2012-10-23T20:18:56.692 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:*** Caught signal (Segmentation fault) **
2012-10-23T20:18:56.692 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: in thread 7f62333b1700
2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: ceph version 0.53-441-g59839a8 (59839a8f9030c28391c7f99aa52a8c58a74c0066)
2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 1: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x71a23a]
2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 2: (()+0xfcb0) [0x7f6238116cb0]
2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 3: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned long, int)+0xeb) [0x7f62373c3e3b]
2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 4: (tcmalloc::ThreadCache::ListTooLong(tcmalloc::ThreadCache::FreeList*, unsigned long)+0x23) [0x7f62373c3ec3]
2012-10-23T20:18:56.694 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 5: (operator delete(void*)+0x28b) [0x7f62373d33ab]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 6: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::_M_erase(std::_Rb_tree_node<std::pair<int const, xlist<IncomingQueue*>*> >*)+0x4b) [0x5d06ab]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 7: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::erase(int const&)+0x230) [0x6cb9a0]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 8: (DispatchQueue::entry()+0x15c4) [0x6c8f24]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 9: (DispatchQueue::DispatchThread::entry()+0x15) [0x5cf865]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 10: (Thread::_entry_func(void*)+0x12) [0x5d3192]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 11: (()+0x7e9a) [0x7f623810ee9a]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 12: (clone()+0x6d) [0x7f62368c74bd]
2012-10-23T20:18:56.695 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:2012-10-23 13:18:55.847063 7f62333b1700 -1 *** Caught signal (Segmentation fault) **
2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: in thread 7f62333b1700
2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:
2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: ceph version 0.53-441-g59839a8 (59839a8f9030c28391c7f99aa52a8c58a74c0066)
2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 1: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x71a23a]
2012-10-23T20:18:56.696 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 2: (()+0xfcb0) [0x7f6238116cb0]
2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 3: (tcmalloc::ThreadCache::ReleaseToCentralCache(tcmalloc::ThreadCache::FreeList*, unsigned long, int)+0xeb) [0x7f62373c3e3b]
2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 4: (tcmalloc::ThreadCache::ListTooLong(tcmalloc::ThreadCache::FreeList*, unsigned long)+0x23) [0x7f62373c3ec3]
2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 5: (operator delete(void*)+0x28b) [0x7f62373d33ab]
2012-10-23T20:18:56.697 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 6: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::_M_erase(std::_Rb_tree_node<std::pair<int const, xlist<IncomingQueue*>*> >*)+0x4b) [0x5d06ab]
2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 7: (std::_Rb_tree<int, std::pair<int const, xlist<IncomingQueue*>*>, std::_Select1st<std::pair<int const, xlist<IncomingQueue*>*> >, std::less<int>, std::allocator<std::pair<int const, xlist<IncomingQueue*>*> > >::erase(int const&)+0x230) [0x6cb9a0]
2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 8: (DispatchQueue::entry()+0x15c4) [0x6c8f24]
2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 9: (DispatchQueue::DispatchThread::entry()+0x15) [0x5cf865]
2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 10: (Thread::_entry_func(void*)+0x12) [0x5d3192]
2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 11: (()+0x7e9a) [0x7f623810ee9a]
2012-10-23T20:18:56.698 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 12: (clone()+0x6d) [0x7f62368c74bd]
2012-10-23T20:18:56.700 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2012-10-23T20:18:56.700 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:
ubuntu@teuthology:/a/teuthology-2012-10-23_19:00:04-regression-master-testing-gcov/334$ cat summary.yaml 
ceph-sha1: 59839a8f9030c28391c7f99aa52a8c58a74c0066
client.0-kernel-sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d
description: collection:fs-basic clusters:fixed-3.yaml fs:btrfs.yaml tasks:cfuse_workunit_suites_blogbench.yaml
duration: 196.24911308288574
failure_reason: 'Command failed with status 2: ''mkdir -- /tmp/cephtest/mnt.0/client.0/tmp
  && cd -- /tmp/cephtest/mnt.0/client.0/tmp && CEPH_REF=59839a8f9030c28391c7f99aa52a8c58a74c0066
  PATH="$PATH:/tmp/cephtest/binary/usr/local/bin" LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/cephtest/binary/usr/local/lib" 
  CEPH_CONF="/tmp/cephtest/ceph.conf" CEPH_SECRET_FILE="/tmp/cephtest/data/client.0.secret" 
  CEPH_ID="0" PYTHONPATH="$PYTHONPATH:/tmp/cephtest/binary/usr/local/lib/python2.7/dist-packages:/tmp/cephtest/binary/usr/local/lib/python2.6/dist-packages" 
  /tmp/cephtest/enable-coredump /tmp/cephtest/binary/usr/local/bin/ceph-coverage /tmp/cephtest/archive/coverage
  /tmp/cephtest/workunit.client.0/suites/blogbench.sh && rm -rf -- /tmp/cephtest/mnt.0/client.0/tmp'''
flavor: gcov
mon.a-kernel-sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d
mon.b-kernel-sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d
owner: scheduled_teuthology@teuthology
success: false
ubuntu@teuthology:/a/teuthology-2012-10-23_19:00:04-regression-master-testing-gcov/334$ cat config.yaml 
kernel: &id001
  kdb: true
  sha1: 66357f1e2ec97aebd1c0c0786b9f76944e2c505d
nuke-on-error: true
overrides:
  ceph:
    coverage: true
    fs: btrfs
    log-whitelist:
    - slow request
    sha1: 59839a8f9030c28391c7f99aa52a8c58a74c0066
  s3tests:
    branch: master
  workunit:
    sha1: 59839a8f9030c28391c7f99aa52a8c58a74c0066
roles:
- - mon.a
  - mon.c
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mds.a
  - osd.3
  - osd.4
  - osd.5
- - client.0
targets:
  ubuntu@plana90.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnXSsUrbCT+Nj7+mYOuyc1zBE7sCWaPL+kUpoGXYyjGwELWr/HtSWaemD6vNJWaEiWm2sfVNkC3D28Ntcbdr1jetpBTcz5dog8jJr8bxahgovD4+K11xHpfXqb9K6KBUAeQLxnNzDaCVVDfqVRoy6Cr4JjrM5w4siPEgnlrAphpkChsrTtk5foXFw3KuAKy+F0UPdzGU3bOXgopKlyldG1eVQOK3v+5zhLsWzzEsUZzeIltG4wmr8Dd2e0nX8ai8P8pFTYN229Exi3kFHLL6UnIxTwgqYiviFiV5ZOyqgocUs6kc/YMuiDAc5YJhR6RFylVRQdG7XrLOUblUGX/s9/
  ubuntu@plana91.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwq9PdHwBKUjNa86vjFTDwYcnXBXF81QqgOmXBN8NNbePIGhjY9Ji6IvvGwrywnCi9a46tY9hFPCvq6y+6tC7Pfjf248C7KYWAxqA4UPCkQQMvedJCk2RAH7oljHqXGuyfFgsveq11bWjTWRYZPpENwfjdB0okvr8TZrZePhJNYgMY2smiSDBQ96Cr211KnQk/cvGFC0u8x/R/MJaZBVD0GANH8xLpe8PpND3uuNIEox/CmXpC+XdXVGnm1AXpF8Bb4gDSgwF8NUyedj8c8GfC0iI1ISg96WYFfNgS4m9ulOlXl0SSdYQ3+DCr6aOz7Nk+2r84Vq8E5wpiKD9z+raJ
  ubuntu@plana95.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXTW5tgwuNkjMqMKrDzJKe/lgplU547LM8k4wC4FVg9/40whvasUDtBXrCKLvBqtyZTGTDJhS/GEgR3XPI010M84RKTJ0OPCE3IMwPMT0/gqetgGdaxPyQ2OdXwYMej8Iac5suWXTfSH4V0sakKBDvRtsmf54cSiM4Edwz8DKSJ46H1JPBdEd6iS/OQlsZIMxs94gCtaOpxGmLwJG4GSSqzx3JA5ydJmueZwh2CRJ6x9VYdad3J1hw4PKKHYwe0/SrPC1MtacOoQPZ14ov9uZ8kch8N+LwRX5N7Mr2UzW4G1+VsO+jfCoF9FtGZ6rIq7Gx0nH5oeqKExrZ2fp2HZgL
tasks:
- internal.lock_machines: 3
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock: null
- ceph: null
- ceph-fuse: null
- workunit:
    clients:
      all:
      - suites/blogbench.sh
Actions #1

Updated by Sage Weil over 11 years ago

  • Status changed from New to Resolved
Actions

Also available in: Atom PDF