Project

General

Profile

Actions

Bug #2683

closed

ceph-fuse: crash during fsstress

Added by Sage Weil almost 12 years ago. Updated over 11 years ago.

Status:
Can't reproduce
Priority:
High
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Regression:
Severity:
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2012-07-01T20:17:38.841 INFO:teuthology.task.workunit.client.0.out:2/998: write - open f4 failed 107
2012-07-01T20:17:38.841 INFO:teuthology.task.workunit.client.0.out:2/999: mknod d6/c158 107
2012-07-01T20:17:38.841 INFO:teuthology.task.workunit.client.0.err:rm: cannot remove `fsstress-plana6110079/*': Transport endpoint is not connected
2012-07-01T20:17:38.841 INFO:teuthology.task.workunit.client.0.err:rm: cannot remove `/tmp/cephtest/mnt.0/client.0/tmp': Transport endpoint is not connected

ubuntu@teuthology:/a/sage-2012-07-01_19:52:36-smoke-wip-msgr-testing-basic/4275$ zcat remote/ubuntu@plana61.front.sepia.ceph.com/log/client.0.log.gz
2012-07-01 20:17:11.999416 7f320d733780  0 lockdep is enabled
2012-07-01 20:17:36.737004 7f320837b700 -1 *** Caught signal (Segmentation fault) **
 in thread 7f320837b700

 ceph version 0.47.3-554-gaf4169e (commit:af4169e74e0c8d263723a5900349d22b42e36974)
 1: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x633fca]
 2: (()+0xfcb0) [0x7f320d0e0cb0]
 3: (std::_Rb_tree_rebalance_for_erase(std::_Rb_tree_node_base*, std::_Rb_tree_node_base&)+0x164) [0x7f320c0d6d44]
 4: (std::_Rb_tree<int, std::pair<int const, ceph::BackTrace*>, std::_Select1st<std::pair<int const, ceph::BackTrace*> >, std::less<int>, std::allocator<std::pair<int const, ceph::BackTrace*> > >::erase(int const&)+0x89) [0x590a79]
 5: (lockdep_will_unlock(char const*, int)+0x385) [0x590465]
 6: (PerfCounters::inc(int, unsigned long)+0x118) [0x5acda8]
 7: (Throttle::put(long)+0xfb) [0x56d6ab]
 8: (SimpleMessenger::dispatch_throttle_release(unsigned long)+0x1ad) [0x54f48d]
 9: (SimpleMessenger::DispatchQueue::entry()+0x883) [0x55a183]
 10: (SimpleMessenger::dispatch_entry()+0x24) [0x55ada4]
 11: (SimpleMessenger::DispatchThread::entry()+0xd) [0x51c78d]
 12: (()+0x7e9a) [0x7f320d0d8e9a]
 13: (clone()+0x6d) [0x7f320b8914bd]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

this is either my wip-msgr branch, or the enabling of lockdep in master.
Actions #1

Updated by Sage Weil almost 12 years ago


(gdb) bt
#0  0x00007fd54b0dcb7b in raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/pt-raise.c:42
#1  0x000000000063411c in reraise_fatal (signum=6) at global/signal_handler.cc:58
#2  handle_fatal_signal (signum=6) at global/signal_handler.cc:104
#3  <signal handler called>
#4  0x00007fd5497d1445 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64
#5  0x00007fd5497d4bab in __GI_abort () at abort.c:91
#6  0x00007fd54a11f69d in __gnu_cxx::__verbose_terminate_handler() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7  0x00007fd54a11d846 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#8  0x00007fd54a11d873 in std::terminate() () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#9  0x00007fd54a11d96e in __cxa_throw () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#10 0x00000000005713b2 in ceph::__ceph_assert_fail (assertion=0x6361b4 "!unclean", file=<optimized out>, line=1773, func=0x639820 "void Client::put_inode(Inode*, int)")
    at common/assert.cc:77
#11 0x000000000047bd7e in Client::put_inode (this=0xad2380, in=0x358d200, n=<optimized out>) at client/Client.cc:1773
#12 0x000000000047bfa7 in Client::_ll_put (this=0xad2380, in=0x358d200, num=12) at client/Client.cc:5763
#13 0x000000000047f17e in Client::ll_forget (this=0xad2380, vino=..., num=12) at client/Client.cc:5807
#14 0x00000000004712c0 in ceph_ll_forget (req=0xadb400, ino=<optimized out>, nlookup=12) at client/fuse_ll.cc:119
#15 0x00007fd54b2fad65 in fuse_session_loop () from /lib/libfuse.so.2
#16 0x00000000004715d3 in ceph_fuse_ll_main (c=<optimized out>, argc=<optimized out>, argv=<optimized out>, fd=<optimized out>) at client/fuse_ll.cc:612
#17 0x000000000046ebf1 in main (argc=2, argv=0xad6280, envp=<optimized out>) at ceph_fuse.cc:142
(gdb) f 11
#11 0x000000000047bd7e in Client::put_inode (this=0xad2380, in=0x358d200, n=<optimized out>) at client/Client.cc:1773
1773    client/Client.cc: No such file or directory.
(gdb) p in
$1 = (Inode *) 0x358d200
(gdb) p *in
$2 = {cct = 0xad8000, ino = {val = 1099511627947}, snapid = {val = 18446744073709551614}, rdev = 0, ctime = {tv = {tv_sec = 1341236125, tv_nsec = 724088000}}, mode = 33206, uid = 1000, 
  gid = 1000, nlink = 1, dir_layout = {dl_dir_hash = 16 '\020', dl_unused1 = 16 '\020', dl_unused2 = 4112, dl_unused3 = 269488144}, layout = {fl_stripe_unit = {v = 4194304}, 
    fl_stripe_count = {v = 1}, fl_object_size = {v = 4194304}, fl_cas_hash = {v = 0}, fl_object_stripe_unit = {v = 0}, fl_unused = {v = 4294967295}, fl_pg_pool = {v = 0}}, 
  size = 8388608, truncate_seq = 1, truncate_size = 18446744073709551615, mtime = {tv = {tv_sec = 1341236190, tv_nsec = 284482000}}, atime = {tv = {tv_sec = 1341236125, 
      tv_nsec = 723361000}}, time_warp_seq = 0, max_size = 33554432, dirstat = {<scatter_info_t> = {version = 0}, mtime = {tv = {tv_sec = 0, tv_nsec = 0}}, nfiles = 0, nsubdirs = 0}, 
  rstat = {<scatter_info_t> = {version = 0}, rctime = {tv = {tv_sec = 0, tv_nsec = 0}}, rbytes = 4683191, rfiles = 1, rsubdirs = 0, ranchors = 0, rsnaprealms = 0}, version = 959, 
  xattr_version = 0, flags = 0, dir_contacts = {_M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<int> >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<int> >> = {<No data fields>}, <No data fields>}, 
        _M_key_compare = {<std::binary_function<int, int, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0x0, _M_left = 0x358d308, 
          _M_right = 0x358d308}, _M_node_count = 0}}}, dir_hashed = false, dir_replicated = false, caps = {_M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<int const, Cap*> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<int const, Cap*> > >> = {<No data fields>}, <No data fields>}, _M_key_compare = {<std::binary_function<int, int, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0x0, 
          _M_left = 0x358d340, _M_right = 0x358d340}, _M_node_count = 0}}}, auth_cap = 0x0, dirty_caps = 0, flushing_caps = 0, flushing_cap_seq = 1524, flushing_cap_tid = {
    0 <repeats 12 times>, 15, 0, 0, 0, 0, 0, 0, 0, 0, 0}, shared_gen = 1, cache_gen = 5, snap_caps = 0, snap_cap_refs = 0, exporting_issued = 0, exporting_mds = -1, exporting_mseq = 0, 
  hold_caps_until = {tv = {tv_sec = 1341236197, tv_nsec = 627888000}}, cap_item = {_item = 0x358d200, _prev = 0xdbcf50, _next = 0x0, _list = 0xad2650}, flushing_cap_item = {
    _item = 0x358d200, _prev = 0x0, _next = 0x0, _list = 0x0}, last_flush_tid = 15, snaprealm = 0x0, snaprealm_item = {_item = 0x358d200, _prev = 0x0, _next = 0x0, _list = 0x0}, 
  snapdir_parent = 0x0, cap_snaps = {_M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<snapid_t const, CapSnap*> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<snapid_t const, CapSnap*> > >> = {<No data fields>}, <No data fields>}, _M_key_compare = {<std::binary_function<snapid_t, snapid_t, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, 
          _M_parent = 0x0, _M_left = 0x358d450, _M_right = 0x358d450}, _M_node_count = 0}}}, open_by_mode = {_M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<int const, int> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<int const, int> > >> = {<No data fields>}, <No data fields>}, _M_key_compare = {<std::binary_function<int, int, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0xb350c0, 
          _M_left = 0x64b8e40, _M_right = 0xb350c0}, _M_node_count = 2}}}, cap_refs = {_M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<int const, int> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<int const, int> > >> = {<No data fields>}, <No data fields>}, _M_key_compare = {<std::binary_function<int, int, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0x22a8bd0, 
          _M_left = 0x618dbd0, _M_right = 0x4e70300}, _M_node_count = 4}}}, oset = {parent = 0x358d200, ino = {val = 1099511627947}, truncate_seq = 0, truncate_size = 0, poolid = 0, 
    objects = {_front = 0x1e8ae20, _back = 0x1e8ae20, _size = 1}, dirty_or_tx = 0}, reported_size = 8388608, wanted_max_size = 0, requested_max_size = 0, _ref = 0, ll_ref = 0, 
  dir = 0x0, dn_set = {_M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<Dentry*> >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<Dentry*> >> = {<No data fields>}, <No data fields>}, 
        _M_key_compare = {<std::binary_function<Dentry*, Dentry*, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0x0, 
          _M_left = 0x358d550, _M_right = 0x358d550}, _M_node_count = 0}}}, symlink = {static npos = <optimized out>, 
    _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>}, _M_p = 0x8ac138 ""}}, dirfragtree = {_splits = {_M_t = {
        _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<frag_t const, int> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<frag_t const, int> > >> = {<No data fields>}, <No data fields>}, _M_key_compare = {<std::binary_function<frag_t, frag_t, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0x0, 
            _M_left = 0x358d588, _M_right = 0x358d588}, _M_node_count = 0}}}}, xattrs = {_M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, ceph::buffer::ptr> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<std::basic_string<char, std::char_traits<char>, std::allocator<char> > const, ceph::buffer::ptr> > >> = {<No data fields>}, <No data fields>}, 
        _M_key_compare = {<std::binary_function<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0x0, _M_left = 0x358d5b8, _M_right = 0x358d5b8}, _M_node_count = 0}}}, fragmap = {
    _M_t = {
      _M_impl = {<std::allocator<std::_Rb_tree_node<std::pair<frag_t const, int> > >> = {<__gnu_cxx::new_allocator<std::_Rb_tree_node<std::pair<frag_t const, int> > >> = {<No data fields>}, <No data fields>}, _M_key_compare = {<std::binary_function<frag_t, frag_t, bool>> = {<No data fields>}, <No data fields>}, _M_header = {_M_color = std::_S_red, _M_parent = 0x0, 
          _M_left = 0x358d5e8, _M_right = 0x358d5e8}, _M_node_count = 0}}}, waitfor_caps = {<std::_List_base<Cond*, std::allocator<Cond*> >> = {
      _M_impl = {<std::allocator<std::_List_node<Cond*> >> = {<__gnu_cxx::new_allocator<std::_List_node<Cond*> >> = {<No data fields>}, <No data fields>}, _M_node = {
          _M_next = 0x358d610, _M_prev = 0x358d610}}}, <No data fields>}, waitfor_commit = {<std::_List_base<Cond*, std::allocator<Cond*> >> = {
      _M_impl = {<std::allocator<std::_List_node<Cond*> >> = {<__gnu_cxx::new_allocator<std::_List_node<Cond*> >> = {<No data fields>}, <No data fields>}, _M_node = {
          _M_next = 0x358d620, _M_prev = 0x358d620}}}, <No data fields>}}

...after 109 passes through hammer.
Actions #2

Updated by Tamilarasi muthamizhan over 11 years ago

  • Status changed from 12 to In Progress
  • Assignee changed from Sage Weil to Sam Lang

Recent logs: ubuntu@teuthology:/a/teuthology-2012-10-06_04:00:05-regression-stable-master-basic/3157

2012-10-07T06:35:09.127 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:client/Client.cc: In function 'void Client::put_inode(Inode*, int)' thread 7f1cf77ce780 time 2012-10-07 06:35:09.129885
2012-10-07T06:35:09.127 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:client/Client.cc: 1773: FAILED assert(!unclean)
2012-10-07T06:35:09.127 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: ceph version 0.48.2argonaut-2-gf031046 (f031046c4d600ce0a0c2c9ad5856dc100b0901fb)
2012-10-07T06:35:09.132 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 1: (Client::put_inode(Inode*, int)+0x5ae) [0x47c37e]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 2: (Client::_ll_put(Inode*, int)+0x1d2) [0x47c592]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 3: (Client::ll_forget(vinodeno_t, int)+0x466) [0x47f976]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 4: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x471580]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 5: (fuse_session_loop()+0x75) [0x7f1cf7399d65]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 6: (ceph_fuse_ll_main(Client*, int, char const**, int)+0x1eb) [0x47184b]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 7: (main()+0x331) [0x46ef51]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 8: (_libc_start_main()+0xed) [0x7f1cf585b76d]
2012-10-07T06:35:09.133 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 9: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x470445]
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:2012-10-07 06:35:09.130813 7f1cf77ce780 -1 client/Client.cc: In function 'void Client::put_inode(Inode*, int)' thread 7f1cf77ce780 time 2012-10-07 06:35:09.129885
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:client/Client.cc: 1773: FAILED assert(!unclean)
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err:
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: ceph version 0.48.2argonaut-2-gf031046 (f031046c4d600ce0a0c2c9ad5856dc100b0901fb)
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 1: (Client::put_inode(Inode*, int)+0x5ae) [0x47c37e]
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 2: (Client::_ll_put(Inode*, int)+0x1d2) [0x47c592]
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 3: (Client::ll_forget(vinodeno_t, int)+0x466) [0x47f976]
2012-10-07T06:35:09.134 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 4: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x471580]
2012-10-07T06:35:09.135 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 5: (fuse_session_loop()+0x75) [0x7f1cf7399d65]
2012-10-07T06:35:09.135 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 6: (ceph_fuse_ll_main(Client*, int, char const**, int)+0x1eb) [0x47184b]
2012-10-07T06:35:09.135 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 7: (main()+0x331) [0x46ef51]
2012-10-07T06:35:09.135 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 8: (
_libc_start_main()+0xed) [0x7f1cf585b76d]
2012-10-07T06:35:09.135 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: 9: /tmp/cephtest/binary/usr/local/bin/ceph-fuse() [0x470445]
2012-10-07T06:35:09.135 INFO:teuthology.task.ceph-fuse.ceph-fuse.0.err: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

ubuntu@teuthology:/a/teuthology-2012-10-06_04:00:05-regression-stable-master-basic/3157$ cat config.yaml 
kernel: &id001
  kdb: true
  sha1: 6285bc231277419255f3498d3eb5ddc9f8e7fe79
nuke-on-error: true
overrides:
  ceph:
    conf:
      global:
        lockdep: true
    fs: btrfs
    log-whitelist:
    - slow request
    sha1: f031046c4d600ce0a0c2c9ad5856dc100b0901fb
  s3tests:
    branch: stable
  workunit:
    sha1: f031046c4d600ce0a0c2c9ad5856dc100b0901fb
roles:
- - mon.a
  - mon.c
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mds.a
  - osd.3
  - osd.4
  - osd.5
- - client.0
targets:
  ubuntu@plana23.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDiwH5Qz5dXnbtYRiTk0QVNNyZQWYcardED+AqVLxoz5h/z/tPUyt6VTcrNvyFiKZcrz70vKy/1S1JNmt74gSc0KE8YhLjvuCaTwJDw1LOTNzc5b074zfnjeNGKqb0L3BefbFFOMh/ZuxGbTJWZXdD1DwP2VWxGdhtHAxglgLjt5541nxw41vT+dVMgQMt7Lv5P3MXl+IY58LUzYC9EkOvgZTPTfRx7IptkDSEmbYGL7dQE6H9VyoukOejj4jgg8ZWhPR9e39OhB/Vh7qtiCTRfapovh1zrfCM/b7O1/nMisUmfOK+nF2ruiTefEA14u59uxlfpaRLQDtyv6b5aPour
  ubuntu@plana30.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYDpptyOTrVH3RqiwH5A//Q2CkkVz5dPTpd/s8qG/Q4EHVA4WDMu80pcDvdSewOfFJl83MEtDKKjuJOuEzI4OGn0DPptDN5wHC1OWrXqFMcIaWVe/KBYOdWEZbA7FECeXgEZR1Sid2bH7XDUE9AYalpS2/SmuuHEU1ObL6zSpAqoY6AIPCR6LgFrtxAqrYmIdpb8YfSuI5uPBv6qikl0yvam06WNerUNQ9lnZXFmFm1wBeicRvWH3jZ6w/xlQBIp/zG6k9IJa0vaLm+FqztLkDWri8Qz1dbdsz0bNjyzD6iRuDOpgmz0Kf8m2IjaJRgRgz2ARcOOdBJKmwnnW/knk5
  ubuntu@plana34.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc3URAyD772tnoWHzOPXosRcjoZsDTSs3bhFuCp8DZdkkphtXy9eAuhTz5+nCUCzcumDfpxcYsisl84204gw3lmwvEicW4Tf+3NRWuHu05s+VGSFe81fGKGxUviM64dEvA/A54KAXbg+hxPg/rYFhHgDSLDL61MKYYZWI8kMV+M93qShzApy73Z8tDdva3WF0DrXV37TnPwSxc4R5j08t/y+5/WDjIj7u21S+kxqfGNQ9ycx/yHT5lf//2HS60dvBnMfQda8NEsUAtS+/9lA85qFiBOI2MzrnCRdi1Z5htVvM/em7mQmT5ttDvF4R5Qn9MgeV438lVoagO0+lvKoMf
tasks:
- internal.lock_machines: 3
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock: null
- ceph: null
- ceph-fuse: null
- workunit:
    clients:
      all:
      - suites/fsstress.sh
ubuntu@teuthology:/a/teuthology-2012-10-06_04:00:05-regression-stable-master-basic/3157$ cat summary.yaml 
ceph-sha1: f031046c4d600ce0a0c2c9ad5856dc100b0901fb
client.0-kernel-sha1: 6285bc231277419255f3498d3eb5ddc9f8e7fe79
description: collection:verify clusters:fixed-3.yaml fs:btrfs.yaml tasks:cfuse_workunit_suites_fsstress.yaml
  validater:lockdep.yaml
duration: 188.04868078231812
failure_reason: 'Command failed with status 1: ''mkdir -- /tmp/cephtest/mnt.0/client.0/tmp
  && cd -- /tmp/cephtest/mnt.0/client.0/tmp && CEPH_REF=f031046c4d600ce0a0c2c9ad5856dc100b0901fb
  PATH="$PATH:/tmp/cephtest/binary/usr/local/bin" LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/cephtest/binary/usr/local/lib" 
  CEPH_CONF="/tmp/cephtest/ceph.conf" CEPH_SECRET_FILE="/tmp/cephtest/data/client.0.secret" 
  CEPH_ID="0" PYTHONPATH="$PYTHONPATH:/tmp/cephtest/binary/usr/local/lib/python2.7/dist-packages:/tmp/cephtest/binary/usr/local/lib/python2.6/dist-packages" 
  /tmp/cephtest/enable-coredump /tmp/cephtest/binary/usr/local/bin/ceph-coverage /tmp/cephtest/archive/coverage
  /tmp/cephtest/workunit.client.0/suites/fsstress.sh && rm -rf -- /tmp/cephtest/mnt.0/client.0/tmp'''
flavor: basic
mon.a-kernel-sha1: 6285bc231277419255f3498d3eb5ddc9f8e7fe79
mon.b-kernel-sha1: 6285bc231277419255f3498d3eb5ddc9f8e7fe79
owner: scheduled_teuthology@teuthology
success: false

Actions #3

Updated by Tamilarasi muthamizhan over 11 years ago

  • Priority changed from Normal to High
Actions #4

Updated by Sage Weil over 11 years ago

Do we think this bug is still there? Haven't seen it in quite a while. Could it have been related to 1638f6266863d6d4eee32c725dc10c94f5871b1e, the double put on hardlink?

Actions #5

Updated by Sam Lang over 11 years ago

The hard link bug was only expressed through the libcephfs API, not ceph-fuse.

Actions #6

Updated by Sage Weil over 11 years ago

  • Status changed from In Progress to Resolved
Actions #7

Updated by Greg Farnum over 11 years ago

  • Status changed from Resolved to Can't reproduce

We believe this was fixed in the ObjectCacher code changes over the last several months.

Actions

Also available in: Atom PDF