Project

General

Profile

Actions

Bug #8005

closed

fuse hang

Added by Sage Weil about 10 years ago. Updated about 10 years ago.

Status:
Rejected
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

[13931.732136] INFO: task fixdep:30782 blocked for more than 120 seconds.
[13931.738761]       Tainted: GF         I  3.14.0-ceph-00079-g61577db #1
[13931.745384] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[13931.753326] fixdep          D 0000000000000000     0 30782  30718 0x00000006
[13931.760506]  ffff8802218dbb38 0000000000000046 0000000000000282 0000000000000003
[13931.768016]  ffff88022169ca40 0000000000013100 ffff8802218dbfd8 0000000000013100
[13931.775606]  ffff88016ff73180 ffff88022169ca40 ffff8802218dbb48 ffff8800c9ed64a8
[13931.783200] Call Trace:
[13931.785740]  [<ffffffff816ed1f9>] schedule+0x29/0x70
[13931.790799]  [<ffffffff812bc335>] __fuse_request_send+0xd5/0x290
[13931.796907]  [<ffffffff81098790>] ? __wake_up_sync+0x20/0x20
[13931.802663]  [<ffffffff812bc502>] fuse_request_send+0x12/0x20
[13931.808512]  [<ffffffff812c538c>] fuse_flush+0xec/0x120
[13931.813832]  [<ffffffff811a572a>] filp_close+0x3a/0x90
[13931.819071]  [<ffffffff811c42fa>] put_files_struct+0x8a/0xe0
[13931.824826]  [<ffffffff811c43fb>] exit_files+0x4b/0x60
[13931.830064]  [<ffffffff8105489e>] do_exit+0x29e/0xa70
[13931.835211]  [<ffffffff812bd634>] ? fuse_request_free+0x44/0x50
[13931.841229]  [<ffffffff812bd718>] ? fuse_put_request+0xd8/0x120
[13931.848293]  [<ffffffff81055104>] do_group_exit+0x44/0xb0
[13931.853789]  [<ffffffff81065106>] get_signal_to_deliver+0x286/0x5f0
[13931.860157]  [<ffffffff81002388>] do_signal+0x58/0x9b0
[13931.865391]  [<ffffffff812c23f6>] ? fuse_getattr+0x46/0x50
[13931.870978]  [<ffffffff811acb1a>] ? vfs_fstat+0x3a/0x70
[13931.876304]  [<ffffffff811acb65>] ? SYSC_newfstat+0x15/0x30
[13931.881972]  [<ffffffff811b2d29>] ? putname+0x29/0x40
[13931.887121]  [<ffffffff81002d60>] do_notify_resume+0x80/0xc0
[13931.892832]  [<ffffffff816f92e2>] int_signal+0x12/0x17


ubuntu@teuthology:/var/lib/teuthworker/archive/teuthology-2014-04-04_23:00:34-fs-master-testing-basic-plana/171257
14798 ?        Ss     0:00 cron
32677 ?        S      0:00  \_ CRON
32679 ?        Ss     0:00      \_ /bin/sh -c test -x /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.daily )
32680 ?        S      0:00          \_ run-parts --report /etc/cron.daily
  320 ?        S      0:00              \_ /bin/bash /etc/cron.daily/mlocate
  326 ?        S      0:00                  \_ /usr/bin/updatedb.mlocate
16431 ?        Ss     0:00 /usr/sbin/sshd -D
16433 ?        Ss     0:00  \_ sshd: ubuntu [priv] 
16449 ?        S      0:05  |   \_ sshd: ubuntu@notty  
16870 ?        Ss     0:00  |       \_ sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0
16872 ?        S      0:11  |           \_ /usr/bin/python /usr/bin/daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0
16874 ?        Sl    58:16  |               \_ ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0
 2342 ?        Ss     0:00  \_ sshd: ubuntu [priv] 
 2358 ?        R      0:43  |   \_ sshd: ubuntu@notty  
 2359 ?        Ss     0:11  |       \_ rsync --server --sender -vulogDtprCe.iLsf . /var/log/ceph/ceph-client.0.16874.log /var/log/ceph/profiling-logger /var/log/ceph/valgrind
 2360 ?        Ss     0:00  \_ sshd: ubuntu [priv] 
 2379 ?        S      0:00      \_ sshd: ubuntu@pts/0  
 2380 pts/0    Ss     0:00          \_ -bash
 2482 pts/0    R+     0:00              \_ ps axf
17108 ?        S      0:00 make -j8
21264 ?        S      0:00  \_ make -f scripts/Makefile.build obj=drivers
29018 ?        S      0:00  |   \_ make -f scripts/Makefile.build obj=drivers/gpu
29019 ?        S      0:00  |   |   \_ make -f scripts/Makefile.build obj=drivers/gpu/drm
30711 ?        D      0:00  |   |       \_ [sh]
30754 ?        D      0:00  |   |       |   \_ [fixdep]
30724 ?        D      0:00  |   |       \_ [sh]
30769 ?        D      0:00  |   |       |   \_ [fixdep]
30748 ?        Z      0:00  |   |       \_ [sh] <defunct>
30170 ?        S      0:00  |   \_ make -f scripts/Makefile.build obj=drivers/input
30807 ?        Z      0:00  |       \_ [sh] <defunct>
25918 ?        S      0:00  \_ make -f scripts/Makefile.build obj=net
27836 ?        S      0:00      \_ make -f scripts/Makefile.build obj=net/ipv4
30107 ?        S      0:00      |   \_ make -f scripts/Makefile.build obj=net/ipv4/netfilter
30718 ?        D      0:00      |       \_ [sh]
30782 ?        D      0:00      |       |   \_ [fixdep]
30770 ?        Z      0:00      |       \_ [sh] <defunct>
30361 ?        S      0:00      \_ make -f scripts/Makefile.build obj=net/netfilter
30776 ?        Z      0:00          \_ [sh] <defunct>
30785 ?        Z      0:00          \_ [sh] <defunct>
30749 ?        S      0:00 gcc -Wp,-MD,drivers/gpu/drm/.drm_dp_i2c_helper.o.d -nostdinc -isystem /usr/lib/gcc/x86_64-linux-gnu/4.6/include -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/arch/x86/include -Iarch/x86/include/generated -Iinclude -include /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/include/linux/kconf
30750 ?        Z      0:00  \_ [cc1] <defunct>
30751 ?        D      0:00  \_ [as]
30771 ?        S      0:00 gcc -Wp,-MD,net/ipv4/netfilter/.nf_nat_irc.o.d -nostdinc -isystem /usr/lib/gcc/x86_64-linux-gnu/4.6/include -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/arch/x86/include -Iarch/x86/include/generated -Iinclude -include /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/include/linux/kconfig.h
30772 ?        Z      0:00  \_ [cc1] <defunct>
30773 ?        D      0:00  \_ [as]
30777 ?        S      0:00 gcc -Wp,-MD,net/netfilter/.nf_conntrack_helper.o.d -nostdinc -isystem /usr/lib/gcc/x86_64-linux-gnu/4.6/include -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/arch/x86/include -Iarch/x86/include/generated -Iinclude -include /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/include/linux/kconf
30778 ?        D      0:00  \_ [cc1]
30779 ?        D      0:00  \_ [as]
30786 ?        S      0:00 gcc -Wp,-MD,net/netfilter/.nf_conntrack_proto.o.d -nostdinc -isystem /usr/lib/gcc/x86_64-linux-gnu/4.6/include -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/arch/x86/include -Iarch/x86/include/generated -Iinclude -include /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-3.2.9/include/linux/kconfi
30787 ?        Z      0:00  \_ [cc1] <defunct>
30788 ?        D      0:00  \_ [as]
30808 ?        D      0:00 [ld]

Actions #1

Updated by Zheng Yan about 10 years ago

still looks like MDS was dead

Actions #2

Updated by Zheng Yan about 10 years ago

  • Status changed from New to Rejected

no error in client log, looks like mds was killed by someone

Actions

Also available in: Atom PDF