Project

General

Profile

Bug #15462

ceph: build_path did not end path lookup where expected, namelen is 146, pos is 0

Added by Sage Weil almost 8 years ago. Updated over 6 years ago.

Status:
Won't Fix
Priority:
Urgent
Assignee:
Category:
fs/ceph
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

[14401.645580] ceph: build_path did not end path lookup where expected, namelen is 146, pos is 0
[14713.758601] ptrace of pid 23946 was attempted by: strace (pid 15604)
[14713.765334] ptrace of pid 24127 was attempted by: strace (pid 15604)
[14719.473829] ptrace of pid 6361 was attempted by: strace (pid 18724)
[14814.988944] ptrace of pid 6361 was attempted by: strace (pid 29971)
[17525.636797] ceph: build_path did not end path lookup where expected, namelen is 151, pos is 0
[18252.049297] ptrace of pid 1255 was attempted by: cat (pid 29246)
[19834.400250] ceph: build_path did not end path lookup where expected, namelen is 147, pos is 0
[20633.119394] ceph: build_path did not end path lookup where expected, namelen is 147, pos is 0
[20762.421962] ceph: build_path did not end path lookup where expected, namelen is 135, pos is 0
[22840.934939] ------------[ cut here ]------------
[22840.939592] WARNING: CPU: 3 PID: 12093 at /srv/autobuild-ceph/gitbuilder.git/build/kernel/locking/lockdep.c:3497 lock_unpin_lock+0x9e/0x100()
[22840.952324] unpinning an unpinned lock
[22840.956097] Modules linked in: ipt_MASQUERADE(E) nf_nat_masquerade_ipv4(E) iptable_nat(E) nf_nat_ipv4(E) nf_nat(E) nf_conntrack_ipv4(E) nf_defrag_ipv4(E) xt_conntrack(E) nf_conntrack(E) ipt_REJECT(E) nf_reject_ipv4(E) xt_CHECKSUM(E) iptable_mangle(E) xt_tcpudp(E) bridge(E) stp(E) llc(E) ipmi_devintf(E) ipmi_si(E) ipmi_msghandler(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) ip_tables(E) ebtable_nat(E) ebtables(E) x_tables(E) ceph(E) libceph(E) fscache(E) dm_crypt(E) xfs(E) libcrc32c(E) gpio_ich(E) coretemp(E) kvm_intel(E) kvm(E) joydev(E) serio_raw(E) 8250_fintek(E) tpm_infineon(E) i7core_edac(E) shpchp(E) edac_core(E) lpc_ich(E) lp(E) parport(E) btrfs(E) xor(E) raid6_pq(E) hid_generic(E) usbhid(E) hid(E) ixgbe(E) dca(E) e1000e(E) ptp(E) ahci(E) psmouse(E) libahci(E) pps_core(E) arcmsr(E) mdio(E)
[22841.029009] CPU: 3 PID: 12093 Comm: kworker/3:3 Tainted: G            E   4.2.0-rc8-ceph-00011-g4a18ede #1
[22841.038703] Hardware name: Supermicro X8SIL/X8SIL, BIOS 1.1 05/27/2010
[22841.045263] Workqueue: ceph-msgr ceph_con_workfn [libceph]
[22841.050791]  0000000000000da9 ffff88029a5e3898 ffffffff817b96e5 0000000000000007
[22841.058299]  ffff88029a5e38e8 ffff88029a5e38d8 ffffffff8108055f ffff88081b9248e8
[22841.065818]  0000000000000046 0000000000000004 ffff8802f88ec880 ffff8802f88ed0d8
[22841.073347] Call Trace:
[22841.075817]  [<ffffffff817b96e5>] dump_stack+0x4c/0x65
[22841.080984]  [<ffffffff8108055f>] warn_slowpath_common+0xaf/0xe0
[22841.087020]  [<ffffffff81080646>] warn_slowpath_fmt+0x46/0x50
[22841.092791]  [<ffffffff810d30ee>] lock_unpin_lock+0x9e/0x100
[22841.098473]  [<ffffffff817bc995>] __schedule+0x845/0x9ed
[22841.103806]  [<ffffffff817bcc6d>] schedule+0x6d/0x90
[22841.108794]  [<ffffffff817bce75>] schedule_preempt_disabled+0x15/0x20
[22841.115268]  [<ffffffff817bf95e>] mutex_lock_nested+0x1de/0x360
[22841.121222]  [<ffffffffc03236e1>] ? dispatch+0x1a1/0xc10 [libceph]
[22841.127427]  [<ffffffffc03236e1>] dispatch+0x1a1/0xc10 [libceph]
[22841.133460]  [<ffffffff810d7bdb>] ? mark_held_locks+0x5b/0x80
[22841.139234]  [<ffffffff810d7d7e>] ? trace_hardirqs_on_caller+0x17e/0x1e0
[22841.145967]  [<ffffffffc0319223>] try_read+0x1b13/0x1db0 [libceph]
[22841.152169]  [<ffffffff810d7bdb>] ? mark_held_locks+0x5b/0x80
[22841.157937]  [<ffffffff817bfab5>] ? mutex_lock_nested+0x335/0x360
[22841.164058]  [<ffffffff810d7d7e>] ? trace_hardirqs_on_caller+0x17e/0x1e0
[22841.170796]  [<ffffffffc031985d>] ceph_con_workfn+0x39d/0x1690 [libceph]
[22841.177516]  [<ffffffff810d2730>] ? __lock_is_held+0x40/0x70
[22841.183204]  [<ffffffff8109d3cd>] process_one_work+0x38d/0x720
[22841.189066]  [<ffffffff8109d221>] ? process_one_work+0x1e1/0x720
[22841.195101]  [<ffffffff8109ddb6>] worker_thread+0x326/0x400
[22841.200692]  [<ffffffff8109da90>] ? rescuer_thread+0x2f0/0x2f0
[22841.206550]  [<ffffffff810a496a>] kthread+0x10a/0x120
[22841.211631]  [<ffffffff810a4860>] ? flush_kthread_worker+0x110/0x110
[22841.218014]  [<ffffffff817c2b5f>] ret_from_fork+0x3f/0x70
[22841.223442]  [<ffffffff810a4860>] ? flush_kthread_worker+0x110/0x110
[22841.229819] ---[ end trace c04295c0d427b785 ]---
[23086.119108] ceph: build_path did not end path lookup where expected, namelen is 141, pos is 0
[30054.072426] hrtimer: interrupt took 171092 ns
[41070.154758] CE: hpet increased min_delta_ns to 20115 nsec
[53563.800672] ceph: build_path did not end path lookup where expected, namelen is 147, pos is 0
[57189.990493] ceph: build_path did not end path lookup where expected, namelen is 146, pos is 0
[77709.315149] ------------[ cut here ]------------
[77709.319809] WARNING: CPU: 1 PID: 29200 at /srv/autobuild-ceph/gitbuilder.git/build/kernel/locking/lockdep.c:3497 lock_unpin_lock+0x9e/0x100()
[77709.332537] unpinning an unpinned lock
[77709.336315] Modules linked in: ipt_MASQUERADE(E) nf_nat_masquerade_ipv4(E) iptable_nat(E) nf_nat_ipv4(E) nf_nat(E) nf_conntrack_ipv4(E) nf_defrag_ipv4(E) xt_conntrack(E) nf_conntrack(E) ipt_REJECT(E) nf_reject_ipv4(E) xt_CHECKSUM(E) iptable_mangle(E) xt_tcpudp(E) bridge(E) stp(E) llc(E) ipmi_devintf(E) ipmi_si(E) ipmi_msghandler(E) ip6table_filter(E) ip6_tables(E) iptable_filter(E) ip_tables(E) ebtable_nat(E) ebtables(E) x_tables(E) ceph(E) libceph(E) fscache(E) dm_crypt(E) xfs(E) libcrc32c(E) gpio_ich(E) coretemp(E) kvm_intel(E) kvm(E) joydev(E) serio_raw(E) 8250_fintek(E) tpm_infineon(E) i7core_edac(E) shpchp(E) edac_core(E) lpc_ich(E) lp(E) parport(E) btrfs(E) xor(E) raid6_pq(E) hid_generic(E) usbhid(E) hid(E) ixgbe(E) dca(E) e1000e(E) ptp(E) ahci(E) psmouse(E) libahci(E) pps_core(E) arcmsr(E) mdio(E)
[77709.409254] CPU: 1 PID: 29200 Comm: kworker/1:1 Tainted: G        W   E   4.2.0-rc8-ceph-00011-g4a18ede #1
[77709.418947] Hardware name: Supermicro X8SIL/X8SIL, BIOS 1.1 05/27/2010
[77709.425517] Workqueue: ceph-msgr ceph_con_workfn [libceph]
[77709.431051]  0000000000000da9 ffff8803a4ee78e8 ffffffff817b96e5 0000000000000007
[77709.438581]  ffff8803a4ee7938 ffff8803a4ee7928 ffffffff8108055f ffff88026c61c8e8
[77709.446118]  0000000000000046 0000000000000003 ffff8802f1eea440 ffff8802f1eeac70
[77709.453655] Call Trace:
[77709.456133]  [<ffffffff817b96e5>] dump_stack+0x4c/0x65
[77709.461300]  [<ffffffff8108055f>] warn_slowpath_common+0xaf/0xe0
[77709.467338]  [<ffffffff81080646>] warn_slowpath_fmt+0x46/0x50
[77709.473116]  [<ffffffff810d30ee>] lock_unpin_lock+0x9e/0x100
[77709.478813]  [<ffffffff817bc995>] __schedule+0x845/0x9ed
[77709.484160]  [<ffffffff817bcc6d>] schedule+0x6d/0x90
[77709.489159]  [<ffffffff817bce75>] schedule_preempt_disabled+0x15/0x20
[77709.495630]  [<ffffffff817bf95e>] mutex_lock_nested+0x1de/0x360
[77709.501587]  [<ffffffffc031fce7>] ? alloc_msg+0x97/0x320 [libceph]
[77709.507806]  [<ffffffffc031fce7>] alloc_msg+0x97/0x320 [libceph]
[77709.513847]  [<ffffffff810d7d7e>] ? trace_hardirqs_on_caller+0x17e/0x1e0
[77709.520588]  [<ffffffffc0318a38>] try_read+0x1328/0x1db0 [libceph]
[77709.526798]  [<ffffffff810d7bdb>] ? mark_held_locks+0x5b/0x80
[77709.532579]  [<ffffffff817bfab5>] ? mutex_lock_nested+0x335/0x360
[77709.538714]  [<ffffffff810d7d7e>] ? trace_hardirqs_on_caller+0x17e/0x1e0
[77709.545455]  [<ffffffffc031985d>] ceph_con_workfn+0x39d/0x1690 [libceph]
[77709.552185]  [<ffffffff810d2730>] ? __lock_is_held+0x40/0x70
[77709.557876]  [<ffffffff8109d3cd>] process_one_work+0x38d/0x720
[77709.563738]  [<ffffffff8109d221>] ? process_one_work+0x1e1/0x720
[77709.569780]  [<ffffffff8109ddb6>] worker_thread+0x326/0x400
[77709.575379]  [<ffffffff8109da90>] ? rescuer_thread+0x2f0/0x2f0
[77709.581248]  [<ffffffff810a496a>] kthread+0x10a/0x120
[77709.586332]  [<ffffffff810a4860>] ? flush_kthread_worker+0x110/0x110
[77709.592723]  [<ffffffff817c2b5f>] ret_from_fork+0x3f/0x70
[77709.598154]  [<ffffffff810a4860>] ? flush_kthread_worker+0x110/0x110
[77709.604536] ---[ end trace c04295c0d427b786 ]---

saw this on teuthology

History

#1 Updated by Ilya Dryomov almost 8 years ago

  • Assignee set to Zheng Yan

#2 Updated by Ilya Dryomov almost 8 years ago

  • Category set to fs/ceph

#3 Updated by Zheng Yan almost 8 years ago

"ceph: build_path did not end path lookup where expected" does not indicate there is an issue.

                pr_err("build_path did not end path lookup where " 
                       "expected, namelen is %d, pos is %d\n", len, pos);
                /* presumably this is only possible if racing with a
                   rename of one of the parent directories (we can not
                   lock the dentries above us to prevent this, but
                   retrying should be harmless) */
                kfree(path);
                goto retry;

the lockdep WARNING is likely to be lockdep/scheduler bug
https://bugzilla.redhat.com/show_bug.cgi?id=1260200

#4 Updated by Sage Weil over 6 years ago

  • Status changed from 12 to Won't Fix

Also available in: Atom PDF