|
Jul 20 12:21:58 10.242.43.108 [ 473.114503] init: tty4 main process (1657) killed by TERM signal
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.114907] init: tty5 main process (1661) killed by TERM signal
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.115271] init: tty2 main process (1667) killed by TERM signal
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.115648] init: tty3 main process (1668) killed by TERM signal
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.116015] init: tty6 main process (1670) killed by TERM signal
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.116643] init: cron main process (1734) killed by TERM signal
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.116990] init: tty1 main process (7739) killed by TERM signal
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.117496] init: plymouth-upstart-bridge main process (8718) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.117765] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.160987] init: plymouth-upstart-bridge main process (8745) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.161260] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.171663] init: plymouth-upstart-bridge main process (8749) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.171928] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.175545] init: plymouth-upstart-bridge main process (8751) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.175808] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.178326] init: plymouth-upstart-bridge main process (8753) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.178594] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.181090] init: plymouth-upstart-bridge main process (8755) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.181353] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.187860] init: plymouth-upstart-bridge main process (8757) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.196089] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.202985] init: plymouth-upstart-bridge main process (8760) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.211089] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.219211] init: plymouth-upstart-bridge main process (8763) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.227973] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.235664] init: plymouth-upstart-bridge main process (8766) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.245201] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.252356] init: plymouth-upstart-bridge main process (8768) terminated with status 1
|
|
Jul 20 12:21:58 10.242.43.108 [ 473.261905] init: plymouth-upstart-bridge respawning too fast, stopped
|
|
Jul 20 12:21:59 10.242.43.108 [ 473.344168] init: wait-for-state (rcplymouth-shutdown) main process (8770) killed by TERM signal
|
|
Jul 20 12:22:23 10.242.43.108 [ 497.408597] init: systemd-logind main process (1778) killed by TERM signal
|
|
Jul 20 12:22:23 10.242.43.108 [ 497.413064] init: Disconnected from D-Bus system bus
|
|
Jul 20 12:25:41 10.242.43.108 [ 25.670787] console [netcon0] enabled
|
|
Jul 20 12:25:41 10.242.43.108 [ 25.674081] netconsole: network logging started
|
|
Jul 20 12:25:41 10.242.43.108 [ 25.678164] XFS (sdi1): Mounting V4 Filesystem
|
|
Jul 20 12:25:41 10.242.43.108 [ 25.711033] XFS (sdi1): Ending clean mount
|
|
Jul 20 12:25:41 10.242.43.108 [ 26.058099] XFS (sdf1): Mounting V4 Filesystem
|
|
Jul 20 12:25:41 10.242.43.108 [ 26.091569] XFS (sdf1): Ending clean mount
|
|
Jul 20 12:25:42 10.242.43.108 [ 26.474840] XFS (sdh1): Mounting V4 Filesystem
|
|
Jul 20 12:25:42 10.242.43.108 [ 26.508025] XFS (sdh1): Ending clean mount
|
|
Jul 20 12:25:43 10.242.43.108 [ 27.179833] XFS (sdc1): Mounting V4 Filesystem
|
|
Jul 20 12:25:43 10.242.43.108 [ 27.212403] XFS (sdc1): Ending clean mount
|
|
Jul 20 12:25:44 10.242.43.108 [ 28.245501] XFS (sdd1): Mounting V4 Filesystem
|
|
Jul 20 12:25:44 10.242.43.108 [ 28.273197] XFS (sdd1): Ending clean mount
|
|
Jul 20 12:25:44 10.242.43.108 [ 29.118596] XFS (sdb1): Mounting V4 Filesystem
|
|
Jul 20 12:25:45 10.242.43.108 [ 29.152164] XFS (sdb1): Ending clean mount
|
|
Jul 20 12:26:16 10.242.43.108 [ 60.320795] init: plymouth-upstart-bridge main process ended, respawning
|
|
Jul 20 12:35:37 10.242.43.108 [ 621.951879] FS-Cache: Loaded
|
|
Jul 20 12:35:37 10.242.43.108 [ 621.981685] Key type ceph registered
|
|
Jul 20 12:35:37 10.242.43.108 [ 621.982105] libceph: loaded (mon/osd proto 15/24)
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.019793] FS-Cache: Netfs 'ceph' registered for caching
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.019990] ceph: loaded (mds proto 32)
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.021968] libceph: client45973 fsid 928cfe74-ce6f-4fbd-b737-e12e81e044e8
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.059822] libceph: mon0 10.242.42.216:6789 session established
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.070011] ------------[ cut here ]------------
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.070198] kernel BUG at /build/linux-lts-utopic-vy2yyy/linux-lts-utopic-3.16.0/fs/ceph/mds_client.c:1846!
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.070500] invalid opcode: 0000 [#1]
|
|
Jul 20 12:35:37 10.242.43.108 SMP
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.070636] Modules linked in:
|
|
Jul 20 12:35:37 10.242.43.108 ceph
|
|
Jul 20 12:35:37 10.242.43.108 libceph
|
|
Jul 20 12:35:37 10.242.43.108 fscache
|
|
Jul 20 12:35:37 10.242.43.108 xfs
|
|
Jul 20 12:35:37 10.242.43.108 libcrc32c
|
|
Jul 20 12:35:37 10.242.43.108 dm_crypt
|
|
Jul 20 12:35:37 10.242.43.108 ipmi_devintf
|
|
Jul 20 12:35:37 10.242.43.108 mei_me
|
|
Jul 20 12:35:37 10.242.43.108 joydev
|
|
Jul 20 12:35:37 10.242.43.108 x86_pkg_temp_thermal
|
|
Jul 20 12:35:37 10.242.43.108 intel_powerclamp
|
|
Jul 20 12:35:37 10.242.43.108 mei
|
|
Jul 20 12:35:37 10.242.43.108 coretemp
|
|
Jul 20 12:35:37 10.242.43.108 ipmi_si
|
|
Jul 20 12:35:37 10.242.43.108 kvm_intel
|
|
Jul 20 12:35:37 10.242.43.108 kvm
|
|
Jul 20 12:35:37 10.242.43.108 crct10dif_pclmul
|
|
Jul 20 12:35:37 10.242.43.108 dcdbas
|
|
Jul 20 12:35:37 10.242.43.108 crc32_pclmul
|
|
Jul 20 12:35:37 10.242.43.108 lpc_ich
|
|
Jul 20 12:35:37 10.242.43.108 aesni_intel
|
|
Jul 20 12:35:37 10.242.43.108 aes_x86_64
|
|
Jul 20 12:35:37 10.242.43.108 lrw
|
|
Jul 20 12:35:37 10.242.43.108 gf128mul
|
|
Jul 20 12:35:37 10.242.43.108 glue_helper
|
|
Jul 20 12:35:37 10.242.43.108 ablk_helper
|
|
Jul 20 12:35:37 10.242.43.108 netconsole
|
|
Jul 20 12:35:37 10.242.43.108 cryptd
|
|
Jul 20 12:35:37 10.242.43.108 mac_hid
|
|
Jul 20 12:35:37 10.242.43.108 ipmi_msghandler
|
|
Jul 20 12:35:37 10.242.43.108 acpi_power_meter
|
|
Jul 20 12:35:37 10.242.43.108 acpi_pad
|
|
Jul 20 12:35:37 10.242.43.108 configfs
|
|
Jul 20 12:35:37 10.242.43.108 sb_edac
|
|
Jul 20 12:35:37 10.242.43.108 edac_core
|
|
Jul 20 12:35:37 10.242.43.108 shpchp
|
|
Jul 20 12:35:37 10.242.43.108 lp
|
|
Jul 20 12:35:37 10.242.43.108 parport
|
|
Jul 20 12:35:37 10.242.43.108 mlx4_en
|
|
Jul 20 12:35:37 10.242.43.108 vxlan
|
|
Jul 20 12:35:37 10.242.43.108 hid_generic
|
|
Jul 20 12:35:37 10.242.43.108 usbhid
|
|
Jul 20 12:35:37 10.242.43.108 ses
|
|
Jul 20 12:35:37 10.242.43.108 enclosure
|
|
Jul 20 12:35:37 10.242.43.108 hid
|
|
Jul 20 12:35:37 10.242.43.108 mpt2sas
|
|
Jul 20 12:35:37 10.242.43.108 tg3
|
|
Jul 20 12:35:37 10.242.43.108 ahci
|
|
Jul 20 12:35:37 10.242.43.108 raid_class
|
|
Jul 20 12:35:37 10.242.43.108 ptp
|
|
Jul 20 12:35:37 10.242.43.108 scsi_transport_sas
|
|
Jul 20 12:35:37 10.242.43.108 mlx4_core
|
|
Jul 20 12:35:37 10.242.43.108 libahci
|
|
Jul 20 12:35:37 10.242.43.108 megaraid_sas
|
|
Jul 20 12:35:37 10.242.43.108 pps_core
|
|
Jul 20 12:35:37 10.242.43.108 wmi
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.072333] CPU: 9 PID: 7376 Comm: kworker/9:9 Not tainted 3.16.0-70-generic #90~14.04.1-Ubuntu
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.072609] Hardware name: Dell Inc. PowerEdge R620/01W23F, BIOS 2.2.2 01/16/2014
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.072874] Workqueue: ceph-msgr con_work [libceph]
|
|
Jul 20 12:35:37 10.242.43.108 622.072874] Workqueue: ceph-msgr con_work [libceph]/01W23F, BIOS 2.2.2 01/16/2014
|
|
4.04.1-Ubuntu
|
|
ent.c:1846!
|
|
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.073028] task: ffff880fe152dbb0 ti: ffff880fff65c000 task.ti: ffff880fff65c000
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.078436] RIP: 0010:[<ffffffffc0513a2a>]
|
|
Jul 20 12:35:37 10.242.43.108 [<ffffffffc0513a2a>] __prepare_send_request+0x7ea/0x7f0 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.089298] RSP: 0018:ffff880fff65fb98 EFLAGS: 00010283
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.094725] RAX: ffff8807dc800b02 RBX: ffff8810127da400 RCX: 0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.100225] RDX: 000000001bbb682b RSI: 0000000000000000 RDI: ffff8807dc800af2
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.105795] RBP: ffff880fff65fc20 R08: 0000000000000000 R09: 0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.111358] R10: ffff88081f403900 R11: 0000000000000000 R12: ffff880fc3f0a0f8
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.116905] R13: ffff8807db98a000 R14: 0000000000000000 R15: ffff8807dc800a80
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.122384] FS: 0000000000000000(0000) GS:ffff88101f280000(0000) knlGS:0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.133255] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.138740] CR2: 00007f148f811000 CR3: 0000000001c13000 CR4: 00000000001407e0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.144332] Stack:
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.149803] ffff880fff65fbcc
|
|
Jul 20 12:35:37 10.242.43.108 ffff880af044c868
|
|
Jul 20 12:35:37 10.242.43.108 0000000000000001
|
|
Jul 20 12:35:37 10.242.43.108 ffff88100fdc80f8
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.160766] ffff8807dc800afa
|
|
Jul 20 12:35:37 10.242.43.108 0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 ffff88100fdc80f8
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.171836] 0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 0000000000000001
|
|
Jul 20 12:35:37 10.242.43.108 0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 ffff8807dc800b02
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.183043] Call Trace:
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.188542] [<ffffffffc0513c60>] __do_request+0x230/0x330 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.194098] [<ffffffffc0513dd8>] __wake_requests+0x78/0xb0 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.199584] [<ffffffffc0516f1e>] dispatch+0x54e/0xb00 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.204957] [<ffffffffc04bdc4b>] try_read+0x4bb/0x10e0 [libceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.210177] [<ffffffff8101d275>] ? native_sched_clock+0x35/0x90
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.215302] [<ffffffff8101d2d9>] ? sched_clock+0x9/0x10
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.220288] [<ffffffff810a5d25>] ? sched_clock_cpu+0x85/0xc0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.225206] [<ffffffff810ad9a1>] ? put_prev_entity+0x31/0x3f0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.230045] [<ffffffffc04bfa49>] con_work+0xb9/0x640 [libceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.234792] [<ffffffff8108b712>] process_one_work+0x182/0x450
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.239412] [<ffffffff8108be81>] worker_thread+0x121/0x570
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.243924] [<ffffffff8108bd60>] ? rescuer_thread+0x380/0x380
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.248431] [<ffffffff81092732>] kthread+0xd2/0xf0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.252803] [<ffffffff81092660>] ? kthread_create_on_node+0x1c0/0x1c0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.257197] [<ffffffff817724d8>] ret_from_fork+0x58/0x90
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.261576] [<ffffffff81092660>] ? kthread_create_on_node+0x1c0/0x1c0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.266025] Code:
|
|
Jul 20 12:35:37 10.242.43.108 8b
|
|
Jul 20 12:35:37 10.242.43.108 87
|
|
Jul 20 12:35:37 10.242.43.108 a8
|
|
Jul 20 12:35:37 10.242.43.108 fc
|
|
Jul 20 12:35:37 10.242.43.108 ff
|
|
Jul 20 12:35:37 10.242.43.108 ff
|
|
Jul 20 12:35:37 10.242.43.108 4c
|
|
Jul 20 12:35:37 10.242.43.108 89
|
|
Jul 20 12:35:37 10.242.43.108 fa
|
|
Jul 20 12:35:37 10.242.43.108 48
|
|
Jul 20 12:35:37 10.242.43.108 c7
|
|
Jul 20 12:35:37 10.242.43.108 c6
|
|
Jul 20 12:35:37 10.242.43.108 84
|
|
Jul 20 12:35:37 10.242.43.108 9b
|
|
Jul 20 12:35:37 10.242.43.108 52
|
|
Jul 20 12:35:37 10.242.43.108 c0
|
|
Jul 20 12:35:37 10.242.43.108 48
|
|
Jul 20 12:35:37 10.242.43.108 c7
|
|
Jul 20 12:35:37 10.242.43.108 c7
|
|
Jul 20 12:35:37 10.242.43.108 38
|
|
Jul 20 12:35:37 10.242.43.108 1e
|
|
Jul 20 12:35:37 10.242.43.108 53
|
|
Jul 20 12:35:37 10.242.43.108 c0
|
|
Jul 20 12:35:37 10.242.43.108 31
|
|
Jul 20 12:35:37 10.242.43.108 c0
|
|
Jul 20 12:35:37 10.242.43.108 e8
|
|
Jul 20 12:35:37 10.242.43.108 c3
|
|
Jul 20 12:35:37 10.242.43.108 c9
|
|
Jul 20 12:35:37 10.242.43.108 e9
|
|
Jul 20 12:35:37 10.242.43.108 c0
|
|
Jul 20 12:35:37 10.242.43.108 e9
|
|
Jul 20 12:35:37 10.242.43.108 cc
|
|
Jul 20 12:35:37 10.242.43.108 f9
|
|
Jul 20 12:35:37 10.242.43.108 ff
|
|
Jul 20 12:35:37 10.242.43.108 ff
|
|
Jul 20 12:35:37 10.242.43.108 4c
|
|
Jul 20 12:35:37 10.242.43.108 63
|
|
Jul 20 12:35:37 10.242.43.108 e0
|
|
Jul 20 12:35:37 10.242.43.108 e9
|
|
Jul 20 12:35:37 10.242.43.108 b7
|
|
Jul 20 12:35:37 10.242.43.108 f9
|
|
Jul 20 12:35:37 10.242.43.108 ff
|
|
Jul 20 12:35:37 10.242.43.108 ff
|
|
Jul 20 12:35:37 10.242.43.108 0b
|
|
Jul 20 12:35:37 10.242.43.108 0f
|
|
Jul 20 12:35:37 10.242.43.108 0b
|
|
Jul 20 12:35:37 10.242.43.108 66
|
|
Jul 20 12:35:37 10.242.43.108 90
|
|
Jul 20 12:35:37 10.242.43.108 0f
|
|
Jul 20 12:35:37 10.242.43.108 1f
|
|
Jul 20 12:35:37 10.242.43.108 44
|
|
Jul 20 12:35:37 10.242.43.108 00
|
|
Jul 20 12:35:37 10.242.43.108 00
|
|
Jul 20 12:35:37 10.242.43.108 55
|
|
Jul 20 12:35:37 10.242.43.108 48
|
|
Jul 20 12:35:37 10.242.43.108 89
|
|
Jul 20 12:35:37 10.242.43.108 e5
|
|
Jul 20 12:35:37 10.242.43.108 41
|
|
Jul 20 12:35:37 10.242.43.108 56
|
|
Jul 20 12:35:37 10.242.43.108 41
|
|
Jul 20 12:35:37 10.242.43.108 55
|
|
Jul 20 12:35:37 10.242.43.108 49
|
|
Jul 20 12:35:37 10.242.43.108 89
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.280070] RIP
|
|
Jul 20 12:35:37 10.242.43.108 [<ffffffffc0513a2a>] __prepare_send_request+0x7ea/0x7f0 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.289114] RSP <ffff880fff65fb98>
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.300271] ---[ end trace bc4ea915aa83170f ]---
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.308390] BUG: unable to handle kernel
|
|
Jul 20 12:35:37 10.242.43.108 paging request
|
|
Jul 20 12:35:37 10.242.43.108 at ffffffffffffffd8
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.312966] IP:
|
|
Jul 20 12:35:37 10.242.43.108 [<ffffffff81092dd0>] kthread_data+0x10/0x20
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.317447] PGD 1c16067
|
|
Jul 20 12:35:37 10.242.43.108 PUD 1c18067
|
|
Jul 20 12:35:37 10.242.43.108 PMD 0
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.321793] Oops: 0000 [#2]
|
|
Jul 20 12:35:37 10.242.43.108 SMP
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.325967] Modules linked in:
|
|
Jul 20 12:35:37 10.242.43.108 ceph
|
|
Jul 20 12:35:37 10.242.43.108 libceph
|
|
Jul 20 12:35:37 10.242.43.108 fscache
|
|
Jul 20 12:35:37 10.242.43.108 xfs
|
|
Jul 20 12:35:37 10.242.43.108 libcrc32c
|
|
Jul 20 12:35:37 10.242.43.108 dm_crypt
|
|
Jul 20 12:35:37 10.242.43.108 ipmi_devintf
|
|
Jul 20 12:35:37 10.242.43.108 mei_me
|
|
Jul 20 12:35:37 10.242.43.108 joydev
|
|
Jul 20 12:35:37 10.242.43.108 x86_pkg_temp_thermal
|
|
Jul 20 12:35:37 10.242.43.108 intel_powerclamp
|
|
Jul 20 12:35:37 10.242.43.108 mei
|
|
Jul 20 12:35:37 10.242.43.108 coretemp
|
|
Jul 20 12:35:37 10.242.43.108 ipmi_si
|
|
Jul 20 12:35:37 10.242.43.108 kvm_intel
|
|
Jul 20 12:35:37 10.242.43.108 kvm
|
|
Jul 20 12:35:37 10.242.43.108 crct10dif_pclmul
|
|
Jul 20 12:35:37 10.242.43.108 dcdbas
|
|
Jul 20 12:35:37 10.242.43.108 crc32_pclmul
|
|
Jul 20 12:35:37 10.242.43.108 lpc_ich
|
|
Jul 20 12:35:37 10.242.43.108 aesni_intel
|
|
Jul 20 12:35:37 10.242.43.108 aes_x86_64
|
|
Jul 20 12:35:37 10.242.43.108 lrw
|
|
Jul 20 12:35:37 10.242.43.108 gf128mul
|
|
Jul 20 12:35:37 10.242.43.108 glue_helper
|
|
Jul 20 12:35:37 10.242.43.108 ablk_helper
|
|
Jul 20 12:35:37 10.242.43.108 netconsole
|
|
Jul 20 12:35:37 10.242.43.108 cryptd
|
|
Jul 20 12:35:37 10.242.43.108 mac_hid
|
|
Jul 20 12:35:37 10.242.43.108 ipmi_msghandler
|
|
Jul 20 12:35:37 10.242.43.108 acpi_power_meter
|
|
Jul 20 12:35:37 10.242.43.108 acpi_pad
|
|
Jul 20 12:35:37 10.242.43.108 configfs
|
|
Jul 20 12:35:37 10.242.43.108 sb_edac
|
|
Jul 20 12:35:37 10.242.43.108 edac_core
|
|
Jul 20 12:35:37 10.242.43.108 shpchp
|
|
Jul 20 12:35:37 10.242.43.108 lp
|
|
Jul 20 12:35:37 10.242.43.108 parport
|
|
Jul 20 12:35:37 10.242.43.108 mlx4_en
|
|
Jul 20 12:35:37 10.242.43.108 vxlan
|
|
Jul 20 12:35:37 10.242.43.108 hid_generic
|
|
Jul 20 12:35:37 10.242.43.108 usbhid
|
|
Jul 20 12:35:37 10.242.43.108 ses
|
|
Jul 20 12:35:37 10.242.43.108 enclosure
|
|
Jul 20 12:35:37 10.242.43.108 hid
|
|
Jul 20 12:35:37 10.242.43.108 mpt2sas
|
|
Jul 20 12:35:37 10.242.43.108 tg3
|
|
Jul 20 12:35:37 10.242.43.108 ahci
|
|
Jul 20 12:35:37 10.242.43.108 raid_class
|
|
Jul 20 12:35:37 10.242.43.108 ptp
|
|
Jul 20 12:35:37 10.242.43.108 scsi_transport_sas
|
|
Jul 20 12:35:37 10.242.43.108 mlx4_core
|
|
Jul 20 12:35:37 10.242.43.108 libahci
|
|
Jul 20 12:35:37 10.242.43.108 megaraid_sas
|
|
Jul 20 12:35:37 10.242.43.108 pps_core
|
|
Jul 20 12:35:37 10.242.43.108 wmi
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.357986] CPU: 9 PID: 7376 Comm: kworker/9:9 Tainted: G D 3.16.0-70-generic #90~14.04.1-Ubuntu
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.367710] Hardware name: Dell Inc. PowerEdge R620/01W23F, BIOS 2.2.2 01/16/2014
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.377862] task: ffff880fe152dbb0 ti: ffff880fff65c000 task.ti: ffff880fff65c000
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.388397] RIP: 0010:[<ffffffff81092dd0>]
|
|
Jul 20 12:35:37 10.242.43.108 [<ffffffff81092dd0>] kthread_data+0x10/0x20
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.399400] RSP: 0018:ffff880fff65f860 EFLAGS: 00010002
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.405030] RAX: 0000000000000000 RBX: 0000000000000009 RCX: 000000000000000f
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.410741] RDX: 0000000000000001 RSI: 0000000000000009 RDI: ffff880fe152dbb0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.416428] RBP: ffff880fff65f860 R08: 000000000000b800 R09: 0000000180270015
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.421993] R10: ffffffff8135f92a R11: ffffea00403d2e00 R12: ffff88101f2930c0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.427459] R13: 0000000000000009 R14: 0000000000000000 R15: ffff880fe152dbb0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.432873] FS: 0000000000000000(0000) GS:ffff88101f280000(0000) knlGS:0000000000000000
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.443527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.448946] CR2: 0000000000000028 CR3: 0000000001c13000 CR4: 00000000001407e0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.454416] Stack:
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.459744] ffff880fff65f878
|
|
Jul 20 12:35:37 10.242.43.108 ffffffff8108c351
|
|
Jul 20 12:35:37 10.242.43.108 ffff880fe152e0e8
|
|
Jul 20 12:35:37 10.242.43.108 ffff880fff65f8d8
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.470657] ffffffff8176e2be
|
|
Jul 20 12:35:37 10.242.43.108 ffff880fe152dbb0
|
|
Jul 20 12:35:37 10.242.43.108 ffff880fff65ffd8
|
|
Jul 20 12:35:37 10.242.43.108 00000000000130c0
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.481842] 00000000000130c0
|
|
Jul 20 12:35:37 10.242.43.108 ffff880fe152dbb0
|
|
Jul 20 12:35:37 10.242.43.108 ffff880fe152e308
|
|
Jul 20 12:35:37 10.242.43.108 ffff880fe152dba0
|
|
Jul 20 12:35:37 10.242.43.108
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.492999] Call Trace:
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.498407] [<ffffffff8108c351>] wq_worker_sleeping+0x11/0x90
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.503847] [<ffffffff8176e2be>] __schedule+0x55e/0x7a0
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.509178] [<ffffffff8176e529>] schedule+0x29/0x70
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.514364] [<ffffffff81071877>] do_exit+0x6e7/0xa60
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.519423] [<ffffffff81017929>] oops_end+0xa9/0x150
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.524377] [<ffffffff81017cdb>] die+0x4b/0x70
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.529203] [<ffffffff810143f0>] do_trap+0xb0/0x150
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.533931] [<ffffffff81014ab7>] do_error_trap+0x97/0x150
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.538550] [<ffffffffc0513a2a>] ? __prepare_send_request+0x7ea/0x7f0 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.543172] [<ffffffff816d9a3c>] ? inet_recvmsg+0x6c/0x80
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.547704] [<ffffffff81015130>] do_invalid_op+0x20/0x30
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.552132] [<ffffffff81773fbe>] invalid_op+0x1e/0x30
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.556434] [<ffffffffc0513a2a>] ? __prepare_send_request+0x7ea/0x7f0 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.560765] [<ffffffffc0513579>] ? __prepare_send_request+0x339/0x7f0 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.565070] [<ffffffffc0513c60>] __do_request+0x230/0x330 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.569332] [<ffffffffc0513dd8>] __wake_requests+0x78/0xb0 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.573577] [<ffffffffc0516f1e>] dispatch+0x54e/0xb00 [ceph]
|
|
Jul 20 12:35:37 10.242.43.108 [ 622.577792] [<ffffffffc04bdc4b>] try_read+0x4bb/0x10e0 [libceph]
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.581959] [<ffffffff8101d275>] ? native_sched_clock+0x35/0x90
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.586064] [<ffffffff8101d2d9>] ? sched_clock+0x9/0x10
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.590098] [<ffffffff810a5d25>] ? sched_clock_cpu+0x85/0xc0
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.594051] [<ffffffff810ad9a1>] ? put_prev_entity+0x31/0x3f0
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.597907] [<ffffffffc04bfa49>] con_work+0xb9/0x640 [libceph]
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.601693] [<ffffffff8108b712>] process_one_work+0x182/0x450
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.605356] [<ffffffff8108be81>] worker_thread+0x121/0x570
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.608890] [<ffffffff8108bd60>] ? rescuer_thread+0x380/0x380
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.612325] [<ffffffff81092732>] kthread+0xd2/0xf0
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.615627] [<ffffffff81092660>] ? kthread_create_on_node+0x1c0/0x1c0
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.618900] [<ffffffff817724d8>] ret_from_fork+0x58/0x90
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.622203] [<ffffffff81092660>] ? kthread_create_on_node+0x1c0/0x1c0
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.625502] Code:
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 48
|
|
Jul 20 12:35:38 10.242.43.108 89
|
|
Jul 20 12:35:38 10.242.43.108 e5
|
|
Jul 20 12:35:38 10.242.43.108 5d
|
|
Jul 20 12:35:38 10.242.43.108 48
|
|
Jul 20 12:35:38 10.242.43.108 8b
|
|
Jul 20 12:35:38 10.242.43.108 40
|
|
Jul 20 12:35:38 10.242.43.108 c8
|
|
Jul 20 12:35:38 10.242.43.108 48
|
|
Jul 20 12:35:38 10.242.43.108 c1
|
|
Jul 20 12:35:38 10.242.43.108 e8
|
|
Jul 20 12:35:38 10.242.43.108 02
|
|
Jul 20 12:35:38 10.242.43.108 83
|
|
Jul 20 12:35:38 10.242.43.108 e0
|
|
Jul 20 12:35:38 10.242.43.108 01
|
|
Jul 20 12:35:38 10.242.43.108 c3
|
|
Jul 20 12:35:38 10.242.43.108 66
|
|
Jul 20 12:35:38 10.242.43.108 2e
|
|
Jul 20 12:35:38 10.242.43.108 0f
|
|
Jul 20 12:35:38 10.242.43.108 1f
|
|
Jul 20 12:35:38 10.242.43.108 84
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 0f
|
|
Jul 20 12:35:38 10.242.43.108 1f
|
|
Jul 20 12:35:38 10.242.43.108 44
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 48
|
|
Jul 20 12:35:38 10.242.43.108 8b
|
|
Jul 20 12:35:38 10.242.43.108 87
|
|
Jul 20 12:35:38 10.242.43.108 c8
|
|
Jul 20 12:35:38 10.242.43.108 04
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 55
|
|
Jul 20 12:35:38 10.242.43.108 48
|
|
Jul 20 12:35:38 10.242.43.108 89
|
|
Jul 20 12:35:38 10.242.43.108 e5
|
|
Jul 20 12:35:38 10.242.43.108
|
|
Jul 20 12:35:38 10.242.43.108 8b
|
|
Jul 20 12:35:38 10.242.43.108 40
|
|
Jul 20 12:35:38 10.242.43.108 d8
|
|
Jul 20 12:35:38 10.242.43.108 5d
|
|
Jul 20 12:35:38 10.242.43.108 c3
|
|
Jul 20 12:35:38 10.242.43.108 66
|
|
Jul 20 12:35:38 10.242.43.108 2e
|
|
Jul 20 12:35:38 10.242.43.108 0f
|
|
Jul 20 12:35:38 10.242.43.108 1f
|
|
Jul 20 12:35:38 10.242.43.108 84
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 0f
|
|
Jul 20 12:35:38 10.242.43.108 1f
|
|
Jul 20 12:35:38 10.242.43.108 44
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108 00
|
|
Jul 20 12:35:38 10.242.43.108
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.636397] RIP
|
|
Jul 20 12:35:38 10.242.43.108 [<ffffffff81092dd0>] kthread_data+0x10/0x20
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.640051] RSP <ffff880fff65f860>
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.643679] CR2: ffffffffffffffd8
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.647286] ---[ end trace bc4ea915aa831710 ]---
|
|
Jul 20 12:35:38 10.242.43.108 [ 622.653714] Fixing recursive fault but reboot is needed!
|
|
Jul 20 12:35:51 10.242.43.108 [ 635.735592] mlx4_core 0000:42:00.0: command 0x49 timed out (go bit not cleared)
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.605332] ------------[ cut here ]------------
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.609188] WARNING: CPU: 1 PID: 109 at /build/linux-lts-utopic-vy2yyy/linux-lts-utopic-3.16.0/kernel/watchdog.c:265 watchdog_overflow_callback+0x9c/0xd0()
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.617289] Watchdog detected hard LOCKUP on cpu 1
|
|
Jul 20 12:35:52 10.242.43.108 636.617289] Watchdog detected hard LOCKUP on cpu 1ux-lts-utopic-vy2yyy/linux-lts-utopic-3.16.0/kernel/watchdog.c:265 watchdog_overflow_callback+0x9c/0xd0()
|
|
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.617440] Modules linked in:
|
|
Jul 20 12:35:52 10.242.43.108 ceph
|
|
Jul 20 12:35:52 10.242.43.108 libceph
|
|
Jul 20 12:35:52 10.242.43.108 fscache
|
|
Jul 20 12:35:52 10.242.43.108 xfs
|
|
Jul 20 12:35:52 10.242.43.108 libcrc32c
|
|
Jul 20 12:35:52 10.242.43.108 dm_crypt
|
|
Jul 20 12:35:52 10.242.43.108 ipmi_devintf
|
|
Jul 20 12:35:52 10.242.43.108 mei_me
|
|
Jul 20 12:35:52 10.242.43.108 joydev
|
|
Jul 20 12:35:52 10.242.43.108 x86_pkg_temp_thermal
|
|
Jul 20 12:35:52 10.242.43.108 intel_powerclamp
|
|
Jul 20 12:35:52 10.242.43.108 mei
|
|
Jul 20 12:35:52 10.242.43.108 coretemp
|
|
Jul 20 12:35:52 10.242.43.108 ipmi_si
|
|
Jul 20 12:35:52 10.242.43.108 kvm_intel
|
|
Jul 20 12:35:52 10.242.43.108 kvm
|
|
Jul 20 12:35:52 10.242.43.108 crct10dif_pclmul
|
|
Jul 20 12:35:52 10.242.43.108 dcdbas
|
|
Jul 20 12:35:52 10.242.43.108 crc32_pclmul
|
|
Jul 20 12:35:52 10.242.43.108 lpc_ich
|
|
Jul 20 12:35:52 10.242.43.108 aesni_intel
|
|
Jul 20 12:35:52 10.242.43.108 aes_x86_64
|
|
Jul 20 12:35:52 10.242.43.108 lrw
|
|
Jul 20 12:35:52 10.242.43.108 gf128mul
|
|
Jul 20 12:35:52 10.242.43.108 glue_helper
|
|
Jul 20 12:35:52 10.242.43.108 ablk_helper
|
|
Jul 20 12:35:52 10.242.43.108 netconsole
|
|
Jul 20 12:35:52 10.242.43.108 cryptd
|
|
Jul 20 12:35:52 10.242.43.108 mac_hid
|
|
Jul 20 12:35:52 10.242.43.108 ipmi_msghandler
|
|
Jul 20 12:35:52 10.242.43.108 acpi_power_meter
|
|
Jul 20 12:35:52 10.242.43.108 acpi_pad
|
|
Jul 20 12:35:52 10.242.43.108 configfs
|
|
Jul 20 12:35:52 10.242.43.108 sb_edac
|
|
Jul 20 12:35:52 10.242.43.108 edac_core
|
|
Jul 20 12:35:52 10.242.43.108 shpchp
|
|
Jul 20 12:35:52 10.242.43.108 lp
|
|
Jul 20 12:35:52 10.242.43.108 parport
|
|
Jul 20 12:35:52 10.242.43.108 mlx4_en
|
|
Jul 20 12:35:52 10.242.43.108 vxlan
|
|
Jul 20 12:35:52 10.242.43.108 hid_generic
|
|
Jul 20 12:35:52 10.242.43.108 usbhid
|
|
Jul 20 12:35:52 10.242.43.108 ses
|
|
Jul 20 12:35:52 10.242.43.108 enclosure
|
|
Jul 20 12:35:52 10.242.43.108 hid
|
|
Jul 20 12:35:52 10.242.43.108 mpt2sas
|
|
Jul 20 12:35:52 10.242.43.108 tg3
|
|
Jul 20 12:35:52 10.242.43.108 ahci
|
|
Jul 20 12:35:52 10.242.43.108 raid_class
|
|
Jul 20 12:35:52 10.242.43.108 ptp
|
|
Jul 20 12:35:52 10.242.43.108 scsi_transport_sas
|
|
Jul 20 12:35:52 10.242.43.108 mlx4_core
|
|
Jul 20 12:35:52 10.242.43.108 libahci
|
|
Jul 20 12:35:52 10.242.43.108 megaraid_sas
|
|
Jul 20 12:35:52 10.242.43.108 pps_core
|
|
Jul 20 12:35:52 10.242.43.108 wmi
|
|
Jul 20 12:35:52 10.242.43.108
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.654135] CPU: 1 PID: 109 Comm: migration/1 Tainted: G D 3.16.0-70-generic #90~14.04.1-Ubuntu
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.664157] Hardware name: Dell Inc. PowerEdge R620/01W23F, BIOS 2.2.2 01/16/2014
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.674489] 0000000000000000
|
|
Jul 20 12:35:52 10.242.43.108 ffff88101f205c00
|
|
Jul 20 12:35:52 10.242.43.108 ffffffff81769e17
|
|
Jul 20 12:35:52 10.242.43.108 ffff88101f205c48
|
|
Jul 20 12:35:52 10.242.43.108
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.685230] 0000000000000009
|
|
Jul 20 12:35:52 10.242.43.108 ffff88101f205c38
|
|
Jul 20 12:35:52 10.242.43.108 ffffffff8106ef1d
|
|
Jul 20 12:35:52 10.242.43.108 ffff881013ec0000
|
|
Jul 20 12:35:52 10.242.43.108
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.696312] 0000000000000000
|
|
Jul 20 12:35:52 10.242.43.108 ffff88101f205d60
|
|
Jul 20 12:35:52 10.242.43.108 0000000000000000
|
|
Jul 20 12:35:52 10.242.43.108 ffff88101f205ef8
|
|
Jul 20 12:35:52 10.242.43.108
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.707527] Call Trace:
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.713003] <NMI>
|
|
Jul 20 12:35:52 10.242.43.108 [<ffffffff81769e17>] dump_stack+0x64/0x82
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.718582] [<ffffffff8106ef1d>] warn_slowpath_common+0x7d/0xa0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.724172] [<ffffffff8106ef8c>] warn_slowpath_fmt+0x4c/0x50
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.729759] [<ffffffff8111d91c>] watchdog_overflow_callback+0x9c/0xd0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.735384] [<ffffffff8115a05d>] __perf_event_overflow+0x8d/0x230
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.740988] [<ffffffff8102acc8>] ? x86_perf_event_set_period+0xe8/0x150
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.746553] [<ffffffff8115aad4>] perf_event_overflow+0x14/0x20
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.752020] [<ffffffff8103221d>] intel_pmu_handle_irq+0x1ed/0x3e0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.757489] [<ffffffff8119e381>] ? unmap_kernel_range_noflush+0x11/0x20
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.762915] [<ffffffff810299cb>] perf_event_nmi_handler+0x2b/0x50
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.768242] [<ffffffff81017f68>] nmi_handle+0x88/0x120
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.773437] [<ffffffff810184dd>] default_do_nmi+0x4d/0x140
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.778559] [<ffffffff810186c0>] do_nmi+0xf0/0x160
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.783536] [<ffffffff8177498f>] end_repeat_nmi+0x1a/0x1e
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.788430] [<ffffffff81772042>] ? _raw_spin_lock+0x32/0x50
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.793206] [<ffffffff81772042>] ? _raw_spin_lock+0x32/0x50
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.797786] [<ffffffff81772042>] ? _raw_spin_lock+0x32/0x50
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.802164] <<EOE>>
|
|
Jul 20 12:35:52 10.242.43.108 <IRQ>
|
|
Jul 20 12:35:52 10.242.43.108 [<ffffffff810b2a16>] sched_rt_period_timer+0xd6/0x2b0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.810819] [<ffffffff81095c67>] __run_hrtimer+0x77/0x1d0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.815182] [<ffffffff810b2940>] ? balance_runtime+0x1b0/0x1b0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.819459] [<ffffffff8109604f>] hrtimer_interrupt+0xef/0x230
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.823638] [<ffffffff81102830>] ? cpu_stop_should_run+0x50/0x50
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.827727] [<ffffffff81048517>] local_apic_timer_interrupt+0x37/0x60
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.831740] [<ffffffff817754af>] smp_apic_timer_interrupt+0x3f/0x60
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.835669] [<ffffffff817734fd>] apic_timer_interrupt+0x6d/0x80
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.839493] <EOI>
|
|
Jul 20 12:35:52 10.242.43.108 [<ffffffff811028a0>] ? multi_cpu_stop+0x70/0xf0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.843286] [<ffffffff81102aae>] cpu_stopper_thread+0x7e/0x150
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.847001] [<ffffffff8176e0bf>] ? __schedule+0x35f/0x7a0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.850733] [<ffffffff81099a1f>] smpboot_thread_fn+0xff/0x1b0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.854430] [<ffffffff81099920>] ? SyS_setgroups+0x180/0x180
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.858072] [<ffffffff81092732>] kthread+0xd2/0xf0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.861719] [<ffffffff81092660>] ? kthread_create_on_node+0x1c0/0x1c0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.865422] [<ffffffff817724d8>] ret_from_fork+0x58/0x90
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.869086] [<ffffffff81092660>] ? kthread_create_on_node+0x1c0/0x1c0
|
|
Jul 20 12:35:52 10.242.43.108 [ 636.872780] ---[ end trace bc4ea915aa831711 ]---
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.484256] ------------[ cut here ]------------
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.487980] WARNING: CPU: 19 PID: 4628 at /build/linux-lts-utopic-vy2yyy/linux-lts-utopic-3.16.0/kernel/watchdog.c:265 watchdog_overflow_callback+0x9c/0xd0()
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.495671] Watchdog detected hard LOCKUP on cpu 19
|
|
Jul 20 12:35:56 10.242.43.108 641.495671] Watchdog detected hard LOCKUP on cpu 19nux-lts-utopic-vy2yyy/linux-lts-utopic-3.16.0/kernel/watchdog.c:265 watchdog_overflow_callback+0x9c/0xd0()
|
|
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.495825] Modules linked in:
|
|
Jul 20 12:35:56 10.242.43.108 ceph
|
|
Jul 20 12:35:56 10.242.43.108 libceph
|
|
Jul 20 12:35:56 10.242.43.108 fscache
|
|
Jul 20 12:35:56 10.242.43.108 xfs
|
|
Jul 20 12:35:56 10.242.43.108 libcrc32c
|
|
Jul 20 12:35:56 10.242.43.108 dm_crypt
|
|
Jul 20 12:35:56 10.242.43.108 ipmi_devintf
|
|
Jul 20 12:35:56 10.242.43.108 mei_me
|
|
Jul 20 12:35:56 10.242.43.108 joydev
|
|
Jul 20 12:35:56 10.242.43.108 x86_pkg_temp_thermal
|
|
Jul 20 12:35:56 10.242.43.108 intel_powerclamp
|
|
Jul 20 12:35:56 10.242.43.108 mei
|
|
Jul 20 12:35:56 10.242.43.108 coretemp
|
|
Jul 20 12:35:56 10.242.43.108 ipmi_si
|
|
Jul 20 12:35:56 10.242.43.108 kvm_intel
|
|
Jul 20 12:35:56 10.242.43.108 kvm
|
|
Jul 20 12:35:56 10.242.43.108 crct10dif_pclmul
|
|
Jul 20 12:35:56 10.242.43.108 dcdbas
|
|
Jul 20 12:35:56 10.242.43.108 crc32_pclmul
|
|
Jul 20 12:35:56 10.242.43.108 lpc_ich
|
|
Jul 20 12:35:56 10.242.43.108 aesni_intel
|
|
Jul 20 12:35:56 10.242.43.108 aes_x86_64
|
|
Jul 20 12:35:56 10.242.43.108 lrw
|
|
Jul 20 12:35:56 10.242.43.108 gf128mul
|
|
Jul 20 12:35:56 10.242.43.108 glue_helper
|
|
Jul 20 12:35:56 10.242.43.108 ablk_helper
|
|
Jul 20 12:35:56 10.242.43.108 netconsole
|
|
Jul 20 12:35:56 10.242.43.108 cryptd
|
|
Jul 20 12:35:56 10.242.43.108 mac_hid
|
|
Jul 20 12:35:56 10.242.43.108 ipmi_msghandler
|
|
Jul 20 12:35:56 10.242.43.108 acpi_power_meter
|
|
Jul 20 12:35:56 10.242.43.108 acpi_pad
|
|
Jul 20 12:35:56 10.242.43.108 configfs
|
|
Jul 20 12:35:56 10.242.43.108 sb_edac
|
|
Jul 20 12:35:56 10.242.43.108 edac_core
|
|
Jul 20 12:35:56 10.242.43.108 shpchp
|
|
Jul 20 12:35:56 10.242.43.108 lp
|
|
Jul 20 12:35:56 10.242.43.108 parport
|
|
Jul 20 12:35:56 10.242.43.108 mlx4_en
|
|
Jul 20 12:35:56 10.242.43.108 vxlan
|
|
Jul 20 12:35:56 10.242.43.108 hid_generic
|
|
Jul 20 12:35:56 10.242.43.108 usbhid
|
|
Jul 20 12:35:56 10.242.43.108 ses
|
|
Jul 20 12:35:56 10.242.43.108 enclosure
|
|
Jul 20 12:35:56 10.242.43.108 hid
|
|
Jul 20 12:35:56 10.242.43.108 mpt2sas
|
|
Jul 20 12:35:56 10.242.43.108 tg3
|
|
Jul 20 12:35:56 10.242.43.108 ahci
|
|
Jul 20 12:35:56 10.242.43.108 raid_class
|
|
Jul 20 12:35:56 10.242.43.108 ptp
|
|
Jul 20 12:35:56 10.242.43.108 scsi_transport_sas
|
|
Jul 20 12:35:56 10.242.43.108 mlx4_core
|
|
Jul 20 12:35:56 10.242.43.108 libahci
|
|
Jul 20 12:35:56 10.242.43.108 megaraid_sas
|
|
Jul 20 12:35:56 10.242.43.108 pps_core
|
|
Jul 20 12:35:56 10.242.43.108 wmi
|
|
Jul 20 12:35:56 10.242.43.108
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.531221] CPU: 19 PID: 4628 Comm: ms_pipe_read Tainted: G D W 3.16.0-70-generic #90~14.04.1-Ubuntu
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.540744] Hardware name: Dell Inc. PowerEdge R620/01W23F, BIOS 2.2.2 01/16/2014
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.550508] 0000000000000000
|
|
Jul 20 12:35:56 10.242.43.108 ffff88101f325c00
|
|
Jul 20 12:35:56 10.242.43.108 ffffffff81769e17
|
|
Jul 20 12:35:56 10.242.43.108 ffff88101f325c48
|
|
Jul 20 12:35:56 10.242.43.108
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.560675] 0000000000000009
|
|
Jul 20 12:35:56 10.242.43.108 ffff88101f325c38
|
|
Jul 20 12:35:56 10.242.43.108 ffffffff8106ef1d
|
|
Jul 20 12:35:56 10.242.43.108 ffff8810136f0000
|
|
Jul 20 12:35:56 10.242.43.108
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.571181] 0000000000000000
|
|
Jul 20 12:35:56 10.242.43.108 ffff88101f325d60
|
|
Jul 20 12:35:56 10.242.43.108 0000000000000000
|
|
Jul 20 12:35:56 10.242.43.108 ffff88101f325ef8
|
|
Jul 20 12:35:56 10.242.43.108
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.581944] Call Trace:
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.587271] <NMI>
|
|
Jul 20 12:35:56 10.242.43.108 [<ffffffff81769e17>] dump_stack+0x64/0x82
|
|
Jul 20 12:35:56 10.242.43.108 [ 641.592763] [<ffffffff8106ef1d>] warn_slowpath_common+0x7d/0xa0
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.598303] [<ffffffff8106ef8c>] warn_slowpath_fmt+0x4c/0x50
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.603794] [<ffffffff8111d91c>] watchdog_overflow_callback+0x9c/0xd0
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.609316] [<ffffffff8115a05d>] __perf_event_overflow+0x8d/0x230
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.614828] [<ffffffff8102acc8>] ? x86_perf_event_set_period+0xe8/0x150
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.620362] [<ffffffff8115aad4>] perf_event_overflow+0x14/0x20
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.625825] [<ffffffff8103221d>] intel_pmu_handle_irq+0x1ed/0x3e0
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.631309] [<ffffffff8119e381>] ? unmap_kernel_range_noflush+0x11/0x20
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.636755] [<ffffffff810299cb>] perf_event_nmi_handler+0x2b/0x50
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.642094] [<ffffffff81017f68>] nmi_handle+0x88/0x120
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.647303] [<ffffffff810184dd>] default_do_nmi+0x4d/0x140
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.652437] [<ffffffff810186c0>] do_nmi+0xf0/0x160
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.657428] [<ffffffff8177498f>] end_repeat_nmi+0x1a/0x1e
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.662331] [<ffffffff81772042>] ? _raw_spin_lock+0x32/0x50
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.667121] [<ffffffff81772042>] ? _raw_spin_lock+0x32/0x50
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.671711] [<ffffffff81772042>] ? _raw_spin_lock+0x32/0x50
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.676102] <<EOE>>
|
|
Jul 20 12:35:57 10.242.43.108 [<ffffffff810a2ba9>] try_to_wake_up+0x1c9/0x340
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.680488] [<ffffffff810a2d50>] wake_up_state+0x10/0x20
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.684806] [<ffffffff810e5486>] wake_futex+0x66/0x90
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.689011] [<ffffffff810e7848>] futex_requeue+0x668/0x8c0
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.693114] [<ffffffff810e80e9>] do_futex+0xa9/0x6a0
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.697087] [<ffffffff810e8751>] SyS_futex+0x71/0x150
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.700936] [<ffffffff8177258d>] system_call_fastpath+0x1a/0x1f
|
|
Jul 20 12:35:57 10.242.43.108 [ 641.704719] ---[ end trace bc4ea915aa831712 ]---
|
|
Jul 20 12:35:58 10.242.43.108 [ 643.424954] ------------[ cut here ]------------
|
|
Jul 20 12:35:58 10.242.43.108 [ 643.428548] WARNING: CPU: 9 PID: 7376 at /build/linux-lts-utopic-vy2yyy/linux-lts-utopic-3.16.0/kernel/watchdog.c:265 watchdog_overflow_callback+0x9c/0xd0()
|
|
Jul 20 12:35:58 10.242.43.108 [ 643.435834] Watchdog detected hard LOCKUP on cpu 9
|
|
Jul 20 12:35:58 10.242.43.108 643.435834] Watchdog detected hard LOCKUP on cpu 9nux-lts-utopic-vy2yyy/linux-lts-utopic-3.16.0/kernel/watchdog.c:265 watchdog_overflow_callback+0x9c/0xd0()
|
|
|
|
|
|
Jul 20 12:35:58 10.242.43.108 [ 643.435990] Modules linked in:
|
|
Jul 20 12:35:58 10.242.43.108 ceph
|
|
Jul 20 12:35:58 10.242.43.108 libceph
|
|
Jul 20 12:35:58 10.242.43.108 fscache
|
|
Jul 20 12:35:58 10.242.43.108 xfs
|
|
Jul 20 12:35:58 10.242.43.108 libcrc32c
|
|
Jul 20 12:35:58 10.242.43.108 dm_crypt
|
|
Jul 20 12:35:58 10.242.43.108 ipmi_devintf
|
|
Jul 20 12:35:58 10.242.43.108 mei_me
|
|
Jul 20 12:35:58 10.242.43.108 joydev
|
|
Jul 20 12:35:58 10.242.43.108 x86_pkg_temp_thermal
|
|
Jul 20 12:35:58 10.242.43.108 intel_powerclamp
|
|
Jul 20 12:35:58 10.242.43.108 mei
|
|
Jul 20 12:35:58 10.242.43.108 coretemp
|
|
Jul 20 12:35:58 10.242.43.108 ipmi_si
|
|
Jul 20 12:35:58 10.242.43.108 kvm_intel
|
|
Jul 20 12:35:58 10.242.43.108 kvm
|
|
Jul 20 12:35:58 10.242.43.108 crct10dif_pclmul
|
|
Jul 20 12:35:58 10.242.43.108 dcdbas
|
|
Jul 20 12:35:58 10.242.43.108 crc32_pclmul
|
|
Jul 20 12:35:58 10.242.43.108 lpc_ich
|
|
Jul 20 12:35:58 10.242.43.108 aesni_intel
|
|
Jul 20 12:35:58 10.242.43.108 aes_x86_64
|
|
Jul 20 12:35:58 10.242.43.108 lrw
|
|
Jul 20 12:35:58 10.242.43.108 gf128mul
|
|
Jul 20 12:35:58 10.242.43.108 glue_helper
|
|
Jul 20 12:35:58 10.242.43.108 ablk_helper
|
|
Jul 20 12:35:58 10.242.43.108 netconsole
|
|
Jul 20 12:35:58 10.242.43.108 cryptd
|
|
Jul 20 12:35:58 10.242.43.108 mac_hid
|
|
Jul 20 12:35:58 10.242.43.108 ipmi_msghandler
|
|
Jul 20 12:35:58 10.242.43.108 acpi_power_meter
|
|
Jul 20 12:35:58 10.242.43.108 acpi_pad
|
|
Jul 20 12:35:58 10.242.43.108 configfs
|
|
Jul 20 12:35:58 10.242.43.108 sb_edac
|
|
Jul 20 12:35:58 10.242.43.108 edac_core
|
|
Jul 20 12:35:58 10.242.43.108 shpchp
|
|
Jul 20 12:35:58 10.242.43.108 lp
|
|
Jul 20 12:35:58 10.242.43.108 parport
|
|
Jul 20 12:35:58 10.242.43.108 mlx4_en
|
|
Jul 20 12:35:58 10.242.43.108 vxlan
|
|
Jul 20 12:35:58 10.242.43.108 hid_generic
|
