Project

General

Profile

Actions

Bug #11288

closed

mira004 is dead

Added by Yuri Weinstein about 9 years ago. Updated about 9 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

This is the last output from SOL:

mira004 login: [   22.143149] Ebtables v2.0 registered
[   22.153855] ip6_tables: (C) 2000-2006 Netfilter Core Team
[   22.185856] cgroup: libvirtd (1622) created nested cgroup for controller "memory" which has incomplete hierarchy support. Nested cgroups may change behavior in the future.
[   22.201306] cgroup: "memory" requires setting use_hierarchy to 1 on the root.
[   22.208695] cgroup: libvirtd (1622) created nested cgroup for controller "devices" which has incomplete hierarchy support. Nested cgroups may change behavior in the future.
[   22.224348] cgroup: libvirtd (1622) created nested cgroup for controller "blkio" which has incomplete hierarchy support. Nested cgroups may change behavior in the future.
[   27.993250] br-front: port 1(eth0) entered forwarding state
[   66.389685] audit_printk_skb: 27 callbacks suppressed
[   66.394907] type=1400 audit(1427817413.940:21): apparmor="STATUS" operation="profile_load" name="libvirt-71c3cb5f-eaff-2d1d-98e8-b9085aaa6c9a" pid=1971 comm="apparmor_parser" 
[   66.411381] type=1400 audit(1427817413.964:22): apparmor="DENIED" operation="capable" parent=1 profile="/usr/sbin/libvirtd" pid=1613 comm="libvirtd" pid=1613 comm="libvirtd" cap
[   66.446329] type=1400 audit(1427817414.000:23): apparmor="DENIED" operation="capable" parent=1 profile="/usr/sbin/libvirtd" pid=1613 comm="libvirtd" pid=1613 comm="libvirtd" cap
[   66.480610] device vnet0 entered promiscuous mode
[   66.496458] br-front: port 2(vnet0) entered forwarding state
[   66.502171] br-front: port 2(vnet0) entered forwarding state
[   66.508499] type=1400 audit(1427817414.060:24): apparmor="DENIED" operation="capable" parent=1 profile="/usr/sbin/libvirtd" pid=1613 comm="libvirtd" pid=1613 comm="libvirtd" cap
[   75.502075] br-front: port 2(vnet0) entered forwarding state
[   79.038452] type=1400 audit(1427817426.608:25): apparmor="STATUS" operation="profile_load" name="libvirt-db3ed22a-96e3-a4d9-b219-fb430657b41f" pid=2080 comm="apparmor_parser" 
[   79.072573] device vnet1 entered promiscuous mode
[   79.080563] br-front: port 3(vnet1) entered forwarding state
[   79.086308] br-front: port 3(vnet1) entered forwarding state
[   88.090178] br-front: port 3(vnet1) entered forwarding state
[  207.026581] type=1400 audit(1427817554.802:26): apparmor="STATUS" operation="profile_load" name="libvirt-3b57a680-7812-bfa6-d30b-8b7f71f8739d" pid=2211 comm="apparmor_parser" 
[  207.043349] type=1400 audit(1427817554.818:27): apparmor="DENIED" operation="capable" parent=1 profile="/usr/sbin/libvirtd" pid=1614 comm="libvirtd" pid=1614 comm="libvirtd" cap
[  207.118105] device vnet2 entered promiscuous mode
[  207.138073] br-front: port 4(vnet2) entered forwarding state
[  207.143791] br-front: port 4(vnet2) entered forwarding state
[  213.244534] type=1400 audit(1427817561.030:28): apparmor="STATUS" operation="profile_load" name="libvirt-774e13b1-d8ad-a43c-807c-73edcbebfb34" pid=2297 comm="apparmor_parser" 
[  213.339112] device vnet3 entered promiscuous mode
[  213.356122] br-front: port 5(vnet3) entered forwarding state
[  213.361842] br-front: port 5(vnet3) entered forwarding state
[  216.143577] br-front: port 4(vnet2) entered forwarding state
[  222.373717] br-front: port 5(vnet3) entered forwarding state
[  421.322991] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07c offset:0x540 grain:8 syndrome:0xe464902 - read error)
[  421.336740] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07c offset:0xac0 grain:8 syndrome:0x1c8c9204 - read error)
[  421.350538] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d06c offset:0xf00 grain:8 syndrome:0xe014e420 - read error)
[  423.359717] EDAC MC0: 5 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0xec0 grain:8 syndrome:0xe014e420 - read error)
[  423.373514] EDAC MC0: 4 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07c offset:0x6c0 grain:8 syndrome:0x723aa01 - read error)
[  426.379026] EDAC MC0: 2 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0x540 grain:8 syndrome:0xe014e420 - read error)
[  426.392836] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0x7c0 grain:8 syndrome:0xe014e420 - read error)
[  426.406624] EDAC MC0: 2 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0xfc0 grain:8 syndrome:0xdd28d540 - read error)
[  426.420434] EDAC MC0: 3 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07c offset:0x440 grain:8 syndrome:0x700a7210 - read error)
[  426.434286] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07c offset:0x6c0 grain:8 syndrome:0x723aa01 - read error)
[  430.440616] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0x140 grain:8 syndrome:0xe464902 - read error)
[  430.454386] EDAC MC0: 5 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0xfc0 grain:8 syndrome:0xdd28d540 - read error)
[  430.468298] EDAC MC0: 4 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07c offset:0x6c0 grain:8 syndrome:0x723aa01 - read error)
[  430.482011] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0x140 grain:8 syndrome:0xe464902 - read error)
[  430.495904] EDAC MC0: 2 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0x7c0 grain:8 syndrome:0xe014e420 - read error)
[  430.509824] EDAC MC0: 3 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0xfc0 grain:8 syndrome:0xe014e420 - read error)
[  430.523739] EDAC MC0: 4 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07c offset:0x6c0 grain:8 syndrome:0x723aa01 - read error)
[  433.531618] EDAC MC0: 1 CE read ECC error on CPU#0Channel#1_DIMM#0 (channel:1 slot:0 page:0x21d07d offset:0xfc0 grain:8 syndrome:0xdd28d540 - read error)
[  434.254655] mce: [Hardware Error]: CPU 0: Machine Check Exception: 4 Bank 8: fe0001c00001009f
[  434.263235] mce: [Hardware Error]: TSC 1254d690bae ADDR 21d07d4c0 MISC 700a72100004078d 
[  434.271530] mce: [Hardware Error]: PROCESSOR 0:106e5 TIME 1427817782 SOCKET 0 APIC 0 microcode 3
[  434.280366] mce: [Hardware Error]: Machine check: Processor context corrupt
[  434.287367] Kernel panic - not syncing: Fatal Machine check
[  434.292982] Rebooting in 30 seconds..

Related issues 1 (0 open1 closed)

Related to sepia - Bug #11117: mira004 has bad disksResolved03/16/2015

Actions
Actions #1

Updated by Dan Mick about 9 years ago

  • Assignee set to Dan Mick

Marked it and all its vps nodes down. Changing desc to include NOC so it can be found quickly.

Actions #2

Updated by Dan Mick about 9 years ago

  • Status changed from New to In Progress

Asked Robert Pan to investigate

Actions #3

Updated by Dan Mick about 9 years ago

  • Status changed from In Progress to Resolved

DIMM replaced, machine back live (albeit with a lot of dead disks; see #11117)

Actions

Also available in: Atom PDF