Hi all,
i have been having this particular issue for a while now,
Our production server restarts all by it self, at first we thought it was space issues (RAM, HARD DRIVE, etc) but checking all those we know the issue is not from any of these.
we check the log messages below is the output from the log and yesterday was the last time it restarted. our EBS Production (appsTier, dbTier) and test (appsTier, dbTier) are running on it.
our EBS version is R12.1.3
linux version is
cat /etc/issue
Oracle Linux Server release 5.8
Kernel \r on an \m
Please help.
Thanks.
[root@erp ~]# cat /var/log/messages
May 3 07:16:25 erp syslogd 1.4.1: restart.
May 3 07:49:46 erp kernel: frmweb[30865]: segfault at 000000006974655e rip 0000 0000f7cda2c1 rsp 00000000ff89da88 error 4
May 3 08:31:28 erp kernel: frmweb[30579]: segfault at 000000006974655e rip 0000 0000f7d812c1 rsp 00000000ff926948 error 4
May 3 10:52:28 erp kernel: FARXPBSH[3444]: segfault at 0000000008ab5000 rip 000 0000008051f22 rsp 00000000ffa36f40 error 6
May 3 11:22:31 erp kernel: frmweb[19133]: segfault at 000000006974655e rip 0000 0000f7dc82c1 rsp 00000000ffa52688 error 4
May 3 11:23:48 erp kernel: frmweb[5893]: segfault at 000000006974655e rip 00000 000f7dcc2c1 rsp 00000000ffd85ce8 error 4
May 3 11:23:52 erp kernel: frmweb[12462]: segfault at 000000006974655e rip 0000 0000f7d232c1 rsp 00000000ffb18c88 error 4
May 3 11:24:29 erp kernel: frmweb[30345]: segfault at 000000006974655e rip 0000 0000f7d712c1 rsp 00000000ffe4e578 error 4
May 3 11:24:29 erp kernel: frmweb[3534]: segfault at 000000006974655e rip 00000 000f7ced2c1 rsp 00000000ffa79248 error 4
May 3 11:24:31 erp kernel: frmweb[8400]: segfault at 000000006974655e rip 00000 000f7d542c1 rsp 00000000ffa85bc8 error 4
May 3 11:28:01 erp kernel: frmweb[27156]: segfault at 000000006974655e rip 0000 0000f7d222c1 rsp 00000000ff83d118 error 4
May 3 11:28:24 erp kernel: frmweb[29869]: segfault at 000000006974655e rip 0000 0000f7d0f2c1 rsp 00000000ff81c8f8 error 4
May 3 11:40:26 erp kernel: frmweb[18436]: segfault at 000000006974655e rip 0000 0000f7d882c1 rsp 00000000ff868068 error 4
May 3 11:43:08 erp kernel: frmweb[2472]: segfault at 000000006974655e rip 00000 000f7da12c1 rsp 00000000ff87e258 error 4
May 3 11:43:09 erp kernel: frmweb[15094]: segfault at 000000006974655e rip 0000 0000f7d4f2c1 rsp 00000000ff990d68 error 4
May 3 11:45:05 erp kernel: frmweb[16180]: segfault at 000000006974655e rip 0000 0000f7d252c1 rsp 00000000ffa07818 error 4
May 3 11:45:06 erp kernel: frmweb[15086]: segfault at 000000006974655e rip 0000 0000f7cfd2c1 rsp 00000000ffc3c9a8 error 4
May 3 11:46:22 erp kernel: frmweb[30310]: segfault at 000000006974655e rip 0000 0000f7d542c1 rsp 00000000ff9322c8 error 4
May 3 11:55:04 erp syslogd 1.4.1: restart.
May 3 11:55:04 erp kernel: klogd 1.4.1, log source = /proc/kmsg started.
May 3 11:55:04 erp kernel: Linux version 2.6.18-308.el5 (mockbuild@ca-build10.u s.oracle.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-50)) #1 SMP Sat Feb 25 12:40:07 EST 2012
May 3 11:55:04 erp kernel: Command line: ro root=LABEL=/ rhgb quiet numa=off
May 3 11:55:04 erp kernel: BIOS-provided physical RAM map:
May 3 11:55:04 erp kernel: BIOS-e820: 0000000000010000 - 0000000000096800 (usa ble)
May 3 11:55:04 erp kernel: BIOS-e820: 0000000000096800 - 00000000000a0000 (res erved)
May 3 11:55:04 erp kernel: BIOS-e820: 00000000000f0000 - 0000000000100000 (res erved)
May 3 11:55:04 erp kernel: BIOS-e820: 0000000000100000 - 00000000bddcc000 (usa ble)
May 3 11:55:04 erp kernel: BIOS-e820: 00000000bddcc000 - 00000000bddde000 (ACP I data)
May 3 11:55:04 erp kernel: BIOS-e820: 00000000bddde000 - 00000000bdddf000 (usa ble)
May 3 11:55:04 erp kernel: BIOS-e820: 00000000bdddf000 - 00000000d0000000 (res erved)
May 3 11:55:04 erp kernel: BIOS-e820: 00000000fec00000 - 00000000fee10000 (res erved)
May 3 11:55:04 erp kernel: BIOS-e820: 00000000ff800000 - 0000000100000000 (res erved)
May 3 11:55:04 erp kernel: BIOS-e820: 0000000100000000 - 000000103ffff000 (usa ble)
May 3 11:55:04 erp kernel: DMI 2.7 present.
May 3 11:55:04 erp kernel: NUMA turned off
May 3 11:55:04 erp kernel: Faking a node at 0000000000000000-000000103ffff000
May 3 11:55:04 erp kernel: Bootmem setup node 0 0000000000000000-000000103ffff0 00
May 3 11:55:04 erp kernel: Memory for crash kernel (0x0 to 0x0) notwithin permi ssible range
May 3 11:55:04 erp kernel: disabling kdump
May 3 11:55:04 erp kernel: ACPI: PM-Timer IO Port: 0x908
May 3 11:55:04 erp kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
May 3 11:55:04 erp kernel: Processor #0 6:13 APIC version 21
May 3 11:55:04 erp kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
May 3 11:55:04 erp kernel: Processor #2 6:13 APIC version 21
May 3 11:55:04 erp kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
May 3 11:55:04 erp kernel: Processor #4 6:13 APIC version 21
May 3 11:55:04 erp kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
May 3 11:55:04 erp kernel: Processor #6 6:13 APIC version 21
May 3 11:55:04 erp kernel: ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] disabled)
May 3 11:55:04 erp last message repeated 59 times
May 3 11:55:04 erp kernel: ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
May 3 11:55:04 erp kernel: ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[ 0])
May 3 11:55:04 erp kernel: IOAPIC[0]: apic_id 8, version 32, address 0xfec00000 , GSI 0-23
May 3 11:55:04 erp kernel: ACPI: IOAPIC (id[0x00] address[0xfec10000] gsi_base[ 24])
May 3 11:55:04 erp kernel: IOAPIC[1]: apic_id 0, version 32, address 0xfec10000 , GSI 24-47
May 3 11:55:04 erp kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
May 3 11:55:04 erp kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
May 3 11:55:04 erp kernel: Setting APIC routing to physical flat
May 3 11:55:04 erp kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000
May 3 11:55:04 erp kernel: Using ACPI (MADT) for SMP configuration information
May 3 11:55:04 erp kernel: Nosave address range: 0000000000096000 - 00000000000 97000
May 3 11:55:04 erp kernel: Nosave address range: 0000000000097000 - 00000000000 a0000
May 3 11:55:04 erp kernel: Nosave address range: 00000000000a0000 - 00000000000 f0000
May 3 11:55:04 erp kernel: Nosave address range: 00000000000f0000 - 00000000001 00000
May 3 11:55:04 erp kernel: Nosave address range: 00000000bddcc000 - 00000000bdd de000
May 3 11:55:04 erp kernel: Nosave address range: 00000000bdddf000 - 00000000d00 00000
May 3 11:55:04 erp kernel: Nosave address range: 00000000d0000000 - 00000000fec 00000
May 3 11:55:04 erp kernel: Nosave address range: 00000000fec00000 - 00000000fee 10000
May 3 11:55:04 erp kernel: Nosave address range: 00000000fee10000 - 00000000ff8 00000
May 3 11:55:04 erp kernel: Nosave address range: 00000000ff800000 - 00000001000 00000
May 3 11:55:04 erp kernel: Allocating PCI resources starting at d4000000 (gap: d0000000:2ec00000)
May 3 11:55:04 erp kernel: SMP: Allowing 64 CPUs, 60 hotplug CPUs
May 3 11:55:04 erp kernel: Built 1 zonelists. Total pages: 16533813
May 3 11:55:04 erp kernel: Kernel command line: ro root=LABEL=/ rhgb quiet numa =off
May 3 11:55:04 erp kernel: Initializing CPU#0
May 3 11:55:04 erp kernel: PID hash table entries: 4096 (order: 12, 32768 bytes )
May 3 11:55:04 erp kernel: Console: colour VGA+ 80x25
May 3 11:55:04 erp kernel: Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
May 3 11:55:04 erp kernel: Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
May 3 11:55:04 erp kernel: Checking aperture...
May 3 11:55:04 erp kernel: PCI-DMA: Using software bounce buffering for IO (SWI OTLB)
May 3 11:55:04 erp kernel: Placing software IO TLB between 0x7236000 - 0xb23600 0
May 3 11:55:04 erp kernel: Memory: 65965020k/68157436k available (2616k kernel code, 1108332k reserved, 1672k data, 224k init)
May 3 11:55:04 erp kernel: Calibrating delay loop (skipped), value calculated u sing timer frequency.. 4788.20 BogoMIPS (lpj=2394103)
May 3 11:55:04 erp kernel: Security Framework v1.0.0 initialized
May 3 11:55:04 erp kernel: SELinux: Initializing.
May 3 11:55:04 erp kernel: selinux_register_security: Registering secondary mo dule capability
May 3 11:55:04 erp kernel: Capability LSM initialized as secondary
May 3 11:55:04 erp kernel: Mount-cache hash table entries: 256
May 3 11:55:04 erp kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
May 3 11:55:04 erp kernel: CPU: L2 cache: 256K
May 3 11:55:04 erp kernel: CPU: L3 cache: 10240K
May 3 11:55:04 erp kernel: using mwait in idle threads.
May 3 11:55:04 erp kernel: CPU: Physical Processor ID: 0
May 3 11:55:04 erp kernel: CPU: Processor Core ID: 0
May 3 11:55:04 erp kernel: MCE: Machine Check Exception Reporting is disabled.
May 3 11:55:04 erp kernel: SMP alternatives: switching to UP code
May 3 11:55:04 erp kernel: ACPI: Core revision 20060707
May 3 11:55:04 erp kernel: Using local APIC timer interrupts.
May 3 11:55:04 erp kernel: Detected 6.234 MHz APIC timer.
May 3 11:55:04 erp kernel: SMP alternatives: switching to SMP code
May 3 11:55:04 erp kernel: Booting processor 1/4 APIC 0x2
May 3 11:55:04 erp kernel: Initializing CPU#1
May 3 11:55:04 erp kernel: Calibrating delay using timer specific routine.. 478 6.92 BogoMIPS (lpj=2393464)
May 3 11:55:04 erp kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
May 3 11:55:04 erp kernel: CPU: L2 cache: 256K
May 3 11:55:04 erp kernel: CPU: L3 cache: 10240K
May 3 11:55:04 erp kernel: CPU: Physical Processor ID: 0
May 3 11:55:04 erp kernel: CPU: Processor Core ID: 1
May 3 11:55:04 erp kernel: Intel(R) Xeon(R) CPU E5-2609 0 @ 2.40GHz step ping 07
May 3 11:55:04 erp kernel: SMP alternatives: switching to SMP code
May 3 11:55:04 erp kernel: Booting processor 2/4 APIC 0x4
May 3 11:55:04 erp kernel: Initializing CPU#2
May 3 11:55:04 erp kernel: Calibrating delay using timer specific routine.. 478 7.55 BogoMIPS (lpj=2393775)
May 3 11:55:04 erp kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
May 3 11:55:04 erp kernel: CPU: L2 cache: 256K
May 3 11:55:04 erp kernel: CPU: L3 cache: 10240K
May 3 11:55:04 erp kernel: CPU: Physical Processor ID: 0
May 3 11:55:04 erp kernel: CPU: Processor Core ID: 2
May 3 11:55:04 erp kernel: Intel(R) Xeon(R) CPU E5-2609 0 @ 2.40GHz step ping 07
May 3 11:55:04 erp kernel: SMP alternatives: switching to SMP code
May 3 11:55:04 erp kernel: Booting processor 3/4 APIC 0x6
May 3 11:55:04 erp kernel: Initializing CPU#3
May 3 11:55:04 erp kernel: Calibrating delay using timer specific routine.. 478 7.96 BogoMIPS (lpj=2393980)
May 3 11:55:04 erp kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
May 3 11:55:04 erp kernel: CPU: L2 cache: 256K
May 3 11:55:04 erp kernel: CPU: L3 cache: 10240K
May 3 11:55:04 erp kernel: CPU: Physical Processor ID: 0
May 3 11:55:04 erp kernel: CPU: Processor Core ID: 3
May 3 11:55:04 erp kernel: Intel(R) Xeon(R) CPU E5-2609 0 @ 2.40GHz step ping 07
May 3 11:55:04 erp kernel: Brought up 4 CPUs
May 3 11:55:04 erp kernel: NMI watchdog testing PASSED.
May 3 11:55:04 erp kernel: time.c: Using 14.318180 MHz WALL HPET GTOD HPET/TSC timer.
May 3 11:55:04 erp kernel: time.c: Detected 2394.103 MHz processor.
May 3 11:55:04 erp kernel: migration_cost=397
May 3 11:55:04 erp kernel: checking if image is initramfs... it is
May 3 11:55:04 erp kernel: Freeing initrd memory: 3399k freed
May 3 11:55:04 erp kernel: NET: Registered protocol family 16
May 3 11:55:04 erp kernel: ACPI: bus type pci registered
May 3 11:55:04 erp kernel: PCI: Using MMCONFIG at c0000000
May 3 11:55:04 erp kernel: ACPI: Interpreter enabled
May 3 11:55:04 erp kernel: ACPI: Using IOAPIC for interrupt routing
May 3 11:55:04 erp kernel: ACPI: No dock devices found.
May 3 11:55:04 erp kernel: ACPI: PCI Root Bridge [PCI0] (0000:00)
May 3 11:55:04 erp kernel: PCI: Transparent bridge - 0000:00:1e.0
May 3 11:55:04 erp kernel: bus 0 -> pxm 0 -> node -1
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs *5 7 10 11)
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *7 10 11)
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 5 7 *10 11)
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 5 7 *10 11)
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs *5 7 10 11)
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 5 *7 10 11)
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKG] (IRQs 5 7 10 11) *0, disabled.
May 3 11:55:04 erp kernel: ACPI: PCI Interrupt Link [LNKH] (IRQs 5 7 10 11) *0, disabled.
May 3 11:55:04 erp kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
May 3 11:55:04 erp kernel: pnp: PnP ACPI init
May 3 11:55:04 erp kernel: pnp: PnP ACPI: found 12 devices
May 3 11:55:04 erp kernel: usbcore: registered new driver usbfs
May 3 11:55:04 erp kernel: usbcore: registered new driver hub
May 3 11:55:04 erp kernel: PCI: Using ACPI for IRQ routing
May 3 11:55:04 erp kernel: PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
May 3 11:55:04 erp kernel: NetLabel: Initializing
May 3 11:55:04 erp kernel: NetLabel: domain hash size = 128
May 3 11:55:04 erp kernel: NetLabel: protocols = UNLABELED CIPSOv4
May 3 11:55:04 erp kernel: NetLabel: unlabeled traffic allowed by default
May 3 11:55:04 erp kernel: hpet0: at MMIO 0xfed00000 (virtual 0xffffffffff5fe00 0), IRQs 2, 8, 0, 0, 0, 0, 0, 0
May 3 11:55:04 erp kernel: hpet0: 8 64-bit timers, 14318180 Hz
May 3 11:55:04 erp kernel: DMAR:Host address width 46
May 3 11:55:04 erp kernel: DMAR:DRHD base: 0x000000f8ffe000 flags: 0x1
May 3 11:55:04 erp kernel: IOMMU f8ffe000: ver 1:0 cap d2078c106f0462 ecap f020 fe
May 3 11:55:04 erp kernel: DMAR:RMRR base: 0x000000bdffd000 end: 0x000000bdffff ff
May 3 11:55:04 erp kernel: DMAR:RMRR base: 0x000000bdff6000 end: 0x000000bdffcf ff
May 3 11:55:04 erp kernel: DMAR:RMRR base: 0x000000bdf83000 end: 0x000000bdf84f ff
May 3 11:55:04 erp kernel: DMAR:RMRR base: 0x000000bdf7f000 end: 0x000000bdf82f ff
May 3 11:55:04 erp kernel: DMAR:RMRR base: 0x000000bdf6f000 end: 0x000000bdf7ef ff
May 3 11:55:04 erp kernel: DMAR:RMRR base: 0x000000000f4000 end: 0x000000000f4f ff
May 3 11:55:04 erp kernel: DMAR:RMRR base: 0x000000000e8000 end: 0x000000000e8f ff
May 3 11:55:04 erp kernel: DMAR:ATSR flags: 0x0
May 3 11:55:04 erp kernel: DMAR:Device scope device [0000:00:1f.05] not found
May 3 11:55:04 erp last message repeated 9 times
May 3 11:55:04 erp kernel: PCI-GART: No AMD northbridge found.
May 3 11:55:04 erp kernel: pnp: 00:01: iomem range 0xf8ffe000-0xf8ffffff has be en reserved
May 3 11:55:04 erp kernel: pnp: 00:02: ioport range 0x408-0x40f has been reserv ed
May 3 11:55:04 erp kernel: pnp: 00:02: ioport range 0x4d0-0x4d1 has been reserv ed
May 3 11:55:04 erp kernel: pnp: 00:02: ioport range 0x310-0x315 has been reserv ed
May 3 11:55:04 erp kernel: pnp: 00:02: iomem range 0xc0000000-0xcfffffff has be en reserved
May 3 11:55:04 erp kernel: pnp: 00:02: iomem range 0xfe000000-0xfebfffff has be en reserved
May 3 11:55:04 erp kernel: pnp: 00:02: iomem range 0xfc000000-0xfc000fff has be en reserved
May 3 11:55:04 erp kernel: pnp: 00:02: iomem range 0xfed1c000-0xfed1ffff has be en reserved
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:01.0
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:01.1
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:02.0
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: d4000000-d40fffff
May 3 11:55:04 erp kernel: PREFETCH window 0x00000000fab00000-0x00000000fabff fff
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:02.1
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:02.2
May 3 11:55:04 erp kernel: IO window: 5000-5fff
May 3 11:55:04 erp kernel: MEM window: fbe00000-fbffffff
May 3 11:55:04 erp kernel: PREFETCH window 0x00000000d4100000-0x00000000d41ff fff
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:02.3
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:03.0
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:03.1
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:03.2
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:03.3
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:11.0
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:1c.0
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:04 erp kernel: PREFETCH window: disabled.
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:1c.7
May 3 11:55:04 erp kernel: IO window: 3000-3fff
May 3 11:55:04 erp kernel: MEM window: fad00000-fbdfffff
May 3 11:55:04 erp kernel: PREFETCH window 0x00000000f9000000-0x00000000f9fff fff
May 3 11:55:04 erp kernel: PCI: Bridge: 0000:00:1e.0
May 3 11:55:04 erp kernel: IO window: disabled.
May 3 11:55:04 erp kernel: MEM window: disabled.
May 3 11:55:05 erp kernel: PREFETCH window: disabled.
May 3 11:55:05 erp kernel: GSI 16 sharing vector 0xA9 and IRQ 16
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:01.1[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:02.1[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:02.2[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:02.3[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:03.0[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:03.1[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:03.2[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:03.3[A] -> GSI 45 (level , low) -> IRQ 169
May 3 11:55:05 erp kernel: GSI 17 sharing vector 0xB1 and IRQ 17
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:11.0[A] -> GSI 16 (level , low) -> IRQ 177
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level , low) -> IRQ 177
May 3 11:55:05 erp kernel: GSI 18 sharing vector 0xB9 and IRQ 18
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:1c.7[D] -> GSI 19 (level , low) -> IRQ 185
May 3 11:55:05 erp kernel: NET: Registered protocol family 2
May 3 11:55:05 erp kernel: IP route cache hash table entries: 524288 (order: 10 , 4194304 bytes)
May 3 11:55:05 erp kernel: TCP established hash table entries: 262144 (order: 1 0, 4194304 bytes)
May 3 11:55:05 erp kernel: TCP bind hash table entries: 65536 (order: 8, 104857 6 bytes)
May 3 11:55:05 erp kernel: TCP: Hash tables configured (established 262144 bind 65536)
May 3 11:55:05 erp kernel: TCP reno registered
May 3 11:55:05 erp kernel: audit: initializing netlink socket (disabled)
May 3 11:55:05 erp kernel: type=2000 audit(1462272774.892:1): initialized
May 3 11:55:05 erp kernel: Total HugeTLB memory allocated, 0
May 3 11:55:05 erp kernel: VFS: Disk quotas dquot_6.5.1
May 3 11:55:05 erp kernel: Dquot-cache hash table entries: 512 (order 0, 4096 b ytes)
May 3 11:55:05 erp kernel: Initializing Cryptographic API
May 3 11:55:05 erp kernel: alg: No test for crc32c (crc32c-generic)
May 3 11:55:05 erp kernel: ksign: Installing public key data
May 3 11:55:05 erp kernel: Loading keyring
May 3 11:55:05 erp kernel: - Added public key 48FDCD0C9217BB5E
May 3 11:55:05 erp kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)
May 3 11:55:05 erp kernel: io scheduler noop registered
May 3 11:55:05 erp kernel: io scheduler anticipatory registered
May 3 11:55:05 erp kernel: io scheduler deadline registered
May 3 11:55:05 erp kernel: io scheduler cfq registered (default)
May 3 11:55:05 erp kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
May 3 11:55:05 erp kernel: ACPI: CPU0 (power states: C1[C1] C2[C2])
May 3 11:55:05 erp kernel: ACPI: CPU1 (power states: C1[C1] C2[C2])
May 3 11:55:05 erp kernel: ACPI: CPU2 (power states: C1[C1] C2[C2])
May 3 11:55:05 erp kernel: ACPI: CPU3 (power states: C1[C1] C2[C2])
May 3 11:55:05 erp kernel: ACPI: Thermal Zone [THM0] (8 C)
May 3 11:55:05 erp kernel: Real Time Clock Driver v1.12ac
May 3 11:55:05 erp kernel: Non-volatile memory driver v1.2
May 3 11:55:05 erp kernel: Linux agpgart interface v0.101 (c) Dave Jones
May 3 11:55:05 erp kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
May 3 11:55:05 erp kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
May 3 11:55:05 erp kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
May 3 11:55:05 erp kernel: 00:08: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
May 3 11:55:05 erp kernel: brd: module loaded
May 3 11:55:05 erp kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00al pha2
May 3 11:55:05 erp kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
May 3 11:55:05 erp kernel: ide-floppy driver 0.99.newide
May 3 11:55:05 erp kernel: usbcore: registered new driver hiddev
May 3 11:55:05 erp kernel: usbcore: registered new driver usbhid
May 3 11:55:05 erp kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driv er
May 3 11:55:05 erp kernel: PNP: PS/2 Controller [PNP0303:KBD,PNP0f0e:PS2M] at 0 x60,0x64 irq 1,12
May 3 11:55:05 erp kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
May 3 11:55:05 erp kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
May 3 11:55:05 erp kernel: mice: PS/2 mouse device common for all mice
May 3 11:55:05 erp kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
May 3 11:55:05 erp kernel: md: bitmap version 4.39
May 3 11:55:05 erp kernel: TCP bic registered
May 3 11:55:05 erp kernel: Initializing IPsec netlink socket
May 3 11:55:05 erp kernel: NET: Registered protocol family 1
May 3 11:55:05 erp kernel: NET: Registered protocol family 17
May 3 11:55:05 erp kernel: ACPI: (supports S0 S4 S5)
May 3 11:55:05 erp kernel: Initalizing network drop monitor service
May 3 11:55:05 erp kernel: Freeing unused kernel memory: 224k freed
May 3 11:55:05 erp kernel: Write protecting the kernel read-only data: 530k
May 3 11:55:05 erp kernel: GSI 19 sharing vector 0x72 and IRQ 19
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 21 (level , low) -> IRQ 114
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1a.0: EHCI Host Controller
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1a.0: new USB bus registered, assig ned bus number 1
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1a.0: debug port 2
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1a.0: irq 114, io mem 0xfac60000
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1a.0: USB 2.0 started, EHCI 1.00, d river 10 Dec 2004
May 3 11:55:05 erp kernel: usb usb1: configuration #1 chosen from 1 choice
May 3 11:55:05 erp kernel: hub 1-0:1.0: USB hub found
May 3 11:55:05 erp kernel: hub 1-0:1.0: 2 ports detected
May 3 11:55:05 erp kernel: GSI 20 sharing vector 0x7A and IRQ 20
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 20 (level , low) -> IRQ 122
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1d.0: EHCI Host Controller
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1d.0: new USB bus registered, assig ned bus number 2
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1d.0: debug port 2
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1d.0: irq 122, io mem 0xfac50000
May 3 11:55:05 erp kernel: ehci_hcd 0000:00:1d.0: USB 2.0 started, EHCI 1.00, d river 10 Dec 2004
May 3 11:55:05 erp kernel: usb usb2: configuration #1 chosen from 1 choice
May 3 11:55:05 erp kernel: hub 2-0:1.0: USB hub found
May 3 11:55:05 erp kernel: hub 2-0:1.0: 2 ports detected
May 3 11:55:05 erp kernel: USB Universal Host Controller Interface driver v3.0
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:01:00.4[B] -> GSI 16 (level , low) -> IRQ 177
May 3 11:55:05 erp kernel: uhci_hcd 0000:01:00.4: UHCI Host Controller
May 3 11:55:05 erp kernel: uhci_hcd 0000:01:00.4: new USB bus registered, assig ned bus number 3
May 3 11:55:05 erp kernel: uhci_hcd 0000:01:00.4: port count misdetected? forci ng to 2 ports
May 3 11:55:05 erp kernel: uhci_hcd 0000:01:00.4: irq 177, io base 0x00003c00
May 3 11:55:05 erp kernel: usb usb3: configuration #1 chosen from 1 choice
May 3 11:55:05 erp kernel: hub 3-0:1.0: USB hub found
May 3 11:55:05 erp kernel: hub 3-0:1.0: 2 ports detected
May 3 11:55:05 erp kernel: usb 1-1: new high speed USB device using ehci_hcd an d address 2
May 3 11:55:05 erp kernel: SCSI subsystem initialized
May 3 11:55:05 erp kernel: HP CISS Driver (v 3.6.28-RH2)
May 3 11:55:05 erp kernel: GSI 21 sharing vector 0x82 and IRQ 21
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 34 (level , low) -> IRQ 130
May 3 11:55:05 erp kernel: cciss 0000:02:00.0: cciss: Trying to put board into performant mode
May 3 11:55:05 erp kernel: cciss 0000:02:00.0: Placing controller into performa nt mode
May 3 11:55:05 erp kernel: cciss/c0d0: p1 p2 p3 p4 < p5 >
May 3 11:55:05 erp kernel: usb 1-1: configuration #1 chosen from 1 choice
May 3 11:55:05 erp kernel: hub 1-1:1.0: USB hub found
May 3 11:55:05 erp kernel: hub 1-1:1.0: 6 ports detected
May 3 11:55:05 erp kernel: cciss/c0d1: p1
May 3 11:55:05 erp kernel: scsi0 : cciss
May 3 11:55:05 erp kernel: shpchp: Standard Hot Plug PCI Controller Driver vers ion: 0.4
May 3 11:55:05 erp kernel: Loading iSCSI transport class v2.0-871.
May 3 11:55:05 erp kernel: iscsi: registered transport (tcp)
May 3 11:55:05 erp kernel: loop: loaded (max 8 devices)
May 3 11:55:05 erp kernel: GSI 22 sharing vector 0xAA and IRQ 22
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 17 (level , low) -> IRQ 170
May 3 11:55:05 erp kernel: ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
May 3 11:55:05 erp kernel: scsi1 : ata_piix
May 3 11:55:05 erp kernel: scsi2 : ata_piix
May 3 11:55:05 erp kernel: ata1: SATA max UDMA/133 cmd 0x4000 ctl 0x4008 bmdma 0x4020 irq 170
May 3 11:55:05 erp kernel: ata2: SATA max UDMA/133 cmd 0x4010 ctl 0x4018 bmdma 0x4028 irq 170
May 3 11:55:05 erp kernel: usb 2-1: new high speed USB device using ehci_hcd an d address 2
May 3 11:55:05 erp kernel: usb 2-1: configuration #1 chosen from 1 choice
May 3 11:55:05 erp kernel: hub 2-1:1.0: USB hub found
May 3 11:55:05 erp kernel: hub 2-1:1.0: 8 ports detected
May 3 11:55:05 erp kernel: ata1: SATA link down (SStatus 0 SControl 0)
May 3 11:55:05 erp kernel: usb 2-1.3: new high speed USB device using ehci_hcd and address 3
May 3 11:55:05 erp kernel: usb 2-1.3: configuration #1 chosen from 1 choice
May 3 11:55:05 erp kernel: hub 2-1.3:1.0: USB hub found
May 3 11:55:05 erp kernel: hub 2-1.3:1.0: 2 ports detected
May 3 11:55:05 erp kernel: usb usb3: Controller not stopped yet!
May 3 11:55:05 erp kernel: ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 0)
May 3 11:55:05 erp kernel: ata2.00: ATAPI: hp DVD A DS8A9SH, EHJ4, max UD MA/100
May 3 11:55:05 erp kernel: ata2.00: configured for UDMA/100
May 3 11:55:05 erp kernel: Vendor: hp Model: DVD A DS8A9SH Rev: EH J4
May 3 11:55:05 erp kernel: Type: CD-ROM ANSI SC SI revision: 05
May 3 11:55:05 erp kernel: sr0: scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw x a/form2 cdda tray
May 3 11:55:05 erp kernel: Uniform CD-ROM driver Revision: 3.20
May 3 11:55:05 erp kernel: device-mapper: uevent: version 1.0.3
May 3 11:55:05 erp kernel: device-mapper: ioctl: 4.11.6-ioctl (2011-02-18) init ialised: dm-devel@redhat.com
May 3 11:55:05 erp kernel: device-mapper: dm-raid45: initialized v0.2594l
May 3 11:55:05 erp kernel: EXT3-fs: INFO: recovery required on readonly filesys tem.
May 3 11:55:05 erp kernel: EXT3-fs: write access will be enabled during recover y.
May 3 11:55:05 erp kernel: kjournald starting. Commit interval 5 seconds
May 3 11:55:05 erp kernel: EXT3-fs: cciss/c0d0p3: orphan cleanup on readonly fs
May 3 11:55:05 erp kernel: EXT3-fs: cciss/c0d0p3: 4 orphan inodes deleted
May 3 11:55:05 erp kernel: EXT3-fs: recovery complete.
May 3 11:55:05 erp kernel: EXT3-fs: mounted filesystem with ordered data mode.
May 3 11:55:05 erp kernel: SELinux: Disabled at runtime.
May 3 11:55:05 erp kernel: type=1404 audit(1462272799.749:2): selinux=0 auid=42 94967295 ses=4294967295
May 3 11:55:05 erp kernel: Floppy drive(s): fd0 is 1.44M
May 3 11:55:05 erp kernel: tg3.c:v3.119 (May 18, 2011)<6>GSI 23 sharing vector 0xB2 and IRQ 23
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 32 (level , low) -> IRQ 178
May 3 11:55:05 erp kernel: tg3 0000:03:00.0: eth0: eth0: Tigon3 [partno(629133- 001) rev 5719001 PHY(5719C)] (PCI Express) 10/100/1000Base-T Ethernet d8:9d:67:2 6:a7:54
May 3 11:55:05 erp kernel: tg3 0000:03:00.0: eth0: RXcsums[1] LinkChgREG[0] MIi rq[0] ASF[1] TSOcap[1]
May 3 11:55:05 erp kernel: tg3 0000:03:00.0: eth0: dma_rwctrl[00000001] dma_mas k[64-bit]
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:01:00.2[B] -> GSI 16 (level , low) -> IRQ 177
May 3 11:55:05 erp kernel: GSI 24 sharing vector 0xBA and IRQ 24
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:03:00.1[B] -> GSI 36 (level , low) -> IRQ 186
May 3 11:55:05 erp kernel: tg3 0000:03:00.1: eth1: eth1: Tigon3 [partno(629133- 001) rev 5719001 PHY(5719C)] (PCI Express) 10/100/1000Base-T Ethernet d8:9d:67:2 6:a7:55
May 3 11:55:05 erp kernel: tg3 0000:03:00.1: eth1: RXcsums[1] LinkChgREG[0] MIi rq[0] ASF[1] TSOcap[1]
May 3 11:55:05 erp kernel: tg3 0000:03:00.1: eth1: dma_rwctrl[00000001] dma_mas k[64-bit]
May 3 11:55:05 erp kernel: input: PC Speaker as /class/input/input0
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:03:00.2[A] -> GSI 32 (level , low) -> IRQ 178
May 3 11:55:05 erp kernel: tg3 0000:03:00.2: eth2: eth2: Tigon3 [partno(629133- 001) rev 5719001 PHY(5719C)] (PCI Express) 10/100/1000Base-T Ethernet d8:9d:67:2 6:a7:56
May 3 11:55:05 erp kernel: tg3 0000:03:00.2: eth2: RXcsums[1] LinkChgREG[0] MIi rq[0] ASF[1] TSOcap[1]
May 3 11:55:05 erp kernel: tg3 0000:03:00.2: eth2: dma_rwctrl[00000001] dma_mas k[64-bit]
May 3 11:55:05 erp kernel: ACPI: PCI Interrupt 0000:03:00.3[B] -> GSI 36 (level , low) -> IRQ 186
May 3 11:55:05 erp kernel: tg3 0000:03:00.3: eth3: eth3: Tigon3 [partno(629133- 001) rev 5719001 PHY(5719C)] (PCI Express) 10/100/1000Base-T Ethernet d8:9d:67:2 6:a7:57
May 3 11:55:05 erp kernel: tg3 0000:03:00.3: eth3: RXcsums[1] LinkChgREG[0] MIi rq[0] ASF[1] TSOcap[1]
May 3 11:55:05 erp kernel: tg3 0000:03:00.3: eth3: dma_rwctrl[00000001] dma_mas k[64-bit]
May 3 11:55:05 erp kernel: sr 2:0:0:0: Attached scsi generic sg0 type 5
May 3 11:55:05 erp kernel: floppy0: no floppy controllers found
May 3 11:55:05 erp kernel: work still pending
May 3 11:55:05 erp kernel: kvm: virtualization flags detected on this hardware: vmx tpr_shadow vnmi flexpriority ept vpid
May 3 11:55:05 erp kernel: loaded kvm module (kvm-83-249.0.1.el5)
May 3 11:55:05 erp kernel: ksm loaded
May 3 11:55:05 erp kernel: Floppy drive(s): fd0 is 1.44M
May 3 11:55:05 erp kernel: floppy0: no floppy controllers found
May 3 11:55:05 erp kernel: work still pending
May 3 11:55:05 erp kernel: lp: driver loaded but no devices found
May 3 11:55:05 erp kernel: NET: Registered protocol family 10
May 3 11:55:05 erp kernel: lo: Disabled Privacy Extensions
May 3 11:55:05 erp kernel: IPv6 over IPv4 tunneling driver
May 3 11:55:05 erp kernel: sit0: Disabled Privacy Extensions
May 3 11:55:05 erp kernel: mtrr: type mismatch for f9000000,800000 old: uncacha ble new: write-combining
May 3 11:55:05 erp kernel: mtrr: type mismatch for f97e0000,10000 old: uncachab le new: write-combining
May 3 11:55:05 erp kernel: mtrr: type mismatch for f97c0000