gc cr block lost
Dear all
We hava an 10.2.0.4 RAC running on AIX 6.1, we found a lot “gc cr block lost” in awr report.
How to resolve this problem?
Event Waits Time (s) (ms) Time Wait Class
------------------------------ ------------ ----------- ------ ------ ----------
log file sync 171,333 288 2 66.1 Commit
log file parallel write 170,780 240 1 55.2 System I/O
CPU time 229 52.7
gc cr block lost 61 46 755 10.6 Cluster
db file parallel write 45,676 31 1 7.2 System I/O
flowing is result of netstat -s
#netstat -s
icmp:
1501240 calls to icmp_error
0 errors not generated because old message was icmp
Output histogram:
echo reply: 48022
destination unreachable: 1478355
echo: 3672830
0 messages with bad code fields
0 messages < minimum length
0 bad checksums
0 messages with bad length
Input histogram:
echo reply: 3671367
destination unreachable: 1586471
echo: 48049
48022 message responses generated
igmp:
0 messages received
0 messages received with too few bytes
0 messages received with bad checksum
0 membership queries received
0 membership queries received with invalid field(s)
0 membership reports received
0 membership reports received with invalid field(s)
0 membership reports received for groups to which we belong
8 membership reports sent
tcp:
74915651 packets sent
57060778 data packets (138705942737 bytes)
33462 data packets (37970884 bytes) retransmitted
5375289 ack-only packets (4239002 delayed)
0 URG only packets
5 window probe packets
11436565 window update packets
2019104 control packets
5526504 large sends
132996311078 bytes sent using largesend
2085120 bytes is the biggest largesend
107952244 packets received
61900612 acks (for 138706680574 bytes)
418658 duplicate acks
0 acks for unsent data
89624245 packets (70001950782 bytes) received in-sequence
4743 completely duplicate packets (818002 bytes)
0 old duplicate packets
17 packets with some dup. data (4248 bytes duped)
302994 out-of-order packets (30842613 bytes)
32 packets (32 bytes) of data after window
32 window probes
286783 window update packets
6552 packets received after close
0 packets with bad hardware assisted checksum
0 discarded for bad checksums
0 discarded for bad header offset fields
0 discarded because packet too short
492 discarded by listeners
0 discarded due to listener's queue full
11878766 ack packet headers correctly predicted
44728305 data packet headers correctly predicted
322438 connection requests
278463 connection accepts
556834 connections established (including accepts)
604193 connections closed (including 2346 drops)
0 connections with ECN capability
0 times responded to ECN
36 embryonic connections dropped
62169023 segments updated rtt (of 57866592 attempts)
0 segments with congestion window reduced bit set
0 segments with congestion experienced bit set
0 resends due to path MTU discovery
44036 path MTU discovery terminations due to retransmits
156798 retransmit timeouts
0 connections dropped by rexmit timeout
9058 fast retransmits
6049 when congestion window less than 4 segments
5 newreno retransmits
156 times avoided false fast retransmits
0 persist timeouts
0 connections dropped due to persist timeout
2859 keepalive timeouts
0 keepalive probes sent
0 connections dropped by keepalive
0 times SACK blocks array is extended
0 times SACK holes array is extended
0 packets dropped due to memory allocation failure
1 connection in timewait reused
0 delayed ACKs for SYN
0 delayed ACKs for FIN
0 send_and_disconnects
0 spliced connections
0 spliced connections closed
0 spliced connections reset
0 spliced connections timeout
0 spliced connections persist timeout
0 spliced connections keepalive timeout
0 TCP checksum offload disabled during retransmit
0 Connections dropped due to bad ACKs
0 Connections dropped due to duplicate SYN packets
0 fastpath loopback connections
0 fastpath loopback sent packets (0 bytes)
0 fastpath loopback received packets (0 bytes)
udp:
147486199 datagrams received
0 incomplete headers
0 bad data length fields
0 bad checksums
1562482 dropped due to no socket
5229040 broadcast/multicast datagrams dropped due to no socket
0 socket buffer overflows
140694677 delivered
144251657 datagrams output
ip:
272497723 total packets received
0 bad header checksums
0 with size smaller than minimum
0 with data size < data length
0 with header length < data size
0 with data length < header length
0 with bad options
0 with incorrect version number
14418667 fragments received
0 fragments dropped (dup or out of space)
254148 fragments dropped after timeout
2750080 packets reassembled ok
255570679 packets for this host
5112394 packets for unknown/unsupported protocol
0 packets forwarded
23568 packets not forwardable
0 redirects sent
224311858 packets sent from this host
0 packets sent with fabricated ip header
0 output packets dropped due to no bufs, etc.
0 output packets discarded due to no route
4173773 output datagrams fragmented
21581265 fragments created
0 datagrams that can't be fragmented
0 IP Multicast packets dropped due to no receiver
0 successful path MTU discovery cycles
0 path MTU rediscovery cycles attempted
0 path MTU discovery no-response estimates
0 path MTU discovery response timeouts
0 path MTU discovery decreases detected
0 path MTU discovery packets sent
0 path MTU discovery memory allocation failures
0 ipintrq overflows
0 with illegal source
0 packets processed by threads
0 packets dropped by threads
0 packets dropped due to the full socket receive buffer
0 dead gateway detection packets sent
0 dead gateway detection packet allocation failures
0 dead gateway detection gateway allocation failures
0 incoming packets dropped due to MLS filters
0 packets not sent due to MLS filters
ipv6:
122495 total packets received
Input histogram:
TCP: 14
UDP: 61243
ICMP v6: 61238
0 with size smaller than minimum
0 with data size < data length
0 with incorrect version number
0 with illegal source
0 input packets without enough memory
0 fragments received
0 fragments dropped (dup or out of space)
0 fragments dropped after timeout
0 packets reassembled ok
122495 packets for this host
0 packets for unknown/unsupported protocol
0 packets forwarded
0 packets not forwardable
0 too big packets not forwarded
120071 packets sent from this host
0 packets sent with fabricated ipv6 header
0 output packets dropped due to no bufs
0 output packets without enough memory
7858 output packets discarded due to no route
0 output datagrams fragmented
0 fragments created
0 packets dropped due to full socket receive buffer
0 packets not delivered due to bad raw IPv6 checksum
0 incoming packets dropped due to MLS filters
0 packets not sent due to MLS filters
icmpv6:
61242 calls to icmp6_error
0 errors not generated because old message was icmpv6
Output histogram:
unreachable: 61238
packets too big: 0
time exceeded: 0
parameter problems: 0
redirects: 0
echo requests: 0
echo replies: 0
group queries: 0
group reports: 0
group terminations: 0
router solicitations: 0
router advertisements: 0
neighbor solicitations: 0
neighbor advertisements: 0
0 messages with bad code fields
0 messages < minimum length
0 bad checksums
0 messages with bad length
Input histogram:
unreachable: 61238
packets too big: 0
time exceeded: 0
parameter problems: 0
echo requests: 0
echo replies: 0
group queries: 0
bad group queries: 0
group reports: 0
bad group reports: 0
our groups' reports: 0
group terminations: 0
bad group terminations: 0
router solicitations: 0
bad router solicitations: 0
router advertisements: 0
bad router advertisements: 0
neighbor solicitations: 0
bad neighbor solicitations: 0
neighbor advertisements: 0
bad neighbor advertisements: 0
redirects: 0
bad redirects: 0
mobility calls when not started: 0
home agent address discovery requests: 0
bad home agent address discovery requests: 0
bad home agent address discovery replys: 0
bad home agent address discovery replys: 0
prefix solicitations: 0
bad prefix solicitations: 0
prefix advertisements: 0
bad prefix advertisements: 0
0 message responses generated