Database Software

1a. On primary db:
===============
OS: Windows 2003 server 32-bit
Oracle: Oracle 10g (10.2.0.1.0) R2 32-bit
Problem: Logs are being received on standby site but not being applied. Some parmaeters and queries are:

1b. tnsnames.ora:
==============
CWO =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = PROJSVR)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = CWO)
)
)

STANDBY =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = BACKUP)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = CWO)
)
)

1c. SPFILE: (Important parameters only
======================================
COMPATIBLE='10.2.0.1.0'
CONTROL_FILES='D:\ORACLE\ORADATA\CF1\CONTROL01.CTL','D:\ORACLE\ORADATA\CF2\CONTROL02.CTL','D:\ORACLE\ORADATA\CF3\CONTROL03.CTL'
DB_DOMAIN=''
DB_NAME='CWO'
DB_UNIQUE_NAME='CWO'
LOG_ARCHIVE_DEST_1='LOCATION=E:\ARCH MANDATORY REOPEN=30'
LOG_ARCHIVE_DEST_2='SERVICE=STANDBY DB_UNIQUE_NAME=CWO REOPEN=30'
LOG_ARCHIVE_DEST_STATE_1='ENABLE'
LOG_ARCHIVE_CONFIG=’’
LOG_ARCHIVE_MAX_PROCESSES=10
LOG_CHECKPOINTS_TO_ALERT=TRUE
REMOTE_LOGIN_PASSWORDFILE='EXCLUSIVE'
STANDBY_FILE_MANAGEMENT='AUTO'
STANDBY_ARCHIVE_DEST= %ORACLE_HOME%\RDBMS
FAL_SERVER=’’
FAL_CLIENT=’’

1d. Some lines of alert file from main db
=========================================

Mon May 14 10:29:55 2012
Thread 1 advanced to log sequence 453
Current log# 2 seq# 453 mem# 0: D:\ORACLE\ORADATA\OLRLFG2\REDO02.LOG
Mon May 14 10:40:07 2012
ARCi: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
ARCi: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
PING[ARCi]: Error 3113 when pinging standby STANDBY.
Mon May 14 10:45:08 2012
Error 12514 received logging on to the standby
Mon May 14 10:45:08 2012
Errors in file d:\oracle\product\10.2.0\admin\cwo\bdump\cwo_arci_3340.trc:
ORA-12514: TNS:listener does not currently know of service requested in connect descriptor

PING[ARCi]: Heartbeat failed to connect to standby 'STANDBY'. Error is 12514.
Mon May 14 10:51:59 2012
WARNING: inbound connection timed out (ORA-3136)
Mon May 14 10:58:26 2012
Thread 1 cannot allocate new log, sequence 454
Private strand flush not complete
Current log# 2 seq# 453 mem# 0: D:\ORACLE\ORADATA\OLRLFG2\REDO02.LOG
Thread 1 advanced to log sequence 454
Current log# 3 seq# 454 mem# 0: D:\ORACLE\ORADATA\OLRLFG3\REDO03.LOG
Mon May 14 11:09:15 2012
ARCi: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
ARCi: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
PING[ARCi]: Error 3113 when pinging standby STANDBY.
Mon May 14 11:14:15 2012
Error 12528 received logging on to the standby
Mon May 14 11:14:16 2012
Errors in file d:\oracle\product\10.2.0\admin\cwo\bdump\cwo_arci_3340.trc:
ORA-12528: TNS:listener: all appropriate instances are blocking new connections

PING[ARCi]: Heartbeat failed to connect to standby 'STANDBY'. Error is 12528.
Mon May 14 11:19:11 2012
Memory Notification: Library Cache Object loaded into SGA
Heap size 2267K exceeds notification threshold (2048K)
KGL object name :XDB.XDbD/PLZ01TcHgNAgAIIegtw==

Mon May 14 11:41:06 2012
Thread 1 cannot allocate new log, sequence 455
Private strand flush not complete
Current log# 3 seq# 454 mem# 0: D:\ORACLE\ORADATA\OLRLFG3\REDO03.LOG
Thread 1 advanced to log sequence 455
Current log# 1 seq# 455 mem# 0: D:\ORACLE\ORADATA\OLRLFG1\REDO01.LOG
Mon May 14 11:42:19 2012
Thread 1 advanced to log sequence 456
Current log# 2 seq# 456 mem# 0: D:\ORACLE\ORADATA\OLRLFG2\REDO02.LOG
Mon May 14 11:42:56 2012
Errors in file d:\oracle\product\10.2.0\admin\cwo\udump\cwo_ora_1120.trc:
ORA-00600: internal error code, arguments: [krbb2ec_stamp_mismtach], [577], [781012849], [], [], [], [], []

Mon May 14 11:59:14 2012
Thread 1 cannot allocate new log, sequence 457
Private strand flush not complete
Current log# 2 seq# 456 mem# 0: D:\ORACLE\ORADATA\OLRLFG2\REDO02.LOG
Thread 1 advanced to log sequence 457
Current log# 3 seq# 457 mem# 0: D:\ORACLE\ORADATA\OLRLFG3\REDO03.LOG
Mon May 14 11:59:43 2012
Thread 1 advanced to log sequence 458
Current log# 1 seq# 458 mem# 0: D:\ORACLE\ORADATA\OLRLFG1\REDO01.LOG
Mon May 14 12:08:09 2012
Thread 1 cannot allocate new log, sequence 459
Private strand flush not complete
Current log# 1 seq# 458 mem# 0: D:\ORACLE\ORADATA\OLRLFG1\REDO01.LOG
Thread 1 advanced to log sequence 459
Current log# 2 seq# 459 mem# 0: D:\ORACLE\ORADATA\OLRLFG2\REDO02.LOG
Mon May 14 12:08:23 2012
Starting control autobackup
Mon May 14 12:08:25 2012
Errors in file d:\oracle\product\10.2.0\admin\cwo\udump\cwo_ora_1120.trc:

Mon May 14 12:08:25 2012
Errors in file d:\oracle\product\10.2.0\admin\cwo\udump\cwo_ora_1120.trc:

Mon May 14 12:08:25 2012
Errors in file d:\oracle\product\10.2.0\admin\cwo\udump\cwo_ora_1120.trc:

Control autobackup written to DISK device
handle 'E:\RMANBK\CF\CTL_SP_CWO_C-3010941875-20120514-00'
Mon May 14 12:08:29 2012
alter database backup controlfile to trace as 'e:\rmanbk\cf\cf_cwo.txt'
Mon May 14 12:08:29 2012
Completed: alter database backup controlfile to trace as 'e:\rmanbk\cf\cf_cwo.txt'
Mon May 14 12:27:07 2012
ARCi: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
ARCi: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
PING[ARCi]: Error 3113 when pinging standby STANDBY.
Mon May 14 13:36:51 2012
WARNING: inbound connection timed out (ORA-3136)
Mon May 14 15:02:25 2012
WARNING: inbound connection timed out (ORA-3136)
Mon May 14 22:00:09 2012
Thread 1 advanced to log sequence 460
Current log# 3 seq# 460 mem# 0: D:\ORACLE\ORADATA\OLRLFG3\REDO03.LOG
Mon May 14 23:00:50 2012
Thread 1 advanced to log sequence 461
Current log# 1 seq# 461 mem# 0: D:\ORACLE\ORADATA\OLRLFG1\REDO01.LOG
Tue May 15 08:20:05 2012
Thread 1 advanced to log sequence 462
Current log# 2 seq# 462 mem# 0: D:\ORACLE\ORADATA\OLRLFG2\REDO02.LOG
Tue May 15 08:25:05 2012
Thread 1 advanced to log sequence 463
Current log# 3 seq# 463 mem# 0: D:\ORACLE\ORADATA\OLRLFG3\REDO03.LOG


2a. On standby db:
===============
OS: Windows 2003 server 32-bit
Oracle: Oracle 10g (10.2.0.1.0) R2 32-bit

2b. tnsnames.ora:
==============
CWO =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = BACKUP)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = CWO)
)
)

2c. SPFILE: (Important parameters only
======================================
CONTROL_FILES='E:\STANDBY\SBCF_STANDBY.CTL'
DB_DOMAIN=''
DB_NAME='CWO'
LOG_ARCHIVE_DEST_1='LOCATION=E:\ARCH MANDATORY REOPEN=30'
LOG_ARCHIVE_DEST_2='SERVICE=CWO DB_UNIQUE_NAME=CWO REOPEN=30'
LOG_ARCHIVE_DEST_STATE_1='ENABLE'
LOG_CHECKPOINTS_TO_ALERT=TRUE
REMOTE_LOGIN_PASSWORDFILE='EXCLUSIVE'
STANDBY_FILE_MANAGEMENT='AUTO'
STANDBY_ARCHIVE_DEST='E:\ARCH '
INSTANCE_NAME=CWO FAL_SERVER=’’
FAL_CLIENT=’’
FAL_CLIENT=’’

standby>

PROCESS PID STATUS CLIENT_P CLIENT_PID CLIENT_DBID GROUP# RESETLOG_ID THREAD# SEQUENCE# BLOCK# BLOCKS DELAY_MINS KNOWN_AGENTS ACTIVE_AGENTS
--------- --------- ------------ -------- ---------------------------------------- ---------------------------------------- ---------------------------------------- ----------- --------- --------- --------- --------- ---------- ------------ -------------
ARCH 4088 CONNECTED ARCH 4088 3010941875 N/A 0 0 0 0 0 0 0 0
ARCH 3080 CONNECTED ARCH 3080 3010941875 N/A 0 0 0 0 0 0 0 0
ARCH 2452 CONNECTED ARCH 2452 3010941875 N/A 0 0 0 0 0 0 0 0
ARCH 2668 CONNECTED ARCH 2668 3010941875 N/A 0 0 0 0 0 0 0 0
ARCH 1296 CONNECTED ARCH 1296 3010941875 N/A 0 0 0 0 0 0 0 0
ARCH 2020 CONNECTED ARCH 2020 3010941875 N/A 0 0 0 0 0 0 0 0
RFS 900 IDLE N/A 3340 3010941875 N/A 0 0 0 0 0 0 0 0
RFS 3424 IDLE UNKNOWN 3336 3010941875 N/A 0 0 0 0 0 0 0 0
RFS 3304 IDLE UNKNOWN 3352 3010941875 N/A 0 0 0 0 0 0 0 0
RFS 2276 IDLE UNKNOWN 3364 3010941875 N/A 0 0 0 0 0 0 0 0
RFS 3432 IDLE UNKNOWN 3368 3010941875 N/A 0 0 0 0 0 0 0 0
RFS 3712 IDLE UNKNOWN 3376 3010941875 N/A 0 0 0 0 0 0 0 0


standby> select*from v$dataguard_stats;

NAME VALUE
-------------------------------- ------------
apply finish time
apply lag
estimated startup time 64
standby has been open N
transport lag

standby> select*from v$standby_log;

GROUP# DBID THREAD# SEQUENCE# BYTES USED ARC STATUS FIRST_CHANGE# FIRST_TIM LAST_CHANGE# LAST_TIME
--------- ---------------------------------------- --------- --------- --------- --------- --- ---------- ------------- --------- ------------ ---------
4 UNASSIGNED 2 0

select *from v$archive_dest_status;

DEST_ID STATUS TYPE DATABASE_MODE RECOVERY_MODE
--------- --------- -------------- --------------- -------------
1 VALID PHYSICAL MOUNTED-STANDBY IDLE
2 ERROR PHYSICAL MOUNTED-STANDBY IDLE

select facility, severity,message from v$dataguard_status;

FACILITY SEVERITY MESSAGE
------------------------ ------------- ------------------------------------------------------------------------------
Log Transport Services Informational ARCp: Archival started
Log Transport Services Informational ARCq: Archival started
Log Transport Services Informational ARCr: Archival started
Log Transport Services Informational ARCs: Archival started
Log Transport Services Informational ARCt: Archival started
Log Transport Services Informational ARCd: Becoming the 'no FAL' ARCH
Log Transport Services Informational ARCd: Becoming the 'no SRL' ARCH
Log Transport Services Informational ARCi: Becoming the heartbeat ARCH
Log Transport Services Error Error 12514 received logging on to the standby
Fetch Archive Log Error FAL[server, ARC0]: Error 12514 creating remote archivelog file 'STANDBY'
Log Transport Services Warning ARCi: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
Log Transport Services Warning ARCi: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Log Transport Services Error PING[ARCi]: Error 3113 when pinging standby STANDBY.
Log Transport Services Error Error 12514 received logging on to the standby
Log Transport Services Error PING[ARCi]: Heartbeat failed to connect to standby 'STANDBY'. Error is 12514.
Log Transport Services Warning ARCi: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
Log Transport Services Warning ARCi: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Log Transport Services Error PING[ARCi]: Error 3113 when pinging standby STANDBY.
Log Transport Services Error Error 12528 received logging on to the standby
Log Transport Services Error PING[ARCi]: Heartbeat failed to connect to standby 'STANDBY'. Error is 12528.
Log Transport Services Warning ARCi: Attempting destination LOG_ARCHIVE_DEST_2 network reconnect (3113)
Log Transport Services Warning ARCi: Destination LOG_ARCHIVE_DEST_2 network reconnect abandoned
Log Transport Services Error PING[ARCi]: Error 3113 when pinging standby STANDBY.