Primary:PRDDB
Standby:PRDDBSTBY
Primary DB:
alert log:
Thu Mar 05 10:14:05 2015
Error 1033 received logging on to the standby
PING[ARC2]: Heartbeat failed to connect to standby '(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=dbprod2.cloud.co.uk)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)
(SERVICE_NAME=PRDDBSTBY.cloud.co.uk)))'. Error is 1033.
Trace file:
Unix process pid: 13185, image: oracle@iddbprod1.cloud.co.uk (ARC2)
*** 2015-03-05 10:10:59.517
*** SESSION ID:(2650.1) 2015-03-05 10:10:59.517
*** CLIENT ID:() 2015-03-05 10:10:59.517
*** SERVICE NAME:() 2015-03-05 10:10:59.517
*** MODULE NAME:() 2015-03-05 10:10:59.517
*** ACTION NAME:() 2015-03-05 10:10:59.517
OCISessionBegin failed. Error -1
.. Detailed OCI error val is 1017 and errmsg is 'ORA-01017: invalid username/password; logon denied
'
*** 2015-03-05 10:11:00.553
OCISessionBegin failed. Error -1
.. Detailed OCI error val is 1017 and errmsg is 'ORA-01017: invalid username/password; logon denied
'
*** 2015-03-05 10:11:01.590
OCISessionBegin failed -1
.. Detailed OCI error val is 1017 and errmsg is 'ORA-01017: invalid username/password; logon denied
'
OCISessionBegin failed. Error -1
.. Detailed OCI error val is 1033 and errmsg is 'ORA-01033: ORACLE initialization or shutdown in progress
'
*** 2015-03-05 10:11:01.626 4338 krsh.c
Error 1033 received logging on to the standby
=============================
PRDDB.__db_cache_size=5301600256
PRDDB.__java_pool_size=33554432
PRDDB.__large_pool_size=50331648
PRDDB.__oracle_base='/u01/app/oracle'#ORACLE_BASE set from environment
PRDDB.__pga_aggregate_target=2130706432
PRDDB.__sga_target=6392119296
PRDDB.__shared_io_pool_size=0
PRDDB.__shared_pool_size=956301312
PRDDB.__streams_pool_size=0
*.audit_file_dest='/u01/app/oracle/admin/PRDDB/adump'
*.audit_trail='db'
*.compatible='11.2.0.4.0'
*.control_files='/u02/app/oracle/oradata/PRDDB/control01.ctl','/u01/app/oracle/fast_recovery_area/PRDDB/control02.ctl'
*.db_block_size=8192
*.db_domain='cloud.co.uk'
*.db_name='PRDDB'
*.db_recovery_file_dest='/u01/app/oracle/fast_recovery_area'
*.db_recovery_file_dest_size=4385144832
*.diagnostic_dest='/u01/app/oracle'
*.dispatchers='(PROTOCOL=TCP) (SERVICE=PRDDBXDB)'
*.fal_server='PRDDBSTBY'
*.java_jit_enabled=TRUE
*.local_listener='(ADDRESS=(PROTOCOL=TCP)(HOST=dbprod1.cloud.co.uk)(PORT=1521))'
*.log_archive_config='DG_CONFIG=(PRDDB,PRDDBSTBY)'
*.log_archive_dest_1='location=/u03/app/oracle/archive/PRDDB valid_for=(all_logfiles,all_roles) db_unique_name=PRDDB'
*.log_archive_dest_2='service="(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=dbprod2.cloud.co.uk)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=PRDDBSTBY.cloud.co.uk)))", LGWR
SYNC AFFIRM db_unique_name="PRDDBSTBY"'
*.log_archive_dest_state_2='ENABLE'
*.log_archive_format='%t_%s_%r.arc'
*.log_archive_max_processes=30
*.open_cursors=1000
*.pga_aggregate_target=2126512128
*.processes=2000
*.remote_login_passwordfile='EXCLUSIVE'
*.sga_target=6381633536
*.standby_file_management='AUTO'
*.undo_tablespace='UNDOTBS1'
========================================
sqlplus sys/pass@PRDDB as sysdba
SQL*Plus: Release 11.2.0.4.0 Production on Thu Mar 5 10:22:17 2015
Copyright (c) 1982, 2013, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
SQL>
sqlplus sys/pass@PRDDBSTBY as sysdba
SQL*Plus: Release 11.2.0.4.0 Production on Thu Mar 5 10:22:48 2015
Copyright (c) 1982, 2013, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
SQL>
================
tnsping PRDDBSTBY
TNS Ping Utility for Linux: Version 11.2.0.4.0 - Production on 05-MAR-2015 10:23:44
Copyright (c) 1997, 2013, Oracle. All rights reserved.
Used parameter files:
/u01/app/oracle/product/11.2.0/dbhome_1/network/admin/sqlnet.ora
Used TNSNAMES adapter to resolve the alias
Attempting to contact (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = dbprod2.cloud.co.uk)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = PRDDBSTBY.cloud.co.uk)))
OK (0 msec)
tnsping PRDDB
TNS Ping Utility for Linux: Version 11.2.0.4.0 - Production on 05-MAR-2015 10:24:49
Copyright (c) 1997, 2013, Oracle. All rights reserved.
Used parameter files:
/u01/app/oracle/product/11.2.0/dbhome_1/network/admin/sqlnet.ora
Used TNSNAMES adapter to resolve the alias
Attempting to contact (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = dbprod1.cloud.co.uk)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = PRDDB.cloud.co.uk)))
OK (0 msec)
=======================================================
cat listener.ora
# listener.ora Network Configuration File: /u01/app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
# Generated by Oracle configuration tools.
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(GLOBAL_DBNAME =PRDDB.cloud.co.uk)
(ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_1)
(SID_NAME = PRDDB )
)
PRDDB =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = dbprod1.cloud.co.uk)(PORT = 1521))
)
)
ADR_BASE_LISTENER = /u01/app/oracle
cat tnsnames.ora
# tnsnames.ora Network Configuration File: /u01/app/oracle/product/11.2.0/dbhome_1/network/admin/tnsnames.ora
# Generated by Oracle configuration tools.
PRDDB =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = dbprod1.cloud.co.uk)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = PRDDB.cloud.co.uk)
)
)
PRDDBSTBY =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = dbprod2.cloud.co.uk)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = PRDDBSTBY.cloud.co.uk)
)
)
======================================================
STANDBY server:
cat initPRDDBSTBY.ora
PRDDB.__db_cache_size=5301600256
PRDDBSTBY.__db_cache_size=4546625536
PRDDB.__java_pool_size=33554432
PRDDBSTBY.__java_pool_size=33554432
PRDDB.__large_pool_size=50331648
PRDDBSTBY.__large_pool_size=805306368
PRDDB.__oracle_base='/u01/app/oracle'#ORACLE_BASE set from environment
PRDDB.__pga_aggregate_target=2130706432
PRDDBSTBY.__pga_aggregate_target=2130706432
PRDDB.__sga_target=6392119296
PRDDBSTBY.__sga_target=6392119296
PRDDB.__shared_io_pool_size=0
PRDDBSTBY.__shared_io_pool_size=0
PRDDB.__shared_pool_size=956301312
PRDDBSTBY.__shared_pool_size=956301312
PRDDB.__streams_pool_size=0
PRDDBSTBY.__streams_pool_size=0
*.audit_file_dest='/u01/app/oracle/admin/PRDDB/adump'
*.audit_trail='db'
*.compatible='11.2.0.4.0'
*.control_files='/u02/app/oracle/oradata/PRDDB/control01.ctl','/u01/app/oracle/fast_recovery_area/PRDDB/control02.ctl'
*.db_block_size=8192
*.db_domain='cloud.co.uk'
*.db_name='PRDDB'
*.db_recovery_file_dest='/u01/app/oracle/fast_recovery_area'
*.db_recovery_file_dest_size=4385144832
*.db_unique_name='PRDDBSTBY'
*.diagnostic_dest='/u01/app/oracle'
*.dispatchers='(PROTOCOL=TCP) (SERVICE=PRDDBXDB)'
*.fal_client='PRDDBSTBY'
*.fal_server='PRDDB'
*.java_jit_enabled=TRUE
*.local_listener='(ADDRESS=(PROTOCOL=TCP)(HOST=iddbprod2.cloud.co.uk)(port=1521))'
*.log_archive_config='DG_CONFIG=(PRDDB,PRDDBSTBY)'
*.log_archive_dest_1='LOCATION=/u03/app/oracle/archive/PRDDB'
*.log_archive_dest_2='SERVICE=PRDDB NOAFFIRM ASYNC VALID_FOR=(ONLINE_LOGFILES,PRIMARY_ROLE) DB_UNIQUE_NAME=PRDDB'
*.log_archive_dest_state_2='ENABLE'
*.log_archive_format='%t_%s_%r.arc'
*.log_archive_max_processes=30
*.open_cursors=1000
*.pga_aggregate_target=2126512128
*.processes=2000
*.remote_login_passwordfile='EXCLUSIVE'
*.sga_target=6381633536
*.standby_file_management='AUTO'
*.undo_tablespace='UNDOTBS1'
====================================
tnsping PRDDBB
TNS Ping Utility for Linux: Version 11.2.0.4.0 - Production on 05-MAR-2015 10:33:09
Copyright (c) 1997, 2013, Oracle. All rights reserved.
Used parameter files:
/u01/app/oracle/product/11.2.0/dbhome_1/network/admin/sqlnet.ora
Used TNSNAMES adapter to resolve the alias
Attempting to contact (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = iddbprod1.cloud.co.uk)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = PRDDBB.cloud.co.uk)))
OK (0 msec)
tnsping PRDDBBSTBY
TNS Ping Utility for Linux: Version 11.2.0.4.0 - Production on 05-MAR-2015 10:33:23
Copyright (c) 1997, 2013, Oracle. All rights reserved.
Used parameter files:
/u01/app/oracle/product/11.2.0/dbhome_1/network/admin/sqlnet.ora
Used TNSNAMES adapter to resolve the alias
Attempting to contact (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = iddbprod2.cloud.co.uk)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME =
PRDDBBSTBY.cloud.co.uk)))
OK (0 msec)
============================
cat listener.ora
# listener.ora Network Configuration File: /u01/app/oracle/product/11.2.0/dbhome_1/network/admin/listener.ora
# Generated by Oracle configuration tools.
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(GLOBAL_DBNAME =PRDDBBSTBY.cloud.co.uk)
(ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_1)
(SID_NAME = PRDDBBSTBY )
)
PRDDBBSTBY =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = iddbprod2.cloud.co.uk)(PORT = 1521))
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
)
)
ADR_BASE_LISTENER = /u01/app/oracle
cat tnsnames.ora
PRDDBB =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = iddbprod1.cloud.co.uk)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = PRDDBB.cloud.co.uk)
)
)
PRDDBBSTBY =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = iddbprod2.cloud.co.uk)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = PRDDBBSTBY.cloud.co.uk)
)
)
==========================================
sqlplus sys/pass@PRDDBB as sysdba
SQL*Plus: Release 11.2.0.4.0 Production on Thu Mar 5 10:34:39 2015
Copyright (c) 1982, 2013, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
SQL>
sqlplus sys/pass@PRDDBBSTBY as sysdba
SQL*Plus: Release 11.2.0.4.0 Production on Thu Mar 5 10:34:56 2015
Copyright (c) 1982, 2013, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
SQL>
===========================================
SQL> select instance_name, status FROM v$instance;
INSTANCE_NAME STATUS
---------------- ------------
IDPRDDBSTBY MOUNTED