Integration

We have setup cluster for 11g PS4 stack including SOA, WC, ECM, OIM.
M1 -->AdminServer, soa-server1,osb_server1,.....ucm_server1.
M2-> soa_server2,osb_server2,......ucm_server2.
When we try to start soa_server2 we are getting this following error due to which soa-infra of soa_server2 is not getting activated.
NOTE : soa_seever1 is up and running fine with out any issue.

h1*Environment details*
SYSTEM :

[oracle@QANees bin]$ uname -a
Linux QANees 2.6.18-238.el5 #1 SMP Sun Dec 19 14:22:44 EST 2010 x86_64 x86_64 x86_64 GNU/Linux

OS :

[oracle@QANees bin]$ cat /etc/redhat-release
Red Hat Enterprise Linux Server release 5.6 (Tikanga)

SOA:

[oracle@QANees bin]$ ./soaversion.sh
**************************************************************
INFO: Detected a WebLogic Installation.
**************************************************************

*****************************************************************************
Oracle SOA Server version 11.1.1.5.0
Build: 0
Build time: Mon Apr 18 18:05:14 PDT 2011
Build type: release
Source tag: PCBPEL_11.1.1.5.0_GENERIC_110418.1550.0174

Oracle BAM Source Tag:ORABAM_11.1.1.5.0_GENERIC_110330.1900


Oracle BPM Source Tag: PCBPEL_11.1.1.5.0_GENERIC_110418.1550.0174

Oracle Implementation-Version: Oracle Middleware 11.1.1 (ASKERNEL_11.1.1.5.0_
GENERIC_110418.2020, ADMINSERVER_11.1.1.5.0_GENERIC_110322.2200, J2EE
_11.1.1.5.0_GENERIC_110329.0915, JDEVADF_11.1.1.5.0_GENERIC_110409.00
25.6013, TOPLINK_11.1.1.5.0_GENERIC_110305.0900, ENTSEC_11.1.1.5.0_GE
NERIC_110326.1205, FMWCONFIG_11.1.1.4.0_GENERIC_RELEASE)

DB:

[oracle@DBNees ~]$ sqlplus

SQL*Plus: Release 11.2.0.1.0 Production on Thu Jul 28 15:05:21 2011

Copyright (c) 1982, 2009, Oracle. All rights reserved.

Error Log:


Jul 28, 2011 9:02:37 PM oracle.core.ojdl.logging.LogUtil log
WARNING: unable to read logging configuration from file '/orainstall/FMW_HOME/user_projects/domains/cls_domain/config/fmwconfig/servers/soa_server2/logging.xml'; exception: oracle.core.ojdl.logging.LoggingConfigurationException: ODL-52049: cannot create instance of class 'oracle.dfw.incident.IncidentDetectionLogFilter': java.lang.ExceptionInInitializerError
oracle.core.ojdl.logging.LoggingConfigurationException: ODL-52049: cannot create instance of class 'oracle.dfw.incident.IncidentDetectionLogFilter': java.lang.ExceptionInInitializerError
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.getInstance(LoggingConfigurationImpl.java:651)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.access$000(LoggingConfigurationImpl.java:104)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl$HandlerState.initHandler(LoggingConfigurationImpl.java:1083)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.configure(LoggingConfigurationImpl.java:281)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.configure(LoggingConfigurationImpl.java:253)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.<init>(LoggingConfigurationImpl.java:161)
at oracle.core.ojdl.logging.config.ServerLoggingConfiguration.<init>(ServerLoggingConfiguration.java:65)
at oracle.core.ojdl.logging.config.ServerLoggingConfiguration.readConfiguration(ServerLoggingConfiguration.java:110)
at oracle.core.ojdl.weblogic.ODLConfiguration.main(ODLConfiguration.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeMain(ClassDeploymentManager.java:362)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeClass(ClassDeploymentManager.java:273)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.access$000(ClassDeploymentManager.java:54)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager$1.run(ClassDeploymentManager.java:214)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeClassDeployment(ClassDeploymentManager.java:246)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.runStartupsBeforeAppDeployments(ClassDeploymentManager.java:149)
at weblogic.management.deploy.classdeployment.ClassDeploymentService.start(ClassDeploymentService.java:21)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
Caused by: java.lang.ExceptionInInitializerError
at oracle.dfw.spi.portable.PortableDiagnosticsFrameworkProvider.init(PortableDiagnosticsFrameworkProvider.java:120)
at oracle.dfw.framework.DiagnosticsFramework.initializeProvider(DiagnosticsFramework.java:98)
at oracle.dfw.framework.DiagnosticsFramework.<init>(DiagnosticsFramework.java:53)
at oracle.dfw.incident.IncidentDetectionLogFilter.<init>(IncidentDetectionLogFilter.java:62)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at java.lang.Class.newInstance0(Class.java:355)
at java.lang.Class.newInstance(Class.java:308)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.getInstance(LoggingConfigurationImpl.java:649)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.access$000(LoggingConfigurationImpl.java:104)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl$HandlerState.initHandler(LoggingConfigurationImpl.java:1083)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.configure(LoggingConfigurationImpl.java:281)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.configure(LoggingConfigurationImpl.java:253)
at oracle.core.ojdl.logging.impl.LoggingConfigurationImpl.<init>(LoggingConfigurationImpl.java:160)
at oracle.core.ojdl.logging.config.ServerLoggingConfiguration.<init>(ServerLoggingConfiguration.java:64)
at oracle.core.ojdl.logging.config.ServerLoggingConfiguration.readConfiguration(ServerLoggingConfiguration.java:110)
at oracle.core.ojdl.weblogic.ODLConfiguration.main(ODLConfiguration.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeMain(ClassDeploymentManager.java:362)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeClass(ClassDeploymentManager.java:272)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.access$000(ClassDeploymentManager.java:54)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager$1.run(ClassDeploymentManager.java:214)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeClassDeployment(ClassDeploymentManager.java:207)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.runStartupsBeforeAppDeployments(ClassDeploymentManager.java:149)
at weblogic.management.deploy.classdeployment.ClassDeploymentService.start(ClassDeploymentService.java:20)
... 3 more
Caused by: java.lang.NullPointerException
at oracle.dfw.impl.common.TempFileManager.recursiveDelete(TempFileManager.java:91)
at oracle.dfw.impl.common.TempFileManager.<clinit>(TempFileManager.java:261)
... 35 more
Jul 28, 2011 9:02:37 PM oracle.core.ojdl.logging.LogUtil log
WARNING: unable to register log dump; exception: java.lang.reflect.InvocationTargetException
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at oracle.core.ojdl.weblogic.ODLConfiguration.main(ODLConfiguration.java:153)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeMain(ClassDeploymentManager.java:362)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeClass(ClassDeploymentManager.java:272)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.access$000(ClassDeploymentManager.java:54)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager$1.run(ClassDeploymentManager.java:214)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.invokeClassDeployment(ClassDeploymentManager.java:207)
at weblogic.management.deploy.classdeployment.ClassDeploymentManager.runStartupsBeforeAppDeployments(ClassDeploymentManager.java:149)
at weblogic.management.deploy.classdeployment.ClassDeploymentService.start(ClassDeploymentService.java:20)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
Caused by: java.lang.NoClassDefFoundError: oracle/dfw/impl/common/TempFileManager
at oracle.dfw.spi.portable.PortableDiagnosticsFrameworkProvider.init(PortableDiagnosticsFrameworkProvider.java:120)
at oracle.dfw.framework.DiagnosticsFramework.initializeProvider(DiagnosticsFramework.java:98)
at oracle.dfw.framework.DiagnosticsFramework.<init>(DiagnosticsFramework.java:53)
at oracle.as.management.logging.tools.LogDump.init(LogDump.java:82)
at oracle.as.management.logging.tools.LogDump.init(LogDump.java:72)
... 21 more
<Jul 28, 2011 9:02:39 PM IST> <Critical> <WebLogicServer> <BEA-000286> <Failed to invoke startup class "DMS-Startup", java.lang.NoClassDefFoundError: oracle/dfw/impl/common/TempFileManager
java.lang.NoClassDefFoundError: oracle/dfw/impl/common/TempFileManager
at oracle.dfw.spi.portable.PortableDiagnosticsFrameworkProvider.init(PortableDiagnosticsFrameworkProvider.java:120)
at oracle.dfw.framework.DiagnosticsFramework.initializeProvider(DiagnosticsFramework.java:98)
at oracle.dfw.framework.DiagnosticsFramework.<init>(DiagnosticsFramework.java:53)
at oracle.dms.wls.DMSStartup.start(DMSStartup.java:212)
at oracle.dms.wls.DMSStartup.startUp(DMSStartup.java:118)
Truncated. see log file for complete stacktrace
>
<Jul 28, 2011 9:02:41 PM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STANDBY>
<Jul 28, 2011 9:02:41 PM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>
Jul 28, 2011 9:02:42 PM oracle.as.jmx.framework.LoggerHelper log
WARNING: Error during preRegister for MBean oracle.dfw:name=Streamer,type=oracle.dfw.jmx.Streaming
java.lang.RuntimeException: java.lang.NoClassDefFoundError: oracle/dfw/impl/common/TempFileManager
at oracle.as.jmx.framework.generic.spi.interceptors.LoggingMBeanInterceptor.internalPreRegister(LoggingMBeanInterceptor.java:663)
at oracle.as.jmx.framework.generic.spi.interceptors.AbstractMBeanInterceptor.doPreRegister(AbstractMBeanInterceptor.java:180)
at oracle.as.jmx.framework.standardmbeans.spi.OracleStandardEmitterMBean.preRegister(OracleStandardEmitterMBean.java:611)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.preRegisterInvoke(DefaultMBeanServerInterceptor.java:1010)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:938)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:482)
at weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$27.run(WLSMBeanServerInterceptorBase.java:714)