Dear Techies,
I am facing an issue with one of our Virtual server during stopping.
going in detail:
The issue started yesterday when one of the Virtual machine is down all of a sudden, I am a newbie ti Virtualization and unable to resolve that and so finally migrated the VM to another server. now I am trying to fix the issue of the server and trying to stop it and unable to do that. The detail of the Failed job is as below:
Please help me out as it is of high priority.
***************************************************************************************************************************************************************************************************************************************************
Job Construction Phase
----------------------
Job ID: 1399027110992
begin()
Appended operation 'Server Stop' to object '34:35:39:34:38:37:43:4e:37:38:31:39:30:33:34:32 (erpovs4)'.
commit()
Completed Step: COMMIT
Objects and Operations
----------------------
Object (IN_USE): [Server] 34:35:39:34:38:37:43:4e:37:38:31:39:30:33:34:32 (erpovs4)
Operation: Server Stop
Job Running Phase at 2014-05-02 16:08:30,992
----------------------------------------------
Job Participants: []
Actioner
--------
16:08:31,225: Starting operation 'Server Stop' on object '34:35:39:34:38:37:43:4e:37:38:31:39:30:33:34:32 (erpovs4)'
Job Internal Error (Operation)com.oracle.ovm.mgr.api.exception.FailedOperationException: OVMAPI_4010E Attempt to send command: dispatch to server: erpovs4 failed. OVMAPI_4004E Server Failed Command: dispatch https://?uname?:?pwd?@10.0.0.232:8899/api/3 sys_shutdown, Status: org.apache.xmlrpc.XmlRpcException: socket.error:(110, 'Connection timed out') [Fri May 02 16:11:41 IST 2014] [Fri May 02 16:11:41 IST 2014]
at com.oracle.ovm.mgr.action.ActionEngine.sendCommandToServer(ActionEngine.java:513)
at com.oracle.ovm.mgr.action.ActionEngine.sendDispatchedServerCommand(ActionEngine.java:450)
at com.oracle.ovm.mgr.action.ActionEngine.sendServerCommand(ActionEngine.java:384)
at com.oracle.ovm.mgr.action.ServerAction.stop(ServerAction.java:149)
at com.oracle.ovm.mgr.op.physical.ServerStop.asyncAction(ServerStop.java:90)
at com.oracle.ovm.mgr.api.collectable.ManagedObjectDbImpl.executeCurrentJobOperationAsyncAction(ManagedObjectDbImpl.java:1134)
at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:356)
at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:333)
at com.oracle.odof.core.storage.Transaction.invokeMethod(Transaction.java:869)
at com.oracle.odof.core.Exchange.invokeMethod(Exchange.java:244)
at com.oracle.ovm.mgr.api.physical.ServerProxy.executeCurrentJobOperationAsyncAction(Unknown Source)
at com.oracle.ovm.mgr.api.job.JobEngine.objectAsyncStart(JobEngine.java:620)
at com.oracle.ovm.mgr.op.physical.ServerStop.running(ServerStop.java:102)
at com.oracle.ovm.mgr.op.physical.ServerStop.action(ServerStop.java:60)
at com.oracle.ovm.mgr.api.collectable.ManagedObjectDbImpl.executeCurrentJobOperationAction(ManagedObjectDbImpl.java:1156)
at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:356)
at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:333)
at com.oracle.odof.core.storage.Transaction.invokeMethod(Transaction.java:869)
at com.oracle.odof.core.Exchange.invokeMethod(Exchange.java:244)
at com.oracle.ovm.mgr.api.physical.ServerProxy.executeCurrentJobOperationAction(Unknown Source)
at com.oracle.ovm.mgr.api.job.JobEngine.operationActioner(JobEngine.java:230)
at com.oracle.ovm.mgr.api.job.JobEngine.objectActioner(JobEngine.java:322)
at com.oracle.ovm.mgr.api.job.InternalJobDbImpl.objectCommitter(InternalJobDbImpl.java:1383)
at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:356)
at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:333)
at com.oracle.odof.core.BasicWork.invokeMethod(BasicWork.java:106)
at com.oracle.odof.command.InvokeMethodCommand.process(InvokeMethodCommand.java:92)
at com.oracle.odof.core.BasicWork.processCommand(BasicWork.java:81)
at com.oracle.odof.core.TransactionManager.processCommand(TransactionManager.java:752)
at com.oracle.odof.core.WorkflowManager.processCommand(WorkflowManager.java:467)
at com.oracle.odof.core.WorkflowManager.processWork(WorkflowManager.java:525)
at com.oracle.odof.io.AbstractClient.run(AbstractClient.java:42)
at java.lang.Thread.run(Thread.java:662)
Caused by: com.oracle.ovm.mgr.api.exception.IllegalOperationException: OVMAPI_4004E Server Failed Command: dispatch https://?uname?:?pwd?@10.0.0.232:8899/api/3 sys_shutdown, Status: org.apache.xmlrpc.XmlRpcException: socket.error:(110, 'Connection timed out') [Fri May 02 16:11:41 IST 2014]
at com.oracle.ovm.mgr.action.ActionEngine.sendAction(ActionEngine.java:909)
at com.oracle.ovm.mgr.action.ActionEngine.sendCommandToServer(ActionEngine.java:509)
... 42 more
FailedOperationCleanup
----------
Starting failed operation 'Server Stop' cleanup on object 'erpovs4'
Complete rollback operation 'Server Stop' cleanup on object 'erpovs4'
Rollbacker
----------
16:11:41,831: Starting rollbacker...
Executing rollback operation 'Server Stop' on object '34:35:39:34:38:37:43:4e:37:38:31:39:30:33:34:32 (erpovs4)'
Complete rollback operation 'Server Stop' completed with direction=DONE
16:11:41,834: Rollbacker completed...
Objects To Be Rolled Back
-------------------------
Object (IN_USE): [Server] 34:35:39:34:38:37:43:4e:37:38:31:39:30:33:34:32 (erpovs4)
Write Methods Invoked
-------------------
16:08:31,077 class="InternalJobDbImpl" vessel_id=23367 method=addTransactionIdentifier accessLevel=6 owningTx=1399027111077
16:08:31,172 class="ServerDbImpl" vessel_id=9590 method=stop accessLevel=6 owningTx=1399027111077
16:08:31,192 Class=ServerStoppingEventDbImpl vessel_id=23376 method=notify accessLevel=6 owningTx=1399027111077
16:08:31,202 class="InternalJobDbImpl" vessel_id=23367 method=setCompletedStep accessLevel=6 owningTx=1399027111077
16:08:31,202 Class=InternalJobDbImpl vessel_id=23367 method=setAssociatedHandles accessLevel=6 owningTx=1399027111077
16:11:41,694 class="ServerDbImpl" vessel_id=9590 method=nextJobOperation accessLevel=6 owningTx=1399027111077
16:11:41,694 class="InternalJobDbImpl" vessel_id=23367 method=setFailedOperation accessLevel=6 owningTx=1399027111077
16:11:41,831 Class=ServerDbImpl vessel_id=9590 method=nextJobOperation accessLevel=6 owningTx=1399027111077
16:11:41,833 class="ServerDbImpl" vessel_id=9590 method=nextJobOperation accessLevel=6 owningTx=1399027111077