IBM allows to use Infiniband as private interconnect for RAC running on its P series servers. Please see the details given in below whitepaper. It was joint solution between IBM and Oracle.
http://www-01.ibm.com/support/docview.wss?uid=tss1wp102449&aid=1
Can we connect RAC database servers hosted on IBM P series to Exadata using Infiniband switches for faster communications between these 2 databases? These are my source and target for Golden Gate replication and for faster shipping of trail files, I want to use infiniband instead of standard 10 GigE network,
Thanks,
Abhi