Infrastructure Software

I am installing Cluster 3.2 with Solaris 10 update 3 on a V210 and V240 and I am having an interconnect problem.

I have bge2 and bge3 on each node cabled back to back via a cross-over cable. I am able to plumb up the interfaces, assign a test IP and ping back and forth with no problem so I know the cables and ports are OK on each server.

After putting bge2 and bge3 down/unplumbing on each node I run scinstall from one of the nodes everything goes well until this point:

Cluster Creation

Log file - /var/cluster/logs/install/scinstall.log.blah

Checking installation status ... done

The Sun Cluster software is installed on "marge".
The Sun Cluster software is installed on "homer".

Started sccheck on "marge".
Started sccheck on "homer".

sccheck completed with no errors or warnings for "marge".
sccheck completed with no errors or warnings for "homer".


Configuring "homer" ... done
Rebooting "homer" ...


The node Homer boots into cluster mode but clintr status shows this:


=== Cluster Transport Paths ===

Endpoint1 Endpoint2 Status
--------- --------- ------

clintr show:

--- Transport Adapters for homer ---

Transport Adapter: bge2
State: Disabled
Transport Type: dlpi
device_name: bge
device_instance: 2
lazy_free: 1
dlpi_heartbeat_timeout: 10000
dlpi_heartbeat_quantum: 1000
nw_bandwidth: 80
bandwidth: 70

Transport Adapter: bge3
State: Disabled
Transport Type: dlpi
device_name: bge
device_instance: 3
lazy_free: 1
dlpi_heartbeat_timeout: 10000
dlpi_heartbeat_quantum: 1000
nw_bandwidth: 80
bandwidth: 70

I am guessing that Marge will not reboot into the cluster because she cannot talk to Homer over the interconnects after he reboots.

I'm not using switches in my scinstall config, just good old network interfaces and crossover cables.

fconfig -a on Homer shows bge0 and bge1 as my public interfaces in IPMP configuration and clprivnet0 using the default 172.16 address range. bge2 and bge3 are nowhere to be found in the listing.

The physical ports on Homer are not lit anymore, almost like something is missing to plumb up the interface.

Do I need an /etc/hostname.bge2 and /etc/hostname.bge3 on each host with 'up' in it? Do I have to manually assign bge2 and bge3 to clprivnet0 (and if so , how)?

I'm missing something subtle here, any insight would be most appreciated.