Hello community,
Would like your insight and help.
One of my server pool clusters has eight OVS that are in a FX2 chassis. The switches connecting to the FX2 chassis are in a ToR. I am leveraging NIC partition to allocate bandwidth to particular logical networks (such as mgmt, heartbeat, fcoe and etc). Network team recently configured switch ports to LACP from active-backup to leverage throughput and high availability..
Each host contains four physical dual port network ports. Two network ports are in a PCIE card and the other two in a passthrough module which connects directly to the ToR. The host has 4 physical NICS. I used nPAR, so the host sees 16 virtual NICS. I created bonds on OVM Manager based on the table below:
| Bond | Physical NIC | Vnic | Network |
| bond0 | Physical NIC 1 | em1_1 | Mgmt |
| em1_2 | Heartbeat |
| em1_4 | N/A |
| Physical NIC 3 | p7p1_1 | Mgmt |
| p7p1_3 | Heartbeat |
| p7p1_4 | N/A |
| bond1 | Physical NIC 2 | em2_1 | Virtual Machine |
| em2_2 | Live Migrate |
| em2_3 | N/A |
| em2_4 | N/A |
| Physical NIC 4 | p7p2_1 | Virtual Machine |
| p7p2_2 | Live Migrate |
| p7p2_3 | N/A |
| p7p2_4 | N/A |
em1_3 and p7p2_3 are FCOE interfaces. They don't belong in any of the bonds. I was able to create both bonds; however, bond1 shows the following:
[root@server01 ~]# ethtool bond1
Settings for bond1:
Supported ports: [ ]
Supported link modes: Not reported
Supported pause frame use: No
Supports auto-negotiation: No
Advertised link modes: Not reported
Advertised pause frame use: No
Advertised auto-negotiation: No
Speed: Unknown!
Duplex: Unknown! (255)
Port: Other
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Link detected: yes
Ethtool bond0 shows:
root@server01 ~]# ethtool bond0
Settings for bond0:
Supported ports: [ ]
Supported link modes: Not reported
Supported pause frame use: No
Supports auto-negotiation: No
Advertised link modes: Not reported
Advertised pause frame use: No
Advertised auto-negotiation: No
Speed: 20000Mb/s
Duplex: Full
Port: Other
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Link detected: yes
Upon reboot, bond0 doesn't have network connectivity. Am I doing something wrong here, below are the switch configs
SWITCH1:
interface port-channel111
description server01 nic_intg a1.1 CR1 Q6 #109-07
switchport mode trunk
switchport trunk allowed vlan 13,176,190
spanning-tree port type edge trunk
no shutdown
vpc111
interface port-channel112
description server01 nic_intg a2.1 CR1 Q6 #109-08
switchport mode trunk
switchport trunk allowed vlan 52,91
spanning-tree port type edge trunk
no shutdown
vpc111
interface Ethernet109/1/7
channel-group 111 mode active
interface Ethernet109/1/8
channel-group 112 mode active
------------------------------------------------------------
SWITCH2:
interface port-channel111
description server01 nic_pcie 7.1 CR1 Q6 #110-07
switchport mode trunk
switchport trunk allowed vlan 13,176,190
spanning-tree port type edge trunk
no shutdown
vpc111
interface port-channel112
description server01 nic_pcie 7.2 CR1 Q62 #110-08
switchport mode trunk
switchport trunk allowed vlan 52,91
spanning-tree port type edge trunk
no shutdown
vpc112
interface Ethernet110/1/7
channel-group 111 mode active
interface Ethernet110/1/8
channel-group 112 mode active
Should the switch configs be in LACP or LAG mode?