Skip to Main Content

Infrastructure Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Guest LDOMS on same subnet cant ping eachother

2823391Mar 1 2015 — edited Mar 1 2015

Hi all,

I have just been reading through a historical thread about some issues with IPMP.

Some tips from "Peasant" where very useful. Please see below

"Just couple of more hints regarding VM.

For VDS, use one VDS - one guest LDOM, don't put everything in primary-vds.

Disable extended-mappin-space everywhere since i noticed sometimes live migration fails with this on.

You might want to disable INTER-VNET-LINK (to off)

I had a situation when network between two guests, that reside same physical machine on the same subnet, just stops working.

I have ran some internal test with those two options on/off (which should improve network throughput), and didn't notice any performance gains, only experienced issue above

Depends on which patchset you are, perhaps those issues are now fixed.

Regards

Peasant"

The issue I am having is that two Guest LDOMS which have IP addresses in h same subnet/range are unable to ping each other. They can ping all other LDOM Guets, control/ Service etc. but not each other.

Actually, before i switched off INTER-VNET-LINK=off then they would just crash.

We have two IO domains with aggregated ports using IPMP. Please let me know what info you require and I hope you can help. Some details below:

First Guest Domain = Sneezy

primary

MAC

    00:10:e0:46:32:e6

VSW

    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK

    primary-vsw50    00:14:4f:f9:c0:79 aggr0     0    switch@0              1               1    50                   1500         off

------------------------------------------------------------------------------

NAME

secondary

MAC

    00:14:4f:fb:51:13

VSW

    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK

    secondary-vsw50  00:14:4f:fb:21:17 aggr0     0    switch@0              1               1    50                   1500         off

------------------------------------------------------------------------------

NAME

sneezy

MAC

    00:14:4f:f8:ce:95

NETWORK

    NAME             SERVICE                     ID   DEVICE     MAC               MODE   PVID VID                  MTU   LINKPROP

    vnet0            primary-vsw50@primary       0    network@0  00:14:4f:f9:1a:0b        50                        1500  phys-state

    vnet1            secondary-vsw50@secondary   1    network@1  00:14:4f:fa:92:25        50                        1500  phys-state

admin@martell:/$

Second guest domain on different host= sleepy

admin@lannister:~$ ldm list -o network

NAME

primary

MAC

    00:10:e0:46:30:a2

VSW

    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK

    primary-vsw50    00:14:4f:fa:c3:20 aggr0     0    switch@0              1               1    50                   1500         off

------------------------------------------------------------------------------

NAME

secondary

MAC

    00:14:4f:fa:8f:07

VSW

    NAME             MAC               NET-DEV   ID   DEVICE     LINKPROP   DEFAULT-VLAN-ID PVID VID                  MTU   MODE   INTER-VNET-LINK

    secondary-vsw50  00:14:4f:f9:a8:69 aggr0     0    switch@0              1               1    50                   1500         off

------------------------------------------------------------------------------

NAME

sleepy

MAC

    00:14:4f:f8:ce:95

NETWORK

    NAME             SERVICE                     ID   DEVICE     MAC               MODE   PVID VID                  MTU   LINKPROP

    vnet0            primary-vsw50@primary       0    network@0  00:14:4f:fa:92:25        50                        1500  phys-state

    vnet1            secondary-vsw50@secondary   1    network@1  00:14:4f:f9:1a:0b        50                        1500  phys-state

admin@lannister:~$ ldm -V

Logical Domains Manager (v 3.1.0.1)

        Hypervisor control protocol v 1.11

        Using Hypervisor MD v 1.4

System PROM:

        Hostconfig      v. 1.4.0        @(#)Hostconfig 1.4.0 2014/04/04 17:51

        Hypervisor      v. 1.13.0.a     @(#)Hypervisor 1.13.0.a 2014/04/08 14:05

        OpenBoot        v. 4.36.0       @(#)OpenBoot 4.36.0 2014/04/04 15:50

Other useful information that may help.

admin@lannister:~$ dladm show-aggr

LINK              MODE  POLICY   ADDRPOLICY           LACPACTIVITY LACPTIMER

aggr0             trunk L2       auto                 active       short

admin@lannister:~$ dladm show-vlan

LINK                VID      OVER                FLAGS

aggr5000            50       aggr0               -----

admin@lannister:~$ dladm

LINK                CLASS     MTU    STATE    OVER

net0                phys      1500   up       --

net1                phys      1500   up       --

net2                phys      1500   up       --

aggr5000            vlan      1500   up       aggr0

aggr0               aggr      1500   up       net0 net1

admin@lannister:~$ dladm show-phys

LINK              MEDIA                STATE      SPEED  DUPLEX    DEVICE

net0              Ethernet             up         10000  full      ixgbe0

net1              Ethernet             up         10000  full      ixgbe1

net2              Ethernet             up         10000  full      vsw0

Many thanks

This post has been answered by 2823391 on Mar 1 2015
Jump to Answer
Comments
Locked Post
New comments cannot be posted to this locked post.
Post Details
Locked on Mar 29 2015
Added on Mar 1 2015
1 comment
1,610 views