Skip to Main Content

Infrastructure Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

Interested in getting your voice heard by members of the Developer Marketing team at Oracle? Check out this post for AppDev or this post for AI focus group information.

Oracle Linux 6.5 and Mellanox/OFA (Infiniband)

Billy VerreynneMar 26 2014 — edited Apr 8 2014

Brand new install and yum update'ed to latest - 3.8.13-26.2.1.el6uek.x86_64.

System has an Infiniband Mellanox PCI card. The driver is supplied by the kernel:

kernel-uek-3.8.13-26.2.1.el6uek.x86_64 : The Linux kernel

Repo        : installed

Matched from:

Other       : Provides-match: /lib/modules/3.8.13-26.2.1.el6uek.x86_64/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko

https://oss.oracle.com/el6/docs/RELEASE-NOTES-U5-en.html states the following:

mlx4_core Conflicts Between the mlnx_en and ofa Packages

Both the mlnx_en and ofa packages contain mlx4_core. Only one of these packages should be installed. Attempting to install both packages on a single server results in a package conflict error. If you have a Mellanox Ethernet Controller, install mlnx_en. If you have a Mellanox InfiniBand Controller, install ofa. If your system has both controllers, use ofa as it supports both the Ethernet and InfiniBand controllers.

Neither is installed as the kernel modules for the Mellanox card and IB s/w (such as ib_ipoib, etc) are available.

Modprobe (via /etc/modprobe.d/* conf files) is configured to load the mlx4_core and ib drivers.

This does not happen at boot. The mlx4_core driver is not loaded. Mobprobe on it does not load. Using insmod <filename> loads it (but throws some warnings about MSI IRQs in the kernel log).

I am missing something here.

Why the release note on mlnx_ and ofa packages, when neither seem to provide anything in addition to the default kernel install?

How does one instruct the kernel to load the core driver (mlx4_ core) and IB stack (RDMA, iSER, IPoIB, etc)? OL6.5 seems quite different to OL5.x in this respect (got it working on 2 same server models just fine with OL5.x).

Thanks.

This post has been answered by Billy Verreynne on Apr 8 2014
Jump to Answer

Comments

Processing
Locked Post
New comments cannot be posted to this locked post.

Post Details

Locked on May 6 2014
Added on Mar 26 2014
7 comments
5,592 views