How to download and install the Intel Xeon D 10GbE X552/X557 driver/VIB for VMware ESXi 6.x

Posted by Paul Braren on Nov 2 2015 (updated on Jul 9 2017) in
  • Virtualization
  • ESXi
  • Network
  • HowTo
  • HomeLab
  • HomeServer
  • Jun 18 2016 Update - It's gotten very easy to install this VIB, with the easy method right up top. For the original fully supported but more time consuming method for production environments, jump below for details, now includes latest March 2017 driver version.

    Fast, easy, and effective 10GbE VIB installation method (unsupported)

    Same command works for upgrades too!

    This super fast download-and-install one liner takes under a minute to apply, partly because the VIB is only 187KB! This particular screenshot actually shows how it's the same command for an upgrade. Your 'Removed:' section may differ. This is an unaltered copy of the Intel VIB
    net-ixgbe_4.5.1-1OEM.600.0.0.2494585.vib

    Warning/Disclaimer:
    I've temporarily hosted this shortcut method at tinkertry.com, for convenience. There is no warranty implied, and there is no support given for anybody who finds they encounters issues. If you are at all concerned about 3rd party VIB source, your connection is https encrypted, and the MD5 hash to help detect data corruption is:
    db909c779fd141796fb97f1e04a4f304
    You can also do an FC on this hosted file versus the VMware file. Of course, those concerned can simply use the fully VMware supported method below, which requires a few more steps, including authentication from "My VMware" just to get the VIB.

    Expert Short Instructions

    For non-production test labs.

    1. backup your ESXi
    2. shutdown all your VMs, or go into maintenance mode first
    3. login to your ESXi SSH shell, and paste in the following command:
      esxcli software vib install -v https://cdn.tinkertry.com/files/net-ixgbe_4.5.1-1OEM.600.0.0.2494585.vib --no-sig-check
    4. Now you can reboot through the web GUI, or via SSH with this command:
      reboot

      That's it! You can see some sample pictures of how things should look in ESXi after you've made the upgrade and now have this new driver loaded.

    4.5.1-installed-TinkerTry-Apr-11-2017
    Easy 10GbE install method used, note no-sig-check option, so the long method detailed below that starts with downloading the zip from VMware is recommended for production workloads.
    vSphere-Client-view-of-x552-installed
    vSphere Client view of installed Intel x552 10GbE.
    vSphere-Web-Client-view-of-x552-installed
    vSphere Web Client view of installed Intel x552 10GbE.

    Original Install Method


    It's here, at last! The long wait since June for this 10GbE VIB ended when JBBERLIN77777 replied to my reports of a VMware X552/X557 driver download site with invalid links. He announced his finding of the download link, over in the huge VMware Communities thread:

    Were's still not sure how he found that URL, but we're all glad it works! Can you tell I'm happy, especially now that I'll have 2 SuperServers directly connected over 10GbE using Cat6a cabling, and each will have a Samsung 950 PRO M.2 NVMe 512GB drive, on November 3rd. In other words, a way to actually push the speeds of that wire. Woo hoo, what timing, this is a great week! No, I don't own a 10GbE switch, and this second SuperServer 5028D-TN4T system is just a loaner from a very gracious Wiredzone customer. I only have it for another few weeks.

    Download

    Here's the driver family download page:

    March 17 2017 Update - new VIB 4.5.1 is released. Here's the Release_Notes_ixgbe-4.5.1.txt and the actual driver download page for the new VIB, requires My VMware login (sign-up is free):

    • VMware ESXi 6.0 ixgbe 4.5.1 NIC Driver for Intel Ethernet Controllers 82599, x540, x550, and x552

      File size: 851.5 KB
      File type: zip
      Download Now Name: ixgbe-4.5.1-2494585-5197765.zip
      Release Date: 2017-03-17
      Build Number: 5197765
      VMware ESXi 6.0 ixgbe 4.5.1 NIC Driver for Intel Ethernet Controllers 82599, x540, x550, and x552
      The ESXi 6.0 driver package, also compatible with ESXi 6.5, includes version 4.5.1 of the Intel ixgbe driver. It supports the products based on the Intel 82599, x540, x550, and x552 10 Gigabit Ethernet Controllers. For detailed information and ESX hardware compatibility, please check the I/O Hardware Compatibility Guide Web application.

      MD5SUM: db909c779fd141796fb97f1e04a4f304
      SHA1SUM: 1f071979d0f2ee0265117986271a37f68dd29043
      SHA256SUM: 192e16d6c37106404826ca944f943d653a49c8c31ba20745abf2ca81fa209d87

    This VIB works fine with 6.0, as we are reassured that's OK at the Download VMware vSphere site:

    > Important Note for Certified I/O drivers
    > ESXi 6.0 supports I/O drivers built and certified on ESXi 5.5. The VMware Compatibility Guide lists both ESXi 5.5-based and ESXi 6.0-based drivers as supported with ESXi 6.0. See Knowledge Base article 2111492.

    I do not know how that URL was found, and there seems to be no 6.0 version of that download site, but if one does show up, it's pretty likely to turn out to be the same exact VIB file inside.

    Nov 03 2015 9:00pm EST Update - Yep, they're all the same VIB. VMware has now fixed the URLs on the existing download site, and they use the same link for all the 5.5 and 6.0 versions.

    Here's the actual driver download, the page you get the VIB:
    - VMware ESXi 5.5 ixgbe 4.1.1.1 NIC Driver for Intel(R) 82599, X540 and X552/X557-AT 10 Gigabit Ethernet Controllers family
    my.vmware.com/group/vmware/details?downloadGroup=DT-ESXI55-INTEL-IXGBE-4111&productId=353

    May 06 2016 Update - new VIB 4.4.1 is released. Here's the release notes and the actual driver download page for the new VIB:
    VMware ESXi 6.0 ixgbe 4.4.1 NIC Driver for Intel Ethernet Controllers 82598, 82599, x540 and x550


    Here's my installation instructions, based on the 4.5.1 README file.

    Installation Instructions

    X552/X557 ESXi VIB on ESXi 6.x instructions.

    Before you Begin!

    Make sure you're ready to reboot soon, with VMs already shut down, or get into maintenance mode. That's because the end of this intruction set has you rebooting!

    Begin

    1. Open an SSH session (PuTTY) to your ESXi 6.0 (or ESXi 6.0 Update 1) server
      (if you forgot to enable SSH, here's how)
    2. Put your system into maintenance mode, or, shut down all your VMs now and ensure you've set your ESXi host to automatically gracefully shutdown all VMs upon host reboot.
    3. Unzip the downloaded ixgbe-4.5.1-2494585-5197765.zip file, the VIB you want is named net-ixgbe_4.5.1-1OEM.600.0.0.2494585.vib and is found at the top level of the unzipped folder.
    4. Upload net-ixgbe_4.5.1-1OEM.600.0.0.2494585.vib to one of your datastores using vSphere Web Client Datastore browser.
    5. Open an SSH session (PuTTY) to your ESXi 6.x host/server, my example below is at ESXi 6.0 Update 1a
      (if you forgot to enable SSH, here's how).
    6. Paste the following commands into your PuTTY session, one line at a time.
      (you will need to specify the full path to where you put your VIB, it will differ from what is seen as Intel_750_NVMe_400GB in my example screenshots, but using tab autocomplete, it's pretty easy to construct this command in your environment, on the fly).
      esxcli software vib install -v /vmfs/volumes/[datastore]/net-ixgbe_4.5.1-1OEM.600.0.0.2494585.vib
    7. Delete the VIB from the datastore.
    8. Type "reboot" and hit return.

    That's it!

    10gbe-vib-install-and-cleanup-successful
    This is my successful install screenshot on ESXi 6.0U2, click twice to zoom in fully. It should look very similar for the newer 4.5.1 on ESXi 6.x
    10GbE_active_on_5028d-tn4t_on_esxi6
    Now that's how it's supposed to look!

    Video

    How to add Intel X552/X557 10GBase-T driver VIB to VMware ESXi 6.x on Supermicro Xeon D SuperServers

    Nov 11 2015 Update

    Turns out SR-IOV likely won't be enabled after all, on this X552 in the Xeon D-1540, but likely will in the Xeon D-1541, details at TinkerTry here.


    See also this great question in this TinkerTry commenter Kent Winsor:

    Hi Paul, can the 10 GB NICS on the Supermicro SuperServer also operate at 1 GB speed under ESXi 6.0? Thank you.

    Yep, no problem at all, auto speed negotiation on by default. So in a sense you have 4 1GbE ports, and one 1GbE dedicated to management.

    All 4 ports handle auto-crossover as well, should you use direct attachment to another system, without a network switch in the middle. Just use normal CAT5e for the 1GbE ports, and normal CAT6a or CAT7 cables for those 10GbE ports, no cross-over cabling required. Easy under Windows, but issues with getting this to work under VMware.

    auto-crossover-cat6a-cabling


    Mar 10 2016 Update

    SR-IOV is alive! (for Xeon D-1541 with BIOS 1.0c)


    May 18 2016 Update

    New driver version! Intel's network product page has since been updated to include the very new ixgbe version 4.4.1 driver. I have updated the instructions above accordingly. It is reported to work fine with a D-Link DXS-1210-TC 10GbE switch, and with ESXi 6.0 Update 2.


    Nov 18 2016 Update

    VMware ESXi 6.5 came out on Nov 15 2016, recorded a video of the simple install method using the unchanged one-liner install, and added it to the article above. Firewall commands instructions are optional for most configurations, so I've left them only in the longer instruction set above.

    Also worth noting that there are issues with trying to force data rates with this driver, so direct connect (auto-crossover RJ45 ports allow any normal CAT6a or CAT7 cable) gets tricky, discussed here.


    Dec 16 2016 Update

    VMware ESXi 6.5 / vSAN 6.5 now officially announced support for direct-connect.


    Apr 14 2017 Update

    4.5.1 driver came out here, here's the details:

    VMware ESXi 6.0 ixgbe 4.5.1 NIC Driver for Intel Ethernet Controllers 82599, x540, x550, and x552

    File size: 851.5 KB
    File type: zip
    Download Now Name: ixgbe-4.5.1-2494585-5197765.zip
    Release Date: 2017-03-17
    Build Number: 5197765

    Article above updated accordingly.

    Here's the contents of the Release_Notes_ixgbe-4.5.1.txt

    Copyright(c) 2013 - 2017 Intel Corporation

    This release includes the ixgbe VMware ESX Driver for Intel(R) Ethernet Controllers 82599, x540, x550, and x552

    Driver version: 4.5.1

    Supported ESXi release: 6.0
    Compatible ESX versions: 6.5

    Dependencies: None
    New hardware supported:

    • Add new devices support for specific OEMs

    Additional configuration options supported by the driver: None

    Bug fixes:

    b1208972122: Fix PSOD when CNA = 8 and VMDQ < 4
    b1208935559: Network device not showing "Cable Type" information for DA connection on X520-DA2
    b1208939075: Allow to force link speed using esxcli or vSphere Web Client

    Features: None

    Known Issues: None


    Apr 19 2017 Update

    If you've gone to ESXi 6.5.0d Build 5310538 and found your 10GbE NICs have disappeared, don't worry, just re-install them. It's all explained right here.


    Jun 09 2017 Update

    Turns out the exact chip in the Xeon D series is actually the X557, which is pictured in the schematics and descriptions Intel created here:
    Datasheet - Volume 4 of 4: Intel Xeon Processor D-1500 Product Family LAN Controller

    10GBASE-KR interface to:
    -- 10 Gb SFI PHY (Inphi* CS4227)
    -- 10GBASE-T PHY (Intel X557-AT / X557-AT2 (2-port)

    X557-AT2

    See also:

    Great tool from Microsoft called NTttcp Utility:
    NTttcp Utility: Profile and Measure Windows Networking Performance
    as featured in this excellent video:

    "10 Gigabit Networking - I wanna go fast. Really, really fast." at Linus Tech Tips.

    See also

    2015-11-03_12-48-24