Article is a work in progress, revisit/refresh for updates. So far, I've been unable to replicate his findings on a new ESXi 6.5 install, seeing normal SATA3 speeds. Others in different circumstances may still run into this slowdown, reasons why not known yet. Details of the ongoing investigation will be added below. So far, it appears mostly folks upgrading to 6.5 encounter this issue, but there is now a report of a fresh install experiencing this too, and Intel Avoton C2758, and an older Intel NUC. Anthony's quick fix seems to resolve all situations. Please leave a comment and share your experiences with us. Tbhe more details, the better!
Yesterday, VMware released ESXi 6.0 Build Number: 4564106. If that's what you're considering, and you:
- use 3.5 or 2.5" drives
- are planning to install or upgrade to ESXi 6.5 (released just yesterday) onto your Xeon D system, including Supermicro SuperServers/Wiredzone Bundles)
this article is for you!
It's all detailed in this wonderfully technical article by fresh Veeam recruit Anthony Spiteri:
Yep, show your support by reading the source article, he did the work:
Highly likely this fix applies to other Xeon D systems as well. Have a look at the (early days/growing) ESXi 6.5 VMware Compatibility Guide for Xeon D here, and the much larger 6.0U2 list here. Of course, it's expected that all Xeon D systems that Supermicro makes will be on the 6.0U2 (and now 6.5) soon, as explained by Supermicro during my visit to their VMworld 2016 US booth.
Yep, that simple, a one-line fix/reboot, and you're back to full speed ahead.
Like Anthony, I'm proud to be also be a Veeam Vanguard, an amazing group that regularly gives back to the broader virtualization community. I really appreciate his helping out his fellow Xeon D owners like this!
I frankly don't recall coming across any of this strangeness during my fairly extensive beta testing. Kinda strange that VMware would do this to their partners, I'm sure there was a reason?
Once validated/reproduced, I'll work on getting this reported to VMware in some official way without having to open a $299 ticket. Ideally, squaring this away before their next 6.5.x release, see also VMware's colorful history, as told by homelaber Florian Grehl.
Next up, testing out the 10GbE support for the Intel X552/X557 10GbE chipset that's on these systems. Tried to get that baked right into 6.5, and likely future releases will have it included. Meanwhile, also a very quick fix, with no reboot required.
The systems under test are the following:
- SYS-5028D-TN4T 12 core Xeon D-1567
- SYS-5028D-TN4T 08 core Xeon D-1541
Each system was configured identically, as follows:
- BIOS 1.1c
- IPMI 3.46
- fresh install of ESXi 6.5 (not upgrade) on 32GB USB
- freshly VMFS 6 formatted SSDs datastore, seen below
- Windows 10 Pro Anniversary Edition UEFI thin provisioned VM was cloned from one SSD to the other
- Pictured at left, NVMe, at right, SATA3 SSD. Click to view larger, again to view native resolution, using arrow keys to easily compare.
Here I demonstrate my first attempt to replicate Anthony's findings.
Preliminarily, it appears that this issue affects folks who upgraded from ESXi 6.0U2 to 6.5. So we might be all set here, folks seeing the slow-down do Anthony's fix, then they're all set.
- How to download and install the Intel Xeon D-1540 10GbE X552/X557 driver/VIB for VMware ESXi 6 on Supermicro 5028D-TN4T/X10SDV-TLN4F
Nov 02 2015
- How to make your unsupported SATA AHCI Controller work with ESXi 5.5 and 6.0
Nov 04 2013 by Andreas Peetz at VMware Front Experience