Technical details about Intel Optane Memory quietly announced, consumer M.2 version coming to 7th Gen Core Processors first
Backstory - M.2 NVMe arrives in 2015
I began talking about NVMe back in 2014, with over a thousand mentions since. It's been a big deal for the home lab/home datacenter, working particular well with VMware's ESXi hypervisor on Xeon D, blessed with full-speed PCIe 3.0 x 4 in that tiny M.2 form factor, and options to expand beyond recently multiplying.
Before M.2 NVMe, ESXi often used RAID controllers to obtain decent queue depths for ESXi performance at reasonable prices
You see, it turned out you often needed a powerful and pricey RAID controller with higher queue depths to get good performance, the kind of performance you'd not get close to with consumer gear typically equipped with SATA over SAS. I've written dozens of articles at TinkerTry about the LSI 9265-8i RAID controller dating back to 2011, ending around 2014. I was valiantly attempting to get reliable and affordable SSD caching of reads and writes. Almost like an early one-host VMware vSAN (formerly Virtual SAN), you could say.
M.2 NVMe changed everything for the virtualization enthusiast
With the arrival of M.2 NVMe, finally anybody could get a queue depth of 1024 in their ESXi home labs, with none of that legacy overhead of (queue depth 32) SATA3. Take the well-regarded Samsung 950 PRO, which "just worked" with any ESXi since 5.5 using the built-in NVMe driver. Unlike Intel's 750 Series, the 850 PRO didn't even need a offer a separate faster driver, and those speeds were a big leap forward, see:
- World's fastest consumer SSD - Samsung 950 PRO M.2 NVMe benchmark results
Nov 07 2015 by Paul Braren at TinkerTry
While Samsung's next generation cooler-running 960 PRO/EVO launch has been bumpy for some, I'm confident those early adopter glitches are likely to be worked out.
Enter Optane/3D XPoint
So it was with several weeks of great NVMe experiences that I headed to Boston about a year ago, to attend an Intel presentation about Optane Memory, see:
- Intel's first M.2 NVMe SSD might be available by late 2016, around the time Intel Micron 3D XPoint arrives
Here's some notes I wrote in that story, about what I learned that night:
- 3D XPoint Technology
- 3D XPoint may have 2H2016 seeding, with availability late in 2016 or early 2017.
- We know 3D XPoint will be more costly than NVMe.
- Intel co-developed 3D XPoint with Micron.
- 3D XPoint is DIMM form factor.
- Intel plans to offer an NVMe storage in the M.2 form factor!
Info we have for today
Now that we're closer to launch, we now know the constraints and requirements. Let's start with some links:
Optane Overview Page:
A 7th Gen Intel® Core™ i-series processor and Intel® Optane™ memory deliver speed and responsiveness.
- Three page pdf Product Overview
Introducing Intel® Optane™ Memory at CES
and finally, the new teaser video.
There's a lot to take in, and this article is just an introduction.
Thoughts about what we may have tomorrow
When will Xeon processors and the datacenter have Optane shipping in quantity, and deployed into production? Not sure. Samples have already to ship to partners, see Intel Has Started Shipping Optane Memory Modules:
Intel has begun shipping Optane memory modules to its partners for testing. This year should see the launch of both these enterprise products designed for servers as well as tiny application accelerator M.2 solid state drives based on the Intel and Micron joint 3D memory venture. The modules that Intel is shipping are the former type of Optane memory and will be able to replace DDR4 DIMMs (RAM) with a memory solution that is not as fast but is cheaper and has much larger storage capacities. The Optane modules are designed to slot into DDR4 type memory slots on server boards.
I think the real question for home lab enthusiasts is when will the price come down for larger capacities to be somewhat affordable. I suspect that could very well take years, but I will surely still interesting to follow this technology as it grows up.
What might this all mean for the ESXi enthusiast? Well, Core i7 hasn't been on the VMware HCL for years now, but that's where Optane support arrives first. That's right, it's more than just an M.2 NVMe slot needed, you also need a system design and BIOS that supports Optane. That means you'll be looking for the 'Intel® Optane™ memory ready’ label.
Given it sure looks a lot like an Intel RST/RSTe-like Intel® Rapid Storage Technology caching solution that relies on Windows drivers, I also have my doubts whether Optane as a drive cache would ever work as a caching layer for VMware's ESXi, however. It's the use-cases afterward that are likely of most interest.
I haven't spotted detailed Optane capable Xeon desktop/server plans yet in the M.2 form factor, with no mentions of both Xeon and Optane anywhere on intel.com. There is mention out there of support for Mobile Xeon, and of course, there's the enterprise (costly) Optane-as-storage PCIe card coming soon at 375GB capacity, the P4800X Series, rumored speeds discussed in comparison to NVMe here.
So keep in mind that Optane is starting out more affordably as just a very fast and small (16GB or 32GB) caching layer for storage in consumer PCs called Storage Accelerator, see:
- XPoint Storage Accelerator arrives in Kaby Lake ThinkPads in early 2017 as a really fast 16GB NVMe cache for its Intel RST RAID volume
aka Intel Optane Memory 8000p series.
One interesting use case could be for folks with a slower but larger 2.5" SATA based SSD, like my 2 TB Samsung 850 EVO for example. The idea would be to boost speeds using Optane as a cache, to obtain speeds for day-to-day use that would be much closer to NVMe. See also my recent, closely-related article:
Meanwhile, have a listen to Allyn Malventano's analysis of Optane, featured in this recent PC Perspective 437 02/15/17 podcast, at this spot.
Mar 29 2017 Update
See new, closely-related article
- Intel Optane SSD DC P4800X Series can be ultra fast vSAN cache, storage, or RHEL/SLES 8x memory extender using Intel Memory Drive Technology
I believe this cheet sheet or glossary of new storage acronyms is needed. These are some of the technologies you'll be hearing a lot more about in the future, including:
NVM - Non-Volatile Memory. Source.
Often used interchangeably with common NVMe - Non-Volatile Memory express. Source.
NVDIMM - Non-Volatile Dual In-line Memory Module. Source.
NGNVM - Next Generation Non Volatile Memory. Source.
- RRAM or ReRAM - Resistive random-access memory. Source.
See also at TinkerTry
Samsung 960 PRO/EVO/SM961 M.2 NVMe SSD disappearance workaround is to power cycle, boot from NVMe problems also reported, firmware 2B7QCXE7 appears to fix EVO
Jan 02 2017
XPoint Storage Accelerator arrives in Kaby Lake ThinkPads in early 2017 as a really fast 16GB NVMe cache for its Intel RST RAID volume
Dec 29 2016
- vSphere 6.5 Core Storage white paper - one home virtualization lab enthusiast's perspective
Dec 07 2016
- M.2 expansion for your NVMe SSDs - EZDIY adds, Angelbird Wings adds and cools, Amfeltec Squid adds, cools, and quadruples
Dec 06 2016
Intel Quietly Launches Official Optane Memory Site
Feb 16 2017 by Allyn Malventano at PC Perspective
Intel Kaby Lake - processors, motherboards, PCs and performance
Feb 15 2017 by Dave James at PCGames
A Closer Look at Intel's Optane SSD DC P4800X Enterprise SSD Performance
Feb 10 2017 by Allyn Malventano at PC Perspective
Intel's Optane faces threat as Micron chases future QuantX tech
Micron is researching second- and third-generation 3D Xpoint storage technology
Feb 03 2017 by Agam Shah at PCWorld
Intel Launches 7th Generation Kaby Lake: 15W/28W with Iris, 35-91W Desktop and Mobile Xeon
Jan 03 2017 by Ian Cutress at AnandTech
Intel Launches 200-Series Kaby Lake Platform – Full Z270 and H270 Motherboard Roundup From ASUS, MSI, Gigabyte, ASRock, EVGA and More
Jan 03 2017 by Hassan Mujtaba at WCCFTECH
Intel Z270 Express and H270 Express Chipsets Support Kaby Lake, More PCI-E 3.0 Lanes
Dec 02 2016 by Tim Verry at PC Perspective
- More VMs vs. “Rust-on-a-Platter”
Jul 21 2014 by Allen Scheer at Intel IT Peer Network
So, remember that Optane Overview Page we started this article with? Here's an excerpt form that page, to help you start to get to know what Optane is claiming it can do in the near-term, in the consumer marketplace, on the Kaby Lake/ 270 chipset motherboards that have already begun to arrive:
Wake your computer instantly, search and find files in a flash, and save large files quickly. A hard disk drive coupled with Intel® Optane™ memory affordably gives you SSD-like speed while maintaining large-storage capacity.
Optimize your computer responsiveness from system boot to application launch. A computer with a 7th Gen Intel® Core™ processor coupled with Intel® Optane™ memory delivers amazing desktop responsiveness so you can work or plan without delays.
Now is the time to get excited about a new computer. After 25 years, a revolutionary new class of memory affordably accelerates your system making your computer experience fast, smooth, and easy.
Affordable performance with HDD capacity
Combine Intel® Optane™ memory with an HDD to affordably get SSD performance while maintaining HDD capacity.
With a 7th Gen Intel® Core™ processor and Intel® Optane™ memory, your pc will deliver snappy responsiveness and high-speed performance even for your most demanding applications.
Delivered by Intel, one of the industry's most trusted technology innovators, this new class of non-volatile memory is backed by over 30 years of memory expertise and global leadership in technology innovation and processor manufacturing.
Intelligent system acceleration
Quickly access key files. Intelligent software automatically learns your computing behaviors to accelerate frequent tasks.