While I can barely find two sticks of 16 GB to rub together, Micron unveils a 256 GB memory module destined for AI servers

In the midst of a memory supply crisis, I am definitely thankful for the 32 GB of DDR5 that came inside my prebuilt rig a few moons ago now. Sure, 16 GB of RAM is fine for most things I’d want to dive into, but the AI industry is playing a whole other ball game. Case in point, I am sweating just thinking about Micron’s 256 GB DDR5 server module.

The Boise, Idaho-based memory manufacturer unveiled the tech on Tuesday. It’s built on Micron’s 1-gamma technology which, per the press release, “is capable of speeds up to 9,200 megatransfers per second (MT/s), greater than 40% faster than modules in volume production today.”

Samples of the registered dual in-line memory modules (RDIMM) are being offered “to key server ecosystem enablers for platform validation” in order to ensure wide-ranging compatibility. To simplify, Micron is offering its still somewhat experimental high-bandwidth memory for those hungry enough for chips that they’d be willing to help iron out the kinks, especially if it means “accelerating the path to production deployment for data center customers building AI and HPC infrastructure at scale”. It’s a typical ‘move fast, break things’ approach.

Latest Videos From

For comparison’s sake, our top pick when it comes to the best DDR5 RAM for gaming is the G.Skill Trident Z5 RGB DDR5-7200 CL34, and that has a speed of 7200 MT/s—mind you, that’s only for a 2x 16 GB RAM kit. AMD CPUs, which are by far the most popular among gamers today, only really require 6000 MT/s, and in our testing, super high speeds aren’t really that useful even with Intel’s speedier controller.

Now, obviously Micron’s 256 GB module is many orders of magnitude more powerful than a consumer RAM kit. As Micron explains, “A single 256 GB module can reduce operating power by more than 40% versus two 128 GB modules, enabling greater efficiency for modern AI data centers.”

The memory module also incorporates “advanced packaging techniques, 3D stacking (3DS) multiple memory dies connected by through-silicon vias (TSVs)” for even greater efficiency gains.

If you’ve read my recent history lesson on Micron, you’ll already know it’s not unusual for the company to place itself at the cutting edge of memory. Indeed, most recently you’d be forgiven for thinking we’re experiencing a storage shortage because Micron has placed it all in this massive 245 TB data centre SSD.