On the SC24 supercomputing convention held in November in Atlanta, Hafþór Júlíus Björnsson (the actor who performed The Mountain in Sport of Thrones), deadlifted a customized barbell weighed down by 453 kilograms (1000 kilos) of stable state drives. The info saved in these drives totaled simply over 280 petabytes.
“With out query, that is essentially the most information lifted by a human in historical past,” says Andy Higginbotham, senior director of enterprise improvement at Phison Electronics.
Behind this publicity stunt is an actual pattern—to feed AI’s insatiable data appetite, reminiscence drives are getting bigger, ad infinitum. Phison lately announced the most important SSD reminiscence drive to this point, storing 128 terabytes of information, and piled lots of of them into Björnsson’s barbell. Inside a couple of weeks, Solidigm announced its personal 123 Tb drive. Samsung and Western Digital additionally lately began carrying comparable merchandise.
The shift in direction of extra AI workloads in information facilities has led to very power-hungry chips, principally GPUs. Because the general energy use in an information heart goes up, individuals are searching for methods to make use of much less energy wherever attainable. On the identical time, large language models and different AI models require ever growing quantities of reminiscence.
“You may see the place storage necessities are going,” says Roger Corell, senior director of AI and management advertising at Solidigm. “You take a look at a big language mannequin only a couple years in the past, you had a half a petabyte per rack or decrease. And now there’s massive language fashions that pair with between three and three and a half petabytes per rack. Storage effectivity to allow continued scaling of AI infrastructure is absolutely, actually necessary.”
Crucially, this new crop of solid-state drives takes up the identical space in a computing rackand energy funds as their roughly 32 Tb and 64 Tb predecessors—though they’re barely taller—that means they are often swapped into information facilities for a simple win.
3 Methods to Enhance SSD Capability
“There’s three sort of vectors you’ll be able to innovate on to drive up capability per SSD,” says Corell. “One is the bits per cell, after which two is what number of cells are you able to pack in a single layer, and what number of layers are you able to stack of those reminiscence cells.”
The variety of bits per cell is actually what number of completely different values will be saved in a single NAND flash floating-gate transistor. These transistors are packed onto a layer with ever-increasing densities. Including extra layers does make the machine taller, however, Corell says, top is just not a limiting consider information facilities at present, so there’s room to broaden.
Solidigm was already making four-bit-per-cell units, so it innovated by packing extra cells per layer to go from the 60 Tb mannequin to its 122 Tb machine, primarily by utilizing the smallest obtainable NAND know-how and decreasing the scale of non-NAND elements. Phison went from thee-bit to four-bits NAND cells, bettering alongside all three vectors to go from its 32 Tb to its 128 Tb drive.
Going to a better variety of bits per cell makes the write occasions considerably slower, however that is nonetheless a win in lots of purposes, says Allyn Malventano, senior supervisor of technical advertising at Phison.
Sustaining the identical energy draw as smaller units is a positive balancing act. “The drive builders are at all times going to should do to determine, okay, if we configure it this specific method, we possibly we will get some greater efficiency, but when we do this, it’s going to take some extra energy with a view to do this proper,” Malventano says. “So there’s a, mainly a tuning operation that goes on for any specific capability.”
The demand for greater capability reminiscence drives is just not slowing down, both. “It’s by no means going to cease. There’s at all times going to be extra demand for bigger SSDs,” Higginbotham says. Solidigm’s Corell predicts there can be petabyte SSDs available on the market earlier than the last decade is completed.
From Your Web site Articles
Associated Articles Across the Net
