Curious how the marketplace for distributed file programs, interconnects, and high-end storage is taking part in out in 2024? You then could be available in the market evaluation that Hyperion Analysis is planning on rolling out over the subsequent a number of months.
Hyperion Analysis is the HPC-focused analyst group that separated from IDC earlier than IDC’s father or mother firm was The group, which is predicated in St. Paul, Minnesota, conducts periodic complete international HPC website surveys to get a greater thought of the compute, storage, and networking investments that among the largest HPC websites around the globe.
Mark Nossokoff, the Hyperion analyst who tracks storage, not too long ago sat down with Datanami to speak in regards to the agency’s analysis and the 2024 international HPC website survey that’s at present underway. The corporate plans to begin releasing outcomes from the 2024 website survey across the Worldwide Supercomputing Convention (ISC), which takes place subsequent month in Hamburg, Germany.
“We’ve got over 1,000 programs at over 100 websites who we ask about the entire gamut of the HPC, storage, and interconnect realm,” Nossokoff mentioned. “We ask about file system utilization utilization, capacities, on prem storage versus capability and storage within the cloud, most popular cloud storage suppliers, most popular on-prem storage distributors. So its has plenty of statistics.”
As in earlier years, the 2024 report will gauge who’s profitable within the battle amongst HPC storage file programs. Total and inside the NAS file system area, NFS was the clear winner in 2021, in accordance with 2021 HPC website survey report shared by Hyperion, with a couple of 53% share throughout 2,006 HPC programs operating at 141 supercomputer websites spanning authorities, business, and academia. That was adopted total by a number of parallel file programs led by Lustre at about 35%, and GPFS/Spectrum Scale at about 25%. , and HDFS at about 20%. ZFS, XFS, and different.
Hyperion might be trying to see how the file system panorama has modified. NFS figures to proceed to truthful nicely, notably amongst business websites, whereas Lustre will probably preserve its lead at authorities websites. Nossokoff may also be trying to see whether or not relative newcomers, corresponding to Distributed Asynchronous Object Storage (DAOS), the open supply object retailer spearheaded by Intel in 2012, have gained any traction.
“It is going to be attention-grabbing to see if DAOS has gained any traction past Argonne and Google, the place it’s the basis for its Parallelstore storage service providing,” Nossokoff mentioned.
Hyperion may also be exploring different conventional NFS-based programs and rising information platform architectures, together with these from DDN, Dell, Hammerspace, HPE, IBM, NetApp, Qumulo, VAST, Weka, and others.
(Pavel Ignatov/Shutterstock)
Hyperion might be trying to see how the surge of funding in AI is impacting storage. Are they utilizing completely different storage varieties for coaching and inference workloads, or is it the identical? Which distributors are shifting forward within the race, and is there anyone new or surprising gaining traction?
“We’re requested a whole lot of about interconnect adoption,” Nossokoff mentioned. “What structure is it? Is it a single [converged] interconnect that handles each storage and the MPI visitors?, Or are they impartial interconnects, one devoted to server-to-server and the opposite devoted to system-to-storage?”
Lastly, Hyperion will analyze the community desire, which is often a horserace between InfiniBand and Ethernet. For the 2021 website survey, Ethernet was forward with a forty five% share, with 100Gb being the commonest pace, whereas InfiniBand had a 36% share of the general community market, with 100Gb and 200Gb sharing an similar 31% share inside the InfiniBand cohort. And the way will OmniPath fare, and can it climb above the 4.5% share it had within the final website survey?
The positioning survey additionally delves into the compute facet of the home, which permits Hyperion to collect very particular information about what number of programs are in use, what number of processors, and so forth. The corporate additionally examines person’s spending on HPC assets within the cloud, offering perception into cloud spending patterns on compute, storage, networking, and software program purposes.
Hyperion doesn’t sometimes launch the whole outcomes from the positioning survey suddenly. The examine is funded by a handful of shoppers, who get first dibs on the good information. However ultimately the analysis trickles right down to the business at giant, giving us an in depth peak behind the HPC curtain.
Associated Gadgets:
Object and File Storage Have Merged, However Product Variations Stay, Gartner Says
The Previous and Way forward for HPDA: A Q&A with Steve Conway
Hammerspace Hits the Market with International Parallel File System
DAOS, ethernet, file system, file programs, GPFS, HDFS, hpc, Hyperion Analysis, infiniband, Lustre, Mark Nossokoff, nas, parallel file system, storage, XFS, ZFS
