Intel’s Gaudi 3 AI accelerator has officially been adopted by IBM Cloud. This marks the first instance of a CSP adopting Gaudi 3 into its portfolio, an exciting development.
IBM Becomes The First CSP To Offer Intel’s Gaudi 3 To Its Customers, Offering a Cost-Effective Alternative To NVIDIA
Team Blue’s AI venture hasn’t been as bright as its competitors, given that the firm didn’t capitalize on the AI hype early on. The company hasn’t managed to find a hold over the industry even now, which is why the adoption rates with Intel’s Gaudi AI lineup are much lower. However, IBM Cloud has become the first CSP to reveal the availability of Intel’s Gaudi 3 AI accelerators, and this is an attempt to deliver cost-effective solutions to clients, according to the CSP.
By bringing Intel Gaudi 3 AI accelerators to IBM Cloud, we’re enabling businesses to help scale generative AI workloads with optimized performance for inferencing and fine-tuning. This collaboration underscores our shared commitment to making AI more accessible and cost-effective for enterprises worldwide.
– Saurabh Kulkarni, VP at Intel
Clients can access the computational capabilities of the Gaudi 3 AI accelerators using IBM’s Cloud Virtual Servers, and interestingly, Signal65 has managed to test out the accelerator on the platform and has revealed performance relative to NVIDIA’s H100 and H200-based GPUs. This will also mark the first time Intel’s Gaudi 3 has been tested apart from internal ones, and the results have shown us that Intel could put a competition in the AI segment if they play their cards out correctly.
The benchmarks reveal that Intel’s latest accelerator outperforms the NVIDIA H100 and H200 AI accelerators on both IBM’s Granite (8B) and Meta’s Llama-3.1 models. The parameters were specific to each test run, meaning that in real-world usecases, Intel’s Gaudi 3 might not reflect the same performance, but these results were interesting. Benchmarks were further done on variable input sizes, and here’s what Signal65 concluded:
Gaudi 3 maintains highly competitive performance against NVIDIA H200 and H100 across various configurations, showcasing its broad applicability to various AI use cases.
To add, Intel’s Gaudi 3 is available in IBM Cloud at a lower rate compared to Team Green’s counterparts, making it an ideal option for clients looking for a cost-effective computational option. Overall, it is safe to say that Intel’s Gaudi 3 might pan out to be an impressive offering, given that it receives the right marketing and adoption. While it certainly cannot mimic NVIDIA’s options in terms of popularity and performance, Gaudi 3 is a viable alternative.