Intel has recently launched an AI accelerator called Gaudi 3 at its Vision 2024 conference, designed to expedite enterprise-level artificial intelligence (AI) workloads. According to GSMArena, Gaudi 3 is faster than the current AI industry standard, Nvidia’s H100, making it a potential game-changer in the AI industry. Gaudi 3 employs the same architecture and principles as its predecessor, Gaudi 2, but it utilizes TSMC’s 5nm process, which improves its efficiency as compared to Gaudi 2’s TSMC’s 7nm. Gaudi 3 comes with up to 128 GB HBM2e with 3.7 TB/s bandwidth and 900W TDP, making it a powerful AI accelerator.
Intel has shared benchmarks that compare Gaudi 3 with Nvidia’s H100, where they have tested various major language models such as LLAMA2-7B, LLAMA2-13B, and GPT 3-175B. The results demonstrate that Gaudi 3 provides up to 1.7 times faster performance than its competition. Furthermore, Intel has claimed that Gaudi 3 offers up to 2.3 times higher electricity efficiency than Nvidia’s H100.
Intel has already begun sampling Gaudi 3 with air-cooling capabilities to its partners, and the product is expected to start shipping in the third quarter. Additionally, Intel has plans to offer Gaudi 3 models with liquid cooling in the fourth quarter of this year, which will further enhance its performance.