Vision 2024: Intel launches Gaudi 3 accelerator and next-gen Lunar Lake, CEO shares future strategy

Gaudi 3 delivers 50% better inference and 40% more power efficiency than NVIDIA H100

Reading time icon 3 min. read


Readers help support Windows Report. We may get a commission if you buy through our links. Tooltip Icon

Read our disclosure page to find out how can you help Windows Report sustain the editorial team Read more

intel gaudi 3 release AI plans

Microsoft is focused on integrating artificial intelligence into PCs, and Intel is at the forefront of this campaign. During the recent Vision 2024 event, Intel unveiled Gaudi 3, its second AI chip, set to take on NVIDIA. Besides, Intel confirmed the next-gen Lunar Lake with 100+ TOPS (Tera Operations Per Second) performance.

At the Vision 2024 event, Intel’s CEO Pat Gelsinger, said,

Innovation is advancing at an unprecedented pace, all enabled by silicon – and every company is quickly becoming an AI company. Intel is bringing AI everywhere across the enterprise, from the PC to the data center to the edge. Our latest Gaudi, Xeon and Core Ultra platforms are delivering a cohesive set of flexible solutions tailored to meet the changing needs of our customers and partners and capitalize on the immense opportunities ahead.

About Gaudi 3, the latest AI chip from Intel

The Gaudi 3 AI accelerator will be the best choice for powering AI systems, boasting 4x higher AI compute for BF16 and a 1.5x rise in memory bandwidth over the previous models.

Tests conducted by Intel reveal that Gaudi 3 will be able to train Llama2 models with 7B and 13B parameters 50% faster than the current market leader, NVIDIA H100.

Intel plans to make Gaudi 3 available to OEMs (Official Equipment Manufacturers), Dell Technologies, HPE (Hewlett Packard Enterprise), Lenovo and Supermicro, by the second quarter of 2024.

Intel also shared a list of enterprises that utilized its products to train AI models or perform AI-powered tasks. It includes NAVER, Bosch, IBM, Seekr, IFF, Landing AI, Roboflow, and Infosys, amongst others.

Intel Xeon and Intel Core Ultra (Lunar Lake) receive improvements

Intel launched two new processors in the Xeon series, the Intel Xeon 6 processor with E-cores (Sierra Forest) and the Intel Xeon 6 processor with P-cores (Granite Rapids). The former offers improved efficiency, while the latter aids the AI performance. Besides, Sierra Forest will launch in the second quarter of 2024, followed by Granite Rapids.

The next-gen Intel Core Ultra (Lunar Lake) series of processors will deliver better results, hitting 100 TOPS (Tera Operations Per Second).

Intel also plans to ship more than 40 million AI PCs worldwide in 2024 across a range of designs, be it handheld consoles or ultra-thin laptops.

Read more about the Vision 24 event in Intel’s official press release.

In the last few years, Intel has made significant developments in the field of AI, but it has yet to beat NVIDIA, which commands roughly 70% of the AI chip market share. Also, NVIDIA plans to release two new AI processors.

The battle is about to get intense, with AI PCs gaining relevance. According to Microsoft, an ideal AI PC should have the Neural Processing Unit, the most recent CPU and GPU, support for Microsoft Copilot, and a dedicated Copilot key.

Most modern-day laptops with AI capabilities ship with a dedicated Neural Processing Unit. Quickly check if your PC has an NPU.

What do you think about Intel making strides in AI and Gaudi 3? Share with our readers in the comments section.

More about the topics: AI, intel