Meta Bets on AWS Graviton Chips to Power Growing Agentic AI Workloads

The deployment will start with tens of millions of Graviton cores


As every major tech giant around the globe, Meta has also been doubling down on its AI goals, even if it comes at a cost off laying off its talent pool. Yes, Meta has announced that it’ll cut 10% of its workforce as AI spending is mounting. Speaking of AI, Meta today confirmed a partnership with Amazon Web Services (AWS) to bring tens of millions of AWS Graviton cores into its compute portfolio.

Meta turns to Graviton cores amid growing AI workloads

The company says this deployment will start with tens of millions of Graviton cores, with room to scale further as its AI efforts grow. These systems rely heavily on CPUs for tasks like reasoning, planning, and executing multi-step workflows, rather than just traditional GPU-heavy training.

“This isn’t just about chips; it’s about giving customers the infrastructure foundation, as well as data and inference services, to build AI that understands, anticipates, and scales efficiently to billions of people worldwide. Meta’s expanded partnership, deploying tens of millions of Graviton cores, shows what happens when you combine purpose-built silicon with the full AWS AI stack to power the next generation of agentic AI,” said Nafea Bshara, Vice President and Distinguished Engineer at Amazon.

Meta also highlights that Graviton5 cores are designed for faster processing and higher bandwidth, which are key for handling continuous AI workloads at scale. Notably, the Graviton5 chip packs 192 cores and a cache that is five times larger than its predecessor, cutting communication delays between cores by up to 33%. That being said, the company is not relying on a single architecture.

A broader shift toward diversified AI infrastructure

What stands out is Meta’s broader approach to infrastructure. The company says no single chip can handle every workload efficiently, which is why it is investing across data centers, custom hardware, and cloud partnerships.

“As we scale the infrastructure behind Meta’s AI ambitions, diversifying our compute sources is a strategic imperative. AWS has been a trusted cloud partner for years, and expanding to Graviton allows us to run the CPU-intensive workloads behind agentic AI with the performance and efficiency we need at our scale,” said Santosh Janardhan, Head of Infrastructure at Meta.

With AI systems now expected to serve billions of users, Meta’s strategy appears to focus on flexibility as much as performance. Not to forget, Meta also recently announced partnership with Broadcom to build custom AI chips for next-gen infrastructure.

More about the topics: AI, Amazon, Meta

Readers help support Windows Report. We may get a commission if you buy through our links. Tooltip Icon

Read our disclosure page to find out how can you help Windows Report sustain the editorial team. Read more

User forum

0 messages