Microsoft's Phi-3 AI model will work on all the Intel CPU and GPU lineups

We would all like to run LLMs fast and smooth but we can’t all afford powerful configurations. That’s why Microsoft created Phi-3, which is actually an SLM (small language model) that can work locally on much modest machines.

Now, Intel has stepped up its game by announcing its full support for Microsoft’s latest Phi-3 AI models across its entire CPU and GPU lineup. This move is not just about keeping up with the times; it’s about pushing the boundaries of what’s possible in AI computing, especially when it comes to personalization and efficiency on devices that aren’t exactly powerhouses.

Intel and Microsoft bring powerful AI processing to everyone

So, what’s the big deal with Microsoft’s Phi-3, you might wonder? Well, it’s all about making AI more accessible and efficient. Phi-3 models are designed to run smoothly on devices with limited processing power, which is a game-changer for developers and users alike. Imagine having the power of advanced AI on your smartphone or a small home device – that’s the future we’re looking at.

Intel already optimized their hardware to work seamlessly with these models. From their Gaudi AI accelerators to the Xeon and Core Ultra CPUs, and not forgetting the Arc GPUs, Intel is all in. This means better performance, more efficient AI processing, and, ultimately, a richer, more personalized experience for users.

And here’s the kick: According to Intel, their 6th Gen Xeon CPUs are showing twice the performance with Phi-3 models compared to their predecessors. And when it comes to edge AI processes, their Core Ultra CPU platform is making significant strides in personalization and responsiveness. The benchmarks are in, and the results are impressive, especially with the Phi-3 mini model tested on Intel’s Core Ultra 7 165H, paired with an Arc A770 GPU.

The possibilities are endless, from smarter home devices to more intuitive personal gadgets, all powered by AI that’s more accessible and efficient than ever before.

AI will soon be blended into all the intelligent devices around us. I don’t want to get into any doomsday scenarios you can find wherever you look on the internet, but I’ll have to agree that all this is a bit worrying.

What do you think about the new Intel developments? Feel free to express your opinion in the comments below.