Microsoft Claims Its Web IQ AI Search Is 2.5x Faster Than the Competition


microsoft web iq
Image credit: Microsoft

AI agents can sound confident while relying on outdated information, which is a problem developers can’t ignore. This is exactly why Microsoft is pushing external web grounding as a foundational layer for AI applications. And, to do so, it is highlighting its Web IQ APIs as a way to deliver current evidence with less latency and fewer tokens.

Microsoft says AI agents need more than training data

In a new engineering post, Microsoft explains why model knowledge alone can’t reliably support every AI task. Training data can become outdated, while broad knowledge does not guarantee accurate answers about specialized subjects, product versions, or local regulations.

External grounding addresses these limitations by retrieving relevant information when a model generates an answer. This gives AI agents access to current documentation, news, regulations, and other sources beyond their training data.

It also helps users verify an answer through source links and supporting evidence. Microsoft stresses that grounding does not guarantee correctness, but it provides a clearer basis for checking recommendations before acting on them.

Microsoft Web IQ targets speed, quality, and lower token usage

Microsoft introduced Web IQ earlier this year as a suite of AI-native web search and grounding APIs. The service aims to provide relevant external information to large language models, AI agents, and applications.

Microsoft claims that Web IQ scored 79.05 in a blind test involving 3,000 queries sampled from production traffic. The next-best service scored 75.70, according to the company’s comparison. Microsoft describes this measure as grounding satisfaction, not an accuracy percentage.

Image credit: Microsoft

The company also claims Web IQ achieved 164-millisecond P95 latency across five data center regions. It says the closest competitor recorded 406 milliseconds, making Web IQ approximately 2.5 times faster by that measure.

Microsoft further claims Web IQ reached peak quality at around 40,000 tokens per query. Competing services reportedly used 60,000 to 100,000 tokens while achieving lower scores.

Developers still need to test their own workloads

Microsoft recommends evaluating freshness, source coverage, citation quality, total task costs, and governance before choosing a grounding service. Results can vary depending on the questions, models, and workflows involved. Web IQ also complements Microsoft’s Work IQ, Fabric IQ, and Foundry IQ offerings. Together, these services aim to connect external web information with workplace collaboration, business data, and organizational knowledge.

More about the topics: AI, microsoft

Readers help support Windows Report. We may get a commission if you buy through our links. Tooltip Icon

Read our disclosure page to find out how can you help Windows Report sustain the editorial team. Read more

User forum

0 messages