‘We are now seeing MAI models outperform general-purpose frontier models’: Microsoft CEO Satya Nadella touts in-house models to cut spiralling AI costs – and reduce growing reliance on frontier labs

Microsoft CEO Satya Nadella says the company plans to expand use of its MAI model range as the company looks to offer customers lower-cost AI options.

The in-house models, unveiled by the company in June, are designed for specific enterprise tasks and span a range of areas, including image and voice generation, audio transcription, and coding.

In a blog post on 23 July, Nadella outlined the tech giant’s new ‘Frontier Diffusion and Control’ strategy, which aims to help customers reduce reliance on costly frontier models and emphasize the importance of model choice for specific use-cases.

The move by Microsoft comes amidst growing concerns about spiralling AI costs over the last six months. With trends such as ‘tokenmaxxing’ and the shift toward consumption-based pricing, some companies have been left with hefty bills as AI use accelerates.

“In a world where software has real marginal cost for the first time, how do we ensure frontier benefits are diffused across the entire ecosystem?” Nadella wrote.

“The key is to optimize the cost-to-outcome frontier in real-world context,” he added. “In practical terms, that means using the right model for each task, and optimizing the context, skills, tools, and agent harness around it.”

Boxing clever with AI model selection

Nadella’s contention here is that these in-house models can give customers “frontier capabilities” albeit in a cheaper, bespoke capacity.

Simply put, these are domain-specific models based for an enterprise’s individual needs, not a one-size-fits-all frontier model such as those offered by OpenAI or Anthropic.

These still form part of the broader “orchestration system” used alongside MAI, but all amounts to helping users box clever when choosing what model to use.

“These models have been built ground up with clean data lineage and optimized for learning transfer from generalist to specialized skills in enterprise RLEs,” he explained.

This will require enterprises to implement evaluation processes when considering which model to use in which context, he said.

“Product-specific evals and model independence give us the control and a direct hill to climb, and to keep refining until we reach the right quality-cost target,” Nadella wrote.

“We are now seeing MAI models outperform general-purpose frontier models in many use-cases while using a fraction of the tokens.”

Internal testing of MAI for its own products has so far delivered “promising early results”, according to Nadella. The company has piloted the use of these models in GitHub Copilot, Outlook, and other Microsoft 365 services.

The company plans to take the same approach with Copilot Chat, PowerPoint, and other services, he added.

Nadella’s comments align closely with recent research from Gartner on rising AI costs.

While focusing primarily on the use of AI in software engineering, the consultancy told ITPro that enterprises should establish a “use-case-driven decision” framework when using the technology for certain tasks.

This, Gartner noted, will help reduce costs by encouraging users to stop needlessly allocating agents to tasks they’re not designed for.

Microsoft eyes model diversity

Nadella’s blog post marks the latest in a string of comments made by the Microsoft chief hinting at the company’s efforts to diversify model choice - and to stop pushing frontier models on customers.

In mid-July, he warned about the risks of relying too heavily on frontier AI labs, describing what he called the “reverse information paradox”.

Nadella said enterprises are essentially “paying twice” for AI services, handing too much data to providers, and receiving little benefit in return.

These providers, meanwhile, gain valuable insights into customer products that could help them refine - or build - competing options.

"If learning flows in only one direction, economic value converges toward the owners of the learning infrastructure rather than the creators of the knowledge itself," he said.

"Therefore, it’s imperative that we distribute the learning infrastructure to every firm so that they can control their own learning loop.

As ITPro noted at the time, his comments were peculiar given the close ties the tech giant maintains with OpenAI and Anthropic, whose models are deeply entwined across its core product range.

Microsoft's long-standing relationship with OpenAI saw it take the lead as the go-to model for its software services, yet this changed last year after striking a deal with Anthropic to give users greater choice.

FOLLOW US ON SOCIAL MEDIA

Follow ITPro on Google News and add us as a preferred source to keep tabs on all our latest news, analysis, views, and reviews.

You can also follow ITPro on LinkedIn, X, Facebook, and BlueSky.