Are reasoning models fundamentally flawed?
A report from Apple has cast significant doubts on the efficacy of reasoning models, going as far as to suggest that when a problem is too complex, they simply give up
A report from Apple has cast significant doubts on the efficacy of reasoning models, going as far as to suggest that when a problem is too complex, they simply give up.
AI reasoning models have emerged in the past year as a beacon of hope for large language models (LLMs), with AI developers such as OpenAI, Google, and Anthropic selling them as the go-to solution for solving the most complex business problems.
However, a new research paper by Apple has cast significant doubts on the efficacy of reasoning models, going as far as to suggest that when a problem is too complex, they simply give up. What's going on here? And does it mean reasoning models are fundamentally flawed?
In this episode, Rory Bathgate speaks to ITPro's news and analysis editor Ross Kelly to explain some of the report's key findings and what it means for the future of AI development.
Highlights
"It sounds a bit obvious, but at the same time, the way that this has been, framed by a lot of providers, makes it seem like they're the be-all and end-all. But once you reach a level of complexity, yeah, you start to encounter some serious problems."
"What's interesting for me, right off the bat, is, what Apple is showing is that that's actually the opposite of what these are good at, that they are maybe more performant, maybe they're slightly better at solving complex problems up to a point, but that if you actually try and give them really complex problems, they are completely ineffective."
"Apple is claiming that OpenAI hasn't made a model that can think, to which my reaction was, did you think OpenAI had made a model that can think? "
- Subscribe to The IT Pro Podcast on Apple Podcasts
- Subscribe to The IT Pro Podcast on Spotify
- Subscribe to the IT Pro newsletter
- Join us on LinkedIn
-
Meta set for AI-driven cuts amid staff protestNews Memo suggests another round of restructuring is set to hit Meta and its staff
-
How to protect your business from living off the land attacksIn-depth A greater focus on identity management and incident response is key for businesses as attackers adopt this new methodology
-
Google Cloud Next 2026: Scaling AI agentsITPro Podcast The hyperscaler is going all in on full-stack AI deployment, underpinned by in-house innovations such as TPUs
-
Can Europe achieve AI sovereignty?ITPro Podcast Efforts to run AI in trusted regions can clash with access to frontier model updates, business scalability
-
How AI is transforming enterprise dataITPro Podcast With natural language processing, data engineers can explore enterprise data with more ease than ever
-
Will AI hiring entrench gender bias?ITPro Podcast This International Women's Day, it's more important than ever to consider the inherent biases of training data
-
February rundown: SaaS-pocalypse now?ITPro Podcast Geopolitical uncertainty is intensifying public and private sector focus on true sovereign workloads
-
The agentic identity crisisITPro Podcast With millions of AI agents being deployed, how can security teams maintain oversight and governance?
-
Building a secure payments strategySponsored Podcast Facilitating a smooth payments experience for iGaming can go hand-in-hand with building a more secure platform
-
Mitigating bad botsSponsored Podcast Web crawlers pose an immediate business risk, necessitating immediate action from IT leaders
