A report from Apple has cast significant doubts on the efficacy of reasoning models, going as far as to suggest that when a problem is too complex, they simply give up.
AI reasoning models have emerged in the past year as a beacon of hope for large language models (LLMs), with AI developers such as OpenAI, Google, and Anthropic selling them as the go-to solution for solving the most complex business problems.
However, a new research paper by Apple has cast significant doubts on the efficacy of reasoning models, going as far as to suggest that when a problem is too complex, they simply give up. What's going on here? And does it mean reasoning models are fundamentally flawed?
In this episode, Rory Bathgate speaks to ITPro's news and analysis editor Ross Kelly to explain some of the report's key findings and what it means for the future of AI development.
Highlights
"It sounds a bit obvious, but at the same time, the way that this has been, framed by a lot of providers, makes it seem like they're the be-all and end-all. But once you reach a level of complexity, yeah, you start to encounter some serious problems."
"What's interesting for me, right off the bat, is, what Apple is showing is that that's actually the opposite of what these are good at, that they are maybe more performant, maybe they're slightly better at solving complex problems up to a point, but that if you actually try and give them really complex problems, they are completely ineffective."
"Apple is claiming that OpenAI hasn't made a model that can think, to which my reaction was, did you think OpenAI had made a model that can think? "
- Subscribe to The IT Pro Podcast on Apple Podcasts
- Subscribe to The IT Pro Podcast on Spotify
- Subscribe to the IT Pro newsletter
- Join us on LinkedIn
-
The Replit vibe coding incident gives us a glimpse into why developers are still wary of AI coding assistantsNews Recent vibe coding snafus highlight the risks of AI coding assistants
-
AI breaches aren’t just a scare story any more – they’re happening in real lifeNews IBM research shows proper AI access controls are leading to costly data leaks
-
Microsoft is doubling down on multilingual large language models – and Europe stands to benefit the mostNews The tech giant wants to ramp up development of LLMs for a range of European languages
-
Google Cloud Summit London 2025: Practical AI deploymentITPro Podcast As startups take hold of technologies such as AI agents, where is the sector headed?
-
The evolution from robots to agentsSponsored Podcast With the right adoption strategy, agentic AI can be a force multiplier for productivity
-
Podcast Transcript: Are reasoning models fundamentally flawed?ITPro Podcast A report from Apple has cast significant doubts on the efficacy of reasoning models, going as far as to suggest that when a problem is too complex, they simply give up
-
‘A complete accuracy collapse’: Apple throws cold water on the potential of AI reasoning – and it's a huge blow for the likes of OpenAI, Google, and AnthropicNews Apple published a research paper on the effectiveness of AI 'reasoning' models - and it seriously rains on the parade of the world’s most prominent developers.
-
Dell Technologies World 2025: All in on AIITPro Podcast From the cloud to the edge, enterprise architecture for AI must be carefully considered
-
SAS Innovate 2025: Pursuing pragmatic AIITPro Podcast As CISA delivered an eleventh-hour reprieve for the CVE database, AWS reportedly began to pause some data center leases
-
Putting small language models under the microscopeITPro Podcast The benefits of small language models are undeniable – but they're no silver bullet
