Do we have too much faith in technology?
With Horizon fresh in everyone’s minds and AI investment reaching new heights, leaders need to acknowledge that software is prone to faults
Computers and technology have well and truly permeated our professional and private lives. While this has led to great strides in efficiency, opened up new opportunities for businesses and individuals, and helped us become more connected than ever before, there are also downsides.
As the world becomes more digital and even menial tasks are increasingly outsourced to computer systems, a simultaneous shift in accountability and oversight needs to take place. Trust in computers is all too often automatic, with the pitfalls of this brought to life through the Horizon scandal in the UK. As we move to a future where AI is ubiquitous and computing permeates every level of life, how do we avoid a repeat of this kind of tragedy and move forward using AI in the most ethical way possible?
In this episode, Jane and Rory discuss the fallibility of tech and why business leaders would do well to approach the data they receive from computer systems with a healthy dose of skepticism.
Highlights
“If you were in a self-driving car, a lot of car companies have said, “Oh, but there's still someone behind the wheel. Well, you'd hope that the person behind the wheel knows how to drive so if they veer off course, they can take control. And it's the same thing when it comes to AI systems. The person there, who's approving this flagging this, the buck has to stop with them at least when it comes to accountability. And for that to be the caset hey have to know what they're doing.”
“People who are perhaps a little bit more into this might know that generative AI isn't prone to hallucinations and calling these false outputs hallucinations is kind of erroneous in its own right. They are false outputs. But what generative AI does is hallucinate.”
“It's a genuine concern in academia, a genuine concern in journalism, that somebody might not be doing their own research, this might not be their own work… But ironically, these professors are now putting their full faith in something that alleges it could detect this stuff, even when they normally themselves, by the way, actually can't detect anything.”
Footnotes
- Post Office Horizon scandal explained: Everything you need to know
- OpenAI aims to reduce generative AI 'hallucinations' with new training method
- OpenAI's Sam Altman: Hallucinations are part of the “magic” of generative AI
- Labour must approach AI carefully to avoid repeating a Dutch disaster
- Government urged to save '555' Post Office workers from "financial ruin"
- Use of generative AI in the legal profession accelerating despite accuracy concerns
- What is ethical AI?
Subscribe
- Subscribe to The IT Pro Podcast on Apple Podcasts
- Subscribe to The IT Pro Podcast on Google Podcasts
- Subscribe to The IT Pro Podcast on Spotify
- Subscribe to the IT Pro newsletter
- Subscribe to IT Pro 20/20
Sign up today and you will receive a free copy of our Future Focus 2026 report - the leading resource for IT decision-maker insight on priorities and investment areas in AI, security and more.

Rory Bathgate is Features and Multimedia Editor at ITPro, overseeing all in-depth content and case studies. He can also be found co-hosting the ITPro Podcast with Jane McCallion, swapping a keyboard for a microphone to discuss the latest learnings with thought leaders from across the tech sector.
In his free time, Rory enjoys photography, video editing, and good science fiction. After graduating from the University of Kent with a BA in English and American Literature, Rory undertook an MA in Eighteenth-Century Studies at King’s College London. He joined ITPro in 2022 as a graduate, following four years in student journalism. You can contact Rory at rory.bathgate@futurenet.com or on LinkedIn.
-
AI is creating a 'two-track' labor marketNews Research from PwC has found that as many entry-level functions are replaced by AI, organizations are looking for leadership and creativity
-
Anthropic suspends Fable and Mythos systems "for all users"News Despite complying with the government, Anthropic suggests it's only a "potential narrow, non-universal jailbreak"
-
The future of employment and gentlemanly hackersFeature Will the next IT jobs be in data center maintenance?
-
How AI code is changing software developmentITPro Podcast At firms like OpenAI the majority of code is now generated with AI tools
-
Managing tech costs in a volatile marketITPro Podcast Rising energy prices and sprawling cloud environments make the jobs of CIOs and CFOs harder than ever
-
April rundown: OpenAI hesitations and Apple's new CEOITPro Podcast As Apple enters a new era, DeepSeek is back and OpenAI is backing out of training clusters
-
January rundown: Amazon layoffs and the return of XPSITPro Podcast This year's tech layoffs have just begun, as Amazon sheds 16,000 workers in one go
-
Are hyperscalers backing out of Net Zero?ITPro Podcast Expanding data center construction and demand for high-energy workloads are pushing hyperscalers off course on carbon
-
The trends we're watching in 2026ITPro Podcast AI agents, worsening cyber attacks, and supercomputer expansion could define the coming year
-
The 2025 that didn't happenITPro Podcast Across AI, wearables, and quantum security, a number of promises fell through