IT Pro is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Doctors reject AI chatbot that is 'more accurate than a GP'

Royal College of GPs say no app can replace human physicians

The Royal College of General Practitioners (RCGP) has dismissed claims a chatbot can diagnose medical conditions as accurately as a GP.

Babylon Health unveiled its new bot at an event held at the Royal College of Physicians yesterday, saying it allows patients to contact the bot via an app without an appointment, with the bot offering health advice based on what patients tell it.

The company said the chatbot, Babylon AI, has achieved medical exam scores of the same level as or higher than a human doctor.

But its claims were disputed by the RCGP.

"No app or algorithm will be able to do what a GP does," said Professor Martin Marshall, vice chair of the RCGP.

"Every day we deliver care to more than a million people across the UK, taking into account the physical, psychological and social factors that may be impacting on a patient's health."

"The potential of technology to support doctors to deliver the best possible patient care is fantastic, but at the end of the day, computers are computers, and GPs are highly-trained medical professionals; the two can't be compared and the former may support but will never replace the latter," he said.

Professor Marshall added that while an app can pass an automated clinical knowledge test, in real life, clinical scenarios don't always have "cut and dried" answers.

Babylon Health said its new Babylon AI tool took part in a series of robust tests, including the relevant sections of the MRCGP exam, which is the final test for a trainee GP and set by the Royal College of GPs.

The average pass mark over the past five years for real-life doctors is 72%, whereas Babylon's AI scored 81%.

Ali Parsa, Babylon's founder and CEO, said the results showed how AI can globally support healthcare and provide accurate health advice regardless of circumstance.

"Tonight's results clearly illustrate how AI-augmented health services can reduce the burden on healthcare systems around the world," Dr Parsa said.

"Our mission is to put accessible and affordable health services into the hands of every person on Earth. These landmark results take humanity a significant step closer to achieving a world where no-one is denied safe and accurate health advice."

The company is also behind the NHS's GP at Hand app, which allows patients at five London clinics to consult with their GP via a video call.

But the College also publicly criticised the GP at Hand app for "cherry-picking" patients, leaving traditional GP services to deal with the most complex patients without sufficient resources, and does not endorse Babylon, or its GP at Hand service, being used in this way by in the NHS.

"Technology has the potential to transform the NHS, but it must be implemented in an equitable way that doesn't benefit some patients, and not others, and is not to the detriment of the general practice service as a whole," Marshall said.

Picture: Babylon Health founder Ali Parsa at Wednesday's launch

Featured Resources

Four strategies for building a hybrid workplace that works

All indications are that the future of work is hybrid, if it's not here already

Free webinar

The digital marketer’s guide to contextual insights and trends

How to use contextual intelligence to uncover new insights and inform strategies

Free Download

Ransomware and Microsoft 365 for business

What you need to know about reducing ransomware risk

Free Download

Building a modern strategy for analytics and machine learning success

Turning into business value

Free Download

Most Popular

Windows Server admins say latest Patch Tuesday broke authentication policies
Server & storage

Windows Server admins say latest Patch Tuesday broke authentication policies

12 May 2022
16 ways to speed up your laptop
Laptops

16 ways to speed up your laptop

13 May 2022
Costa Rica declares state of emergency following Conti ransomware attack
ransomware

Costa Rica declares state of emergency following Conti ransomware attack

10 May 2022