IT Pro is supported by its audience. When you purchase through links on our site, we may earn an affiliate commission. Learn more

Scientists build drones capable of detecting violence in crowds

But the algorithm gets less accurate the more people it tries to track

Scientists have trained drones to recognise violent behaviour in crowds using AI.

In a paper called Eye in the Sky, researchers from Cambridge University and India's technology and sciences institutes detailed how they fed an alogirthm videos of human poses to help their camera-fitted drones detect people committing violent acts.

The researchers claim the system boasts a 94% accuracy rate at identifying violent poses,and works in three steps: first the AI detects humans from aerial images, then it uses a system called "ScatterNet Hybrid Deep Learning" to interpret the pose of each detected human and finally the orientation of the limbs in the estimated pose are numbered and joined up like a coloured skeleton to identify individuals.

The algorithm used by the AI is trained to match five poses the researchers have deemed violent, which are classified as strangling, punching, kicking, shooting and stabbing.

Volunteers acted out the poses to train the AI, but they were generously spaced out and used exaggerated movements whilst acting out attacks. The report explains that the larger the crowd, and the more violent individuals within it, the less accurate the AI becomes.

"The accuracy of the Drone Surveillance System (DSS) decreases with the increase in the number of humans in the aerial image. This can be due to the inability of the FPN network to locate all the humans or the incapability of the SHDL network to estimate the pose of the humans accurately," the researchers wrote. "The incorrect pose can result in a wrong orientation vector which can lead the SVM to classify the activities incorrectly."

When one violent individual is in the crowd, the system is 94.1% accurate, which reduces to 90.6% with two, down to 88.3% for three, 87.8% for 4 and 84% for five violent individuals. By those figures, tracking violence in widespread incidents like the 2011 riots would currently be unworkable.

AI-powered recognition software is already in use among law enforcement bodies, despite fears that it is not accurate enough.

Both the Metropolitan Police and South Wales Police were accused of using dangerously inaccurate facial recognition technology by privacy campaign groups last month.

The groups revealed the Met had a failure rate of 98% when using facial recognition to identify suspects at last year's Notting Hill Carnival and that South Wales Police misidentified 2,400 innocent people and stored their information without their knowledge.

Image: Shutterstock

Featured Resources

Four strategies for building a hybrid workplace that works

All indications are that the future of work is hybrid, if it's not here already

Free webinar

The digital marketer’s guide to contextual insights and trends

How to use contextual intelligence to uncover new insights and inform strategies

Free Download

Ransomware and Microsoft 365 for business

What you need to know about reducing ransomware risk

Free Download

Building a modern strategy for analytics and machine learning success

Turning into business value

Free Download

Most Popular

Windows Server admins say latest Patch Tuesday broke authentication policies
Server & storage

Windows Server admins say latest Patch Tuesday broke authentication policies

12 May 2022
16 ways to speed up your laptop
Laptops

16 ways to speed up your laptop

13 May 2022
Costa Rica declares state of emergency following Conti ransomware attack
ransomware

Costa Rica declares state of emergency following Conti ransomware attack

10 May 2022