EU proposes strict regulations to curb AI misuse

The draft regulations call for the use of systems that allow ‘social scoring' by governments to be banned

The European Commission (EC) has proposed a new set of wide-reaching regulations that aim to combat the misuse of artificial intelligence (AI).

Under the draft regulations, EU citizens will be protected from the use of AI for mass surveillance by law enforcement, which was ruled unlawful in the UK last year. The use of AI in recruitment, credit score evaluation, as well as border control management will be also be classified as "high-risk” due to discrimination concerns, while systems that allow ‘social scoring' by governments will be banned.

The 100-page document, long-awaited by digital rights campaigners, aims to deliver “harmonised rules” on AI across the EU’s 27 member states and proposes “laying down effective, proportionate and dissuasive penalties for their infringement”. Similarly to the fines imposed by GDPR reaches, companies that break the rules face fines up to 6% of their global turnover or €30 million, whichever is the higher figure.

Commenting on the newly-drafted rules, the EC's executive vice president for the digital age Margrethe Vestager said that, regarding AI, “trust is a must, not a nice to have”. 

Related Resource

AI thought leadership digest

Expert outlook on the future of AI

AI thought leadership digest - whitepaper from DataRobotDownload now

“With these landmark rules, the EU is spearheading the development of new global norms to make sure AI can be trusted. By setting the standards, we can pave the way to ethical technology worldwide and ensure that the EU remains competitive along the way. Future-proof and innovation-friendly, our rules will intervene where strictly needed: when the safety and fundamental rights of EU citizens are at stake,” she added.

BCS, The Chartered Institute for IT stated that, by directly prohibiting the use of AI for indiscriminate surveillance and social scoring, the new AI legislation sets Europe on a different path to the US and China. BCS director of Policy, Dr Bill Mitchell OBE, said that “there will be a huge amount of work to do to professionalise large sections of the economy ready for this sweeping legislation”.

“These ambitious plans to make AI work for the good of society will be impossible to deliver without a fully professionalised AI industry. Those with responsibility for adopting and managing AI will need to ensure their systems comply with these new regulations, as well as those designing and developing these systems,”  he added.

Mitchell also predicts that “those involved in AI” will need to provide “evidence they have behaved ethically, competently and transparently”. 

“In principle this is something we should all welcome, and it will help restore public trust in AI systems that are used to make high stakes decisions about people,” he added.

The EC will now have to thrash out the details of the proposed regulations with EU national governments and the European Parliament before the rules can come into force, a process that can take a number of years. 

Featured Resources

Defeating ransomware with unified security from WatchGuard

How SMBs can defend against the onslaught of ransomware attacks

Free download

The IT expert’s guide to AI and content management

How artificial intelligence and machine learning could be critical to your business

Free download

The path to CX excellence

Four stages to thrive in the experience economy

Free download

Becoming an experience-based business

Your blueprint for a strong digital foundation

Free download

Most Popular

What are the pros and cons of AI?
machine learning

What are the pros and cons of AI?

8 Sep 2021
Zoom: From pandemic upstart to hybrid work giant
video conferencing

Zoom: From pandemic upstart to hybrid work giant

14 Sep 2021
Citrix mulling potential sale after tumultuous 2021
mergers and acquisitions

Citrix mulling potential sale after tumultuous 2021

15 Sep 2021