IBM has added a feature to its Watson OpenScale software that detects and mitigates against gender and ethnic bias.
These recommended bias monitors are the latest addition to Watson OpenScale, which was launched in September 2018, with the purpose of giving business users and non-data scientists the ability to monitor their AI and machine learning models to better understand performance. The software helps to monitor algorithmic bias and provides explanations for AI outputs.
Up till now, users manually selected which features or attributes of a model to monitor for bias in production, based on their own knowledge. But according to IBM, with the recommended bias monitors, Watson OpenScale will now automatically identify whether known protected attributes, including sex, ethnicity, marital status, and age, are present in a model and recommend they are monitored.
What's more, IBM says it is working with the regulatory compliance experts at Promontory to continue expanding this list of attributes to cover the sensitive demographic attributes most commonly referenced in data regulation.
"As regulators begin to turn a sharper eye on algorithmic bias, it is becoming more critical that organisations have a clear understanding of how their models are performing and whether they are producing unfair outcomes for certain groups," said Susannah Shattuck, the offering manager for Watson OpenScale.
Artificial intelligence is a rapidly advancing sector, particularly in the UK where it is often reported that the country is one of the leading developers, but this growth is often offset with concerns that the technology is being developed in a way that accentuates inequality.
In March, the Centre for Data Ethics and Innovation (CDEI) announced it had joined forces with the Cabinet Office's Race Disparity Unit to investigate potential bias in algorithmic decision-making.
As algorithms become more commonplace in society, their potential to help people increases. However, recent reports have shown that human bias can creep into algorithms, thus ultimately harming the people it's meant to help.
Get the ITPro. daily newsletter
Receive our latest news, industry updates, featured resources and more. Sign up today to receive our FREE report on AI cyber crime & security - newly updated for 2023.
Bobby Hellard is ITPro's Reviews Editor and has worked on CloudPro and ChannelPro since 2018. In his time at ITPro, Bobby has covered stories for all the major technology companies, such as Apple, Microsoft, Amazon and Facebook, and regularly attends industry-leading events such as AWS Re:Invent and Google Cloud Next.
Bobby mainly covers hardware reviews, but you will also recognise him as the face of many of our video reviews of laptops and smartphones.