How we test security software

How we test: Security software

To assess how well consumer-grade security packages actually handle threats in the wild, we draw on real-world tests carried out by not one but two specialist antivirus testing labs – namely and The scores we cite represent the average of the ratings reported by each lab in their latest available reports. The number of false positives represents the total number of incorrect alerts raised up by each package, across both labs’ tests.

To measure the impact of each security product on system responsiveness, AV-Comparatives uses a combination of its own in-house test suite and the PCMark 10 benchmark, while AV-Test times a series of standardised tasks, including launching applications, opening websites and copying files, on both a typical and high-end PC. We convert these scores into a percentage and take the average to reach our performance rating for each suite we test.

The Veritas Backup exc console

We also run our own speed tests, using each suite to scan through an external hard disk containing 55GB of assorted files, including documents, images, application installers – and the EICAR test file, a harmless bit of code that all security packages identify as faux-malware for testing purposes.

While protection and performance are of great importance when choosing a security suite, those aren’t the only things we consider. We extensively road-test each package ourselves, and take into account the accessibility and user-friendliness of the interface, as well as the breadth and usefulness of features beyond the standard scanning component. Naturally, we also weigh up value for money, and all of these factors are combined to award each security suite a star rating out of five.


ITPro is a global business technology website providing the latest news, analysis, and business insight for IT decision-makers. Whether it's cyber security, cloud computing, IT infrastructure, or business strategy, we aim to equip leaders with the data they need to make informed IT investments.

For regular updates delivered to your inbox and social feeds, be sure to sign up to our daily newsletter and follow on us LinkedIn and Twitter.