Sponsor Content Created With Fastly
Mitigating bad bots
Web crawlers pose an immediate business risk, necessitating immediate action from IT leaders
One of the major challenges of today’s environments is the rising tide of bots, with generative AI driving a new era of the technology.
Bots have been a part of the internet since at least the 1990s but recent technological advancements have swollen their number exponentially. Some of these net dwellers are benign, others are malicious, and some sit somewhere in between.
But no matter what category they fall into, they can all cause problems for businesses. How much of an issue is this for businesses and what can they do to mitigate it?
In this special discussion, in association with Fastly, ITPro’s managing editor Jane McCallion speaks to Marshall Irwin chief information security officer (CISO) at Fastly, to discover more about how organizations can protect themselves from the risks of bots.
Highlights
“Bot traffic is a growing portion of web traffic. In total, I think it takes up about 37% of our traffic overall, a pretty huge number and a growing number, one that continues to grow over time and I think for various reasons, we expect it to continue to grow. Of that portion of traffic, about 80% of that is malicious and then a growing portion of it is driven by AI bots.”
“Traditionally, bot traffic becomes a problem when you're thinking about fraud on your platform sometimes, or things as a CISO I'm very mindful of which is like account takeover attacks that are trying to compromise your users accounts and bots are often used to do that.”
“One challenge, typically for for customers or websites in the media space, is that they're consuming that content, feeding it into their LLM models, and then monetizing that content without any return for the website or media platform. And that's a big problem, it presents an immediate business risk, and it's something that's been in the news. So your bigger media companies are quite mindful in seeing this problem and seeing their revenue and their monetization potential.”
“What CISOs and IT leaders will not be as mindful of are these more recent problems that I've been talking about, this problem of crawling to scrape your inventory and monetize it elsewhere, or the operational problems that these are going to cause and I think that's going to hit a much broader category of industries. It means that a much larger group of CISOs and IT leaders are going to need to be mindful of this outside of these sort of more niche use cases, where I think your leaders in those functions have been working for a long time to try to address this problem.”
Footnotes
- Learn more about Fastly bot management
- Security experts issue warning over the rise of 'gray bot' AI web scrapers
- AI is helping bad bots take over the internet
Subscribe
- Subscribe to The IT Pro Podcast on Apple Podcasts
- Subscribe to The IT Pro Podcast on Spotify
- Subscribe to the IT Pro newsletter
- Join us on LinkedIn
Sign up today and you will receive a free copy of our Future Focus 2026 report - the leading resource for IT decision-maker insight on priorities and investment areas in AI, security and more.
ITPro is a global business technology website providing the latest news, analysis, and business insight for IT decision-makers. Whether it's cyber security, cloud computing, IT infrastructure, or business strategy, we aim to equip leaders with the data they need to make informed IT investments.
For regular updates delivered to your inbox and social feeds, be sure to sign up to our daily newsletter and follow on us LinkedIn and Twitter.
-
The next IoT challenge: making connected products work at global scaleAs connected products move from pilots to operational infrastructure, organizations focused on scaling IoT need to think beyond the device and design for reliability, security and scale from day one
-
Meta is launching a trades academy to bolster AI infrastructure build-outsNews The tech giant will stump up to help train workers who will build data centers – and guarantees them jobs
-
Dell Technologies World 2026: agents, hardware, and tokenomicsJane, live from Las Vegas, takes us through her week at Dell’s AI agent extravaganza
-
Google Cloud Next 2026: Scaling AI agentsITPro Podcast The hyperscaler is going all in on full-stack AI deployment, underpinned by in-house innovations such as TPUs
-
Can Europe achieve AI sovereignty?ITPro Podcast Efforts to run AI in trusted regions can clash with access to frontier model updates, business scalability
-
How AI is transforming enterprise dataITPro Podcast With natural language processing, data engineers can explore enterprise data with more ease than ever
-
Will AI hiring entrench gender bias?ITPro Podcast This International Women's Day, it's more important than ever to consider the inherent biases of training data
-
February rundown: SaaS-pocalypse now?ITPro Podcast Geopolitical uncertainty is intensifying public and private sector focus on true sovereign workloads
-
The agentic identity crisisITPro Podcast With millions of AI agents being deployed, how can security teams maintain oversight and governance?
-
Building a secure payments strategySponsored Podcast Facilitating a smooth payments experience for iGaming can go hand-in-hand with building a more secure platform
