Sponsor Content Created With Fastly
Mitigating bad bots
Web crawlers pose an immediate business risk, necessitating immediate action from IT leaders
One of the major challenges of today’s environments is the rising tide of bots, with generative AI driving a new era of the technology.
Bots have been a part of the internet since at least the 1990s but recent technological advancements have swollen their number exponentially. Some of these net dwellers are benign, others are malicious, and some sit somewhere in between.
But no matter what category they fall into, they can all cause problems for businesses. How much of an issue is this for businesses and what can they do to mitigate it?
In this special discussion, in association with Fastly, ITPro’s managing editor Jane McCallion speaks to Marshall Irwin chief information security officer (CISO) at Fastly, to discover more about how organizations can protect themselves from the risks of bots.
Highlights
“Bot traffic is a growing portion of web traffic. In total, I think it takes up about 37% of our traffic overall, a pretty huge number and a growing number, one that continues to grow over time and I think for various reasons, we expect it to continue to grow. Of that portion of traffic, about 80% of that is malicious and then a growing portion of it is driven by AI bots.”
“Traditionally, bot traffic becomes a problem when you're thinking about fraud on your platform sometimes, or things as a CISO I'm very mindful of which is like account takeover attacks that are trying to compromise your users accounts and bots are often used to do that.”
“One challenge, typically for for customers or websites in the media space, is that they're consuming that content, feeding it into their LLM models, and then monetizing that content without any return for the website or media platform. And that's a big problem, it presents an immediate business risk, and it's something that's been in the news. So your bigger media companies are quite mindful in seeing this problem and seeing their revenue and their monetization potential.”
“What CISOs and IT leaders will not be as mindful of are these more recent problems that I've been talking about, this problem of crawling to scrape your inventory and monetize it elsewhere, or the operational problems that these are going to cause and I think that's going to hit a much broader category of industries. It means that a much larger group of CISOs and IT leaders are going to need to be mindful of this outside of these sort of more niche use cases, where I think your leaders in those functions have been working for a long time to try to address this problem.”
Footnotes
- Learn more about Fastly bot management
- Security experts issue warning over the rise of 'gray bot' AI web scrapers
- AI is helping bad bots take over the internet
Subscribe
- Subscribe to The IT Pro Podcast on Apple Podcasts
- Subscribe to The IT Pro Podcast on Spotify
- Subscribe to the IT Pro newsletter
- Join us on LinkedIn
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
ITPro is a global business technology website providing the latest news, analysis, and business insight for IT decision-makers. Whether it's cyber security, cloud computing, IT infrastructure, or business strategy, we aim to equip leaders with the data they need to make informed IT investments.
For regular updates delivered to your inbox and social feeds, be sure to sign up to our daily newsletter and follow on us LinkedIn and Twitter.
-
Thousands of Microsoft Teams users are being targeted in a new phishing campaignNews Microsoft Teams users should be on the alert, according to researchers at Check Point
-
What is Microsoft Maia?Explainer Microsoft's in-house chip is planned to a core aspect of Microsoft Copilot and future Azure AI offerings
-
Why do AI projects fail?ITPro Podcast Without a careful approach at the design phase, AI tools will fall apart in runtime
-
Is vibe coding the future?ITPro Podcast As developers use AI to speed up code generation, leaders must work to ensure the technology complements existing practices
-
September rundown: The UK becomes an AI playgroundITPro Podcast Big tech has announced tens of billions in infrastructure investments for the UK – how will it help?
-
August rundown: Are AI job losses a fantasy?ITPro Podcast AWS CEO Matt Garman's comments were made as big tech continues to lay off workers – but AI may not be the cause
-
Will devs lose their jobs to AI?ITPro Podcast Major errors in AI code generation throw doubt on the timeline to replacing human workers
-
Google Cloud Summit London 2025: Practical AI deploymentITPro Podcast As startups take hold of technologies such as AI agents, where is the sector headed?
-
The evolution from robots to agentsSponsored Podcast With the right adoption strategy, agentic AI can be a force multiplier for productivity
-
Podcast Transcript: Are reasoning models fundamentally flawed?ITPro Podcast A report from Apple has cast significant doubts on the efficacy of reasoning models, going as far as to suggest that when a problem is too complex, they simply give up
