With enterprises ramping up the use of AI agents, new research suggests many might turn to the technology itself to establish guardrails.
Analysis from Gartner shows ‘guardian agents’ will account for anywhere between 10 to 15% of the broader agentic AI market by 2030. These agents are designed specifically to support and mediate interactions with AI agents, the consultancy explained.
“They function as both AI assistants, supporting users with tasks like content review, monitoring and analysis, and as evolving semi-autonomous or fully autonomous agents, capable of formulating and executing action plans as well as redirecting or blocking actions to align with predefined agent goals,” according to Gartner.
The rise of these guardian agents comes amid growing in agentic AI, the consultancy found.
In a poll of CIOs and IT leaders, 24% of respondents said they have already deployed “a few” AI agents, or less than a dozen. Just 4% revealed they’d deployed over that number, the survey found.
The poll found that 50% of respondents were currently researching or experimenting with the technology, however, underlining the growing interest among tech leaders. An additional 17% said they plan to deploy AI agents by the end of 2026.
Avivah Litan, VP Distinguished Analyst at Gartner, said the projected uptake of AI agents means many enterprises need to implement robust guardrails. With this in mind, deploying agents designed specifically for governance-related tasks could be the go-to approach.
“Agentic AI will lead to unwanted outcomes if it is not controlled with the right guardrails,” Litan said.
“Guardian agents leverage a broad spectrum of agentic AI capabilities and AI-based, deterministic evaluations to oversee and manage the full range of agent capabilities, balancing runtime decision making with risk management.”
Agentic AI security threats are looming
According to Gartner polling, agents will likely be deployed across a wide range of business functions in the year ahead - particularly in areas such as IT, accounting, and human resources.
But while these are designed to support and drive productivity, there are key security considerations that tech leaders need to be wary of.
“As use-cases for AI agents continue to grow, there are several threat categories impacting them, including input manipulation and data poisoning, where agents rely on manipulated or misinterpreted data,” the consultancy said.
Credential hijacking was identified as a major threat faced by enterprises deploying AI agents, while agentic interaction which “fake or criminal websites and sources” could result in poisoned actions.
“The rapid acceleration and increasing agency of AI agents necessitates a shift beyond traditional human oversight,” said Litan.
“As companies move towards complex multi-agent systems that communicate at breakneck speed, humans cannot keep up with the potential for errors and malicious activities.
"This escalating threat landscape underscores the urgent need for guardian agents, which provide automated oversight, control, and security for AI applications and agents.”
What CIOs need to consider when using ‘guardian agents’
Gartner said CIOs, security leaders, and AI practitioners should focus on three distinct types of ‘guardian agents’ to improve safety and security.
These include ‘reviewers’, which could be used to identify and review AI-generated outputs and content for “accuracy and acceptable use”.
‘Monitor’ agents are designed to observe and track AI and agentic actions for human workers while ‘protectors’ can adjust or block actions and permissions during operations.
“Guardian agents will manage interactions and anomalies no matter the usage type,” the consultancy said. “This is a key pillar of their integration, since Gartner predicts that 70% of AI apps will use multi-agent systems by 2028.”
MORE FROM ITPRO
-
Public sector organizations are drowning in security debtNews An analysis finds that nearly eight-in-ten public sector organizations have left flaws unaddressed for more than a year
-
How immersive does a video meeting really need to be?Opinion It’s time to accept that virtual business meetings are awful and no amount of innovation will make them more engaging
-
Get used to working with AI teammates in SlackNews The workplace collaboration app is all-in on AI agents
-
How AI agents are being deployed in the real worldSupported Content These intelligent systems, capable of independent decision-making and learning, are transforming how organisations detect, respond to, and manage security problems
-
Agentic AI is coming for customer service jobsNews A report from Cisco shows the agentic AI shift is coming “faster than anyone anticipated”
-
SAS wants its AI agents to supercharge workers, not replace themSAS has announced a new agentic AI service aimed at helping enterprises deploy agents alongside domain-specific AI models.
-
Google Cloud is leaning on all its strengths to support enterprise AIAnalysis Google Cloud made a big statement at its annual conference last week, staking its claim as the go-to provider for enterprise AI adoption.
-
Salesforce wants technicians and tradespeople to take AI agents on the road with themNews Salesforce wants to equip technicians and tradespeople with agentic AI tools to help cut down on cumbersome administrative tasks.
-
Databricks and Anthropic are teaming up on agentic AI development – here’s what it means for customersNews Simplifying agentic AI adoption is the name of the game for Databricks
-
‘DIY’ agent platforms are big tech’s latest gambit to drive AI adoption
Analysis The rise of 'DIY' agentic AI development platforms could enable big tech providers to drive AI adoption rates.
