This new Microsoft tool lets enterprises track internal AI adoption rates – and even how rival companies are using the technology
The new Benchmarks tool from Microsoft lets managers snoop on staff Copilot adoption rates
Want to know if your staff are actually using that expensive AI bot you've splashed out on? Microsoft has your back with a feature that tracks adoption and usage of its Copilot AI suite.
The tool, called Benchmarks, will be rolled out to Microsoft Copilot Dashboard in Viva Insights. Benchmarks will let companies compare teams inside their organization, and track adoption across different groups, such as manager types, regions, and job functions.
According to Microsoft, Benchmarks will also show the percentage of active Copilot users and returning user percentages.
"These insights help identify adoption trends and provide broader context and new opportunities to improve Copilot engagement," Microsoft said in a blog post.
That will allow companies to see whether an employee is using AI as much as their coworkers in similar roles.
"The cohort benchmark is based on a comparison cohort of employees within your company who share similar job functions, regions, or manager roles," the company noted.
"The calculation uses Job function, Region, and Manager attributes to determine expected values by role. The cohort result looks at the role composition of the selected group, and constructs a weighted average expected result based on matching roles across the tenant."
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
The analytics tool comes as research suggests AI may not be as useful as hoped for all tasks, with MIT reporting 95% of AI pilots fail and a census survey suggesting AI use has dipped at large companies.
However, enterprises remain keen to get staff on board, with some taking drastic action. As ITPro reported in September 2025, CEOs at IgniteTech and Coinbase both admitted to firing staff who refused to use AI tools in their work.
The Microsoft Benchmarks tool suggests managers are looking for ways to quantify adoption, which could help when it comes to reporting return on investment (ROI) to the C-suite.
Similarly, this could help reduce license costs by removing Copilot for teams that don’t really use it – but such metrics could also be used to pit employees against each other in how much AI they use.
Microsoft tool offers external comparisons
Microsoft isn't just letting companies pit teams against each other in the race to drive AI adoption, but also offering up data from rival organizations so AI users can see how they compare to other businesses.
Benchmarks includes external data to compare internal stats with other companies, such as the top companies in a similar sector, of a similar size, or in the same region, or against all other companies.
"This new feature lets organizations compare Copilot usage internally across different company groups, as well as externally against similar companies," Microsoft added in a blog post.
Microsoft stressed that external data has all been anonymized – something it doesn't promise for individual users inside a company – with each cohort requiring at least 20 companies to be used as a benchmark.
"External benchmarks are calculated using randomized mathematical models to ensure privacy," Microsoft added. "Each benchmark group includes at least 20 companies and is derived from approximations to prevent the use of any single company’s actual data."
Benchmarks will already be available to private preview customers in Copilot Dashboard, and will roll out to all customers later this month, Microsoft said, adding it will consider adding additional benchmarks based on customer feedback.
Make sure to follow ITPro on Google News to keep tabs on all our latest news, analysis, and reviews.
MORE FROM ITPRO
Freelance journalist Nicole Kobie first started writing for ITPro in 2007, with bylines in New Scientist, Wired, PC Pro and many more.
Nicole the author of a book about the history of technology, The Long History of the Future.
-
Nearly half of software developers don’t check AI-generated codeNews A concerning number of developers are failing to check AI-generated code, exposing enterprises to huge security threats
-
Veeam patches Backup & Replication vulnerabilities, urges users to updateNews The vulnerabilities affect Veeam Backup & Replication 13.0.1.180 and all earlier version 13 builds – but not previous versions.
-
Retailers are turning to AI to streamline supply chains and customer experience – and open source options are proving highly popularNews Companies are moving AI projects from pilot to production across the board, with a focus on open-source models and software, as well as agentic and physical AI
-
Microsoft CEO Satya Nadella wants an end to the term ‘AI slop’ and says 2026 will be a ‘pivotal year’ for the technology – but enterprises still need to iron out key lingering issuesNews Microsoft CEO Satya Nadella might want the term "AI slop" shelved in 2026, but businesses will still be dealing with increasing output problems and poor returns.
-
OpenAI says prompt injection attacks are a serious threat for AI browsers – and it’s a problem that’s ‘unlikely to ever be fully solved'News OpenAI details efforts to protect ChatGPT Atlas against prompt injection attacks
-
Google DeepMind CEO Demis Hassabis thinks startups are in the midst of an 'AI bubble'News AI startups raising huge rounds fresh out the traps are a cause for concern, according to Hassabis
-
OpenAI turns to red teamers to prevent malicious ChatGPT use as company warns future models could pose 'high' security riskNews The ChatGPT maker wants to keep defenders ahead of attackers when it comes to AI security tools
-
AWS has dived headfirst into the agentic AI hype cycle, but old tricks will help it chart new watersOpinion While AWS has jumped on the agentic AI hype train, its reputation as a no-nonsense, reliable cloud provider will pay dividends
-
AWS CEO Matt Garman says AI agents will have 'as much impact on your business as the internet or cloud'News Garman told attendees at AWS re:Invent that AI agents represent a paradigm shift in the trajectory of AI and will finally unlock returns on investment for enterprises.
-
Westcon-Comstor partners with Fortanix to drive AI expertise in EMEANews The new agreement will help EMEA channel partners ramp up AI and multi-cloud capabilities
