This new Microsoft tool lets enterprises track internal AI adoption rates – and even how rival companies are using the technology
The new Benchmarks tool from Microsoft lets managers snoop on staff Copilot adoption rates
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
You are now subscribed
Your newsletter sign-up was successful
Want to know if your staff are actually using that expensive AI bot you've splashed out on? Microsoft has your back with a feature that tracks adoption and usage of its Copilot AI suite.
The tool, called Benchmarks, will be rolled out to Microsoft Copilot Dashboard in Viva Insights. Benchmarks will let companies compare teams inside their organization, and track adoption across different groups, such as manager types, regions, and job functions.
According to Microsoft, Benchmarks will also show the percentage of active Copilot users and returning user percentages.
"These insights help identify adoption trends and provide broader context and new opportunities to improve Copilot engagement," Microsoft said in a blog post.
That will allow companies to see whether an employee is using AI as much as their coworkers in similar roles.
"The cohort benchmark is based on a comparison cohort of employees within your company who share similar job functions, regions, or manager roles," the company noted.
"The calculation uses Job function, Region, and Manager attributes to determine expected values by role. The cohort result looks at the role composition of the selected group, and constructs a weighted average expected result based on matching roles across the tenant."
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
The analytics tool comes as research suggests AI may not be as useful as hoped for all tasks, with MIT reporting 95% of AI pilots fail and a census survey suggesting AI use has dipped at large companies.
However, enterprises remain keen to get staff on board, with some taking drastic action. As ITPro reported in September 2025, CEOs at IgniteTech and Coinbase both admitted to firing staff who refused to use AI tools in their work.
The Microsoft Benchmarks tool suggests managers are looking for ways to quantify adoption, which could help when it comes to reporting return on investment (ROI) to the C-suite.
Similarly, this could help reduce license costs by removing Copilot for teams that don’t really use it – but such metrics could also be used to pit employees against each other in how much AI they use.
Microsoft tool offers external comparisons
Microsoft isn't just letting companies pit teams against each other in the race to drive AI adoption, but also offering up data from rival organizations so AI users can see how they compare to other businesses.
Benchmarks includes external data to compare internal stats with other companies, such as the top companies in a similar sector, of a similar size, or in the same region, or against all other companies.
"This new feature lets organizations compare Copilot usage internally across different company groups, as well as externally against similar companies," Microsoft added in a blog post.
Microsoft stressed that external data has all been anonymized – something it doesn't promise for individual users inside a company – with each cohort requiring at least 20 companies to be used as a benchmark.
"External benchmarks are calculated using randomized mathematical models to ensure privacy," Microsoft added. "Each benchmark group includes at least 20 companies and is derived from approximations to prevent the use of any single company’s actual data."
Benchmarks will already be available to private preview customers in Copilot Dashboard, and will roll out to all customers later this month, Microsoft said, adding it will consider adding additional benchmarks based on customer feedback.
Make sure to follow ITPro on Google News to keep tabs on all our latest news, analysis, and reviews.
MORE FROM ITPRO
Freelance journalist Nicole Kobie first started writing for ITPro in 2007, with bylines in New Scientist, Wired, PC Pro and many more.
Nicole the author of a book about the history of technology, The Long History of the Future.
-
What is model collapse and why is it a risk for enterprise AI?In-depth Model collapse is a nightmare for AI companies and users, with AI models trained on AI data losing quality with each generation
-
Developers are slacking on AI-generated code checksNews While organizations are aware of the risks, many are spending little time or effort on tracking artifact versions, origins, and security attestations
-
'That language is no longer reflective of how Copilot is used today': Microsoft says Copilot isn't just for 'entertainment purposes only'News Sharp-eyed users spotted Microsoft describing its Copilot AI as "for entertainment purposes only"
-
‘Fragmentation is poison’: How Microsoft is targeting disparate data to boost AI adoptionNews Amir Netz, the co-creator of Microsoft's Power BI service, tells ITPro that business context is key to effective AI deployment.
-
Microsoft is rolling out Copilot Cowork to more customersNews Use of Copilot Cowork has been limited to select customers so far
-
AI adoption rates aren’t matching IT hypeNews The appetite for AI is there, but a range of issues are hampering adoption
-
Satya Nadella needs to remember the Streisand effect for 'AI slop'Opinion Attempts to discourage criticism may backfire for Microsoft’s CEO
-
Microsoft has a new AI poster child in Anthropic – and it’s about timeOpinion Microsoft is cosying up to Anthropic at a crucial time in the race to deliver on AI promises
-
Concerns are mounting over the cognitive impact of AI as workers report experiencing ‘brain fry’ – and it’s causing "increased employee errors, decision fatigue, and intention to quit"News Research from Boston Consulting Group backs earlier studies in highlighting the negative cognitive impact of AI at work
-
Anthropic's Claude Cowork tool is coming to Microsoft CopilotNews The new Copilot Cowork tool will be made available through a new Microsoft 365 tier at the end of March
