Microsoft says AI tools such as Copilot or ChatGPT are affecting critical thinking at work – staff using the technology encounter 'long-term reliance and diminished independent problem-solving'
AI tools might be convenient for workers, but there's a risk they'll become too reliant in the future
Using generative AI at work may impact the critical thinking skills of employees — and that's according to Microsoft.
Researchers at Microsoft and Carnegie Mellon University surveyed 319 knowledge workers in an attempt to study the impact of generative AI at work, raising concerns about what the rise of the technology means for our brains.
Concerns about the negative impact are valid, the report noted, with researchers pointing to the “deterioration of cognitive faculties that ought to be preserved”.
That referenced research into the impact of automation on human work — which found that depriving workers of the opportunity to use their judgement left their cognitive function "atrophied and unprepared" to deal with anything beyond the routine.
Similar effects have also been noticed with reduced memory and smartphones, and attention spans and social media users.
"Surprisingly, while AI can improve efficiency, it may also reduce critical engagement, particularly in routine or lower-stakes tasks in which users simply rely on AI, raising concerns about long-term reliance and diminished independent problem-solving," researchers said.
The study noted that users engaged in critical thinking mostly to double check quality of work, and that the more confidence a worker had in the generative AI tool in question, the less likely they were to use their own critical thinking to engage with their work.
"When using GenAI tools, the effort invested in critical thinking shifts from information gathering to information verification; from problem-solving to AI response integration; and from task execution to task stewardship," the research found.
Researchers said more work was needed on the subject, especially because generative AI tools are constantly evolving and changing how we interact with them.
They called for developers of generative AI to make use of their own data and telemetry to understand how these tools can "evolve to better support critical thinking in different tasks."
"Knowledge workers face new challenges in critical thinking as they incorporate GenAI into their knowledge workflows," the researchers added. "To that end, our work suggests that GenAI tools need to be designed to support knowledge workers’ critical thinking by addressing their awareness, motivation, and ability barriers."
Reliance on AI tools could become a big problem
All of this is a problem as Microsoft has pushed its AI-powered Copilot tools into its wider software package, a trend across the wider industry — though some workers are sneaking it into their companies without explicit approval, too.
RELATED WHITEPAPER
Beyond cutting costs, one of the long cited assumptions about AI is that it could remove routine tasks from day-to-day work — helping employees do less drudgery and shift to more creative work.
Achieving that requires finding the right balance between fully automated tasks, those with a human in the loop, and wholly human work.
Research from Stanford has suggested workers are more effective and productive working alongside an AI assistant, but also found we easily slip into overreliance on such tools, sparking compliance or too much trust in the technology.
MORE FROM ITPRO
-
OpenAI says some of its researchers are blowing through $7,000 worth of AI tokens every dayNews OpenAI has revealed that researchers now spend around $600 each day on AI tokens amidst a surge in agentic coding. Some, meanwhile, are using upwards of $7,000 worth of tokens per day.
-
Nvidia in the crosshairs with the Threadripper Halo AI workstationNews The new device boasts 3.4x the total system memory compared to the Nvidia DGX Station, according to AMD
-
“Enterprises are becoming much more rigorous about the economics of AI”: Snowflake wants to help you cut AI costs by choosing the right model for the right taskNews New dynamic model routing capabilities aim to help customers box clever when it comes to their AI model choice
-
Microsoft has joined the growing list of companies cracking down on ‘tokenmaxxing’News The company is updating internal guidance to reduce rising costs
-
‘AI cost management has the same problems that cloud had’: Enterprises are still facing huge AI bills thanks to ‘tokenmaxxing’ – that means FinOps practices are more important than everNews With firms facing surging AI bills, FinOps techniques are more important than ever
-
‘We are now seeing MAI models outperform general-purpose frontier models’: Microsoft CEO Satya Nadella touts in-house models to cut spiralling AI costs – and reduce growing reliance on frontier labsNews The Microsoft chief says pricey frontier models don't have to be used for every task, and its own in-house MAI models could be the key to reducing costs.
-
3 ways to get your data AI-readySponsored Data placement, preparation, and orchestration make or break an AI project – and the Dell AI Data Platform reduces the strain on enterprise IT teams across both storage and the data foundation
-
‘A company should be able to use a model without giving up the knowledge that makes it unique’: Microsoft CEO Satya Nadella says enterprises shouldn’t be sharing so much data with AI providersNews The Microsoft chief warned that corporate data could be at risk thanks to AI models
-
‘What we’re seeing right now is just rapid escalation in AI token spend’: Accenture tells staff to stop using AI for unnecessary tasks amid surging costsNews Accenture has told some staff to roll back the use of AI for basic tasks while the consultancy grapples with surging AI token costs.
-
‘The claims in the suit are false’: Workday hits back amid lawsuit claiming AI recruitment discriminationNews Is AI hiring discriminatory? A California judge has given the go-ahead for a class action suit against Workday
