Using generative AI at work may impact the critical thinking skills of employees — and that's according to Microsoft.
Researchers at Microsoft and Carnegie Mellon University surveyed 319 knowledge workers in an attempt to study the impact of generative AI at work, raising concerns about what the rise of the technology means for our brains.
Concerns about the negative impact are valid, the report noted, with researchers pointing to the “deterioration of cognitive faculties that ought to be preserved”.
That referenced research into the impact of automation on human work — which found that depriving workers of the opportunity to use their judgement left their cognitive function "atrophied and unprepared" to deal with anything beyond the routine.
Similar effects have also been noticed with reduced memory and smartphones, and attention spans and social media users.
"Surprisingly, while AI can improve efficiency, it may also reduce critical engagement, particularly in routine or lower-stakes tasks in which users simply rely on AI, raising concerns about long-term reliance and diminished independent problem-solving," researchers said.
The study noted that users engaged in critical thinking mostly to double check quality of work, and that the more confidence a worker had in the generative AI tool in question, the less likely they were to use their own critical thinking to engage with their work.
"When using GenAI tools, the effort invested in critical thinking shifts from information gathering to information verification; from problem-solving to AI response integration; and from task execution to task stewardship," the research found.
Researchers said more work was needed on the subject, especially because generative AI tools are constantly evolving and changing how we interact with them.
They called for developers of generative AI to make use of their own data and telemetry to understand how these tools can "evolve to better support critical thinking in different tasks."
"Knowledge workers face new challenges in critical thinking as they incorporate GenAI into their knowledge workflows," the researchers added. "To that end, our work suggests that GenAI tools need to be designed to support knowledge workers’ critical thinking by addressing their awareness, motivation, and ability barriers."
Reliance on AI tools could become a big problem
All of this is a problem as Microsoft has pushed its AI-powered Copilot tools into its wider software package, a trend across the wider industry — though some workers are sneaking it into their companies without explicit approval, too.
RELATED WHITEPAPER
Beyond cutting costs, one of the long cited assumptions about AI is that it could remove routine tasks from day-to-day work — helping employees do less drudgery and shift to more creative work.
Achieving that requires finding the right balance between fully automated tasks, those with a human in the loop, and wholly human work.
Research from Stanford has suggested workers are more effective and productive working alongside an AI assistant, but also found we easily slip into overreliance on such tools, sparking compliance or too much trust in the technology.
MORE FROM ITPRO
-
The move to a digital network and its role in the bigger picture of achieving true digital transformation: how SMBs can set themselves up for successSupported Beyond the dial tone, the digital switchover is the key to SMB success
-
Middlesbrough Council boosts cybersecurity spending, strategy in response to repeated cyberattacksReviews Councils across the UK have publicly struggled with maintaining services in the face of major cyber disruption
-
Huawei executive says 'we need to embrace AI hallucinations’News Tao Jingwen, director of Huawei’s quality, business process & IT management department, said firms should embrace hallucinations as part and parcel of generative AI.
-
Satya Nadella says “our multi-model approach goes beyond choice’ as Microsoft adds Claude AI models to 365 CopilotNews Users can choose between both OpenAI and Anthropic models in Microsoft 365 Copilot
-
The rise of the UK’s ‘invisible’ AI workforceNews Research from Multiverse shows AI skills are becoming common in non-tech roles
-
Why Nvidia’s $100 billion deal with OpenAI is a win-win for both companiesNews OpenAI will use Nvidia chips to build massive systems to train AI
-
Shadow AI can be a tool for AI innovation with the right controls, say Gartner analystsNews Data-driven messaging and a supportive approach to securing AI tools are necessary for security staff looking to balance AI risks and unlock better funding
-
Zoom CEO Eric Yuan thinks AI will pave the way for a three-day week – and he’s not the only big tech exec excited about reduced working hoursNews Yuan joins Nvidia CEO Jensen Huang and Bill Gates in touting the potential for AI to unlock reduced working hours
-
DeepSeek’s R1 model training costs pour cold water on big tech’s massive AI spendingNews Chinese AI developer DeepSeek says it created an industry-leading model on a pittance
-
Global AI spending is set to hit $2 trillion next year – here’s where all the money is goingNews Huge spending increases in AI services and associated infrastructure are expected
