In mid-2024, Anthropic CEO Dario Amodei projected AI training costs to soar to such an extent that building a new model could cost upwards of $100 billion.
Amodei’s lofty claims appear to have been completely shot down with the publication of a new research paper from DeepSeek. In a recent paper, published in the academic journal Nature, the Chinese AI developer claims it spent a paltry amount training its flagship R1 model.
All told, training costs amounted to $294,000, with the company using 512 Nvidia H800 chips to build the model that had US companies sweating earlier this year.
It’s worth noting that these costs come in addition to around $6 million spent by the firm to create the base LLM R1 is built on. Regardless, the results are impressive given the far higher training costs associated with competing models.
So what makes DeepSeek R1 tick?
Under the hood of DeepSeek R1
DeepSeek R1 is a ‘reasoning model', meaning it’s designed specifically to excel at tasks such as mathematics and coding. It’s also an ‘open weight’ model, so is freely available for anyone to download.
As ITPro reported earlier this year, the decision to offer R1 as an open weight model was welcomed by industry stakeholders, and also gave competitors a vital insight into how the model performed compared to others out there on the market.
R1 is among the most popular models currently available on AI community platform, Hugging Face, having been downloaded over 10 million times.
AI reasoning models are purposefully trained on real-world data, enabling them to “learn” how to solve specific problems. It’s a costly, long-winded process but has been a key focus for AI providers over the last 18-months as they offer users more intuitive tools.
According to this latest research paper, DeepSeek was able to reduce training costs through a carrot-and-stick type approach to reinforcement learning. Researchers essentially incentivized and rewarded the model to produce correct answers to user queries.
In a blog post dissecting the paper, researchers at Carnegie Mellon University noted that this was akin to a child playing video games, constantly learning new ways to progress.
“As the child navigates their avatar through the game world, they learn through trial and error that some actions (such as collecting gold coins) earn points, whereas others (such as running into enemies) set their score back to zero,” researchers explained.
“In a similar vein, DeepSeek-R1 was awarded a high score when it answered questions correctly and a low score when it gave wrong answers.”
So much for huge training costs
DeepSeek has previously hinted that its training processes were highly cost efficient. A preprint release of the study, published in January, pointed toward far lower costs compared to US competitors.
Some Silicon Valley figures questioned the veracity of DeepSeek’s claims at the time, but with R1 becoming the first peer-reviewed LLM, the company appears vindicated.
AI training has long been lamented as a costly, compute-intensive process for big tech providers. Amodei isn’t alone in highlighting the huge costs associated with this, either.
In 2023, OpenAI CEO Sam Altman hinted that foundation model training had cost upwards of $100 million.
These figures appear to have been confirmed during his appearance at a 2024 MIT event, where he said it’s “more than that”, per reports from Wired.
Make sure to follow ITPro on Google News to keep tabs on all our latest news, analysis, and reviews.
MORE FROM ITPRO
-
The Salesloft hackers claim they have 1.5 billion compromised Salesforce recordsNews Dozens of big tech companies have been impacted by the Salesloft Drift attacks
-
Acer Aspire Vero 16 (2025) reviewReviews Improved performance and battery life make this greener laptop a fantastic mainstream business choice
-
Global AI spending is set to hit $2 trillion next year – here’s where all the money is goingNews Huge spending increases in AI services and associated infrastructure are expected
-
OpenAI just revealed what people really use ChatGPT for – and 70% of queries have nothing to do with workNews More than 70% of ChatGPT queries have nothing to do with work, but are personal questions or requests for help with writing.
-
This DeepSeek-powered pen testing tool could be a Cobalt Strike successor – and hackers have downloaded it 10,000 times since JulyNews ‘Villager’, a tool developed by a China-based red team project known as Cyberspike, is being used to automate attacks under the guise of penetration testing.
-
Anthropic CEO Dario Amodei's prediction about AI in software development is nowhere nearly to becoming a realityNews In March, Anthropic CEO Dario Amodei claimed up to 90% of code would be written by AI within six months – his prediction hasn't quite come to fruition.
-
Is the honeymoon period over for Microsoft and OpenAI? Strained relations and deals with competitors spell trouble for the partnership that transformed the AI industryAnalysis Microsoft and OpenAI are slowly drifting apart as both forge closer ties with respective rivals and reevaluate their long-running partnership.
-
Box reveals new AI capabilities at BoxWorks 2025News Extract and Automate will help businesses make better use of their data, the cloud company claims
-
Large enterprises could be wavering on AI adoptionNews AI adoption rates have dipped, but it's probably nothing to worry about for IT leaders
-
Businesses are being taken for fools with AI agentsOpinion AI agents are still not very good at their 'jobs', or at least pretty terrible at producing returns on investment – yet businesses are still buying into the hype.
