AWS ditches Nvidia for in-house 'Inferentia' silicon

Alexa queries and facial recognition data will now be processed by Amazon's own chips

An Amazon Eco Dot being pressed by a user

Amazon Web Services (AWS) will ditch Nvidia chips responsible for the processing of Alexa queries and will instead use its own in-house silicon, the company confirmed on Friday.

The cloud giant will also be shifting data processing for its cloud-based facial recognition system, 'Rekognition', over to these in-house chips, according to Reuters.

Alexa queries, issued through Amazon's Echo line of smart speakers, are sent through the company's data centres where they undergo several stages of processing before coming back to users with an answer, including translating the processed text into audible speech.

The company said that the "majority" of this processing will now be handled using Amazon's own "Inferentia" computing chips. These were first launched in 2018 as Amazon's first custom silicon-designed chips for accelerating deep learning workloads.

Amazon has said that the shift to Inferentia for Alexa processing had resulted in a 25% latency boost and 30% lower cost. The firm hopes the same will happen with its Rekognition system, which has also started to adopt the Inferentia chip.

The cloud giant didn't specify which company previously handled Rekognition processing, but the service has come under some scrutiny from civil rights groups for its involvement with law enforcement. Police were temporarily banned from using it earlier in the year, following the Black Lives Matter protests.

Nvidia and Intel are two of the biggest providers of computing chips, often for data centres, with companies like Amazon and Microsoft included in their clientele. However, a number of firms have begun to move away from vendors and are bringing the technology in-house. For example, Apple has recently moved away from Intel chips in favour of the A14 Bionic processors, which will be used going forward.

Featured Resources

Virtual desktops and apps for dummies

An easy guide to virtual desktop infrastructure, end-user computing, and more

Download now

The total economic impact of optimising and managing your hybrid multi-cloud

Cost savings and business benefits of accelerating the cloud journey

Download now

A buyer’s guide for cloud-based phone solutions

Finding the right phone system for your modern business

Download now

What’s next for the education sector?

A new learning experience

Download now

Recommended

Taming the machine: AI Governance
artificial intelligence (AI)

Taming the machine: AI Governance

29 Apr 2021
Panasonic finalizes deal to acquire supply chain firm Blue Yonder
Acquisition

Panasonic finalizes deal to acquire supply chain firm Blue Yonder

23 Apr 2021
10 keys to AI success in 2021
Whitepaper

10 keys to AI success in 2021

10 Mar 2021
MLOps 101: The foundation for your AI strategy
Whitepaper

MLOps 101: The foundation for your AI strategy

10 Mar 2021

Most Popular

KPMG offers staff 'four-day fortnight' in hybrid work plans
flexible working

KPMG offers staff 'four-day fortnight' in hybrid work plans

6 May 2021
Hackers use open source Microsoft dev platform to deliver trojans
Security

Hackers use open source Microsoft dev platform to deliver trojans

14 May 2021
How to move Windows 10 from your old hard drive to SSD
operating systems

How to move Windows 10 from your old hard drive to SSD

30 Apr 2021