Facebook launches open-source bot training framework
ParlAI helps researchers train machines on key conversation tasks


Facebook has released an open-source framework that allows human tutors to teach AI chatbots how to have more natural conversations.
The company's artificial-intelligence research team, known as FAIR, has released the Python-based ParlAI tool, which gives researchers the ability to train bots over many different datasets at once, including benchmarking datasets like WebQuestions, WikiMovies and bAbl tasks.
Training is split into five tasks: general question answering; sentence completion, where the bot has to fill in the next word of a dialogue; back-and-forth chit-chat; visual dialogue with conversations involving images; and goal oriented dialogue, where a conversation is intended with a specific outcome.
"For the first time, ParlAI provides a place for researchers to collect all the significant dialog tasks in one place," wrote FAIR researchers Jason Weston, Alexander Miller and Will Feng in a blog post.
"Not only does this allow for much easier iteration on any of these tasks individually, but also makes it possible to easily train a bot on all of them (which eventually should lead to better bots) and to evaluate bots across all those skills."
The framework uses Amazon Mechanical Turk, a programme which uses low-paid human operators to do repetitive grunt-work that goes into training AI models, to improve the quality of AI conversations through question-and-answer sessions.
The release comes as part of the company's push into the AI space. The goal is to provide advertisers and brands with the ability to roll out natural-language chatbots on platforms like Facebook Messenger and WhatsApp, allowing customers to make enquiries, bookings and purchases just by talking to an AI helper.
Get the ITPro daily newsletter
Sign up today and you will receive a free copy of our Future Focus 2025 report - the leading guidance on AI, cybersecurity and other IT challenges as per 700+ senior executives
"ParlAI is a platform we hope will bring together the community of researchers working on AI agents that perform dialog," Facebook's researchers said, "and continue pushing the state of the art in dialog research."
Adam Shepherd has been a technology journalist since 2015, covering everything from cloud storage and security, to smartphones and servers. Over the course of his career, he’s seen the spread of 5G, the growing ubiquity of wireless devices, and the start of the connected revolution. He’s also been to more trade shows and technology conferences than he cares to count.
Adam is an avid follower of the latest hardware innovations, and he is never happier than when tinkering with complex network configurations, or exploring a new Linux distro. He was also previously a co-host on the ITPro Podcast, where he was often found ranting about his love of strange gadgets, his disdain for Windows Mobile, and everything in between.
You can find Adam tweeting about enterprise technology (or more often bad jokes) @AdamShepherUK.
-
What is polymorphic malware?
Explainer Polymorphic malware constantly changes its code to avoid detection, making it a top cybersecurity threat that demands advanced, behavior-based defenses
-
Outgoing Kaseya CEO teases "this is just the beginning" for the company
Opinion We spoke to Fred Voccola who remains a key figurehead at the firm as it enters its next chapter...
-
Meta to pay $725 million in Cambridge Analytica lawsuit settlement
News The settlement closes the long-running lawsuit into how Facebook's owner, Meta, handled the Cambridge Analytica scandal
-
Meta's earnings are 'cause for concern' and 2023 looks even bleaker
Analysis Calls for investor faith in metaverse tech only emphasise the worries that its investment strategy won't pay off
-
Microsoft and Meta announce integration deal between Teams and Workplace
News Features from both business collaboration platforms will be available to users without having to switch apps
-
Facebook is shutting down its controversial facial recognition system
News The move will see more than a billion facial templates removed from Facebook's records amid a push for more private applications of the technology
-
'Changing name to Meat': Industry reacts to Facebook's Meta rebrand
News The rebrand attempts to provide a clearer distinction between Facebook and its umbrella company
-
Facebook's Oversight Board demands more transparency
News Board bashed the social media giant for its preferential treatment of certain high-profile accounts
-
Facebook claims AI managed to reduce hate speech by 50%
News The social media platform has hit back at claims the tech it uses to fight hate speech is inadequate
-
Facebook to hire 10,000 workers across the EU
News The high-skilled jobs drive is a “vote of confidence” in the European tech industry