OpenAI Five
OpenAI's Dota 2 bot that defeated professional players.
The system uses reinforcement learning, where the bots learn by playing against themselves hundreds of times a day.[1][2] Each bot is a neural network with a single 4096-unit LSTM layer that observes the game state through the Dota developer's API.[3] The nonprofit research organization OpenAI created a set of five AI agents, collectively named OpenAI Five, designed to compete in the five-versus-five online battle arena game Dota 2.[2]
Quick Facts
- First public appearance
- 2017
Facts from the source article.
Key facts and history
OpenAI chose Dota 2 because it was popular on Twitch, supported Linux, and had an available API.[1] The first public demonstration was a one-on-one match at The International 2017, where the bot defeated Ukrainian professional player Dendi.[1] At The International 2018, OpenAI Five lost both exhibition matches against professional teams, but OpenAI considered it a success for analyzing and adjusting their algorithms.[4] The system was built on the "Rapid" infrastructure, which spins up thousands of machines and coordinates them.[5]
At a live event in San Francisco during April 2019, the bots achieved a victory in a best-of-three match against OG, the team that had won The International 2018.[4] Also in April 2019, a four-day online event allowed the public to compete against the bots, resulting in 42,729 matches being played.[4] By 2018, the system had accumulated the equivalent of roughly 180 years of gameplay experience, utilizing 256 GPUs and 128,000 CPU cores for its training.[5]
What the cited sources add
A Quartz article notes that OpenAI's Dota 2 bot plays millions of games against itself over two weeks.[6] A CNBC article reports that Bill Gates called the bots' victory "a huge milestone in advancing artificial intelligence" because it required teamwork and collaboration.[7] The Verge article notes that the bots played a simplified version of Dota, with restrictions such as no invisibility, summons, or illusions.[7][8] A Quartz article explains that OpenAI's Rapid system coordinates thousands of processors running hundreds of reinforcement learning algorithms simultaneously.[6]
References
- Wikipedia, "OpenAI Five" (CC BY-SA 4.0), which cites: OpenAI, "OpenAI Five", openai.com/five; Savov, "My favorite game has been invaded by killer AI bots and Elon Musk hype", The Verge, 14 August 2017; Frank, "OpenAI's bot beats top Dota 2 player so badly that he quits", Venture Beat; OpenAI, "Dota 2", blog.openai.com, 11 August 2017; OpenAI, "More on Dota 2", blog.openai.com, 16 August 2017; Simonite, "Can Bots Outwit Humans in One of the Biggest Esports Games?", 25 June 2018; Kahn, "A Bot Backed by Elon Musk Has Made an AI Breakthrough in Video Game World", Bloomberg.com, 25 June 2018; "Bill en.wikipedia.org
- Knight, "A team of AI algorithms just crushed humans in a complex computer game", MIT Tech Review, 25 June 2018. facts only, no text reused. technologyreview.com
- Wikipedia, "OpenAI Five" (CC BY-SA 4.0), which cites: "Dota 2 with Large Scale Deep Reinforcement Learning", OpenAI (original not read by us) en.wikipedia.org
- Wikipedia, "OpenAI Five" (CC BY-SA 4.0), which cites: OpenAI, "OpenAI Five Benchmark", blog.openai.com, 18 July 2018; Simonite, "Can Bots Outwit Humans in One of the Biggest Esports Games?", 25 June 2018; Vincent, "AI bots trained for 180 years a day to beat humans at Dota 2", The Verge, 25 June 2018; Savov, "The OpenAI Dota 2 bots just defeated a team of former pros", The Verge, 6 August 2018; Hutson, "Just Months Old, a Game-Playing A.I. Takes on the World", Medium, 31 July 2019; Simonite, "Pro Gamers Fend off Elon Musk-Backed AI Bots—for Now"; Quach, "Game over, machines: Humans defeat Open en.wikipedia.org
- Wikipedia, "OpenAI Five" (CC BY-SA 4.0), which cites: "Why are AI researchers so obsessed with games?", QUARTZ, 4 August 2018; OpenAI, "OpenAI Five", blog.openai.com, 25 June 2018; Schulman, "Proximal Policy Optimization Algorithms", 2017 (we also read that source) en.wikipedia.org
- "Why are AI researchers so obsessed with games?", QUARTZ, 4 August 2018. facts only, no text reused. qz.com
- "Bill Gates says gamer bots from Elon Musk-backed nonprofit are 'huge milestone' in A.I.", CNBC, 28 June 2018. facts only, no text reused. cnbc.com
- Savov, "My favorite game has been invaded by killer AI bots and Elon Musk hype", The Verge, 14 August 2017. facts only, no text reused. theverge.com
Each numbered sentence above was checked against the source it cites before publication. Sentences citing Wikipedia adapt text from the English Wikipedia article OpenAI Five (contributors), used under CC BY-SA 4.0; this entry is available under the same licence. Other sources were used for facts only; no text or images are copied from them.
More in Dota
Spotted an error? Know more?
Reader corrections go straight into our review queue. Suggest an edit · How this site is sourced