homehome Home chatchat Notifications


Artificial Intelligence is now beating us at shooter games

What will they do next?

Mihai Andrei
July 6, 2018 @ 4:22 pm

share Share

Another week, another game that’s taken away from us. After the classics chess and Go succumbed to AIs, a current favorite in computer games — Dota2 — was mastered by machines just a week ago. Now, computer scientists reported that AIs are kicking butt at yet another popular computer game: Quake III.

Screenshot from Quake III.

If you like games where you go out and shoot stuff, then you’re probably familiar with the Quake series. If not, the premise is pretty simple — you roam around a map, you pick up guns, and you shoot your opponents before they shoot you. Rinse and repeat, it’s simplistic but highly addictive.

As it’s been done in previous similar efforts, the machine algorithm (stemming from DeepMind, a Google subsidiary) isn’t given much information on how to play the game — it’s left to its own devices, to figure out strategies on how to win. But DeepMind’s engineers added a twist: they trained a total of 30 agents with different playstyles to introduce a “diversity” of play styles.

So how does the AI learn how to play? By playing a lot — a LOT. In this case, it took nearly half a million games, each lasting about 5 minute, to get the AI to its current level. The robots did not only learn how to play, but they devised the same strategies that human players typically use. A new map was generated procedurally for each game, to make sure that the AIs don’t develop strategies that work on a single map.

Also, programmers didn’t give them any numerical information, they had to learn to play just by “looking” at the screen, similar to how a human player would.

It’s worth noting that the stripped-down version of Quake III that the bots learned is much simpler than Dota2, for instance.

A graph showing the Elo (skill) rating of various players. The “FTW” agents are DeepMinds. Credit: DeepMind

To test the skill of the newly trained AIs, DeepMind hosted a contest: two-player teams of bots, humans, and a mixture of bots and humans squared off. The bot-only teams were the most successful, winning 74% of the time. However, the more bots researchers added in the team, the worse the team fared, indicating that they lack a specific understanding of team play.

Of course, the purpose of these AIs is not to beat us at out favorite games and take the fun out of everything (even though things sure seem that way sometimes). The goal is to design new ways to teach AIs different concepts more effective — though in this case, teaching bots how to get better at shooting people might not be the most soothing of applications.

share Share

A Brain Implant Just Turned a Woman’s Thoughts Into Speech in Near Real Time

This tech restores speech in real time for people who can’t talk, using only brain signals.

Using screens in bed increases insomnia risk by 59% — but social media isn’t the worst offender

Forget blue light, the real reason screens disrupt sleep may be simpler than experts thought.

We Should Start Worrying About Space Piracy. Here's Why This Could be A Big Deal

“We are arguing that it’s already started," say experts.

An Experimental Drug Just Slashed Genetic Heart Risk by 94%

One in 10 people carry this genetic heart risk. There's never been a treatment — until now.

We’re Getting Very Close to a Birth Control Pill for Men

Scientists may have just cracked the code for male birth control.

A New Antibiotic Was Hiding in Backyard Dirt and It Might Save Millions

A new antibiotic works when others fail.

Researchers Wake Up Algae That Went Dormant Before the First Pyramids

Scientists have revived 7,000-year-old algae from Baltic Sea sediments, pushing the limits of resurrection ecology.

A Fossil So Strange Scientists Think It’s From a Completely New Form of Life

This towering mystery fossil baffled scientists for 180 Years and it just got weirder.

ChatGPT Seems To Be Shifting to the Right. What Does That Even Mean?

ChatGPT doesn't have any political agenda but some unknown factor is causing a subtle shift in its responses.

This Freshwater Fish Can Live Over 120 Years and Shows No Signs of Aging. But It Has a Problem

An ancient freshwater species may be quietly facing a silent collapse.