Google machine learns to master video games

3 min read Original article ↗

The difference with DeepMind's computer program, which the company describes as an "agent", is that it is armed only with the most basic information before it is given a video game to play.

Dr Hassabis explained: "The only information we gave the system was the raw pixels on the screen and the idea that it had to get a high score. And everything else it had to figure out by itself."

The team presented the machine with 49 different videogames, ranging from classics such as Space Invaders and Pong, to boxing and tennis games and the 3D-racing challenge Enduro.

In 29 of them, it was comparable to or better than a human games tester. For Video Pinball, Boxing and Breakout, its performance far exceeded the professional's, but it struggled with Pac-Man, Private Eye and Montezuma's Revenge.

"On the face it, it looks trivial in the sense that these are games from the 80s and you can write solutions to these games quite easily," said Dr Hassabis.

"What is not trivial is to have one single system that can learn from the pixels, as perceptual inputs, what to do.

"The same system can play 49 different games from the box without any pre-programming. You literally give it a new game, a new screen and it figures out after a few hours of game play what to do."

The research is the latest development in the field of "deep learning", which is paving the way for smarter machines.

Scientists are developing computer programs that - like the human brain - can be exposed to large amounts of data, such as images or sounds, and then intuitively extract useful information or patterns.

Examples include machines that can scan millions of images and understand what they are looking at: they can tell a cat is a cat, for example. This ability is key for self-driving cars, which need an awareness of their surroundings.

Or machines that can understand human speech, which can be used in sophisticated voice recognition software or for systems that translate languages in real-time.

Dr Hassabis said: "One of the things holding back robotics today, in factories, in things like elderly care robots and in household-cleaning robots, is that when these machines are in the real world, they have to deal with the unexpected. You can't pre-program it with every eventuality that might happen.

"In some sense, these machines need intelligence that is adaptable and they have to be able to learn for themselves."

Some fear that creating computers that can outwit humans could be dangerous.

In December, Prof Stephen Hawking said that the development of full artificial intelligence "could spell the end of the human race".

Follow Rebecca on Twitter, external