homehome Home chatchat Notifications


Robot learns like a toddler to predict future outcomes in its environment

Taking inspiration from babies, this machine learns to predict seconds into the future.

Tibi Puiu
December 5, 2017 @ 10:22 pm

share Share

Credit: University of California, Berkeley.

Researchers at the University of California, Berkeley, have developed a robot that has the ability to learn like a human toddler, allowing it to predict outcomes. Called Vestri, the robot is capable of learning all by itself with no human supervision required.

Teaching a robot how to play

When toddlers play with toys, they’re doing more than just entertaining themselves. Effectively, with every twist or throw the children learn about how the world works. By manipulating objects, toddlers learn how these respond all by themselves and can then form judgments about how these objects will likely behave in the future if used in the same way.

This great learning strategy, sometimes called “motor babbling”, has been emulated by American scientists into the Vestri robot. The technology in question, called “visual foresight”, effectively enables the robot to imagine what its next action should be and what the likeliest consequences might look like, and then take action based on the best results.

“Children can learn about their world by playing with toys, moving them around, grasping, and so forth. Our aim with this research is to enable a robot to do the same: to learn about how the world works through autonomous interaction,” said UC Berkeley assistant professor Sergey Levine and lead author of the study which was presented at the Neural Information Processing Systems conference. “The capabilities of this robot are still limited, but its skills are learned entirely automatically, and allow it to predict complex physical interactions with objects that it has never seen before by building on previously observed patterns of interaction.

Scientists hope that in the future, such technology could enable self-driving cars to predict roads ahead but for now at least, this ‘robotic imagination’ is fairly simple and limited. Vestri can make predictions only several seconds into the future but even that’s enough to help it figure out how to best move objects around on a table without disturbing obstacles. Vestri chose the right path around 90 per cent of the time.

What’s crucial about this skillset is that no human intervention nor prior knowledge about physics is required. Everything Vestri learned, it’s done so from scratch from unattended and unsupervised exploration — ‘playing’ with objects on a table.

After it had trained itself, Vestri is able to build a predictive model of its surroundings. It then uses this model to manipulate new objects it had never encountered before.  The predictions are produced in the form of video scenes that had not actually happened but could happen if an object was pushed in a certain way.

“In the same way that we can imagine how our actions will move the objects in our environment, this method can enable a robot to visualize how different behaviors will affect the world around it,” said Levine. “This can enable intelligent planning of highly flexible skills in complex real-world situations.”

Because Vestri’s video predictions rely on observations made autonomously by the robot through camera images, the method is general and broadly applicable. That’s in contrast to conventional computer vision techniques which require human supervision to label thousands or even millions of images.

Next, the Berkeley researchers want to expand the number of objects Vestri is able to play with but also to enhance the movements its capable of making. By expanding its repertoire, the researchers hope to make Vestri more versatile and adapted to all sorts of environments.

“This can enable intelligent planning of highly flexible skills in complex real-world situations,” Levine concluded.

Scientific reference: NIPS Conference.

share Share

Archaeologists Find Neanderthal Stone Tool Technology in China

A surprising cache of stone tools unearthed in China closely resembles Neanderthal tech from Ice Age Europe.

A Software Engineer Created a PDF Bigger Than the Universe and Yes It's Real

Forget country-sized PDFs — someone just made one bigger than the universe.

The World's Tiniest Pacemaker is Smaller Than a Grain of Rice. It's Injected with a Syringe and Works using Light

This new pacemaker is so small doctors could inject it directly into your heart.

Scientists Just Made Cement 17x Tougher — By Looking at Seashells

Cement is a carbon monster — but scientists are taking a cue from seashells to make it tougher, safer, and greener.

Three Secret Russian Satellites Moved Strangely in Orbit and Then Dropped an Unidentified Object

We may be witnessing a glimpse into space warfare.

Researchers Say They’ve Solved One of the Most Annoying Flaws in AI Art

A new method that could finally fix the bizarre distortions in AI-generated images when they're anything but square.

The small town in Germany where both the car and the bicycle were invented

In the quiet German town of Mannheim, two radical inventions—the bicycle and the automobile—took their first wobbly rides and forever changed how the world moves.

Scientists Created a Chymeric Mouse Using Billion-Year-Old Genes That Predate Animals

A mouse was born using prehistoric genes and the results could transform regenerative medicine.

Americans Will Spend 6.5 Billion Hours on Filing Taxes This Year and It’s Costing Them Big

The hidden cost of filing taxes is worse than you think.

Underwater Tool Use: These Rainbow-Colored Fish Smash Shells With Rocks

Wrasse fish crack open shells with rocks in behavior once thought exclusive to mammals and birds.