homehome Home chatchat Notifications


This AI can do a 3D facial reconstruction from a single picture

It's seriously cool.

Mihai Andrei
January 4, 2019 @ 8:20 pm

share Share

It’s not only really cool, but also free and publicly available, thanks to the researchers who developed it.

Demonstration obtained with an example face.

3D reconstructions have long been a painstaking task. You generally need several pictures from different angles, and for something as complex as the human face, results have typically been lackluster. But a recent paper from UK scientists demonstrated impressive capabilities using a single, forward-facing image.

The researchers from the University of Nottingham and Kingston University developed a so-called convolutional neural network (CNN). This type of network allows algorithms to learn a bit like humans do, using interconnected neuron-like nodes.

[panel style=”panel-default” title=”Convolutional neural networks” footer=””]

Convolutional networks were inspired by biological processes in that the connectivity pattern between neurons resembles the organization of the animal visual cortex. As a result, they are especially used in analyzing visual imagery.

Given enough time and resources, these networks can find patterns in all sorts of data, though the relevancy and usefulness of those patterns remains a human challenge. Still, some networks have proven surprisingly capable of mimicking creativity.[/panel]

An example of how the algorithm “sees” the faces. Credits: Jackson et al.

Using this network, the team was able to produce remarkably accurate 3D facial reconstructions from a single photo. You can try it here, either using 8 example faces provided on the website, or by uploading your own images.

If you want to dig a little deeper, researchers also uploaded the paper and the code they are using — both of which can be accessed for free.

So far, almost a million faces have been uploaded and over 2 million models have been generated (presumably most models are done with the example faces, which include Barack Obama, Alan Turing, and Marie Curie).

For now, the technology is limited to human faces — as was dramatically highlighted by my failed first attempt, which was to upload a picture of my cat.

The most important use for this technology is in video monitoring and facial recognition. It could also be implemented in computer games or augmented reality where you could generate a character that looks just like you.

However, there are also some concerns: as smartphone producers are replacing fingerprint sensors with facial recognition, there are concerns that this type of algorithm could trick the security software. Aaron Jackson, the study’s first author thinks that’s unlikely. He does concede, however, that the technology could be used by authoritarian governments for population monitoring.

For now, we can enjoy the simple pleasure of viewing our faces in 3D. Ah, the joys of the internet!

share Share

How a 1932 Movie Lawsuit Changed Hollywood Forever and Made Disclaimers a Thing

MGM Studios will remember Rasputin forever. After all, he caused them to lose a legal battle that changed the film industry forever.

Launch code for US nuclear arsenal was '00000000' until 1977

When you think about security passwords, your mind probably goes to lengthy, complex combinations; especially when we’re talking about something that can kill billions of people and start a worldwide nuclear holocaust. But things can sometimes be surprising. For 15 years, from the Cuban Missile Crisis through much of the Cold War, the launch codes […]

Even ExxonMobil is telling Trump to tone it down on fossil fuels

Even ExxonMobil, a symbol of fossil fuel dominance, is urging climate action, underscoring the tension between Trump’s policies and industry realities.

In 1911, Einstein wrote a letter to Marie Curie, telling her to ignore the haters

The gist of it is simple: "ignore the trolls".

CT-Scan of an unopened walnut is both beautiful and relaxing

A walnut's rugged shell conceals a labyrinth of chambers and partitions, revealed in mesmerizing detail through CT scanning.

The incredible fishes that wander oceans with a transparent head

They're some of the most unusual creatures in the ocean.

How Internet Slang Has Become Part of Everyday Language

From "LOL" to "FOMO," online lingo is shaping how we communicate.

Millions of Americans are falling for AI-generated content on Facebook

With the 2024 U.S. election on the horizon, AI-generated content is flooding social media, blurring the lines between authentic and synthetic content.

This Polish radio station fired all its journalists and replaced them with AI hosts -- and people are furious

"It is a dangerous precedent that hits us all," said fired journalists.

More Airbnbs, more crime? Airbnb associated with spike in robbery and theft

More to opportunities for crime, and loss of cohesion within communities are contributing to increased crime rates.