homehome Home chatchat Notifications


An AI algorithm just completed a famous Rembrandt painting

... and they say computers can't create art.

Mihai Andrei
June 24, 2021 @ 7:46 pm

share Share

A 17th-century copy by Gerrit Lundens with lines added indicating the areas cut off of the original painting in 1715.

In 1642, famous Dutch painter Rembrandt van Rijn completed a large painting called Militia Company of District II under the Command of Captain Frans Banninck Cocq — today, the painting is commonly referred to as The Night Watch. It was the height of the Dutch Golden Age, and The Night Watch brilliantly showcased that.

The painting measured 363 cm × 437 cm (11.91 ft × 14.34 ft) — so big that the characters in it were almost life-sized, but that’s only the start of what makes it so special. Rembrandt made dramatic use of light and shadow and also created the perception of motion in what would normally be a stationary military group portrait. Unfortunately, though, the painting was trimmed in 1715 to fit between two doors at Amsterdam City Hall.

For over 300 years, the painting has been missing 60cm (2ft) from the left, 22cm from the top, 12cm from the bottom and 7cm from the right. Now, computer software has restored the missing parts.

Artificial art

Artificial Intelligence (AI) works through a process called machine learning. Existing information is fed into the algorithm, which then does its best to produce new outcomes based on the data it was given. The Rijksmuseum in Amsterdam, where the painting is displayed, used two images to feed the AI. The first was a high-resolution scan of the original, and the second was a painted copy done before the trimming by Gerrit Lundens (see above).

In other words, rather than have an artist create a copy, the researchers had the AI reproduce the original material from a copy, but using Rembrandt’s original style.

The restoration has revealed new elements of the painting, including three characters on the left. Image credits: Rijksmuseum.

The resulting images were then printed and mounted next to the original painting so visitors can admire the whole painting as it was completed by Rembrandt — or at least, the closest thing to that we can get.

“Our attempt here is to make a best guess, without the hand of an artist, into what The Night Watch looked like,” Robert Erdmann, senior scientist at the Rijksmuseum, told the BBC.

The painting reveals three new figures: two militiamen and a young boy. In addition, the AI offered a clearer view of the boy in the left foreground, running away from the militia. Since these are real characters, the addition is significant because it shows just what Rembrandt wanted to reproduce. But perhaps even more significantly, the additions complete Rembrandt’s vision of the painting, which was to grab the viewer’s attention and drag it from place to place, by creating the illusion of motion.

“It is spectacular because what Rembrandt painted was Captain Frans Banninck Cocq ordering his lieutenants to march out and that is now exactly what you see,” said Taco Dibbits, director of the Rijksmuseum, for The Guardian.

“With the addition especially on the left and the bottom, an empty space is created in the painting where they march towards. When the painting was cut [the lieutenants] were in the centre, but Rembrandt intended them to be off-centre marching towards that empty space, and that is the genius that Rembrandt understands: you create movement, a dynamic of the troops marching towards the left of the painting.”

The result, museum officials say, is better than the Lundens copy. Because the painter had been sitting on the left side of the picture, his perspective was slightly skewed. Lundens also used different types of paint than Rembrandt, and his work aged differently than the original.

Even though the results of this project are impressive, museum Dibbits still hopes someone will turn up one day with the missing parts of the original — especially since by 1715, Rembrandt was already an appreciated (and expensive) artist. Until that happens, if it does happen at all, we’ll have to settle for the AI version.

share Share

Scientists uncover how your brain flushes out waste during sleep

Scientists uncover a pulsating system that flushes out brain waste during non-REM sleep.

Woman's nut allergy triggered after sex in bizarre first

She was allergic to Brazil nuts, but it wasn’t any she ate that sent her to the hospital.

Weekend warriors, rejoice: working out once in a while is also good for your brain

It seems that even exercise just on the weekend still has significant cognitive benefits.

Can Your Voice Reveal Diabetes? This New AI Thinks So

Researchers have developed a voice-based AI tool that can detect Type 2 diabetes with surprising accuracy.

Archaeologists uncover 1,300-year-old throne room in Peru linked to powerful female ruler

Recently studied murals suggest a powerful female leader once ruled the Moche.

Breakdancer develops one-inch lump on his scalp after 20 years of headspins

Surgeons removed the man's "breakdance bulge" and the patient is now okay.

Scientists Use Math to Show New Type of Particles Once Considered Impossible Might Be Real

Researchers uncover new particle behaviors that break the two-type mold of quantum mechanics.

Hobbyist Builds AI-Assisted Rifle Robot Using ChatGPT: "We're under attack from the front left and front right. Respond accordingly"

The viral video sparked ethical debates about the broader implications of AI weapons.

Drones Helps Researchers Uncover a Lost Mega-Fortress in Georgia

Researchers have long known about the formidable scale of the Dmanisis Gora fortress, but a recent study has unveiled its true magnitude. Using drone-based imagery and photogrammetry, a team of scientists has revealed that this 3,000-year-old structure in the Caucasus Mountains spans an astonishing 60 to 80 hectares. A cultural crossroads The South Caucasus is […]

Eating more peanuts, herbs, and spices can boost your gut microbiome

A small change in diets can make a big difference for your health.