homehome Home chatchat Notifications


How a musician and his robots improvise together

In the video above, you can see PhD student Mason Bretan from the Robot Musicianship Group at Georgia Tech in the US jam with some of the robots he helped create. The robots got rhythm, and they got the skills. Just look at that amazing marimba solo at the middle of the video – that was completely […]

Mihai Andrei
January 26, 2015 @ 10:23 am

share Share

In the video above, you can see PhD student Mason Bretan from the Robot Musicianship Group at Georgia Tech in the US jam with some of the robots he helped create. The robots got rhythm, and they got the skills. Just look at that amazing marimba solo at the middle of the video – that was completely improvised.

“The piece is called “What You Say” and is inspired by the high energy funk piece, “What I Say”, from Miles Davis’ Live-Evil album. The incredible brilliance of the musicians on that album (as well as the numerous other great musicians around the world) are not only an inspiration to me and my own musical and instrumental aspirations, but also set the standard for the level of musicianship that I hope machines will one day achieve. And through the power of artificial intelligence, signal processing, and engineering I firmly believe it is possible for machines to be artistic, creative, and inspirational”, Bretan wrote in his Youtube description.

The lab has been working on the robots for the past six years, with the ultimate goal of enabling them to compose jazz music and grooving to it. The star of the band is Shimon, the robot who holds the mallets. Since Bretan has joined the team, they’ve also developed the three smartphone-connected, bopping members – Shimis. Shimis added a more electronic feel and some dance moves to the existing music.

“I’m always trying something new with the robots, and sometimes they surprise me with something that’s sort of out there or pretty cool,” Bretan said in an interview.

In order to do this, scientists have actually had to break down the music theory and translate it into a sort of programming language. Then, in order to progress, they had to make the robots understand what they can do and what their limitations are.

“Because their note generating algorithms rely on their physical constraints, if you give the same algorithm to a different robot (like a marimba playing robot with one arm or 10 arms), you will get different musical behaviours and outcomes,” Bretantold Mashable via email.

It’s important to note that the goal isn’t to replace human musicians – but rather to explore the creativity that robots might harbor. It seems a bit strange to say that robots harbot creativity, but that’s basically how you call exploring different musical patterns, isn’t it? Even if it’s based on preprogrammed algorithms, I think you can still call it creativity.

A musician since the age of 4, Bretan blended his passion for music with his interest in programming and robotics to develop robot musicians.

“I do this not only because of the interesting science behind it, but also because I think that autonomous machines have artistic potential and the ability to be creative”, Bretan added.

His project and dissertation will likely be finished in 2015.

share Share

This 5,500-year-old Kish tablet is the oldest written document

Beer, goats, and grains: here's what the oldest document reveals.

A Huge, Lazy Black Hole Is Redefining the Early Universe

Astronomers using the James Webb Space Telescope have discovered a massive, dormant black hole from just 800 million years after the Big Bang.

Did Columbus Bring Syphilis to Europe? Ancient DNA Suggests So

A new study pinpoints the origin of the STD to South America.

The Magnetic North Pole Has Shifted Again. Here’s Why It Matters

The magnetic North pole is now closer to Siberia than it is to Canada, and scientists aren't sure why.

For better or worse, machine learning is shaping biology research

Machine learning tools can increase the pace of biology research and open the door to new research questions, but the benefits don’t come without risks.

This Babylonian Student's 4,000-Year-Old Math Blunder Is Still Relatable Today

More than memorializing a math mistake, stone tablets show just how advanced the Babylonians were in their time.

Sixty Years Ago, We Nearly Wiped Out Bed Bugs. Then, They Started Changing

Driven to the brink of extinction, bed bugs adapted—and now pesticides are almost useless against them.

LG’s $60,000 Transparent TV Is So Luxe It’s Practically Invisible

This TV screen vanishes at the push of a button.

Couple Finds Giant Teeth in Backyard Belonging to 13,000-year-old Mastodon

A New York couple stumble upon an ancient mastodon fossil beneath their lawn.

Worms and Dogs Thrive in Chernobyl’s Radioactive Zone — and Scientists are Intrigued

In the Chernobyl Exclusion Zone, worms show no genetic damage despite living in highly radioactive soil, and free-ranging dogs persist despite contamination.