homehome Home chatchat Notifications


Scientists connect brain to a basic tablet - paralyzed patient googles with ease

We're living in the future.

Mihai Andrei
October 29, 2015 @ 7:30 am

share Share

It’s things like this that make you feel like we’re living in the future. For patient T6, 2014, it was an amazing year; she got the chance to move from 1980s DOS to modern day Android – literally. She learned how to use a tablet with her brain.

This new technology allows paralyzed users to use an Android tablet just like a regular user does. Photo by Timothy Muza.

This new technology allows paralyzed users to operate an Android tablet just like a regular user does. Photo by Timothy Muza.

Like millions of other people in the world, T6 suffers from severe paralysis. Some people have it from accidents, some have it from strokes or diseases. She has it from amyotrophic lateral sclerosis (also known as Lou Gehrig’s disease). She retains her wit and love for red lipstick, but her body has mostly stopped listening to her. Communicating with the outside world was extremely complicated.

Technology has advanced to a point where there is hope for people like her; however, while a limited variety of techniques exist, actually enabling paralyzed people to efficiently communicate with the outside world is very complicated and difficult

“We really wanted to move these assisted technologies towards clinical feasibility,” said Dr. Paul Nuyujukian, a neuroengineer and physician from Stanford University, in a talk at the 2015 Society for Neuroscience annual conference that took place this week in Chicago.

With this in mind, they invented what they call a neural prosthetic: it acts like a bridge, allowing her brain to communicate with a device such as a tablet. They installed a tiny chip inside her brain; this chip decodes signals from her brain into sophisticated algorithms that allow her to control a mouse for example. But even this turned out to be very expensive – and Nuyujukian set out to fix that.

Their breakthrough came when they realized that controlling a cursor, from a mental point of view, is very similar to pointing a finger on a screen and moving it around – something that many people do every day, and that is well documented from a mental activity perspective.

“We were going to design our own touchscreen hardware, but then realized the best ones were already on the market, laughed Nuyujukian, so we went on Amazon instead and bought a Nexus 9 tablet.”

They rewired the tablet so that brain waves could control where the touchscreen clicks – the change was surprisingly easy.

“Basically the tablet recognized the prosthetic as a wireless Bluetooth mouse,” explained Nuyujukian. We pointed her to a web browser app and told her to have fun.

The patient found it surprisingly easy to google and browse around – she looked for some information on gardening, taking full advantage of the autocomplete feature. It’s not just a pretty interface – she now has access to the entire Android interface. She is now connected to the web.

According to previous studies, this relatively cheap connection can last at least two years without requiring repair or fixing, and researchers are now working on ways to expand its lifespan. But even for two waves, the achievement is spectacular.

“We set out to utilize what’s already been perfected in terms of the hardware to make the experience more pleasant,” said Nuyujukian. “We’ve now showed that we can expand the scope of our system to a standard tablet.”

They are also working on increasing the capabilities of the user, implementing click-and-drag and multi-touch maneuvers. They also want to expand to other operating systems.

“Our goal is to unlock the full user interface common to general-purpose computers and mobile devices,” said Nuyujukian. “This is a first step towards developing a fully-capable brain-controlled communication and computer interface for restoring function for people with paralysis.”

share Share

A Dutch 17-Year-Old Forgot His Native Language After Knee Surgery and Spoke Only English Even Though He Had Never Used It Outside School

He experienced foreign language syndrome for about 24 hours, and remembered every single detail of the incident even after recovery.

If you use ChatGPT a lot, this study has some concerning findings for you

So, umm, AI is not your friend — literally.

Miyazaki Hates Your Ghibli-fied Photos and They're Probably a Copyright Breach Too

“I strongly feel that this is an insult to life itself,” he said.

Bad microphone? The people on your call probably think less of you

As it turns out, a bad microphone may be standing between you and your next job.

Just 10 Minutes of Mindfulness a Day Can Boost Your Mental Health

Daily short mindfulness sessions significantly reduce depression and anxiety while encouraging healthier lifestyles.

This AI Tool Can Scan Your Food and Tell You Exactly How Many Calories and Other Nutrients It Has

Knowing what's inside your food has never been so easy.

Why Can't We Remember Our Lives as Babies? Our Earliest Memories May Still be There

New research suggests infants can form memories far earlier than previously thought, but where do they go?

Most Back Pain Treatments Don't Work—Here's What Actually Helps

Sometimes, the simplest solutions—moving more, staying strong, and managing stress—are the best we have.

Is AI Moderation a Useful Tool or Another Failed Social Media Fix?

A new study suggests that an optimized AI model could detect harmful social media comments with 87% accuracy.

Study shows "Pro Life" supporters sometimes care more about banning casual sex than sanctity of life

Some Pro Life advocates may actually be subconsciously more fixated on the lives of the parents.