homehome Home chatchat Notifications


Scientists connect brain to a basic tablet - paralyzed patient googles with ease

We're living in the future.

Mihai Andrei
October 29, 2015 @ 7:30 am

share Share

It’s things like this that make you feel like we’re living in the future. For patient T6, 2014, it was an amazing year; she got the chance to move from 1980s DOS to modern day Android – literally. She learned how to use a tablet with her brain.

This new technology allows paralyzed users to use an Android tablet just like a regular user does. Photo by Timothy Muza.

This new technology allows paralyzed users to operate an Android tablet just like a regular user does. Photo by Timothy Muza.

Like millions of other people in the world, T6 suffers from severe paralysis. Some people have it from accidents, some have it from strokes or diseases. She has it from amyotrophic lateral sclerosis (also known as Lou Gehrig’s disease). She retains her wit and love for red lipstick, but her body has mostly stopped listening to her. Communicating with the outside world was extremely complicated.

Technology has advanced to a point where there is hope for people like her; however, while a limited variety of techniques exist, actually enabling paralyzed people to efficiently communicate with the outside world is very complicated and difficult

“We really wanted to move these assisted technologies towards clinical feasibility,” said Dr. Paul Nuyujukian, a neuroengineer and physician from Stanford University, in a talk at the 2015 Society for Neuroscience annual conference that took place this week in Chicago.

With this in mind, they invented what they call a neural prosthetic: it acts like a bridge, allowing her brain to communicate with a device such as a tablet. They installed a tiny chip inside her brain; this chip decodes signals from her brain into sophisticated algorithms that allow her to control a mouse for example. But even this turned out to be very expensive – and Nuyujukian set out to fix that.

Their breakthrough came when they realized that controlling a cursor, from a mental point of view, is very similar to pointing a finger on a screen and moving it around – something that many people do every day, and that is well documented from a mental activity perspective.

“We were going to design our own touchscreen hardware, but then realized the best ones were already on the market, laughed Nuyujukian, so we went on Amazon instead and bought a Nexus 9 tablet.”

They rewired the tablet so that brain waves could control where the touchscreen clicks – the change was surprisingly easy.

“Basically the tablet recognized the prosthetic as a wireless Bluetooth mouse,” explained Nuyujukian. We pointed her to a web browser app and told her to have fun.

The patient found it surprisingly easy to google and browse around – she looked for some information on gardening, taking full advantage of the autocomplete feature. It’s not just a pretty interface – she now has access to the entire Android interface. She is now connected to the web.

According to previous studies, this relatively cheap connection can last at least two years without requiring repair or fixing, and researchers are now working on ways to expand its lifespan. But even for two waves, the achievement is spectacular.

“We set out to utilize what’s already been perfected in terms of the hardware to make the experience more pleasant,” said Nuyujukian. “We’ve now showed that we can expand the scope of our system to a standard tablet.”

They are also working on increasing the capabilities of the user, implementing click-and-drag and multi-touch maneuvers. They also want to expand to other operating systems.

“Our goal is to unlock the full user interface common to general-purpose computers and mobile devices,” said Nuyujukian. “This is a first step towards developing a fully-capable brain-controlled communication and computer interface for restoring function for people with paralysis.”

share Share

Scientists Quietly Developed a 6G Chip Capable of 100 Gbps Speeds

A single photonic chip for all future wireless communication.

Japan Is Starting to Use Robots in 7-Eleven Shops to Compensate for the Massive Shortage of Workers

These robots are taking over repetitive jobs and reducing workload as Japan combats a worker crisis.

A small, portable test could revolutionize how we diagnose Alzheimer's

A passive EEG scan could spot memory loss before symptoms begin to show.

A Single LSD Treatment Could Keep Anxiety At Bay for Months

This was all done in a controlled medical setting.

The Evolution of the Human Brain Itself May Explain Why Autism is so Common

Scientists uncover how human brain evolution boosted neurodiversity — and vulnerability to autism.

Anthropic AI Wanted to Settle Pirated Books Case for $1.5 Billion. A Judge Thinks We Can Do Better

This case is quickly shaping up to be a landmark in AI history.

First Mammalian Brain-Wide Map May Reveal How Intuition and Decision-Making Works

The brain’s decision signals light up like a Christmas tree, from cortex to cerebellum.

Your Next Therapist Could be a Video Game or a Wearable and It Might Actually Work

An inside look at a new wave of evidence-backed digital therapies.

Researchers Discovered How to Trap Cancer Cells by "Reprogramming" Their Environment

Scientists find a way to stop glioblastoma cells by stiffening a key brain molecule

A Rare Condition Made a Woman See Dragons Instead of Human Faces

It's one of the weirdest conditions.