Jun 03 2008
Monkey Controls Robotic Arm With Its Mind
This is the next step in the progress toward brain-computer interfaces. Previously researchers had enabled human subjects to control the cursor on a computer screen with an EEG-computer interface. After a significant training period, through thoughts alone the subject could move the cursor on the screen. This seems like a small accomplishment but it was a significant proof of concept. Also, while modest, such an interface could enable quadraplegics to communicate or control external devices, like a wheelchair.
Researchers at Duke University led by project leader Miguel Nicolelis have previously published research in which they trained monkeys to manipulate a cursor onscreen using only a brain interface, without having to move any part of their body.
Last week in Nature online was published the results of similar research from from the University of Pittsburgh led by Dr. Andrew Schwartz. He took the next step by connecting the interface to a robotic arm. First they mapped the activity in the frontal and parietal lobes – the parts of the brain responsible for movement of the arm – while the monkeys moved their limb normally. Then they connected these signals (produced from a few hundred neurons) to a computer controlling a robotic arm. The monkeys were then able to move the robotic arm by moving their own arm. Since the signals had been mapped the researchers were able to match the robotic arm movements to the monkeys own arm. Eventually the monkeys learned how to move the robotic arm without moving their own arm. They were then able to control the arm well enough to feed themselves with it, while they were otherwise restrained and unable to move their own limbs.
This is an exciting development in this line of technology – the interface of brain and computer. This shows how quickly the brain can adapt to controlling an external device, and even separate the movements from the movements of the body. From this point better and more exquisite control is only a matter of more precise mapping and measurement of neuronal firing. This is like coming up with the basic concept of a printed circuit – from there continued progress of computing power was almost assured.
The monkeys used their own visual feedback to learn how to control the arm. Some kind of sensory feedback is critical for the brain to learn how to control the device. Control of the arm, as well as the naturalness of the feel of such an external device, would likely be significantly improved if the subject could somehow feel the arm. There are multiple types of sensory feedback that our brains receive from our limbs. Not only does the skin have tactile sensation, limbs have proprioception which is the sense of where the limb is in 3-dimensional space. This is why you can precisely control your limbs even with your eyes closed. Also, the muscles provide sensory feedback on the degree to which they are stretched. All of this sensory information is important for the brain to control the limb and for you to feel as if you own the limb, that it is part of you.
It seems that the human brain is plastic enough that it can remap both sensory input and motor output. This happens often after nerve injuries, when the nerves have to regrow. If they do not grow back to the exact location they previously terminated, then the brain has to remap to the new layout of the nerves. This can be done with practice and visual feedback. The same principle would likely apply to learning how to interface with a robotic arm. If it had the same motor input and sensory output as a real limb eventually it could feel as natural as the limb you were born with.
Adapting to new prosthetic limbs of this type would be much easier and more successful the younger the recipient. However, it is also likely that in the future through stem cell therapy or other approaches that the plasticity of the brain (the ability to rewire itself to adapt to new uses and inputs) could be increased even in older adults.
The next step in this technology, starting with motor output, then progressing to sensory input, would be cognitive input. This would involve a computer interface where the computer or prosthetic would not just give raw sensory information to the brain but complex information. This is Matrix territory – downloading languages or having access to vast amounts of information stored outside the biological brain. One computer-brain interfacing is a reality, this seems to be the inevitable arc of this technology.
The applications of such technology are too numerous to discuss fully. The most obvious uses in the short term would be prosthetics for amputees and those suffering from paralysis. Like the Bionic Man – limbs could be replaced with robotic limbs. For those with intact but paralyzed limbs, robotic exoskeletons could be used.
In addition to limb replacement and augmentation, there is direct control of external devices. This could enable a paralyzed person to control their entire home without having to lift a finger. Computers could be used for communication.
Beyond helping the sick and injured, this technology could also be used to augment the healthy. For example, direct interfaces could be used to provide exquisite real-time control of robots and machinery, either as an exoskeleton (like the Iron Man suit) or independent robotics. Or how about just controlling software – thinking what you want to write and having the words appear onscreen.
Some, like Ray Kurzweil, believe that this technology will inevitably lead to computer-brain symbiosis – we will become biological computer hybrids, “cyborgs.” I can think of no reason why such technology cannot work, and the rapidity with which it is currently developing speaks to the feasibility of such concepts. Exactly how long such technology will take to develop and the precise forms it will take are impossible to predict with any confidence – but I think we can paint the broad brushstrokes. We are seeing the beginning steps to the age of computer-brain interface technology. This is a transformative technology, and even the most enthusiastic futurists probably underestimate the degree to which it will affect our lives.