Aug 07 2009

Virtual You

New research builds upon the growing body of research into how our brains give us a sense that we are inside our bodies. That is one of the brain’s functions that we take for granted – and do not even realize that it is a function of the brain or that it is necessary – until it is not functioning. When that happens we have an out-of-body experience (OBE).

Prior to modern neuroscience, OBEs were interpreted as mystical or spiritual experiences. In many cultures they were provoked by drugs during spiritual rituals. They have also been reported during certain dream states and in near-death experiences.

Unless one is a neuroscientist or has a keen interest in how the brain works, we tend to think of our mental selves as an integrated whole and not as a collection of independent functions – the latter is more close to the truth. Our brains are more like committees with many different parts carrying out specific functions – some conscious, some unconscious. But since we are our brains we are only aware of the net effect of that part of our brain function that produces our conscious awareness and attention. We are not aware of the bickering committee operating behind the scenes, and therefore we are not aware of all the subconscious tasks being carried out by individual components of our brains.

That is – until one of them stops working. Then we experience a bizarre alteration is our consciousness. There are many interesting examples of this. We can easily understand how if the part of our brain that controls the movement of our left arm is damaged, our left arm becomes paralyzed – we can’t move it. But what happens when the part of the brain that maps the left side of the world is damaged? Then we not only cannot move the left side of our body, we cannot think about the left side of ourselves or the world (a syndrome called “neglect”). Patients with this lesion, usually following a stroke, do not know their left arm is weak, they do not know they have a left arm. If you show them their own left hand they will say that it is yours, or someone else’s. You cannot convince them that it is theirs.

There is another part of the brain that gives us the sense of ownership over the various parts of our bodies (separate from the mapping of the world above). In rare cases after damage this ownership module can lose its input from a paralyzed limb and instead create the illusion of ownership over an imaginary limb (a supernumerary phantom limb). People with this condition feel as if they have an extra limb – they can see it and feel it, and even scratch themselves with it. But of course, they cannot manipulate reality outside themselves with it, because it does not exist except in the crossed wiring in their brains.

And, of course, there are parts of the brain that make us feel as if we are inside our own bodies. This is not an automatic consequence of being our physical selves – our brains have to specifically create the sensation that we exist inside our bodies – that we are placed in three-dimensional space behind our eyes. Our brain gives us an in-body experience, and therefore when this part of the brain is disrupted we have an OBE.

What researchers have been working on are ways to artificially create, at will, an OBE. What they learned is that the creation of an in-body experience is partly based on integrating sensory input – tactile sensation, vestibular sensation (input from the inner ear about orientation to gravity and acceleration), proprioception (sensation of where the body is in three-dimensional space) and visual input. This integration takes place in the temporoparietal junction, especially on the right (non-dominant) side.

Incidentally, this is next to the area of the brain that makes us feel as if we are connected to external reality – so we feel we are in our bodies and our bodies are in the world. Disruption of this function results in what is called “derealization.”

What researcher have learned is that the brain can be tricked by mixing up the tactile and visual input into placing the sense of self somewhere other than where the body is actually located. They have done a series of experiments in which a subject is wearing a virtual reality visor, so that they only see a computer-generated image. This image includes a video of their own back – so there is an image of themselves standing a few feet in front of them. When their back is stroked or otherwise stimulated, the subjects see the virtual self in front of them being stroked at the same time they feel it. Their brains try to integrate these two bits of information – that body in front of me is being stroked and I feel it, therefore I must be inside that body. This is enough to provoke an out-of-body sensation is some subjects (although not a full OBE).

This latest experience is a variation on this same setup. This time subjects are wearing a device on their backs that can both light up and provide a vibration sensation. Subjects can therefore see the lights flashing while feeling the vibration. Sometimes, the lights are in a different area from where the vibration is, and subjects may report that they feel the vibration where they see the lights, rather than where the vibration is actually occurring. Essentially, their brains are being fed contradictory information, and it can be integrated in different ways. Once a “choice” has been made, that is what the subjects experience.

This is similar to visual integration of contradictory or ambiguous visual information – also known as optical illusions. Like the 2-D representation of 3-D objects, your brain can see them one way or another, and often will flip back and forth (like the spinning girl illusion).

In this experiment, subjects who felt the vibration where they saw the lights were more likely to place themselves physically closer to where their virtual self had been, rather than where their bodies were. When the subjects were moved back a few feet and then told to walk up to where they were standing before, those with an out-of-body sensation moved farther up, toward where their virtual self was placed.

This research is fairly well progressed in terms of figuring out what the different parts of the brain are doing to create the in-body and in-reality sensation. However, it is still in its infancy in terms of manipulating this brain function. It is promising, however, that such crude interventions can create such interesting effects.

And of course, we have to speculate about the applications of this technology when it is mature. The same list crops up in most news reports, and I have discussed them here as well. If we can fully manipulate our brains integration of sensory information to create the sensation that we are inside our bodies – we can trick the brain into creating the full sensation that we are inside a virtual representation of ourselves, or an avatar. This means we can feel as if we are inside a virtual game world, that we actually are our avatars – not just watching them on a screen. I have to say – I really hope I eventually see this application.

There are more practical applications as well. This kind of manipulation may be used to make operators of robots feel as if they are the robot, not just operating it, which may significantly enhance control. This would be most important for prosthetic limbs – so when we can give someone a bionic arm they will feel that it is actually their arm, not just a piece of hardware bizarrely attached to their body.

This will all, of course, inevitably lead to the Matrix where people are living virtual lives inside a virtual world. These scientists may be unwittingly doing the basic science research that will later be used by our robot overlords to enslave us inside the Matrix. But I guess that’s a risk we’ll have to take.

15 responses so far

15 thoughts on “Virtual You”

  1. Brian English says:

    This rocks! I just posted a link to this page on my philosophy discussion which is in part about self. Generally self is considered to be a whole. Again, this rocks!

  2. JeffG says:

    Even though you did a great job describing the details, Steve, it’s still tough to imagine the effect as a non-neurologist who’s never had an OBE. The example that comes to mind is the extreme case where someone claims to have experienced hovering over the room and looking down on themselves. In that case, our post hoc assessment of our sensory input would seem to have differed radically from what our eyes actually saw. Is this the general idea we should take from this research? Does it relate to Dennett’s “multiple drafts” idea that our recollection of the event was revised as our brain struggles to resolve the asynchrony between our senses? If so, would that pose a problem for the extremely cool idea of using this in a video game which would require a sort of real-time illusion? Thanks for the great post.

  3. We can’t say yet, but to create a convincing real-time video game illusion we will probably need to coordinate multiple senses – tactile, proprioception, and vision. One would think that the more senses used the more compelling the illusion, or the greater the probability of successfully occupying one’s avatar.

    The good thing is, what is suggested by this research, is that the illusion seems to snap into place (like optical illusions). But it is not yet complete or reliable.

  4. HHC says:

    Is the use of vibration as stimulation based on the concept that everything in the universe vibrates as a matter of course? Vibration stimulation applied along the spinal chord is a real trip, sensory info is dispersed and then reintegrated in the brain.

  5. rmgw says:

    “Our brain gives us an in-body experience, and therefore when this part of the brain is disrupted we have an OBE”.

    -an Order of the British Empire? Thought only the Queen could give those….
    Wonderful article, though – going to forward it to the reiki-enthusiasts!

  6. Draal says:

    Is the use of vibration as stimulation based on the concept that everything in the universe vibrates as a matter of course?

    Are you referring to temperature (the average measurement of the kinetic energy of atoms)?

    Or string theory?

    In either case, um, no. And if someone is claiming it, well, they’re wrong sincea n atomic scale vibration is many orders of magnitude off from what we can feel.

  7. RickK says:

    I remember hearing about a hospital that, in an attempt to better understand the OBE associated with near-death experiences, placed hidden messages on top of cabinets and other places in the operating rooms and trauma rooms. These were placed so that someone actually floating above the room could see them, but the patients and doctors could not. The results were that nobody who’d had an OBE in those rooms were able to recall the messages.

    Does anyone know details about this, or a link?

  8. HHC says:

    Draal, Thanks for your reply and links.

  9. eiskrystal says:

    -We can’t say yet, but to create a convincing real-time video game illusion we will probably need to coordinate multiple senses-

    I would suspect that spending time in the VR world would greatly increase the effect.

    It actually surprises me that a feeling during an OBE would automatically default to being outside your body given that all your bits are inside. Has anyone researched why we default to floating above our bodies?

  10. JeffG says:

    I keep waiting for Bob to say the porn industry should pump billions of dollars into this technology. But apparently he’s going to disappoint us.

  11. HHC says:

    JeffG, Do you like to wait for a Diet Coke or the Real Thing?

  12. JeffG says:


  13. Amish Gone Wild says:

    if we aint in awr bodees then em i in Uncle Cleetus? coz he STINXS!

Leave a Reply