Unreal Nature

June 26, 2009

Later

Filed under: Uncategorized — unrealnature @ 6:46 am

… the recalibration of subjective timing is not a party trick of the brain; it is critical to solving the problem of causality. At bottom, causality requires a temporal order judgment: did my motor act come before or after that sensory signal? The only way this problem can be accurately solved in a multisensory brain is by keeping the expected time of signals well calibrated, so that “before” and “after” can be accurately determined even in the face of different sensory pathways of different speeds.

It must be emphasized that everything I’ve been discussing is in regard to conscious awareness. It seems clear from preconscious reactions that the motor system does not wait for all the information to arrive before making its decisions but instead acts as quickly as possible, before the participation of awareness, by way of fast subcortical routes. This raises a question: what is the use of perception, especially since it lags behind reality, is retrospectively attributed, and is generally outstripped by automatic (unconscious) systems? The most likely answer is that perceptions are representations of information that cognitive systems can work with later. Thus it is important for the brain to take sufficient time to settle on its best interpretation of what just happened rather than stick with its initial, rapid interpretation. Its carefully refined picture of what just happened is all it will have to work with later, so it had better invest the time.

That’s from the end of a long essay, Brain Time, by David M. Eagleman (Jun 24, 2009) on The Edge. Here is more:

… It has long been recognized that the nervous system faces the challenge of feature-binding — that is, keeping an object’s features perceptually united, so that, say, the redness and the squareness do not bleed off a moving red square. That feature-binding is usually performed correctly would not come as a surprise were it not for our modern picture of the mammalian brain, in which different kinds of information are processed in different neural streams. Binding requires coordination — not only among different senses (vision, hearing, touch, and so on) but also among different features within a sensory modality (within vision, for example: color, motion, edges, angles, and so on).

But there is a deeper challenge the brain must tackle, without which feature-binding would rarely be possible. This is the problem of temporal binding: the assignment of the correct timing of events in the world. The challenge is that different stimulus features move through different processing streams and are processed at different speeds. The brain must account for speed disparities between and within its various sensory channels if it is to determine the timing relationships of features in the world.

What is mysterious about the wide temporal spread of neural signals is the fact that humans have quite good resolution when making temporal judgments. Two visual stimuli can be accurately deemed simultaneous down to five milliseconds, and their order can be assessed down to twenty-millisecond resolutions. How is the resolution so precise, given that the signals are so smeared out in space and time?

To answer this question, we have to look at the tasks and resources of the visual system. As one of its tasks, the visual system — couched in blackness, at the back of the skull — has to get the timing of outside events correct. But it has to deal with the peculiarities of the equipment that supplies it: the eyes and parts of the thalamus. These structures feeding into the visual cortex have their own evolutionary histories and idiosyncratic circuitry. As a consequence, signals become spread out in time from the first stages of the visual system (for example, based on how bright or dim the object is).

So if the visual brain wants to get events correct timewise, it may have only one choice: wait for the slowest information to arrive. To accomplish this, it must wait about a tenth of a second. In the early days of television broadcasting, engineers worried about the problem of keeping audio and video signals synchronized. Then they accidentally discovered that they had around a hundred milliseconds of slop: As long as the signals arrived within this window, viewers’ brains would automatically resynchronize the signals; outside that tenth- of- a- second window, it suddenly looked like a badly dubbed movie.

This brief waiting period allows the visual system to discount the various delays imposed by the early stages; however, it has the disadvantage of pushing perception into the past. There is a distinct survival advantage to operating as close to the present as possible; an animal does not want to live too far in the past. Therefore, the tenth-of- a-second window may be the smallest delay that allows higher areas of the brain to account for the delays created in the first stages of the system while still operating near the border of the present. This window of delay means that awareness is postdictive, incorporating data from a window of time after an event and delivering a retrospective interpretation of what happened. Among other things, this strategy of waiting for the slowest information has the great advantage of allowing object recognition to be independent of lighting conditions. Imagine a striped tiger coming toward you under the forest canopy, passing through successive patches of sunlight. Imagine how difficult recognition would be if the bright and dim parts of the tiger caused incoming signals to be perceived at different times. You would perceive the tiger breaking into different space-time fragments just before you became aware that you were the tiger’s lunch. Somehow the visual system has evolved to reconcile different speeds of incoming information; after all, it is advantageous to recognize tigers regardless of the lighting.

Read the full piece. [ link] You won’t want to miss the description of their experiment to determine if time really does slow down when you’re scared shitless:

… we harnessed participants to a platform that was then winched fifteen stories above the ground. The perceptual chronometer, strapped to the participant’s forearm like a wristwatch, displayed random numbers and their negative images alternating just a bit faster than the participant’s determined threshold. Participants were released and experienced free fall for three seconds before landing (safely!) in a net. During the fall, they attempted to read the digits.

-Julie

http://www.unrealnature.com/

Blog at WordPress.com.