Stereopsis


In the science of visual perception, stereopsis is the sensation that objects in space extend into depth, and that objects have different distances from each other. This sensation is much stronger than the suggestion of depth that is created by two-dimensional perspective.
In humans, at least two mechanisms produce the sensation of stereopsis: [|binocular depth vision] and [|motion vision]. In binocular depth vision, the sensation arises from processing differences in retinal images resulting from the two eyes looking from different, but similar, directions. In motion vision, the sensation arises from processing motion information when the observer moves. The sensation of stereopsis is similar in both cases.
In research on depth vision, the term stereopsis is primarily used for binocular depth vision and not for the sensation of depth resulting from motion vision. Sometimes the term "relative depth" is used. This term emphasizes that it refers not to the distance to the observer, but to the mutual depth relationships of the perceived objects. If the meaning is clear from the context, the single word "depth" is also used instead of "relative depth."
The word stereopsis comes. Together, these indicate seeing the outside of three-dimensional, "solid" objects.
Binocular depth vision comes in two qualities: [|coarse stereopsis] and fine stereopsis. Fine stereopsis plays a role in the recognition of shapes and objects, and coarse stereopsis in spatial localization.

Summary of research

Research into binocular depth vision begins with Charles Wheatstone, who was the first to make a stereoscope. At the end of the 19th century, he was the first to demonstrate that horizontal [|disparity] of vertical lines is sufficient to evoke a sensation of depth. Bela Julesz showed in the 20th century that the sensation also occurs with dots and that depth vision precedes the perception of forms. Jodi Krol showed around the same time that a light transition is necessary, but that two corresponding edges of opposite contrast do not give a depth sensation. He also found that the depth of the surfaces between these edges is an interpretation. The left and right visual directions should be stimulated at approximately the same time, but this does not have to happen at exactly the same time. This is illustrated by the [|Puflrich illusion].
Kenneth Ogle found that the quality of depth perception differs for small and large disparities and on this basis distinguishes different types of stereopsis. It is generally accepted that in the absence of a sensation of stereopsis the perceived image is usually seen in the plane of the [|horopter]. John Foley describes that in exceptional cases the image can also appear slightly behind or in front of the horopter. Jodi Krol shows that the latter happens when the eyes are unconsciously directed slightly in front of or behind the intended fixation point due to certain reflexes and the fixation point is therefore not on the horopter.
Finally, nerve cells have been found in the visual cortex that are tuned to a certain disparity. These cells form the basis for neural models for binocular depth vision and for the solution of the [|correspondence problem] to be discussed. These cells are part of two [|neurophysiological mechanisms] that are specialized in shape and object recognition and in spatial localization, respectively.

Binocular disparity

When attention is directed to a point F in space, automatic eye movements are performed, causing the eye to rotate and point F is mapped onto the point of the eye with which it can see most sharply, the fovea. The direction in which the eye then looks is called the principle ocular direction. Every other point in space is seen by the eye in a certain direction that can be expressed as the angle that this direction makes with the principle direction. This is called visual direction or simply direction. The directions in which each eye sees the same object are sometimes the same, but usually not. The difference in directions is called disparity. The separate article on directional vision explains how the brain combines the directions that each eye sees into a combined image with single images, double images and fused images that are apparently seen from a point in the middle between both eyes.

Horizontal disparity

The horizontal distance of approximately 6.5 cm between the two eyes ensures that points in space that are at different depths relative to the fixation point have a horizontal difference in direction. This difference is called horizontal disparity and is expressed as the difference between the angles α and β in the figure. In addition to horizontal disparity, there is also vertical disparity. This term indicates a vertical disalignment between the two eyes which can be caused by vertical eye movement or tilting the head. The latter is usually partially or completely corrected with automatically performed eye movements. Vertical disparities can also evoke a sense of depth in some cases.
The terms horizontal and vertical disparity only make sense when the observer is upright. Another term that is sometimes used and that better describes the load is binocular disparity. Binocular disparity has many similarities with motion parallax and is therefore sometimes also called binocular parallax. Motion parallax also evokes a depth sensation, but it requires the observer to move or the observed objects to move relative to each other. Under neurophysiological mechanisms it can be read that motion parallax is possibly processed in the same system as coarse stereopsis.

Horopter

Points at the same depth as the fixation point lie on a circle through both eyes and the fixation point. This circle is called the horopter. Points on this circle project onto corresponding points in both eyes, i.e. onto points that look in the same direction in the left and right eye. We perceive the horopter as a kind of screen on which we see the world.

Crossed disparity

The directions in both eyes of a point C that is closer than the horopter are seen crossed on this screen: the direction in which the direction of the left eye is seen is to the right of the direction of the right eye. This is called crossed disparity or negative disparity.

Parallel disparity

The directions in both eyes of a point P that is further away than the horopter are seen side by side on this screen: the right direction is seen on the right. This is called parallel disparity or positive disparity.

Wheatstone's proof

showed in 1838 that two objects that differ only in horizontal disparity produce a sensation of relative depth. To ensure that this sensation could not be caused by two-dimensional perspective, he used a pair of flat plates with two vertical lines, a line stereogram, to represent the visual directions, and invented the stereoscope to view these plates.

Depth as a function of disparity

Ogle investigated how the sensation of depth depends on the degree of disparity. Ogle asked an observer to fixate a point F and then moved a vertical rod Y in depth away from X. The magnitude of the perceived depth was found to increase linearly at small disparities, and to decrease again at larger disparities, and to be completely absent at even larger disparities. In the latter case, Y was seen at the distance of the horopter.
If Ogle asked the observer to look back and forth between X and Y, depth perception was found to be possible over a much larger range.
According to the research of Ogle and others, depth differences are perceived only in a narrow region of space, further away and closer than the horopter and this occurs with three qualities: fine stereopsis, coarse stereopsis and no stereopsis.

Fine stereopsis

With fine stereopsis the observer can indicate the size of the depth: the greater the disparity, the greater the perceived depth. Ogle used the term patent stereopsis for this. Later researchers replaced this term with fine stereopsis.

Coarse stereopsis

With coarse stereopsis the observer can indicate whether one object is further away than the other, but not how much. Ogle used the term qualitative stereopsis for this. Later researchers replaced this term with coarse stereopsis.

No stereopsis

In the remaining area, objects are seen without depth sensation, at or around the distance of the horopter, and usually as a double image.

Conditions for binocular depth vision

Horizontal disparity is a condition for seeing relative depth, but not a sufficient condition. The visual directions in the left and right eyes must also have a certain similarity, such as equal light transitions or spots, and must be stimulated more or less simultaneously. Eye movements ensure that objects in space fall on corresponding points in both eyes as much as possible and the disparity remains as small as possible.

Equal edges

Hering suggested as early as 1864 that the visual directions must contain equal "edges" and that the surfaces between these edges are "filled in" during perception. This has been confirmed by Krol. Edges with an opposite contrast do not give a depth sensation. Seeing an opposite contrast triggers an eye movement reflex, which means that the opposite contrasts do not fall on corresponding points and the edges appear to lie slightly in front of or behind the fixation point.

Color and brightness

The color and brightness do not have to be the same. Stereopsis even occurs with opposite colors, where the perceived color alternates between the two colors. There is no color mixing.

Random dot stereogram

Julesz has shown with random dot stereograms that stereopsis also occurs when the visual directions consist of small, random white and black spots, where a certain group of spots in the left image has shifted in the right eye. Each eye alone sees only spots, but both eyes together see the group of shifted spots as a shape with depth.

Figure. Random dot stereogram
Figure Hidden shape. ''The image alternates between the left and right images of the random dot stereogram above. The movement that then becomes visible reveals which shape is hidden in the stereogram. In this case, a square. This square also becomes visible when the stereogram is viewed through a stereoscope, only then the square does not move.''