Stereoscopic motion

This article is about the binocular perception of motion and its mental representation. For stereoscopic motion pictures, see 3D film.

Stereoscopic motion, as introduced by Béla Julesz in his book Foundations of Cyclopean Perception of 1971, is a translational motion of figure boundaries defined by changes in binocular disparity over time[1] in a real-life 3D scene, a 3D film or other stereoscopic scene. This translational motion gives rise to a mental representation of three dimensional motion created in the brain on the basis of the binocular motion stimuli. Whereas the motion stimuli as presented to the eyes have a different direction for each eye, the stereoscopic motion is perceived as yet another direction on the basis of the views of both eyes taken together. Stereoscopic motion, as it is perceived by the brain, is also referred to as cyclopean motion, and the processing of visual input that takes place in the visual system relating to stereoscopic motion is called stereoscopic motion processing.

Provided the binocular motion stimuli correspond to a physical object moving in 3D space, the stereoscopic motion closely represents its actual motion. Alternatively, the images with the binocular motion stimuli can be artificially created, for instance using dynamic random dot stereograms.

Cyclopean (stereoscopic) motion and cyclopean images are aspects of so-called cyclopean vision[2] – named after the mythical giant Cyclops who had only one eye – involving a mental representation of objects in space as if they were perceived in full depth and from a position of a "cyclopean eye" situated approximately between the two eyes.

By definition, individuals who have only monocular vision do not perform stereoscopic motion processing. They rely instead on monocular depth cues to perceive motion in space (see also: kinetic depth effect).

Sensing and processing

Stereoscopic motion is sensed in a way that cannot be explained by feature tracking or by inferring the motion from memory of position and time,[3] and it appears to involve specific low-level motion sensing.[4] Purely binocular motion stimuli appear to influence also stereoblind persons as far as their sensation of self-motion is concerned.[5] Using dynamic random dot stereograms presented using a virtual reality head-mounted display, it was demonstrated from subjects' performance on real-world tasks of ball catching and obstacle avoidance that stereoscopic motion can derive from purely binocular stimuli, that is, without requiring any first-order motion perception. In other words, motion can be derived without using retinal flow, instead using optical flow understood in a more abstract sense.[6]

It has been shown that also the adaptation to moving disparity information induces a motion aftereffect. This effect is called the stereoscopic motion aftereffect to distinguish it from the more well-known luminance motion aftereffect.[7]

How the brain combines different cues, including stereo cues, motion cues (both temporal changes in disparity and monocular velocity ratios[8]), vergence angle and monocular cues for sensing motion in depth and 3D object position is an area of active research in vision science and neighboring disciplines.[9][10][11]

See also

References

  1. Béla Julesz (1971). Foundations of cyclopean perception. Chicago: University of Chicago Press. Cited by: Patterson, Robert; Donnelly, Michael; Phinney, Raymond E.; Nawrot, Mark; Whiting, Ana; Eyle, Terri (1997). "Speed Discrimination of Stereoscopic (Cyclopean) Motion". Vision Research 37 (7): 871–878. doi:10.1016/S0042-6989(96)00226-X. ISSN 0042-6989.
  2. Howard, Ian P.; Rogers, Brian J. (2012). "Cyclopean vision". pp. 210–248. doi:10.1093/acprof:oso/9780199764150.003.0153.
  3. Patterson, Robert; Donnelly, Michael; Phinney, Raymond E.; Nawrot, Mark; Whiting, Ana; Eyle, Terri (1997). "Speed Discrimination of Stereoscopic (Cyclopean) Motion". Vision Research 37 (7): 871–878. doi:10.1016/S0042-6989(96)00226-X. ISSN 0042-6989.
  4. Patterson, Robert (1999). "Stereoscopic (cyclopean) motion sensing". Vision Research 39 (20): 3329–3345. doi:10.1016/S0042-6989(99)00047-4. ISSN 0042-6989.
  5. Jeremy M. Wolfe; Richard Held (March 1980). "Cyclopean stimulation can influence sensations of self-motion in normal and stereoblind subjects". Perception & Psychophysics 28 (2): 139–142. doi:10.3758/bf03204339.
  6. Jack M. Loomis; Andrew C. Beall; Kristen L. Macuga; Jonathan W. Kelly; Roy S. Smith (March 2006). "Visual Control of Action Without Retinal Optic Flow". Psychological Science 17 (3): 214–221. doi:10.1111/j.1467-9280.2006.01688.x.
  7. Patterson, Robert; Bowd, Christopher; Phinney, Ray; Pohndorf, Robert; Barton-Howard, Wanda J.; Angilletta, Michelle (1994). "Properties of the stereoscopic (Cyclopean) motion aftereffect". Vision Research 34 (9): 1139–1147. doi:10.1016/0042-6989(94)90296-8. ISSN 0042-6989.
  8. Blake, Randolph; Wilson, Hugh (2011). "Binocular vision". Vision Research 51 (7): 754–770. doi:10.1016/j.visres.2010.10.009. ISSN 0042-6989.
  9. For stereo and motion cues, see for example the following review article: Domini, Fulvio; Caudek, Corrado; Tassinari, Hadley (2006). "Stereo and motion information are not independently processed by the visual system". Vision Research 46 (11): 1707–1723. doi:10.1016/j.visres.2005.11.018. ISSN 0042-6989.
  10. For stereo and motion cues, see also the recent review article: Ban, Hiroshi; Preston, Tim J; Meeson, Alan; Welchman, Andrew E (2012). "The integration of motion and disparity cues to depth in dorsal visual cortex". Nature Neuroscience 15 (4): 636–643. doi:10.1038/nn.3046. ISSN 1097-6256.
  11. For stereo, motion and vergence angle cues, see for example the following article: Fine, I.; Jacobs, Robert A. (1999). "Modeling the Combination of Motion, Stereo, and Vergence Angle Cues to Visual Depth". Neural Computation 11 (6): 1297–1330. doi:10.1162/089976699300016250. ISSN 0899-7667.