Common coding theory

Common coding theory is a cognitive psychology theory describing how perceptual representations (e.g. of things we can see and hear) and motor representations (e.g. of hand actions) are linked. The theory claims that there is a shared representation (a common code) for both perception and action. More important, seeing an event activates the action associated with that event, and performing an action activates the associated perceptual event.[1]

The idea of direct perception-action links originates in the work of the American psychologist William James and more recently, American neurophysiologist and Nobel prize winner Roger Sperry. Sperry argued that the perception–action cycle is the fundamental logic of the nervous system.[2] Perception and action processes are functionally intertwined: perception is a means to action and action is a means to perception. Indeed, the vertebrate brain has evolved for governing motor activity with the basic function to transform sensory patterns into patterns of motor coordination.

Background

The classical approach to cognition is a 'sandwich' model which assumes three stages of information processing: perception, cognition and then action. In this model, perception and action do not interact directly, instead cognitive processing is needed to convert perceptual representations into action. For example, this might require creating arbitrary linkages (mapping between sensory and motor codes).[3]

In contrast, the common coding account claims that perception and action are directly linked by a common computational code.[4]

This theory, put forward by German scientist Wolfgang Prinz and his colleagues from the Max Planck Institute, claims parity between perception and action. Its core assumption is that actions are coded in terms of the perceivable effects (i.e., the distal perceptual events) they should generate.[5] This theory also states that perception of an action should activate action representations to the degree that the perceived and the represented action are similar.[6] Such a claim suggests that we represent observed, executed and imagined actions in a commensurate manner and makes specific predictions regarding the nature of action and perceptual representations. First, representations for observed and executed actions should rely on a shared neural substrate. Second, a common cognitive system predicts facilitation of action based on directly prior perception and vice versa. Third, such a system predicts interference effects when action and perception attempt to access shared representations simultaneously.

Evidence for common coding

In the past decade, a growing number of results have been interpreted in favor of the common coding theory.

For instance, one functional MRI study demonstrated that the brain’s response to the 2/3 power law of motion (i.e., which dictates a strong coupling between movement curvature and velocity) is much stronger and more widespread than to other types of motion. Compliance with this law was reflected in the activation of a large network of brain areas subserving motor production, visual motion processing, and action observation functions. These results support the common coding and the notion of similar neural coding for motion perception and production.[7]

One of the most direct evidence for common coding in the brain now stems from the fact that pattern classifiers that can differentiate based on brain activity whether someone has performed action A or B can also classify, above chance, whether that person heard the sound of action A or B, thereby demonstrating that action execution and perception are represented using a common code.[8]

Recently, the common coding theory received increased interest from researchers in developmental psychology,[9] cognitive neuroscience,[10] robotics,[11] and social psychology.[12]

Commensurate representation

Common coding posits, on top of separate coding, further domains of representation in which afferent and efferent information share the same format and dimensionality of representation. Common coding refers to ‘late’ afferent representations (referring to events in the environment) and ‘early’ efferent representations (referring to intended events). Such representations are commensurate since they both exhibit distal reference.[13][14] They permit creating linkages between perception and action that do not rely on arbitrary mappings. Common coding conceives action planning in terms of operations that determine intended future events from given current events (matching between event codes and action codes). In particular perception and action may modulate each other by virtue of similarity. Unlike rule-based mapping of incommensurate codes which requires preceding acquisition of mapping rules, similarity-based matching of commensurate codes requires no such preceding rule acquisition.

Ideomotor principle

In line with the ideomotor theory of William James (1890) and Hermann Lotze (1852), the common coding theory posits that actions are represented in terms of their perceptual consequences. Actions are represented like any other events, the sole distinctive feature being that they are (or can be) generated through bodily movements. Perceivable action consequences may vary on two major dimensions: resident vs. remote effects, and ‘cool’ versus ‘hot’ outcomes (i.e., reward values associated with action outcomes).[15]

When individuals perform actions they learn what their movements lead to (Ideomotor learning). The ideomotor theory claims that these associations can also be used in the reverse order (cf. William James, 1890 II, p. 526): When individuals perceive events of which they know (from previous learning) that they may result from certain movements, perception of these events may evoke the movements leading to them (Ideomotor control). The distinction between learning and control is equivalent to the distinction between forward and inverse computation in motor learning and control.[16] Ideomotor learning supports prediction and anticipation of action outcomes, given current action. Ideomotor control supports selection and control of action, given intended outcomes.

Related approaches

While most traditional approaches tend to stress the relative independence of perception and action, some theories have argued for closer links. Motor theories of speech and action perception have made a case for motor contributions to perception.[17][18] Close non-representational connections between perception and action have also been claimed by ecological approaches.[19][20] Today common coding theory is closely related to research and theory in two intersecting fields of study: Mirror neurons systems and embodied cognition. As concerns mirror systems, common coding seems to reflect the functional logic of mirror neurons and mechanisms in the brain.[21] As concerns embodied cognition, common coding is compatible with the claim that meaning is embodied, i.e. grounded in perception and action.[22][23]

See also

References

  1. ↑ Prinz, W. (1984). Modes of linkage between perception and action. In W. Prinz & A.-F. Sanders (Eds.), Cognition and motor processes (pp. 185-193). Berlin: Springer.
  2. ↑ Sperry, R.W. (1952). Neurology and the mind-body problem. American Scientist, 40, 291-312.
  3. ↑ Massaro, D. W. (1990). An information-processing analysis of perception and action. In O. Neumann & W. Prinz (Eds.), Relationships between perception and action: Current approaches (pp. 133-166). Berlin: Springer.
  4. ↑ Prinz, W. (2005). Experimental approaches to action. In J. Roessler and N. Eilan (Eds.), Agency and self-awareness (pp. 165-187). New-York, Oxford University press.
  5. ↑ Prinz, W. (1997). Perception and action planning. European Journal of Cognitive Psychology, 9: 129-154.
  6. ↑ Knoblich, G. & Flach, R. (2001). Predicting the effects of actions: interactions of perception and action. Psychological Science, 12, 467-472.
  7. ↑ Eran Dayan, E., Casile, A., Levit-Binnun, N., Giese, M.A., Hendler, T., & Flash, T. (2007). Neural representations of kinematic laws of motion: Evidence for action-perception coupling. PNAS, 104, 20582-20587.
  8. ↑ Ezel, JA, Gazzola, V, Keysers, C. (2008) Testing Sumulation Theory with Cross-Modal Multivariate Classification of fMRI DATA. Plos One 3(11) e3690. http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0003690
  9. ↑ Sommerville, J. A., & Decety, J. (2006). Weaving the fabric of social interaction: Articulating developmental psychology and cognitive neuroscience in the domain of motor cognition. Psychonomic Bulletin & Review, 13, 179-200.
  10. ↑ Jackson, P.L., & Decety, J. (2004). Motor cognition: A new paradigm to investigate social interactions. Current Opinion in Neurobiology, 14, 1-5.
  11. ↑ Proctor and Vu (2006). Stimulus-response compatibility: Data, theory and application. Taylor & Francis
  12. ↑ Dijksterhuis, A., & Bargh, J.A. (2001). The perception-behavior expressway: automatic effects of social perception on social behavior. Advances in Experimental Social Psychology, 33, 1-40.
  13. ↑ Prinz, W. (1992). Why don't we perceive our brain states? European Journal of Cognitive Psychology, 4, 1-20.
  14. ↑ Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24, 849-878.
  15. ↑ Dickinson, A., & Balleine, B. W. (2002). The role of learning in the operation of motivational systems. In H. Pashler & R. Gallistel (Eds.), Stevens' handbook of experimental psychology (Vol. 3, pp. 497-533). New York: John Wiley.
  16. ↑ Wolpert, D., & Ghahramani, Z. (2004). Computational motor control. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (3 ed., pp. 485-494). Cambridge, MA: MIT Press.
  17. ↑ Viviani, P. (2002). Motor competence in the perception of dynamic events: A tutorial. In W. Prinz & B. Hommel (Eds.), Common mechanisms in perception and action: Attention and Performance (Vol. XIX, pp. 406-442). Oxford: Oxford University Press.
  18. ↑ Liberman, A. M. (1982). On finding that speech is special. American Psychologist, 37, 148-167.
  19. ↑ Fowler, C. A., & Turvey, M. T. (1982). Observational perspective and descriptive level in perceiving and acting. In W. B. Weimer & D. S. Palermo (Eds.), Cognition and the symbolic processes (Vol. 2, pp. 1-19). Hillsdale, NJ: Lawrence Erlbaum.
  20. ↑ Gibson, J. J. (1979). The ecological approach to visual perception. Boston: Houghton Mifflin.
  21. ↑ Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169-192.
  22. ↑ Noë, A. (2004) Action in Perception. MIT Press.
  23. ↑ Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617-645.

Further reading