Visual memory

Close up of the human eye, the main organ of visual processing.

Visual memory describes the relationship between perceptual processing and the encoding, storage and retrieval of the resulting neural representations. Visual memory occurs over a broad time range spanning from eye movements to years in order to visually navigate to a previously visited location.[1] Visual memory is a form of memory which preserves some characteristics of our senses pertaining to visual experience. We are able to place in memory visual information which resembles objects, places, animals or people in a mental image. The experience of visual memory is also referred to as the mind's eye through which we can retrieve from our memory a mental image of original objects, places, animals or people.[1] Visual memory is one of several cognitive systems, which are all interconnected parts that combine to form the human memory.[2] Types of palinopsia, the persistence or recurrence of a visual image after the stimulus has been removed, is a dysfunction of visual memory.[3]

Neuroanatomy

In humans, areas specialized for visual object recognition in the ventral stream have a more inferior location in the temporal cortex, whereas areas specialized for the visual-spatial location of objects in the dorsal stream have a more superior location in the parietal cortex. However, these two streams hypothesis, although useful, are a simplification of the visual system because the two streams maintain intercommunication along their entire rostral course.

Posterior parietal cortex

Posterior parietal cortex (light green) is shown at the posterior area of the parietal lobe

The posterior parietal cortex is a portion of the parietal lobe, which manipulates mental images, and integrates sensory and motor portions of the brain.

A majority of experiments highlights a role of human posterior parietal cortex in visual working memory and attention. We therefore have to establish a clear separation of visual memory and attention from processes related to the planning of goal-directed motor behaviors.

We can only hold in mind a minute fraction of the visual scene. These mental representations are stored in visual short-term memory.[4] Activity in the posterior parietal cortex is tightly correlated with the limited amount of scene information that can be stored in visual short-term memory.[4] These results suggest that the posterior parietal cortex is a key neural locus of our impoverished mental representation of the visual world.[4]

The posterior cortex might act as a capacity-limited store for the representation of the visual scene, the frontal/prefrontal cortex might be necessary for the consolidation and/or maintenance of this store, especially during extended retention intervals.

Visual cortex

The dorsal stream (green) and ventral stream (purple) are both actively involved in visual memory. Both pathways originate in the visual cortex

There is a visual cortex in each hemisphere of the brain, much of which is located in the Occipital lobe. The left hemisphere visual cortex receives signals mainly from the right visual field and the right visual cortex mainly from the left visual field, although each cortex receives a considerable amount of information from the ipsilateral visual field as well. The visual cortex also receives information from subcortical regions, such as the lateral geniculate body, located in the thalamus. However, ample evidence indicates that object identity and location are preferentially processed in ventral (occipito-temporal) and dorsal (occipito-parietal) cortical visual streams, respectively.[4] Comparison of rCBF during performance of the two tasks again revealed differences between the ventral and dorsal pathways.[4]

Dorsal stream pathway

The dorsal stream pathway is mainly involved in the visual-spatial location of objects in the external world, and it is also known colloquially as the 'where' pathway. The dorsal stream pathway is also involved in the guidance of movements (e.g., reaching for an object in space), and is therefore implicated in the analysis of the movement of objects in addition to their spatial locations.

The dorsal stream pathway begins with purely visual information in the occipital lobe, and then this information is transferred to the parietal lobe for spatial awareness functions. Specifically, the posterior parietal cortex is essential for "the perception and interpretation of spatial relationships, accurate body image, and the learning of tasks involving coordination of the body in space." [5]

Ventral stream pathway

The ventral stream pathway is mainly involved in object recognition, and is known colloquially as the 'what' pathway. It has connections to the medial temporal lobe (which is involved in the storage of long-term memories), the limbic system (which regulates emotions), and the dorsal stream pathway (which is involved in the visual-spatial locations and motions of objects). Therefore, the ventral stream pathway not only deals with the recognition of objects in the external world, but also the emotional judgement and analysis of these objects.

The ventral stream pathway begins with purely visual information in the primary visual cortex (occipital lobe), and then this information is transferred to the temporal lobe.

Occipital lobes

Located at the back of the brain, the occipital lobes receive and process visual information. The occipital lobes also process colors and shapes. Whereas the right occipital lobe interprets images from the left visual space, the left occipital lobe interprets images from the right visual space. Damage to the occipital lobes can permanently damage visual perception[6]

Occipital lobe injury complications

Damage to the occipital lobe is characterized by loss of visual capability and the inability to identify colors both important processes in visual memory.

Short term visual memory

Visual short term memory is the capacity for holding a small amount of visual information in mind in an active, readily available state for a short period of time (usually no more than 30 seconds). Although visual short term memory is essential for the execution of a wide array of perceptual and cognitive functions, and is supported by an extensive network of brain regions, its storage capacity is severely limited.[4]

Visual short-term memory storage is mediated by distinctive posterior brain mechanisms, such that capacity is determined both by a fixed number of objects and by object complexity.[4]

Long term visual memory

Recall of the patterns from long term visual memory is associated with rCBF increases in different areas of the prefrontal cortex and the anterior cingulate cortex.[4]

Methods of study

Benton visual retention test

An example of the Benton Visual Retention Test. The target stimulus is presented at the top, after a delay participants are asked to recall the correct target stimulus from the list of design cards.

The Benton Visual Retention Test is an assessment of visual perception, and visual memory abilities.[7] More than 50 years of proven clinical use is the staple of the Benton Visual Retention Test.[7] This test has proven its sensitivity to reading disabilities, nonverbal learning disabilities, traumatic brain injury, attention-deficit disorder, alzheimer's, and other forms of dementia.[7] During testing participants are presented with 10 cards for 10 seconds with unique designs on each.[8] After the time has passed participants are asked to immediately reproduce the designs from each card using their visual memory.[8] In the second stage participants are asked to copy each of the 10 card designs while the cards are in view.[8] The participants results from each task are then assessed and placed into six categories; omissions, distortions, preservations, rotations, misplacements, and sizing errors.[8] The further the participant’s scores varies from the averages provided in the Benton Visual Retention Test manual the worse the participant is assessed to be on visual memory ability.[8] The Benton Visual Retention Test has proved to be a generalizable test with the ability to be accurately administered to participants aged 8-adult,[7] and no gender effect.[8] Some studies have suggested a significant gender and education interaction indicating that an age-associated decline in visual memory performance may be more prominent for those individuals with a lower education level.[8]

Neuroimaging tests

An example of a colored geometrical pattern a subject would encode, store, and recall while performing a visual memory neuroimaging test.

Neuroimaging studies focus on the neural networks involved in visual memory using methods designed to activate brain areas involved in encoding, storage, and recall. These studies involve the use of one or multiple types of brain imaging techniques designed to measure timing or activation within the brain. The data collected from neuroimaging studies gives researchers the ability to visualize which brain regions are activated in specific cognitive visual memory tasks. With the use of brain imaging devices researchers able to further investigate memory performance above and beyond standard tests based on exact response times, and activation.

Control condition

The subject's resting brain activation level is first determined in order to form a control or 'baseline' to measure from.[9] Subjects are blindfolded and instructed to lay motionless while simultaneously eliminating any visual imagery present in their mind's eye.[9] These instructions are intended to minimize the activation of brain regions involved in visual memory to form a true resting brain state.[9] After the scan is complete a control has been formed which can be compared with activated regions of the brain while performing visual memory tasks.[9]

Activation condition

During encoding participants are typically exposed to 1-10 visual patterns while connected to a brain imaging device.[10] As the subject encodes the visual patterns researchers are able to directly view the activation of areas involved in visual memory encoding.[9] During recall subjects again need to have all visual stimuli removed by means of a dark room or blindfolding to avoid interfering activation of other visual areas in the brain.[9] Subjects are asked to recall each image clearly in their mind's eye. While recalling the images researchers are able view the areas activated by the visual memory task. Comparing the control ‘baseline’ state to the activated areas during the visual memory task allows researchers to view which areas are used during visual memory.

Current theories

Visuo-spatial sketch pad

The visuo-spatial sketchpad is part of Baddeley and Hitch’s model of working memory. It is responsible for temporarily storing visual and spatial information, which is currently being used or encoded. It is thought of as a three-dimensional cognitive map, which contains spatial features about where the person is and visual images of the area, or an object being concentrated on.[11] It is used in tasks such as mental image manipulation where a person imagines how a real object would look if it were changed in some way (rotated, flipped, moved, change of colour, etc.). It is also responsible for representing how vivid an image is. A vivid image is one which you have a high potential for retrieving its sensory details. The visuo-spatial sketchpad is responsible for holding onto the visual and spatial qualities of a vivid image in your working memory, and the degree of vividness is directly affected by the limits of the sketchpad.[12]

Eidetic or 'photographic memory'

Main article: Eidetic memory

Eidetic memory is an ability to recall images, sounds, or objects in memory with high precision for a few minutes without using mnemonics. It occurs in a small number of children and generally is not found in adults.

The popular culture concept of “photographic memory,” where (e.g.) someone can briefly look at a page of text and then recite it perfectly from memory, is not the same as seeing eidetic images, and photographic memory has never been demonstrated to exist.

For citations of the above, follow the entry for "eidetic memory".

Iconic memory

Main article: Iconic memory

Iconic memory is the visual part of the sensory memory system. Iconic memory is responsible for visual priming, because it works very quickly and unconsciously. Iconic memory decays very quickly, but contains a very vivid image of the surrounding stimuli.[13]

Spatial memory

Spatial memory is a person’s knowledge of the space around them, and their whereabouts in it. It also encompasses all memories of areas and places, and how to get to and from them. Spatial memory is distinct from object memory and involves different parts of the brain. Spatial memory involves the dorsal parts of the brain and more specifically the hippocampus. However many times both types of memory are used together, such as when trying to remember where you put a lost object. A classic test of spatial memory is the Corsi block-tapping task, where an instructor taps a series of blocks in a random order and the participant attempts to imitate them. The amount of blocks they can tap before performance breaks down on average is called their Corsi span. Spatial memory is always being used whenever a person is moving any part of their body; therefore it is generally more vulnerable to decay then object memory is.[12]

Object memory

Object memory involves processing features of an object or material such as texture, color, size, and orientation. It is processed mainly in the ventral regions of the brain. A few studies have shown that on average most people can recall up to four items each with a set of four different visual qualities. It is a separate system from spatial memory and is not affected by interference from spatial tasks.[12]

Accuracy

Visual memory is not always accurate and can be misled by outside conditions. This can be seen in studies carried out by Elizabeth Loftus and Gary Wells. In one study by Wells, individuals were exposed to misleading information after witnessing an event; they were then tested on their ability to remember details from this event. Their findings included: when given misinformation that contradicts the witnessed event they were less able to recall those details; and whether misinformation was given before or after the witnessed event did not seem to matter.[14] Furthermore, visual memory can be subjected to various memory errors which will affect accuracy.

Visual memory in education

Visual memory, in an academic environment, entails work with pictures, symbols, numbers, letters, and especially words. Students must be able to look at a word, form an image of that word in their minds and be able to recall the appearance of the word later. When teachers introduce a new vocabulary word, generally they write it on the chalkboard, have the children spell it, read it and then use it in a sentence. The word is then erased from the chalkboard. Students with good visual memory will recognize that same word later in their readers or other texts and will be able to recall the appearance of the word to spell it.[15]

Children who have not developed their visual memory skills cannot readily reproduce a sequence of visual stimuli. They frequently experience difficulty in remembering the overall visual appearance of words or the letter sequence of words for reading and spelling.[15]

Factors affecting visual memory

Sleep

Findings surrounding sleep and visual memory have been mixed. Studies have reported performance increases after a bout of sleep compared with the same period of waking. The implications of this are that there is a slow, offline process during sleep that strengthens and enhances the memory trace.[16] Further studies have found that quiet rest has shown the same learning benefits as sleep. Replay has been found to occur during post-training quiet wakefulness as well as sleep. In a recent study where a visual search task was administered quiet rest or sleep is found to be necessary for increasing the amount of associations between configurations and target locations that can be learned within a day.[16] Reactivation in sleep was only observed after extensive training of rodents on familiar tasks. It rapidly dissipates; it also makes up a small proportion of total recorded activity in sleep.[16] It has also been found that there are gender differences between males and females in regards to visual memory and sleep. In a study done testing sleep and memory for pictures it was found that daytime sleep contributed to retention of source memory rather than item memory in females, females did not have recollection or familiarity influenced by daytime sleep, whereas males undergoing daytime sleep had a trend towards increased familiarity.[17] The reasons for this may be linked to different memory traces resulting from different encoding strategies, as well as with different electrophysiological changes during daytime sleep.[17]

Brain Damage

Brain damage is another factor that has been found to have an effect on visual memory. Memory impairment affects both novel and familiar experiences. Poor memory after damage to the brain is usually considered to result from information being lost or rendered inaccessible.[18] With such impairment it is assumed that it must be due to the incorrect interpretation of previously encountered information as being novel.[18] In experiments testing rats’ object recognition memory it was found that memory impairment can be the opposite, that there was a tendency to treat novel experiences as familiar. A possible solution for this impairment could be the use of a visual-restriction procedure that reduces interference.[18]

Age

Studies have shown that with aging, in terms of short-term visual memory, viewing time and task complexity have an impact on performance. When there is a delay or when the task is complex recall declines.[19] In a study conducted to measure whether visual memory in older adults with age-related visual decline was caused by memory performance or visual functioning, the following were examined: relationships among age, visual activity, and visual and verbal memory in 89 community dwelling volunteers aged 60–87 years. The findings were that the effect of vision was not specific to visual memory.[20] Therefore vision was found to be correlated with general memory function in older adults and is not modality specific. As we age performance in regards to spatial configurations deteriorates. In a task to store and combine two different spatial configurations to form a novel one young people out-performed the elderly.[21] Vision also has an effect on performance. Sighted participants outperformed the visually impaired regardless of testing modality. This suggests that vision tends to shape the general supramodal mechanisms of memory.[21]

Alcohol

Studies have shown that there is an effect of alcohol on visual memory. In a recent study visual working memory and its neutral correlates was assessed in university students who partake in binge drinking, the intermittent consumption of large amounts of alcohol.[22] The findings revealed that there may be binge-drinking related functional alteration in recognition working memory processes. This suggests that impaired prefrontal cortex function may occur at an early age in binge drinkers. Another study conducted in 2004[23] examined the level of response to alcohol and brain response during visual working memory. This study looked at the neural correlated of the low level of response to alcohol using functional magnetic resonance imaging during a challenging visual memory task. The results were that young people who report having needed more alcohol to feel the effects showed higher levels of brain response during visual working memory, this suggests that the individual’s capacity to adjust to cognitive processing decreases, they are less able to adjust cognitive processing to contextual demands.[23]

Dysfunction of visual memory

Hallucinatory palinopsia, which is a dysfunction of visual memory, is caused by posterior visual pathway cortical lesions and seizures, most commonly in the non-dominant parietal lobe. Focal hyperactivity causes persistent activation of a visual cortex-hippocampal neuronal circuit which encodes an object or scene that is already in visual memory. "All of the hallucinatory palinopsia symptoms occur concomitantly in a patient with one lesion, which supports current evidence that objects, features, and scenes are all units of visual memory, perhaps at different levels of processing. This alludes to neuroanatomical integration in visual memory creation and storage."[3] Studying the excitability alterations associated with palinopsia in migraineurs could provide insight on mechanisms of encoding visual memory.[24]

One common group of people that have visual memory problems are children with reading disabilities. It was often thought that disabilities are caused by failure to perceive the letters of a written word in the right order. However, studies show it is more likely that it is caused by a failure to encode and process the correct order of letters within the word.[25] This means that the child perceives the word just as anyone else would, however their brains do not appear to hold onto the visual characteristics of the word. Although initially it was found that children with reading disabilities had comparable visual memory to those without difficulty, a more specific part of the visual memory system has been found to cause reading disabilities.

These parts are the sustained and transient visual processing systems.[25] The sustained system is responsible for fine detail such as word and letter recognition and is very important in encoding words in their correct order. The transient system is responsible for controlling eye movements, and processing the larger visual environment around us. When these two processes do not work in synchronization this can cause reading disabilities. This has been tested by having children with and without reading disabilities perform on tasks related to the transient systems, where the children with reading disabilities did very poorly. It has also been found in postmortem examinations of the brains of people with reading disabilities that they have fewer neurons and connections in the areas representing the transient visual systems.[25] However there is debate over whether this is the only reason for reading disabilities, scotopic sensitivity syndrome, deficits in verbal memory and orthographic knowledge are other proposed factors.[25]

Deficits in visual memory can also be caused by disease and/or trauma to the brain. These can lead to the patient losing their spatial memory, and/or their visual memory for specific things. For example a patient “L.E.” suffered brain damage and her ability to draw from memory was severely diminished, whilst her spatial memory remained normal. Other patients represent the opposite, where memory for colors and shapes is unaffected but spatial memory for previously known places is greatly impaired.[26] These case studies show that these two types of visual memory are located in different parts of the brain and are somewhat unrelated in terms of functioning in daily life.

References

  1. ↑ 1.0 1.1 Berryhill , M. (2008, May 09). Visual memory and the brain. Retrieved from http://www.visionsciences.org/symposia2008_4.html
  2. ↑ Magnussen, S. (2009). Cognition and Neurosciences: Implicit visual working memory, 50, 532-542
  3. ↑ 3.0 3.1 Gersztenkorn, D; Lee, AG (Jul 2, 2014). "Palinopsia revamped: A systematic review of the literature.". Survey of ophthalmology 60: 1–35. doi:10.1016/j.survophthal.2014.06.003. PMID 25113609.
  4. ↑ 4.0 4.1 4.2 4.3 4.4 4.5 4.6 4.7 Todd, J, & Marois, R. (2004). Capacity limit of visual short term memory in human posterior parietal cortex. Retrieved from http://www.ioi.knaw.nl/viscog/temp/Todd%20(2004)%20Nature.pdf
  5. ↑ Bear, Mark (2007). Neuroscience: Exploring the Brain. Hagerstown, MD: Lippincott Williams & Wilkins. ISBN 0-7817-6003-8.
  6. ↑ [The human brain. (2009, July). Retrieved from http://www.allabouttbi.com/partsofthebrain]
  7. ↑ 7.0 7.1 7.2 7.3 Benton visual retention test,® fifth edition. (n.d.). Retrieved from http://www.pearsonassessments.com/HAIWEB/Cultures/en-us/Productdetail.htm?Pid=015-8027-507&Mode=summary
  8. ↑ 8.0 8.1 8.2 8.3 8.4 8.5 8.6 Seo, E; Lee, D; Choo, I; Youn, J; Kim, K; Jhoo, J; Suh, K; Paek, Y; Woo, J (2007). "Performance on the benton visual retention test in an educationally diverse elderly population". The Gerontological Society of America 62 (3): 191–193.
  9. ↑ 9.0 9.1 9.2 9.3 9.4 9.5 "Visual memory, visual imagery, and visual recognition of large field patterns by the human brain: functional anatomy by positron emissions tomography". Cerebral cortex 1: 79–93. 1995.
  10. ↑ Vogel, E; Machizawa, M (2004). "Neural activity predicts individual differences in visual working memory capacity". Nature 428 (6984): 748–451. Bibcode:2004Natur.428..748V. doi:10.1038/nature02447.
  11. ↑ Logie, R.H., & Marchetti, C. (1991). Mental images in human cognition. Elsevier Science Publishers. Pg. 105-113
  12. ↑ 12.0 12.1 12.2 Oh, S. H.; Kim, M. (2004). "The role of spatial working memory in visual search efficiency". Psychometric Bulletin and Review 11 (2): 275–281. doi:10.3758/bf03196570.
  13. ↑ Della Sala, S.; Gray, C.; Baddeley, A.; Allamano, N.; Wilson, L. (1999). "Pattern span: a means of unwelding visuo-spatial memory". Neuropsychologia 37 (10): 1189–1199. doi:10.1016/s0028-3932(98)00159-6. PMID 10509840.
  14. ↑ Bradfield, A. L.; Wells, G. L. (1998). "Good, You Identified the Suspect": Feedback to Eyewitness Distorts Their Reports of the Witnessing Experience". Journal of Applied Psychology 83 (3): 360–372. doi:10.1037/0021-9010.83.3.360.
  15. ↑ 15.0 15.1 Cusimano, Addie, & , Initials. (2009, July). Visual memory and beyond. Retrieved from http://www.achievepublications.com/chpt3.html
  16. ↑ 16.0 16.1 16.2 Cai, D.J.; Jiang, Y.V.; Makovski, T.; Mednick, S.C. (2009). "Sleep and rest facilitate implicit memory in a visual search task". Vision Research 49 (21): 2557–2565. doi:10.1016/j.visres.2009.04.011. PMC 2764830. PMID 19379769.
  17. ↑ 17.0 17.1 Fu, X.; Wang, B. (2009). "Gender difference in the effect of daytime sleep on declarative memory for pictures". Journal of Zhejiang University 10 (7): 36–546.
  18. ↑ 18.0 18.1 18.2 Bussey, T.J.; Cowell, R.A.; McTighe, S.M.; Saksida, L.M.; Winters, B.D. (2010). "Paradoxical False Memory for Objects After Brain Damage". Science 330 (6009): 1408–1410. Bibcode:2010Sci...330.1408M. doi:10.1126/science.1194780. PMID 21127256.
  19. ↑ Hallikainen, M., Hanninen, T., Koivisto, K., Partanen, K., Pitkanen, A., Soininen, H.S., Riekkinen, P.J., Vainio, P. (1994). Volumetric MRI analysis of the amygdala and the hippocampus in subjects with age-associated memory impairment.
  20. ↑ Goossens, L.; Marcoen, A.; Verhaeghen, P. (1993). "Facts and fiction about memory again: A quantitative integer". Journal of Gerontology 48 (4): 157–171.
  21. ↑ 21.0 21.1 Bhatt, E., Cattaneo, Z., Merabet, L.B., Pece, A., Vecchi, T. (2008). The Influence of Reduced Visual Acuity on Age-Related Decline in Spatial Working Memory: An Investigation. Aging, Neuropsychology, and Cognition.
  22. ↑ Cadaveira, F.; Corral, M.; Crego, A.; Mota, N.; Parada, M.; Rodriguez-Holguin, S. (2010). "Reduced anterior prefrontal cortex activation in young binge drinkers during a visual working memory task". Drug and Alcohol Dependence 109 (1–3): 45–56. doi:10.1016/j.drugalcdep.2009.11.020. PMID 20079980.
  23. ↑ 23.0 23.1 Burke, C., Paulus, M., Pulido, C., Schuckit, M., Tapert, S.F. (2004). Level of Response to Alcohol and Brain Response during Visual Working Memory. Journal of Studies on Alcohol. 692-700.
  24. ↑ Belcastro, V; Cupini, LM; Corbelli, I; Pieroni, A; D'Amore, C; Caproni, S; Gorgone, G; Ferlazzo, E; Di Palma, F; Sarchielli, P; Calabresi, P (Jul 2011). "Palinopsia in patients with migraine: a case-control study.". Cephalalgia : an international journal of headache 31 (9): 999–1004. doi:10.1177/0333102411410083. PMID 21628437.
  25. ↑ 25.0 25.1 25.2 25.3 Catts, H.W. (2005). Language and reading disabilities. Allyn & Bacon, an imprint of Pearson Education Inc. pg. 102-106
  26. ↑ Wilson, B. A.; Baddeley, A. D.; Young, A. W. (1999). "LE, A person who lost her "mind's eye"". Neurocase 5 (2): 119–127. doi:10.1093/neucas/5.2.119.

External links