Cognitive flexibility

Cognitive flexibility has been described as the mental ability to switch between thinking about two different concepts, and to think about multiple concepts simultaneously.[1] Despite some disagreement in the literature about how to operationally define the term, one commonality is that cognitive flexibility is a component of executive functioning.[2] Research has primarily been conducted with children at the school age; however, individual differences in cognitive flexibility are apparent across the lifespan.[3] Measures for cognitive flexibility include the A-not-B task, Dimensional Change Card Sorting Task, Multiple Classification Card Sorting Task, Wisconsin Card Sorting Task, and the Stroop Test. Functional Magnetic Resonance Imaging (fMRI) research has shown that specific brain regions are activated when a person engages in cognitive flexibility tasks. These regions include the prefrontal cortex (PFC), basal ganglia, anterior cingulate cortex (ACC), and posterior parietal cortex (PPC).[4] Studies conducted with people of various ages and with particular deficits have further informed how cognitive flexibility develops and changes within the brain. Cognitive flexibility also has implications both inside and outside of the classroom. A person’s ability to switch between modes of thought and to simultaneously think about multiple concepts has been shown to be a vital component of learning.[5]

Definitions

Cognitive flexibility can be seen from a variety of viewpoints. A synthesized research definition of cognitive flexibility is a switch in thinking, whether that is specifically based on a switch in rules or broadly based on a need to switch one’s previous beliefs or thoughts to new situations. Moreover, it refers to simultaneously considering multiple aspects of thought at once, whether they be two aspects of a specific object, or many aspects of a complex situation. Other terms for cognitive flexibility include mental flexibility, mental set shifting, cognitive shifting, task switching/shifting, and attention switching/shifting.

Most commonly, cognitive flexibility refers to the mental ability to adjust thinking or attention in response to changing goals and/or environmental stimuli.[1] Researchers have more specifically described cognitive flexibility as the capacity to shift or switch one’s thinking and attention between different tasks or operations typically in response to a change in rules or demands.[6] For example, when sorting cards based on specific rules, children are considered cognitively flexible if they are able to successfully switch from sorting cards based on the color of the object to sorting based on the type of object on the card.

Cognitive flexibility has been more broadly a described as the ability to adjust one’s thinking from old situations to new situations as well as the ability to overcome responses or thinking that have become habitual and adapt to new situations.[7][8] As such, if one is able to overcome previously held beliefs or habits (when it is required for new situations) then they would be considered cognitively flexible. Lastly, the ability to simultaneously consider two aspects of an object, idea, or situation at one point in time refers to cognitive flexibility.[9] According to this definition, when sorting cards based on specific rules, children are considered cognitively flexible if they can sort cards based on the color of the objects and type of objects on the card simultaneously. Similarly, cognitive flexibility has been defined as having the understanding and awareness of all possible options and alternatives simultaneously within any given situation.[10]

Contributing factors

Regardless of the specificity of the definition, researchers have generally agreed that cognitive flexibility is a component of executive functioning, higher-order cognition involving the ability to control one’s thinking.[11] Executive functioning includes other aspects of cognition, including inhibition, memory, emotional stability, planning, and organization. Cognitive flexibility is highly related with a number of these abilities, including inhibition, planning and working memory.[6] Thus, when an individual is better able to suppress aspects of a stimulus to focus on more important aspects (i.e. inhibit color of object to focus on kind of object), they are also more cognitively flexible. In this sense, they are better at planning, organizing, and at employing particular memory strategies.

Researchers have argued that cognitive flexibility is also a component of multiple classification, as originally described by psychologist Jean Piaget. In multiple classification tasks, participants (primarily children, who have already developed or are in the process of developing this skill) must classify objects in several different ways at once - thereby thinking flexibly about them.[12] Similarly, in order to be cognitively flexible they must overcome centration, which is the tendency for young children to solely focus on one aspect of an object or situation.[13] For example, when children are young they may be solely able to focus on one aspect of an object (i.e. color of object), and be unable to focus on both aspects (i.e. both color and kind of object). Thus, research suggests if an individual is centrated in their thinking, then they will be more cognitively inflexible.

Research has suggested that cognitive flexibility is related to other cognitive abilities, such as fluid intelligence, reading fluency, and reading comprehension.[12][14] Fluid intelligence, described as the ability to solve problems in new situations, enables fluid reasoning ability. When one is able to reason fluidly, they are in turn more likely to be cognitively flexible. Furthermore, those who are able to be cognitively flexible have been shown to have the ability to switch between and/or simultaneously think about sounds and meanings, which increases their reading fluency and comprehension. Cognitive flexibility has also been shown to be related to one’s ability to cope in particular situations. For example, when individuals are better able to shift their thinking from situation to situation they will focus less on stressors within these situations.[15]

In general, researchers in the field focus on development of cognitive flexibility between the ages of three and five.[16] However, cognitive flexibility has been shown to be a broad concept that can be studied with all different ages and situations.[3] Thus, with tasks ranging from simple to more complex, research suggests that there is a developmental continuum that spans from infancy to adulthood.

Measures/assessments

A variety of assessments are appropriate for distinguishing between different levels of cognitive flexibility at different ages. Below are the common tests used to assess cognitive flexibility in the order of the developmentally appropriate age.

A-not-B task

In the A-not-B task, children are shown an object hidden at Location A within their reach, and are then prompted to search for the object at Location A, where they find it. This activity is repeated several times, with the hidden object at Location A. Then, in the critical trial, the object is hidden in Location B, a second location within easy reach of child. Typically, children younger than one year old search for the object under Location A, where the object was previously hidden. However, after their first birthday, children are capable of mentally switching to locate the object in Location B, demonstrating flexibility. Researchers have agreed that the A-not-B task is a simple task that effectively measures cognitive flexibility during infancy.[16][17]

Dimensional Change Card Sorting Task

Dimensional Change Card Sorting Task

In the Dimensional Change Card Sorting Task (DCCS), children are initially asked to sort cards by a single dimension (such as color), and are subsequently required to alter their strategy to sort cards based on a second dimension (such as shape).[18] Typically, three-year-old children are able to sort cards based on a single dimension, but are unable to switch to sort the cards based on a second dimension. However, five-year-old children are able to sort cards based on one dimension and can then switch to sorting cards on a second dimension.[17][19]

Multiple Classification Card Sorting Task

Multiple Classification Card Sorting Task

In the Multiple Classification Card Sorting Task, children are shown cards and asked to sort them based on two different dimensions (e.g. by color, such as yellow and blue, and object type, such as animals and food) simultaneously into four piles within a matrix (e.g. yellow animals, yellow foods, blue animals and blue foods). This task appears to be more difficult as research has shown that seven-year-old children were incapable of sorting cards based on the two dimensions simultaneously. These children focused on the two dimensions separately, whereas at the age of eleven, children were capable of sorting cards based on these two dimensions simultaneously. This demonstrates an increase in cognitive flexibility between the ages of seven and eleven.[9][12]

Wisconsin Card Sorting Test

Wisconsin Card Sorting Test

The Wisconsin Card Sorting Test (WCST) is used to determine an individual's competence in abstract reasoning, and the ability to change problem-solving strategies when needed.[20] In this test, a number of cards are presented to the participants. The figures on the cards differ with respect to color, quantity, and shape. The participants are then given a pile of additional cards and are asked to match each one to one of the previous cards. Typically, children between ages nine and eleven demonstrate the cognitive flexibility needed for this test.[3][17]

Stroop Test

The Stroop Test is also known as the Color-word Naming Test. In this measure, there are three types of cards in the deck. The "color card" displays patches of different colors, which participants are asked to identify as quickly as possible. The "word card," displays the names of colors printed in black and white ink, which participants are again asked name as quickly as possible. The final card type is the "color-word card", which displays the names of the colors printed in an ink of a conflicting color (e.g. the word RED would be printed in yellow), and requires participants to name the ink colors while ignoring the conflicting color names. The basic score on each card is the total time (in seconds) that the participant takes to respond verbally.[21] Typically, naming the color of the word takes longer and results in more errors when the color of the ink does not match the name of the color. In this situation, adults tend to take longer to respond than children because adults are more sensitive to the actual color of the word and thus are more likely to be influenced by it when naming the conflicting color word printed.

Neural underpinnings

The mechanisms underlying cognitive flexibility have been explored extensively using various methods. Human studies using functional magnetic resonance imaging (fMRI) have revealed a variety of distinct regions of the brain that work in concert from which flexibility could be predicted reliably, including the prefrontal cortex (PFC), basal ganglia, anterior cingulate cortex (ACC), and posterior parietal cortex (PPC).[4]

The regions active during engagement of cognitive flexibility depend on the task and various factors involved in flexibility that are used to assess the behavior, as flexible thinking requires aspects of inhibition, attention, working memory, response selection, and goal maintenance.[6] Several studies using task switching paradigms have demonstrated the complexities of the network involved in cognitive flexibility. Activation of the dorsolateral PFC has been shown during resolution of interference of irrelevant task sets.[22] Another study further extended these results by demonstrating that the level of abstractness of the switch type influenced recruitment of differing regions in the PFC depending on whether the participant was asked to make a cognitive set switch, a response switch, or a stimulus or perceptual switch. A set switch would require switching between task rules, as with the WCST, and is considered to be the most abstract. A response switch would require different response mapping, such as circle right button and square left button and vice versa. Lastly, a stimulus or perceptual set switch would require a simple switch between a circle and a square. Activation is mediated by the level of abstractness of the set switch in an anterior to posterior fashion within the PFC, with the most anterior activations elicited by set switches and the most posterior activations resulting from stimulus or perceptual switches.[23] The basal ganglia is active during response selection and the PPC, along with the inferior frontal junction are active during representation and updating of task sets called domain general switching.[24]

Development of cognitive flexibility

Children can be strikingly inflexible when assessed using traditional tests of cognitive flexibility, but this does not come as a surprise considering the many cognitive processes involved in the mental flexibility, and the various developmental trajectories of such abilities. With age, children generally show increases in cognitive flexibility which is likely a product of the protracted development of the frontoparietal network evident in adults, with maturing synaptic connections, increased myelination and regional gray matter volume occurring from birth to mid-twenties.[25]

Deficits in cognitive flexibility

Diminished cognitive flexibility has been noted in a variety of neuropsychiatric disorders such as anorexia nervosa, obsessive–compulsive disorder, schizophrenia, autism, and in a subset of people with ADHD.[26][27] Each of these disorders exhibit varying aspects of cognitive inflexibility. For example, those with obsessive–compulsive disorder experience difficulty shifting their attentional focus as well as inhibiting motor responses.[28] Children with autism show a slightly different profile with deficits in adjusting to changing task contingencies, while often maintaining the ability to respond in the face of competing responses.[29] Potential treatments may lie in neurochemical modulation. Juveniles with Anorexia nervosa have marked decreases in set-shifting abilities, possibly associated with incomplete maturation of prefrontal cortices associated with malnutrition.[30] One can also consider people with addictions to be limited in cognitive flexibility, in that they are unable to flexibly respond to stimuli previously associated with the drug.[31]

Cognitive flexibility and aging

The elderly often experience deficits in cognitive flexibility. The aging brain undergoes physical and functional changes including a decline in processing speed, central sensory functioning, white matter integrity, and brain volume. Regions associated with cognitive flexibility such as the PFC and PC atrophy, or shrink, with age, but also show greater task-related activation in older individuals when compared to younger individuals.[32] This increase in blood flow is potentially related to the evidence that atrophy heightens blood flow and metabolism, which is measured as the BOLD response, or blood-oxygen-level dependence, with fMRI. Studies suggest that aerobic exercise and training can have plasticity inducing effects that could potentially serve as an intervention in old age that combat the decline in executive function.[33]

Implications for education and general learning

Educational applications

Cognitive flexibility and other executive function skills are crucial to success both in classroom settings and life. A study examining the impact of cognitive intervention for at-risk children in preschool classrooms found that children who received such intervention for one to two years significantly outperformed their peers. Compared to same-age children who were randomly assigned to the control condition (a literacy unit developed by the school district), preschoolers who received intervention achieved accuracy scores of 85% on tests of inhibitory control (self-discipline), cognitive flexibility, and working memory.[34] Their peers in the control (no intervention) condition, on the other hand, demonstrated only 65% accuracy. Educators involved in this study ultimately opted to implement the cognitive skills training techniques instead of the district-developed curriculum.

Further indicative of the role cognitive flexibility plays in education is the argument that how students are taught greatly impacts the nature and formation of their cognitive structures, which in turn affect students’ ability to store and readily access information.[5] A crucial aim of education is to help students learn as well as appropriately apply and adapt what they have learned to novel situations. This is reflected in the integration of cognitive flexibility into educational policy regarding academic guidelines and expectations. For example, as outlined in the Common Core Standards Initiative, a standards-based education reform developed to increase high school graduation rates, educators are expected to present within the classroom “high level cognitive demands by asking students to demonstrate deep conceptual understanding through the application of content knowledge and skills to new situations.”[35] This guideline within the Common Core Initiative is the essence of cognitive flexibility, and a teaching style focused on promoting it has been seen to foster understanding especially in disciplines where information is complex and nonlinear.[36] A counterexample is evident in cases where such material is presented in an oversimplified manner and learners fail to transfer their knowledge to a new domain.

Impact on teaching and curriculum design

An alternative educational approach informed by cognitive flexibility is hypertext, which is frequently computer-supported instruction. Computers allow for complex data to be presented in a multidimensional and coherent format, allowing users to access that data as needed. The most widely used example of hypertext is the Internet, which dynamically presents information in terms of interconnection (e.g. hyperlinks). Hypertext documents, therefore, include nodes – bits of information – and links, the pathways between these nodes. Applications for teacher education have involved teacher-training sessions based on video instruction, whereby novice teachers viewed footage of master teachers conducting a literacy workshop. In this example, the novice teachers received a laserdisc of the course content, a hypertext document that allowed the learners to access content in a self-directed manner. These cognitive flexibility hypertexts (CFH) provide a “three-dimensional” and “open-ended” representation of material for learners, enabling them to incorporate new information and form connections with preexisting knowledge.[37] While further research is needed to determine the efficacy of CFH as an instructional tool, classrooms where cognitive flexibility theory is applied in this manner are hypothesized to result in students more capable of transferring knowledge across domains.

Yet classroom application of cognitive flexibility must not rely solely on computer-based instruction. Researchers in the field advocate a teaching style that incorporates group problem-solving activities and demands higher-level thought.[38] According to this process, a teacher initially poses a single question in a number of ways. Next, students discuss the problem with the teacher and amongst themselves, asking questions. In forming these questions, students are actively brainstorming and recalling prior knowledge. At this point, the teacher provides specific conditions of the issue discussed, and students must adapt their prior knowledge, along with that of their peers, to generate a solution. Other curriculum designs tailored to young children such as “Tools of the Mind” incorporate practices which aim to improve students’ capacity to shift and prolong attention as well as think “outside the box” (i.e. generate creative solutions).

Learning applications beyond the classroom

A vastly different application can be seen in the study of cognitive flexibility and video games. Examining the trait under the guise of “mental flexibility,” Dutch researchers observed that players of first-person shooter games (e.g. Call of Duty, Battlefield) exhibited greater “mental flexibility” on a series of measures than did non-gamers.[39] The researchers posit that, while video game play may be controversial due to frequently graphic content, harnessing the effect of such games could lead to similar gains in various populations (e.g. the elderly, who face cognitive decline) and is therefore socially relevant.

Public awareness of cognitive flexibility has increased in recent years. As a result, several online programs marketed to those seeking to increase cognitive ability – by way of specifically focusing on cognitive flexibility training techniques - have been created to enhance "brain fitness." Programs claim to train speed, accuracy, memory, attention, cognitive flexibility and problem-solving, amongst others.[40] Presently, the efficacy of such programs requires further research and analysis before any clear benefits can be determined.

See also

References

  1. ↑ 1.0 1.1 Scott, W A (1962). "Cognitive complexity and cognitive flexibility". American Sociological Association 25: 405–414. doi:10.2307/2785779.
  2. ↑ "What is executive functioning?".
  3. ↑ 3.0 3.1 3.2 Chelune, G J; Baer, R A (1986). "Developmental norms for the Wisconsin Card Sorting Test". Journal of Clinical and Experimental Neuropsychology 8: 219–228. doi:10.1080/01688638608401314.
  4. ↑ 4.0 4.1 Leber, A B; Turk-Browne N B; Chun M M (9 September 2008). "Neural predictors of moment-to-moment fluctuations in cognitive flexibility". Proc Natl Acad Sci U S A 105 (36): 13592–7. doi:10.1073/pnas.0805423105. PMC 2527350. PMID 18757744.
  5. ↑ 5.0 5.1 Boger-Mehall, S R (2007). "Cognitive Flexibility Theory: Implications for Teaching and Teacher Education". Retrieved November 18, 2012.
  6. ↑ 6.0 6.1 6.2 Miyake, A; Friedman, N P; Emerson, M J.; Witzki, A H; Howerter, A; Wagner, T (2000). "The unity and diversity of executive functions and their contributions to complex "frontal lobe" tasks: A latent variable analysis". Cognitive Psychology 41 (1): 49–100. doi:10.1006/cogp.1999.0734. PMID 10945922.
  7. ↑ Moore, A; Malinowski, P (2009). "Mediation, mindfulness, and cognitive flexibility". Conscious Cognition 18: 176–186. doi:10.1016/j.concog.2008.12.008.
  8. ↑ Deak, G O (2003). "The development of cognitive flexibility and language abilities". Advances in Child Development and Behavior 31: 271–327. doi:10.1016/s0065-2407(03)31007-9. PMID 14528664.
  9. ↑ 9.0 9.1 Bigler, R S; Liben, L S (1992). "Cognitive mechanisms in children's gender stereotyping: Theoretical and educational implications of a cognitive-based intervention". Child Development 63 (6): 1351–1363. doi:10.1111/j.1467-8624.1992.tb01700.x. PMID 1446556.
  10. ↑ Martin, M M; Rubin, R B (1995). "A new measure of cognitive flexibility". Psychological Reports 76: 623–626. doi:10.2466/pr0.1995.76.2.623.
  11. ↑ "Executive Function Fact Sheet". National Center for Learning Disabilities. 2005. Retrieved December 2012.
  12. ↑ 12.0 12.1 12.2 Cartwright, K B (2002). "Cognitive development and reading: The relation of reading-specific multiple classification skill to reading comprehension in elementary school children". Journal of Educational Psychology 94: 56–63. doi:10.1037/0022-0663.94.1.56.
  13. ↑ Piaget, J (1972). "The mental development of the child". In Weiner, I B; Elkind, D. Readings in Child Development. John Wiley & Sons, Inc. pp. 271–279. ISBN 0-471-92573-X.
  14. ↑ Colzanto, L S; van Wouwe, N C; Lavender, T J; & Hommel, B (2006). "Intelligence and cognitive flexibility: Fluid intelligence correlates with feature "unbinding" across perception and action.". Psychonomic Bulletin & Review 13: 1043–1048. doi:10.3758/BF03213923.
  15. ↑ Han, H D; Park, H W; Kee, B S; Na, C; Na, D E; Zaichkowsky, L (1998). "Performance enhancement with low stress and anxiety modulated by cognitive flexibility". Korean Neuropsychiatric Association 7: 221–226. doi:10.4306/pi.2011.8.3.221.
  16. ↑ 16.0 16.1 Zelazo, P D; Frye, D (1998). "Cognitive complexity and control: II. The development of executive function in childhood". Current Directions in Psychological Science 7: 121–126. doi:10.1111/1467-8721.ep10774761.
  17. ↑ 17.0 17.1 17.2 Kirkham, N Z; Cruess, L; Diamond, A (2003). "Helping children apply their knowledge to their behavior on a dimension-switching task". Developmental Science 6: 449–476. doi:10.1111/1467-7687.00300.
  18. ↑ Fisher, A (2011). "Automatic shifts of attention in the Dimensional Change Card Sort Task: Subtle changes in task materials lead to flexible switching" (PDF). Journal of Experimental Child Psychology. 111-119 108. doi:10.1016/j.jecp.2010.07.001.
  19. ↑ Zelazo, P D; Frye, D; Rapus, T (1996). "An age-related dissociation between knowing rules and using them". Cognitive Development 11 (1): 37–63. doi:10.1016/S0885-2014(96)90027-1.
  20. ↑ Biederam J, Faraone S, Monutaeux M et al. (2000). "Neuropsychological functioning in nonreferred siblings of children with attention deficit/hyperactivity disorder". Journal of Abnormal Psychology 109 (2): 252–65. doi:10.1037/0021-843X.109.2.252.
  21. ↑ Jensen, A R (1965). "Scoring the stroop test". Acta Psychologica 24 (0): 398–408. doi:10.1016/0001-6918(65)90024-7.
  22. ↑ Hyafil, A; Summerfield C; Koechlin E (2009). "Two mechanisms for task switching in the prefrontal cortex". J Neurosci 29 (16): 5135–5142. doi:10.1523/JNEUROSCI.2828-08.2009. PMID 19386909.
  23. ↑ Kim, C; Johnson N F; Cilles S E; Gold B T (Mar 30, 2011). "Common and distinct mechanisms of cognitive flexibility in prefrontal cortex". J Neurosci 31 (13): 4771–9. doi:10.1016/j.brainres.2012.06.013.
  24. ↑ Yehene, E; Meiran N; Soroker N (Jun 2008). "Basal ganglia play a unique role in task switching within the frontal-subcortical circuits: evidence from patients with focal lesions". J Cogn Neurosci 20 (6): 1079–93. doi:10.1162/jocn.2008.20077. PMID 18211234.
  25. ↑ Morton, JB; Bosma R; Ansari D (2009). "Age-related changes in brain activation associated with dimensional shifts of attention: An fMRI study". Neuroimage 46 (1): 249–256. doi:10.1016/j.neuroimage.2009.01.037. PMID 19457388.
  26. ↑ Steinglass, J E; Walsh B T; Stern Y (May 2006). "Set shifting deficit in anorexia nervosa". J Int Neuropsychol Soc 12 (3): 431–5. doi:10.1017/s1355617706060528. PMID 16903136.
  27. ↑ Etchepareborda, M C; Mulas F (Feb 2004). "Cognitive flexibility, an additional symptom of attention deficit hyperactivity disorder. Is it a therapeutically predictive element?][Article in Spanish]". Rev Neurol 38 (Suppl 1): S97–102. PMID 15011162.
  28. ↑ Chamberlain, S R; Blackwell A D; Fineberg N A; Robbins T W; Sahakian B J (May 2005). "The neuropsychology of obsessive compulsive disorder: the importance of failures in cognitive and behavioural inhibition as candidate endophenotypic markers". Neurosci Biobehav Rev 29 (3): 399–419. doi:10.1016/j.neubiorev.2004.11.006. PMID 15820546.
  29. ↑ Kriete, T; Noelle D C (2005). "Impaired cognitive flexibility and intact cognitive control in autism: A computational cognitive neuroscience approach". In Proceedings of the 27th annual conference of the cognitive science society: 1190–1195.
  30. ↑ Bühren, K; Mainz V; Herpertz-Dahlmann B; Schäfer K; Kahraman-Lanzerath B; Lente C; Konrad K (2012). "Cognitive flexibility in juvenile anorexia nervosa patients before and after weight recovery". Journal of Neural Transmission 119 (9): 1047–1057. doi:10.1007/s00702-012-0821-z.
  31. ↑ Stalnaker, T A; Takahashi Y; Roesch MR; Schoenbaum G (2009). "Neural substrates of cognitive inflexibility after chronic cocaine exposure". Neuropharmacology 56 (Suppl 1): 63–72. doi:10.1016/j.neuropharm.2008.07.019. PMC 2647515. PMID 18692512.
  32. ↑ Greenwood, P M (Nov 2007). "Functional plasticity in cognitive aging: review and hypothesis". Neuropsychology 21 (6): 657–73. doi:10.1037/0894-4105.21.6.657. PMID 17983277.
  33. ↑ Masley, S; Roetzheim R; Gualtieri T (2009). "Aerobic exercise enhances cognitive flexibility". Journal of Clinical Psychology in Medical Settings 16: 186–193. doi:10.1007/s10880-009-9159-6.
  34. ↑ Diamond, A.; Barnett, W S; Thomas, J; Munro, S (2007). "Preschool Program Improves Cognitive Control". Science 318 (5855): 1387–1388. doi:10.1126/science.1151148.
  35. ↑ "Common Core State Standards Initiative Standards-Setting Criteria" (PDF).
  36. ↑ Chikatla, S; Rebecca Reese (2007). "Cognitive Flexibility Theory". University of South Alabama. Retrieved November 18, 2012.
  37. ↑ Duffy, Thomas M.; Spiro, Rand (1992). "5". In David Jonassen. Constructivism and the Technology of Instruction: A Conversation (1st ed.). Routledge. pp. 57–75. ISBN 0805812725.
  38. ↑ Stephens, Elizabeth Campbell (1995). "The design, development, and evaluation of Literacy education : application and practice (LEAP) : an interactive hypermedia program for English/language arts teacher education" (BOOK, THESIS/DISSERTATION, MANUSCRIPT). University of Houston M.D. Anderson Library Houston, TX 77004 United States: University of Houston. Retrieved November 18, 2012.
  39. ↑ Colzato, L S; van Leeuwen, P; van den Wildenberg, W; Hommel, B (2010). "DOOM’d to switch: superior cognitive flexibility in players of first person shooter games". Front. Psychology. doi:10.3389/fpsyg.2010.00008.
  40. ↑ For example, brain training by Lumosity, Fit Brains, or BrainHQ amongst others.

External links