Intelligent tutoring system

An intelligent tutoring system (ITS) is a computer system that aims to provide immediate and customized instruction or feedback to learners,[1] usually without intervention from a human teacher. ITSs have the common goal of enabling learning in a meaningful and effective manner by using a variety of computing technologies. There are many examples of ITSs being used in both formal education and professional settings in which they have demonstrated their capabilities and limitations. There is a close relationship between intelligent tutoring, cognitive learning theories and design; and there is ongoing research to improve the effectiveness of ITS. An ITS aims to solve the problem of over-dependency of students over teachers for quality education. It aims to provide access to high quality education to each and every student, thus reforming the entire education system.

History of ITS

Early mechanical systems

Skinner teaching machine 08

The possibility of intelligent machines have been discussed for centuries. Blaise Pascal created the first calculating machine capable of mathematical functions in the 17th century simply called Pascal's Calculator. At this time the mathematician and philosopher Gottfried Wilhelm Leibniz envisioned machines capable of reasoning and applying rules of logic to settle disputes (Buchanan, 2006).[2] These early works contributed to the development of the computer and future applications.

The concept of intelligent machines for instructional use date back as early as 1924, when Sidney Pressey of Ohio State University created a mechanical teaching machine to instruct students without a human teacher.[3][4] His machine resembled closely a typewriter with several keys and a window that provided the learner with questions. The Pressey Machine allowed user input and provided immediate feedback by recording their score on a counter.[5]

Pressey himself was influenced by Edward L. Thorndike, a learning theorist and educational psychologist at the Columbia University Teacher College of the late 19th and early 20th centuries. Thorndike posited laws for maximizing learning. Thorndike's laws included the law of effect, the law of exercise, and the law of recency. Following later standards, Pressey's teaching and testing machine would not considered intelligent as it was mechanically run and was based on one question and answer at a time,[5] but it set an early precedent for future projects. By the 1950s and 1960s, new perspectives on learning were emerging. Burrhus Frederic "B.F." Skinner at Harvard University did not agree with Thorndike's learning theory of connectionism or Pressey's teaching machine. Rather, Skinner was a behaviourist who believed that learners should construct their answers and not rely on recognition.[4] He too, constructed a teaching machine structured using an incremental mechanical system that would reward students for correct responses to questions.[4]

Early electronic systems

In the period following the second world war, mechanical binary systems gave way to binary based electronic machines. These machines were considered intelligent when compared to their mechanical counterparts as they had the capacity to make logical decisions. However, the study of defining and recognizing a machine intelligence was still in its infancy.

Alan Turing, a mathematician, logician and computer scientist, linked computing systems to thinking. One of his most notable papers outlined a hypothetical test to assess the intelligence of a machine which came to be known as the Turing test. Essentially, the test would have a person communicate with two other agents, a human and a computer asking questions to both recipients. The computer passes the test if it can respond in such a way that the human posing the questions cannot differentiate between the other human and the computer. The Turing test has been used in its essence for more than two decades as a model for current ITS development. The main ideal for ITS systems is to effectively communicate.[5] As early as the 1950s programs were emerging displaying intelligent features. Turing's work as well as later projects by researchers such as Allen Newell, Clifford Shaw, and Herb Simon showed programs capable of creating logical proofs and theorems. Their program, The Logic Theorist exhibited complex symbol manipulation and even generation of new information without direct human control and is considered by some to be the first AI program. Such breakthroughs would inspire the new field of Artificial Intelligence officially named in 1956 by John McCarthy in 1956 at the Dartmouth Conference.[2] This conference was the first of its kind that was devoted to scientists and research in the field of AI.

The PLATO V CAI terminal in 1981

The latter part of the 1960s and 1970s saw many new CAI (Computer-Assisted instruction) projects that built on advances in computer science. The creation of the ALGOL programming language in 1958 enabled many schools and universities to begin developing Computer Assisted Instruction (CAI) programs. Major computer vendors and federal agencies in the US such as IBM, HP, and the National Science Foundation funded the development of these projects.[6] Early implementations in education focused on programmed instruction (PI), a structure based on a computerized input - output system. Although many supported this form of instruction, there was limited evidence supporting its effectiveness.[5] The programming language LOGO was created in 1967 by Wally Feurzeig and Seymour Papert as a language streamlined for education. PLATO, an educational terminal featuring displays, animations, and touch controls that could store and deliver large amounts of course material, was developed by Donald Bitzer in the University of Illinois in the early 1970s. Along with these, many other CAI projects were initiated in many countries including the US, the UK, and Canada.[6]

At the same time that CAI was gaining interest, Jaime Carbonell suggested that computers could act as a teacher rather than just a tool (Carbonell, 1970). A new perspective would emerge that focused on the use of computers to intelligently coach students called Intelligent Computer Assisted Instruction or Intelligent Tutoring Systems (ITS). Where CAI used a behaviourist perspective on learning based on Skinner's theories (Dede & Swigger, 1988),[7] ITS drew from work in cognitive psychology, computer science, and especially artificial intelligence.[7] There was a shift in AI research at this time as systems moved from the logic focus of the previous decade to knowledge based systems—systems could make intelligent decisions based on prior knowledge (Buchanan, 2006).[2] Such a program was created by Seymour Papert and Ira Goldstein who created Dendral, a system that predicted possible chemical structures from existing data. Further work began to showcase analogical reasoning and language processing. These changes with a focus on knowledge had big implications for how computers could be used in instruction. The technical requirements of ITS, however, proved to be higher and more complex than CAI systems and ITS systems would find limited success at this time.[6]

Towards the latter part of the 70's interest in CAI technologies began to wane.[6][8] Computers were still expensive and not as available as expected. Developers and instructors were reacting negatively to the high cost of developing CAI programs, the inadequate provision for instructor training, and the lack of resources.[8]

Microcomputers and intelligent systems

The microcomputer revolution in the late 1970s and early 80s helped to revive CAI development and jumpstart development of ITS systems. Personal computers such as the Apple 2, Commodore PET, and TRS-80 reduced the resources required to own computers and by 1981, 50% of US schools were using computers (Chambers & Sprecher, 1983).[6] Several CAI projects utilized the Apple 2 as a system to deliver CAI programs in high schools and universities including the British Columbia Project and California State University Project in 1981.[6]

The early 80s would also see Intelligent Computer-Assisted Instruction (ICAI) and ITS goals diverge from their roots in CAI. As CAI became increasingly focused on deeper interactions with content created for a specific area of interest, ITS sought to create systems that focused on knowledge of the task and the ability to generalize that knowledge in non-specific ways (Larkin & Chabay, 1992).[7] The key goals set out for ITS were to be able to teach a task as well as perform it, adapting dynamically to its situation. In the transition from CAI to ICAI systems, the computer would have to distinguish not only between the correct and incorrect response but the type of incorrect response to adjust the type of instruction. Research in Artificial Intelligence and Cognitive Psychology fueled the new principles of ITS. Psychologists considered how a computer could solve problems and perform 'intelligent' activities. An ITS programme would have to be able to represent, store and retrieve knowledge and even search its own database to derive its own new knowledge to respond to learner's questions. Basically, early specifications for ITS or (ICAI) require it to "diagnose errors and tailor remediation based on the diagnosis" (Shute & Psotka, 1994, p. 9).[5] The idea of diagnosis and remediation is still in use today when programming ITS.

A key breakthrough in ITS research was the creation of LISPITS, a program that implemented ITS principles in a practical way and showed promising effects increasing student performance. LISPITS was developed and researched in 1983 as an ITS system for teaching students the LISP programming language (Corbett & Anderson, 1992).[9] LISPITS could identify mistakes and provide constructive feedback to students while they were performing the exercise. The system was found to decrease the time required to complete the exercises while improving student test scores (Corbett & Anderson, 1992).[9] Other ITS systems beginning to develop around this time include TUTOR created by Logica in 1984 as a general instructional tool[10] and PARNASSUS created in Carnegie Mellon University in 1989 for language instruction.[11]

Modern ITS

After the implementation of initial ITS, more researchers created a number of ITS for different students. In the late 20th century, Intelligent Tutoring Tools (ITTs) was developed by the Byzantium project, which involved six universities. The ITTs were general purpose tutoring system builders and many institutions had positive feedbacks while using them. (Kinshuk, 1996)[12] This builder, ITT, would produce an Intelligent Tutoring Applet (ITA) for different subject areas. Different teachers created the ITAs and built up a large inventory of knowledge that was accessible by others through the Internet. Once an ITS was created, teachers could copy it and modify it for future use. This system was efficient and flexible. However, Kinshuk and Patel believed that the ITS was not designed from an educational point of view and was not developed based on the actual needs of students and teachers. (Kinshuk and Patel, 1997).[13] Modern day ITS try to replicate the role of a teacher, a teaching assistant and involves problem generation, intelligent automatic feedback generation with a high recall value.

There were three ITS projects that functioned based on conversational dialogue: AutoTutor, Atlas (Freedman, 1999),[14] and Why2. The idea behind these projects was that since students learn best by constructing knowledge themselves, the programs would begin with leading questions for the students and would give out answers as a last resort. AutoTutor's students focused on answering questions about computer technology, Atlas's students focused on solving quantitative problems, and Why2's students focused on explaining physical systems qualitatively. (Graesser, VanLehn, and others, 2001)[15] Other similar tutoring systems such as Andes (Gertner, Conati, and VanLehn, 1998)[16] tend to provide hints and immediate feedbacks for students when students have trouble answering the questions. They could guess their answers and have correct answers without deep understanding of the concepts. Research was done with a small group of students using Atlas and Andes respectively. The results showed that students using Atlas made significant improvements compared with students who used Andes.[17] However, since the above systems require analysis of students' dialogues, improvement is yet to be made so that more complicated dialogues can be managed.

The current architectures which dominate the field are the AutoTutor, Cognitive Tutor, and the Generalized Intelligent Framework for Tutoring

Structure

Intelligent tutoring systems consist of four basic components based on a general consensus amongst researchers (Nwana,1990;[18] Freedman, 2000;[19] Nkambou et al., 2010[20]):

  1. The Domain model
  2. The Student model
  3. The Tutoring model, and
  4. The User interface model

The domain model (also known as the cognitive model or expert knowledge model) is built on ACT-R theory which tries to take into account all the possible steps required to solve a problem. More specifically, this model "contains the concepts, rules, and problem-solving strategies of the domain to be learned. It can fulfill several roles: as a source of expert knowledge, a standard for evaluating the student's performance or for detecting errors, etc." (Nkambou et al., 2010, p. 4).[20]

The student model can be thought of as an overlay on the domain model. It is considered as the core component of an ITS paying special attention to student's cognitive and affective states and their evolution as the learning process advances. As the student works step-by-step through their problem solving process the system engages in a process called model tracing. Anytime the student model deviates from the domain model the system identifies, or flags, that an error has occurred.

The tutor model accepts information from the domain and student models and makes choices about tutoring strategies and actions. At any point in the problem-solving process the learner may request guidance on what to do next, relative to their current location in the model. In addition, the system recognizes when the learner has deviated from the production rules of the model and provides timely feedback for the learner, resulting in a shorter period of time to reach proficiency with the targeted skills.[21] The tutor model may contain several hundred production rules that can be said to exist in one of two states, learned or unlearned. Every time a student successfully applies a rule to a problem, the system updates a probability estimate that the student has learned the rule. The system continues to drill students on exercises that require effective application of a rule until the probability that the rule has been learned reaches at least 95% probability.[22]

Knowledge tracing tracks the learner's progress from problem to problem and builds a profile of strengths and weaknesses relative to the production rules. The cognitive tutoring system developed by John Anderson at Carnegie Mellon University presents information from knowledge tracing as a skillometer, a visual graph of the learner's success in each of the monitored skills related to solving algebra problems. When a learner requests a hint, or an error is flagged, the knowledge tracing data and the skillometer are updated in real-time.

The user interface component "integrates three types of information that are needed in carrying out a dialogue: knowledge about patterns of interpretation (to understand a speaker) and action (to generate utterances) within dialogues; domain knowledge needed for communicating content; and knowledge needed for communicating intent" (Padayachee, 2002, p. 3).[23]

Nkambou et al. (2010) make mention of Nwana's (1990)[18] review of different architectures underlining a strong link between architecture and paradigm (or philosophy). Nwana (1990) declares, "[I]t is almost a rarity to find two ITSs based on the same architecture [which] results from the experimental nature of the work in the area" (p. 258). He further explains that differing tutoring philosophies emphasize different components of the learning process (i.e., domain, student or tutor). The architectural design of an ITS reflects this emphasis, and this leads to a variety of architectures, none of which, individually, can support all tutoring strategies (Nwana, 1990, as cited in Nkambou et al., 2010). Moreover, ITS projects may vary according to the relative level of intelligence of the components. As an example, a project highlighting intelligence in the domain model may generate solutions to complex and novel problems so that students can always have new problems to work on, but it might only have simple methods for teaching those problems, while a system that concentrates on multiple or novel ways of teaching a particular topic might find a less sophisticated representation of that content sufficient.[19]

Design and development methods

Apart from the discrepancy amongst ITS architectures each emphasizing different elements, the development of an ITS is much the same as any instructional design process. Corbett et al. (1997) summarized ITS design and development as consisting of four iterative stages: (1) needs assessment, (2) cognitive task analysis, (3) initial tutor implementation and (4) evaluation.[24]

The first stage known as needs assessment, is common to any instructional design process, especially software development. This involves a learner analysis, consultation with subject matter experts and/or the instructor(s). This first step is part of the development of the expert/knowledge and student domain. The goal is to specify learning goals and to outline a general plan for the curriculum; it is imperative not to computerize traditional concepts but develop a new curriculum structure by defining the task in general and understanding learners' possible behaviours dealing with the task and to a lesser degree the tutor's behavior. In doing so, three crucial dimensions need to be dealt with: (1) the probability a student is able to solve problems; (2) the time it takes to reach this performance level and (3) the probability the student will actively use this knowledge in the future. Another important aspect that requires analysis is cost effectiveness of the interface. Moreover, teachers and student entry characteristics such as prior knowledge must be assessed since both groups are going to be system users.[24]

The second stage, cognitive task analysis, is a detailed approach to expert systems programming with the goal of developing a valid computational model of the required problem solving knowledge. Chief methods for developing a domain model include: (1) interviewing domain experts, (2) conducting "think aloud" protocol studies with domain experts,(3) conducting "think aloud" studies with novices and (4) observation of teaching and learning behavior. Although the first method is most commonly used, experts are usually incapable of reporting cognitive components. The "think aloud" methods, in which the experts is asked to report aloud what s/he is thinking when solving typical problems, can avoid this problem.[24] Observation of actual online interactions between tutors and students provides information related to the processes used in problem-solving, which is useful for building dialogue or interactivity into tutoring systems.[25]

The third stage, initial tutor implementation, involves setting up a problem solving environment to enable and support an authentic learning process. This stage is followed by a series of evaluation activities as the final stage which is again similar to any software development project.[24]

The fourth stage, evaluation includes (1) pilot studies to confirm basic usability and educational impact; (2) formative evaluations of the system under development, including (3) parametric studies that examine the effectiveness of system features and finally, (4) summative evaluations of the final tutor's effect: learning rate and asymptotic achievement levels.[24]

Eight principles of ITS design and development

Anderson et al. (1987)[26] outlined eight principles for intelligent tutor design and Corbett et al. (1997)[24] later elaborated on those principles highlighting an all-embracing principle which they believed governed intelligent tutor design, they referred to this principle as:

Principle 0: An intelligent tutor system should enable the student to work to the successful conclusion of problem solving.

  1. Represent student competence as a production set.
  2. Communicate the goal structure underlying the problem solving.
  3. Provide instruction in the problem solving context.
  4. Promote an abstract understanding of the problem-solving knowledge.
  5. Minimize working memory load.
  6. Provide immediate feedback on errors.
  7. Adjust the grain size of instruction with learning.
  8. Facilitate successive approximations to the target skill.[24]

Use in practice

All this is a substantial amount of work, even if authoring tools have become available to ease the task.[27] This means that building an ITS is an option only in situations in which they, in spite of their relatively high development costs, still reduce the overall costs through reducing the need for human instructors or sufficiently boosting overall productivity. Such situations occur when large groups need to be tutored simultaneously or many replicated tutoring efforts are needed. Cases in point are technical training situations such as training of military recruits and high school mathematics. One specific type of intelligent tutoring system, the Cognitive Tutor, has been incorporated into mathematics curricula in a substantial number of United States high schools, producing improved student learning outcomes on final exams and standardized tests.[28] Intelligent tutoring systems have been constructed to help students learn geography, circuits, medical diagnosis, computer programming, mathematics, physics, genetics, chemistry, etc. Intelligent Language Tutoring Systems (ILTS), e.g. this[29] one, teach natural language to first or second language learners. ILTS requires specialized natural language processing tools such as large dictionaries and morphological and grammatical analyzers with acceptable coverage.

Applications

During the rapid expansion of the web boom, new computer-aided instruction paradigms, such as e-learning and distributed learning, provided an excellent platform for ITS ideas. Areas that have used ITS include natural language processing, machine learning, planning, multi-agent systems, ontologies, semantic Web, and social and emotional computing. In addition, other technologies such as multimedia, object-oriented systems, modeling, simulation, and statistics have also been connected to or combined with ITS. Historically non-technological areas such as the educational sciences and psychology have also been influenced by the success of ITS.[30]

In recent years, ITS has begun to move away from the search-based to include a range of practical applications.[31] ITS have expanded across many critical and complex cognitive domains, and the results have been far reaching. ITS systems have cemented a place within formal education and these systems have found homes in the sphere of corporate training and organizational learning. ITS offers learners several affordances such as individualized learning, just in time feedback, and flexibility in time and space.

While Intelligent tutoring systems evolved from research in cognitive psychology and artificial intelligence, there are now many applications found in education and in organizations. Intelligent tutoring systems can be found in online environments or in a traditional classroom computer lab, and are used in K-12 classrooms as well as in universities. There are a number of programs that target mathematics but applications can be found in health sciences, language acquisition, and other areas of formalized learning.

Reports of improvement in student comprehension, engagement, attitude, motivation, and academic results have all contributed to the ongoing interest in the investment in and research of theses systems. The personalized nature of the intelligent tutoring systems affords educators the opportunity to create individualized programs. Within education there are a plethora of intelligent tutoring systems, an exhaustive list does not exist but several of the more influential programs are listed below.

Examples in education

Algebra Tutor PAT (PUMP Algebra Tutor or Practical Algebra Tutor) developed by the Pittsburgh Advanced Cognitive Tutor Center at Carnegie Mellon University, engages students in anchored learning problems and uses modern algebraic tools in order to engage students in problem solving and in sharing of their results. The aim of PAT is to tap into a students' prior knowledge and everyday experiences with mathematics in order to promote growth. The success of PAT is well documented (ex. Miami-Dade County Public Schools Office of Evaluation and Research) from both a statistical (student results) and emotional (student and instructor feedback) perspective.[32]

Mathematics Tutor The Mathematics Tutor (Beal, Beck & Woolf, 1998) helps students solve word problems using fractions, decimals and percentages. The tutor records the success rates while a student is working on problems while providing subsequent, lever-appropriate problems for the student to work on. The subsequent problems that are selected are based on student ability and a desirable time in is estimated in which the student is to solve the problem.[33]

eTeacher eTeacher (Schiaffino et al., 2008) is an intelligent agent that supports personalized e-learning assistance. It builds student profiles while observing student performance in online courses. eTeacher then uses the information from the student's performance to suggest a personalized courses of action designed to assist their learning process.[34]

ZOSMAT ZOSMAT was designed to address all the needs of a real classroom. It follows and guides a student in different stages of their learning process. This is a student-centered ITS does this by recording the progress in a student's learning and the student program changes based on the student's effort. ZOSMAT can be used for either individual learning or in a real classroom environment alongside the guidance of a human tutor.[35]

REALP REALP was designed to help students enhance their reading comprehension by providing reader-specific lexical practice and offering personalized practice with useful, authentic reading materials gathered from the Web. The system automatically build a user model according to student's performance. After reading, the student is given a series of exercises based on the target vocabulary found in reading.[36]

CIRCSlM-Tutor CIRCSIM_Tutor is an intelligent tutoring system that is used with first year medical students at the Illinois Institute of Technology. It uses natural dialogue based, Socratic language to help students learn about regulating blood pressure.[37]

Why2-Atlas Why2-Atlas is an ITS that analyses students explanations of physics principles. The students input their work in paragraph form and the program converts their words into a proof by making assumptions of student beliefs that are based on their explanations. In doing this, misconceptions and incomplete explanations are highlighted. The system then addresses these issues through a dialogue with the student and asks the student to correct their essay. A number of iterations may take place before the process is complete.[38]

SmartTutor The University of Hong Kong (HKU) developed a SmartTutor to support the needs of continuing education students. Personalized learning was identified as a key need within adult education at HKU and SmartTutor aims to fill that need. SmartTutor provides support for students by combining Internet technology, educational research and artificial intelligence.[39]

AutoTutor AutoTutor assists college students in learning about computer hardware, operating systems and the Internet in an introductory computer literacy course by simulating the discourse patterns and pedagogical strategies of a human tutor. AutoTutor attempts to understand learner's input from the keyboard and then formulate dialog moves with feedback, prompts, correction and hints.[40]

ActiveMath ActiveMath is a web-based, adaptive learning environment for mathematics. This system strives for improving long-distance learning, for complementing traditional classroom teaching, and for supporting individual and lifelong learning.[41]

ESC101-ITS The Indian Institute of Technology, Kanpur, India developed the ESC101-ITS, an intelligent tutoring system for introductory programming problems.

Examples in corporate training and industry

SHERLOCK "SHERLOCK" is used to train Air Force technicians to diagnose problems in the electrical systems of F-15 jets. The ITS creates faulty schematic diagrams of systems for the trainee to locate and diagnose. The ITS provides diagnostic readings allowing the trainee to decide whether the fault lies in the circuit being tested or if it lies elsewhere in the system. Feedback and guidance are provided by the system and help is available if requested.[42]

Cardiac Tutor The Cardiac Tutor's aim is to support advanced cardiac support techniques to medical personnel. The tutor presents cardiac problems and, using a variety of steps, students must select various interventions. Cardiac Tutor provides clues, verbal advice, and feedback in order to personalize and optimize the learning. Each simulation, regardless of whether the students were successfully able to help their patients, results in a detailed report which students then review.[43]

CODES Cooperative Music Prototype Design is a Web-based environment for cooperative music prototyping. It was designed to support users, especially those who are not specialists in music, in creating musical pieces in a prototyping manner. The musical examples (prototypes) can be repeatedly tested, played and modified. One of the main aspects of CODES is interaction and cooperation between the music creators and their partners.[44]

Effectiveness

Assessing the effectiveness of ITS programs is problematic. ITS vary greatly in design, implementation, and educational focus. When ITS are used in a classroom, the system is not only used by students, but by teachers as well. This usage can create barriers to effective evaluation for a number of reasons; most notably due to teacher intervention in student learning. Teachers often have the capability to enter new problems into the system, adjusting the curriculum and creating interactions with the students as they learn. All of these variables make evaluation of an ITS complex.[45]

Despite the inherent complexities, numerous studies have attempted to measure the overall effectiveness of ITS, often by comparisons of ITS to human tutors.[46][47][48][49] Reviews of early ITS systems (1995) showed an effect size of d = 1.0 in comparison to no tutoring, where as human tutors were given an effect size of d = 2.0.[46] Kurt VanLehn's much more recent overview (2011) of modern ITS found that there was no statistical difference in effect size between expert one-on-one human tutors and step-based ITS.[49] Some individual ITS have been evaluated more positively than others. Studies of the Algebra Cognitive Tutor found that the ITS students outperformed students taught by a classroom teacher on standardized test problems and real-world problem solving tasks.[50] Subsequent studies found that these results were particularly pronounced in students from special education, non-native English, and low-income backgrounds.[51]

Some recognized strengths of ITS are their ability to provide immediate yes/no feedback, individual task selection, on-demand hints, and support mastery learning.[49][52]

Limitations

Intelligent tutoring systems are expensive both to develop and implement. The research phase paves the way for the development of systems that are commercially viable. However, the research phase is often expensive; it requires the cooperation and input of subject matter experts, the cooperation and support of individuals across both organizations and organizational levels. Another limitation in the development phase is the conceptualization and the development of software within both budget and time constraints. There are also factors that limit the incorporation of intelligent tutors into the real world, including the long timeframe required for development and the high cost of the creation of the system components. A high portion of that cost is a result of content component building.[20] For instance, surveys revealed that encoding an hour of online instruction time took 300 hours of development time for touring content.[53] Similarly, building the Cognitive Tutor took a ratio of development time to instruction time of at least 200:1 hours.[46] The high cost of development often eclipses replicating the efforts for real world application.[54] Intelligent tutoring systems are not, in general, commercially feasible for real-world applications.[54]

A criticism of Intelligent Tutoring Systems currently in use, is the pedagogy of immediate feedback and hint sequences that are built in to make the system "intelligent". This pedagogy is criticized for its failure to develop deep learning in students. When students are given control over the ability to receive hints, the learning response created is negative. Some students immediately turn to the hints before attempting to solve the problem or complete the task. When it is possible to do so, some students bottom out the hints - receiving as many hints as possible as fast as possible - in order to complete the task faster. If students fail to reflect on the tutoring system's feedback or hints, and instead increase guessing until positive feedback is garnered, the student is, in effect, learning to do the right thing for the wrong reasons. Tutoring systems are unable to detect shallow learning and therefore, the learning for some users is not optimal.[55]

Another criticism of intelligent tutoring systems is the failure of the system to ask questions of the students to explain their actions. If the student is not learning the domain language than it becomes more difficult to gain a deeper understanding, to work collaboratively in groups, and to transfer the domain language to writing. For example, if the student is not "talking science" than it is argued that they are not being immersed in the culture of science, making it difficult to undertake scientific writing or participate in collaborative team efforts. Intelligent tutoring systems have been criticized for being too "instructivist" and removing intrinsic motivation, social learning contexts, and context realism from learning.[56]

Practical concerns, in terms of the inclination of the sponsors/authorities and the users to adapt intelligent tutoring systems, should be taken into account.[54] First, someone must have a willingness to implement the ITS.[54] Additionally an authority must recognize the necessity to integrate an intelligent tutoring software into current curriculum and finally, the sponsor or authority must offer the needed support through the stages of the system development until it is completed and implemented.[54]

Evaluation of an intelligent tutoring system is an important phase; however, it is often difficult, costly, and time consuming.[54] Even though there are various evaluation techniques presented in the literature, there are no guiding principles for the selection of appropriate evaluation method(s) to be used in a particular context.[57][58] Careful inspection should be undertaken to ensure that a complex system does what it claims to do. This assessment may occur during the design and early development of the system to identify problems and to guide modifications (i.e. formative evaluation).[59] In contrast, the evaluation may occur after the completion of the system to support formal claims about the construction, behaviour of, or outcomes associated with a completed system (i.e. summative evaluation).[59] The great challenge introduced by the lack of evaluation standards resulted in neglecting the evaluation stage in several existing ITS'.[57][58][59]

Current and Future directions

Some aspects that human tutors can do that intelligent tutoring systems are still limited by are in the areas of dialogue and feedback. One reason for these limitations are that human tutors are able to interpret the affective state of the student. Current research has been focusing on how to improve on these areas of ITS to make it more effective.

Dialogue

Human tutors have the ability to understand a person's tone and inflection within a dialogue and interpret this to provide continual feedback through an ongoing dialogue. Intelligent tutoring systems are now being developed to attempt to simulate natural conversations. To get the full experience of dialogue there are many different areas in which a computer must be programmed; including being able to understand tone, inflection, body language, and facial expression and then to respond to these. Dialogue in an ITS can be used to ask specific questions to help guide students and elicit information while allowing students to construct their own knowledge.[60] The development of more sophisticated dialogue within an ITS has been a focus in some current research partially to address the limitations and create a more constructivist approach to ITS.[61]

Emotional Affect

There is a growing body of work that is considering the role of affect on learning and trying to develop intelligent tutoring systems that will be able to interpret and adapt to the different emotional states.[62][63] Humans do not just use cognitive processes in learning but the affective processes they go through also plays an important role. For example, learners learn better when they have a certain level of disequilibrium (frustration), but not enough to make the learner feel completely overwhelmed.[62] This has motivated affective computing to begin to produce and research creating intelligent tutoring systems that can interpret the affective process of an individual.[62] An ITS can be developed to read an individual's expressions and other signs of affect in an attempt to find and tutor to the optimal affective state for learning. There are many complications in doing this since affect is not expressed in just one way but in multiple ways so that for an ITS to be effective in interpreting affective states it may require a multimodal approach (tone, facial expression, etc...).[62] These ideas have created a new field within ITS, that of Affective Tutoring Systems (ATS).[63] One example of an ITS that addresses affect is Gaze Tutor which was developed to track students eye movements and determine whether they are bored or distracted and then the system attempts to reengage the student.[64]

ITS conference

The Intelligent Tutoring Systems conference was created in 1988 by Claude Frasson (Canada) and is typically held every other year, opposite the International Conference on Artificial Intelligence in Education.[65] It was hosted in Montreal (Canada) by Claude Frasson and Gilles Gauthier, in 1988, 1992, 1996 and 2000; in San Antonio (US) by Carol Redfield and Valerie Shute in 1998; in Biarritz (France) and San Sebastian (Spain) by Guy Gouardères and Stefano Cerri in 2002; in Maceio (Brazil) by Rosa Maria Vicari and Fábio Paraguaçu in 2004; in Jhongli (Taiwan) by Tak-Wai Chan in 2006. The conference was back in Montreal in 2008 (for its 20th anniversary) and hosted by Roger Nkambou and Susanne Lajoie. ITS 2010 was held in Pittsburgh (US), hosted by Jack Mostow, Judy Kay, and Vincent Aleven. ITS 2012 (http://its2012.its-conferences.com) was held in Chania (Crete), hosted by George Papadourakis, Stefano Cerri and William Clancey. ITS 2014 (http://its2014.its-conferences.com) was held in Honolulu(Hawaii), hosted by Martha Crosby, Stefan Trausan-Matu and Kristy Elizabeth Boyer. The International Artificial Intelligence in Education (AIED) Society publishes The International Journal of Artificial Intelligence in Education (IJAIED) and produces the International Conference on Artificial Intelligence in Education (http://iaied.org/conf/1/) every odd numbered year. The American Association of Artificial Intelligence (AAAI) will sometimes have symposia and papers related to intelligent tutoring systems. A number of books have been written on ITS including three published by Lawrence Erlbaum Associates.

See also

Bibliography

Books

Papers

References

  1. ↑ Joseph Psotka, Sharon A. Mutter (1988). Intelligent Tutoring Systems: Lessons Learned. Lawrence Erlbaum Associates. ISBN 0-8058-0192-8.
  2. ↑ 2.0 2.1 2.2 Buchanan, B. (2006). A (Very) Brief History of Artificial Intelligence. AI Magazine 26(4). pp.53-60.
  3. ↑ Sidney Pressey
  4. ↑ 4.0 4.1 4.2 Fry, E. (1960). Teaching Machine Dichotomy: Skinner vs. Pressey. Pshychological Reports(6) 11-14. Southern University Press.
  5. ↑ 5.0 5.1 5.2 5.3 5.4 Shute, V. J., & Psotka, J. (1994). Intelligent Tutoring Systems: Past, Present, and Future. Human resources directorate manpower and personnel research division. pp. 2-52
  6. ↑ 6.0 6.1 6.2 6.3 6.4 6.5 Chambers, J., & Sprecher, J. (1983). Computer-Assisted Instruction: Its Use in the Classroom. Englewood Cliffs, New Jersey: Prentice-Hall Inc.
  7. ↑ 7.0 7.1 7.2 Larkin, J, & Chabay, R. (Eds.). (1992). Computer Assisted Instruction and Intelligent Tutoring Systems: Shared Goals and Complementary Approaches. Hillsdale, New Jersey: Lawrence Erlbaum Associates.
  8. ↑ 8.0 8.1 Anderson, K. (1986) Computer-Assisted Instruction. Journal of Medical Systems, 10(2), 163-171.
  9. ↑ 9.0 9.1 Corbett, A.T., & Anderson, J. R. (1992). LISP Intelligent Tutoring System Research in Skill Acquisition. In Larkin, J. & Chabay, R. (Eds.) Computer assisted instruction and intelligent tutoring systems: shared goals and complementary approaches (pp.73-110) Englewood Cliffs, New Jersey: Prentice-Hall Inc.
  10. ↑ Ford, L. A New Intelligent Tutoring System (2008) British Journal of Educational Technology, 39(2), 311-318
  11. ↑ Bailin, A & Levin, L. Introduction: Intelligent Computer Assisted Language Instruction (1989) Computers and the Humanities, 23, 3-11
  12. ↑ Kinshuk (1996). Computer aided learning for entry level Accountancy students. PhD Thesis, De Montfort University, England, July 1996.
  13. ↑ Kinshuk, and Ashok Patel. (1997) A Conceptual Framework for Internet Based Intelligent Tutoring Systems. Knowledge Transfer, II, 117-24.
  14. ↑ Freedman, R. 1999. Atlas: A Plan Manager for Mixed-Initiative, Multimodal Dialogue. (1999) AAAI Workshop on Mixed-Initiative Intelligence
  15. ↑ Graesser, Arthur C., Kurt VanLehn, Carolyn P. Rose, Pamela W. Jordan, and Derek Harter. (2001) Intelligent Tutoring Systems with Conversational Dialogue. Al Magazine 22.4, 39-52.
  16. ↑ Gertner, A.; Conati, C.; and VanLehn, K. (1998) Procedural Help in Andes; Generating Hints Using a Bayesian Network Student Model. Articicial Intelligence, 106-111.
  17. ↑ Shelby, R. N.; Schulze, K. G.; Treacy, D. J.; Wintersgill, M. C.; VanLehn, K.; and Weinstein, A. (2001) The Assessment of Andes Tutor.
  18. ↑ 18.0 18.1 Nwana, H. S. (1990). Intelligent tutoring systems: An overview. Artificial Intelligence Review, 4, 251-277.
  19. ↑ 19.0 19.1 Freedman, R. (2000). What is an intelligent tutoring system? Intelligence, 11(3), 15–16.
  20. ↑ 20.0 20.1 20.2 Nkambou, R., Mizoguchi, R., & Bourdeau, J. (2010). Advances in intelligent tutoring systems. Heidelberg: Springer.
  21. ↑ Anderson, H. & Koedinger, M. (1997). Intelligent tutoring goes to school in the Big City. International Journal of Artificial Intelligence in Education, 8, 30-43.
  22. ↑ Corbett, Albert T. and Anderson, John R., "Student Modeling and Mastery Learning in a Computer-Based Programming Tutor" (2008). Department of Psychology. Paper 18. http://repository.cmu.edu/psychology/18
  23. ↑ Padayachee I. (2002. Intelligent Tutoring Systems: Architecture and Characteristics.
  24. ↑ 24.0 24.1 24.2 24.3 24.4 24.5 24.6 Corbett A. T., Koedinger, K. R., & Anderson, J. R. (1997). Intelligent tutoring systems. In M. G. Helander, T. K. Landauer, & P. V. Prabhu (Eds.), Handbook of human-computer interaction (pp. 849–874). Amsterdam: Elsevier.
  25. ↑ Shah, Farhana; Martha Evens; Joel Michael; Allen Rovick (2002). "Classifying Student Initiatives and Tutor Responses in Human Keyboard-to-Keyboard Tutoring Sessions". Discourse Processes 33 (1): 23. doi:10.1207/s15326950dp3301_02.
  26. ↑ Anderson, J., Boyle, C., Farrell, R., & Reiser, B. (1987). Cognitive principles in the design of computer tutors. In P. Morris (Ed.), Modeling cognition. NY: John Wiley.
  27. ↑ For an example of an ITS authoring tool, see Cognitive Tutoring Authoring Tools
  28. ↑ Koedinger, K. R.; Corbett, A. (2006). "Cognitive Tutors: Technology bringing learning science to the classroom". In Sawyer, K. The Cambridge Handbook of the Learning Sciences. Cambridge University Press. pp. 61–78. OCLC 62728545.
  29. ↑ Shaalan, Khalid F. (February 2005). "An Intelligent Computer Assisted Language Learning System for Arabic Learners". Computer Assisted Language Learning: An International Journal (Taylor & Francis Group Ltd.) 18 (1 & 2): 81–108. doi:10.1080/09588220500132399.
  30. ↑ Ramos, C., Ramos, C., Frasson, C., & Ramachandran, S. (2009). Introduction to the special issue on real world applications of intelligent tutoring systems. , 2(2) 62-63.
  31. ↑ https://trac.v2.nl/export/.../Intelligent%20Tutoring%20Systems.pdf
  32. ↑ Evaluation of the Cognitive Tutor Algebra I Program A Shneyderman - Miami–Dade County Public Schools, Office of Evaluation and Research, Miami Fl. September 2001
  33. ↑ Beal, C. R., Beck, J., & Woolf, B. (1998). Impact of intelligent computer instruction on girls' math self concept and beliefs in the value of math. Paper presented at the annual meeting of the American Educational Research Association.
  34. ↑ Schiaffino, S., Garcia, P., & Amandi, A. (2008). eTeacher: Providing personalized assistance to e-learning students. Computers & Education , 51 , 1744-1754
  35. ↑ Keles, A., Ocak, R., Keles, A., & Gulcu A. (2009). ZOSMAT: Web-based Intelligent Tutoring System for Teaching-Learning Process. [Elsevier.]. Expert Systems with Applications , 36 , 1229-1239.
  36. ↑ Heffernan, N. T., Turner, T. E., Lourenco, A. L. N., Macasek, M. A., Nuzzo-Jones, G., & Koedinger, K. R. (2006). The ASSISTment Builder: Towards an Analy- sis of Cost Effectiveness of ITS creation. Presented at FLAIRS2006, Florida.
  37. ↑ http://www.cs.iit.edu/~circsim/
  38. ↑ aroque.bol.ucla.edu/pubs/vanLehnEtAl-its02-architectureWhy.pdf
  39. ↑ Cheung, B., Hui, L., Zhang, J., & Yiu, S. M. (2003). SmartTutor: An intelligent tutoring system in web-based adult education. Journal of Systems and Software , 68 , 11-25
  40. ↑ Graesser, A.C., Wiemer-Hastings, K., Wiemer-Hastings, P., & Kreuz, R., & TRG. (1999). AutoTutor: A simulation of a human tutor. Journal of Cognitive Systems Research , 1 , 35-51
  41. ↑ Melis, E., & Siekmann, J. (2004). Activemath: An Intel- ligent Tutoring System for Mathematics. In R. Tadeus- iewicz, L.A. Zadeh, L. Rutkowski, J. Siekmann, (Eds.), 7th International Conference "Artificial Intelligence and Soft Computing" (ICAISC) Lecture Notes in AI LNAI 3070 . Springer-Verlag 91-101
  42. ↑ Lajoie, S. P., & Lesgold, A. (1989). Apprenticeship training in the workplace: Computer coached practice environment as a new form of apprenticeship. Machine- Mediated Learning , 3 , 7-28
  43. ↑ Eliot, C., & Woolf, B. (1994). Reasoning about the user within a simulation-based real-time training system. In Proceedings of the fourth international conference on user modeling , 121-126.
  44. ↑ MILETTO, E. M., PIMENTA, M. S., VICARI, R. M., & FLORES, L. V. (2005). CODES: A web-based environment for cooperative music prototyping. Organised Sound, 10(3), 243-253.
  45. ↑ Intelligent Tutoring Systems, Chapter 37 / Corbett, Koedinger & Anderson / Chapter 37 (Original pp 849-874) 14 retrieved May 21, 2012 from http://act-r.psy.cmu.edu/papers/173/Chapter_37_Intelligent_Tutoring_Systems.pdf
  46. ↑ 46.0 46.1 46.2 Anderson, J.R.; Corbett, A. T.; Koedinger, K. R.; Pelletier, R. (1995). "Cognitive tutors: Lessons learned". The Journal of the Learning Sciences 4: 167–207. doi:10.1207/s15327809jls0402_2.
  47. ↑ Christmann, E.; Badgett, J. (1997). "Progressive comparison of the effects of computer-assisted learning on the academic achievement of secondary students". Journal of Research on Computing in Education 29: 325–338.
  48. ↑ Fletcher, J. D. (2003). Evidence for learning from technology-assisted instruction. In H. F. O'Neil & R. Perez (Eds.), Technology applications in education: A learning view (pp. 79–99). Mahwah, NJ: Erlbaum.
  49. ↑ 49.0 49.1 49.2 VanLehn, K. "The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems". Educational Psychologist 46 (4): 197–221. doi:10.1080/00461520.2011.611369.
  50. ↑ Koedinger, K. R.; Anderson, J. R.; Hadley, W. H.; Mark, M. A. (1997). "Intelligent tutoring goes to school in the big city". International Journal of Artificial Intelligence in Education 8: 30–43.
  51. ↑ Plano, G. S. (2004). "The Effects of the Cognitive Tutor Algebra on student attitudes and achievement in a 9th grade Algebra course". Unpublished doctoral dissertation, Seton Hall University, South Orange, NJ.
  52. ↑ Koedinger, Kenneth; Alven, Vincent (2007). "Exploring the Assistance Dilemma in Experiments with Cognitive Tutors". Educ Psychol Rev 19: 239–264. doi:10.1007/s10648-007-9049-0.
  53. ↑ Murray, T. (1999). Authoring intelligent tutoring systems: An analysis of the state of the art. International Journal of Artificial Intelligence in Education (IJAIED), 10, 98–129.
  54. ↑ 54.0 54.1 54.2 54.3 54.4 54.5 Polson, Martha C.; Richardson, J. Jeffrey, eds. (1988). Foundations of Intelligent Tutoring Systems. Lawrence Erlbaum.
  55. ↑ Koedinger, K.; Aleven, V. (2007). "Exploring the assistance dilemma in experiments with cognitive tutors". Educational Psychology Review 19: 239–264. doi:10.1007/s10648-007-9049-0.
  56. ↑ Jonassen, D. H., & Reeves, T. C. (1996). Learning with technology: Using computers as cognitive tools. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology (pp. 693 - 719). New York: Macmillan.
  57. ↑ 57.0 57.1 Iqbal, A., Oppermann, R., Patel, A. & Kinshuk (1999). A Classification of Evaluation Methods for Intelligent Tutoring Systems. In U. Arend, E. Eberleh & K. Pitschke (Eds.) Software Ergonomie '99 - Design von Informationswelten, Leipzig: B. G. Teubner Stuttgart, 169-181.
  58. ↑ 58.0 58.1 Siemer, J., & Angelides, M. C. (1998). A comprehensive method for the evaluation of complete intelligent tutoring systems. Decision support systems, 22(1), 85–102.
  59. ↑ 59.0 59.1 59.2 Mark, M. A., Greer, J. E.. (1993). Evaluation methodologies for intelligent tutoring systems. Journal of Artificial Intelligence in Education, 4, 129–129.
  60. ↑ Graessner A. C., Kurt VanLehn, C. P R., Jordan, P. & Harter, D. (2001). Intelligent tutoring systems with conversational dialogue. AI Magazine, 22(4), 39.
  61. ↑ Graesser, A. C., Chipman, P., Haynes, B. C., & Olney, A. (2005). AutoTutor: An intelligent tutoring system with mixed-initiative dialogue. , 48(4) 612-618.
  62. ↑ 62.0 62.1 62.2 62.3 D'Mello, C.; Graessner, A. (2012). "Dynamics of affective states during complex learning". Learning and Instruction 22 (2): 145–157. doi:10.1016/j.learninstruc.2011.10.001.
  63. ↑ 63.0 63.1 Sarrafzadeh, A., Alexander, S., Dadgostar, F., Fan, C., & Bigdeli, A. (2008). How do you know that I don't understand?" A look at the future of intelligent tutoring systems. Computers in Human Behavior, 24(4), 1342-1363
  64. ↑ D'Mello, S., Olney, A., Williams, C., & Hays, P. (2012). Gaze tutor: A gaze-reactive intelligent tutoring system. International Journal of Human - Computer Studies, 70(5), 377-398.
  65. ↑ Zaïane, Osmar R. (August 5, 2009). "Computer science conference rankings". Retrieved 2009-10-31

External links