The IMS Question and Test Interoperability specification (QTI) defines a standard format for the representation of assessment content and results, supporting the exchange of this material between authoring and delivery systems, repositories and other learning management systems. It allows assessment materials to be authored and delivered on multiple systems interchangeably. It is, therefore, designed to facilitate interoperability between systems[1].
The specification consists of a data model that defines the structure of questions, assessments and results from questions and assessments together with an XML data binding that essentially defines a language for interchanging questions and other assessment material. The XML binding is widely used for exchanging questions between different authoring tools and by publishers. The assessment and results parts of the specification are less widely used.
Contents |
QTI was produced by the IMS Global Learning Consortium, which is an industry and academic consortium that develops specifications for interoperable learning technology. QTI was inspired by the need for interoperability in question design, and to avoid people losing or having to re-type questions when technology changes. Developing and validating good questions is time consuming, and it's desirable to be able to create them in a platform and technology neutral format.
QTI version 1.0 was materially based on a proprietary Questions Markup Language (QML) language defined by QuestionMark, but the language has evolved over the years and can now describe almost any reasonable question that one might want to describe. (QML is still in use by Questionmark and is generated for interoperability by tools like Adobe Captivate).
The most widely used version of QTI at the time of writing is version 1.2, which was finalized in 2002. This works well for exchanging simple question types, and is supported by many tools that allow the creation of questions.
Version 2.0 was released in 2005, with v2.1 due for release in 2008[2]. 2.0 addressed the item (individual question) level of the specification only, with 2.1 covering assessments and results as well as correcting errors which had become apparent in 2.0. Version 2.x is a significant improvement on earlier versions, defining a new underlying interaction model. It is also notable for its significantly greater degree of integration with other specifications (some of which did not exist during the production of v1): the specification addresses the relationship with IMS Content Packaging v1.2, IEEE Learning Object Metadata, IMS Learning Design, IMS Simple Sequencing and other standards such as XHTML. It also provides guidance on representing context-specific usage data and information to support the migration of content from earlier versions of the specification.
Because v2.0 was limited to items only, and v2.1 has yet to be formally released by IMS (although two public drafts plus an addendum are currently available), uptake of v2.x has been slow to date. The delay between the release of 2.0 and 2.1 (over three years to date) may have hindered uptake to some extent, with developers reluctant to commit to v2.0 knowing that v2.1 is in development. The use of a profile of v1.2.1 in the IMS Common Cartridge specification may exacerbate this. A number of implementations are emerging, however, and uptake may increase once the specification is finally available in a stable form.
In early 2009, the IMS Global Learning Consortium withdrew QTI 2.1, stating that "Adequate feedback on the specification has not been received, and therefore, the specification has been put back into the IMS project group process for further work."[3] The most recent version of QTI that is fully endorsed by IMS GLC is v1.2.1. This decision met with disapproval on the IMS-QTI mailing list.[4] A further clarification on the QTI 2.1 withdrawal acknowledged the work done on implementing the QTI 2.1 draft specification, and cited criticism on the lack of interoperability of IMS specifications as a reason for endorsing only IMS QTI 1.2.[5] A few weeks later IMS GLC reposted the QTI v2.1 draft specification on their website[6] with a warning that the specification is incomplete:
Caution: The QTIv2.1PD Version 2 specification is incomplete in its current state. The IMS QTI project group is in the process of evolving this specification based on input from market participants. Suppliers of products and services are encouraged to participate by contacting Mark McKell at [e-mail address removed]. This specification will be superseded by an updated release based on the input of the project group participants.
Please note that supplier's claims as to implementation of QTI v2.1 and conformance to it HAVE NOT BEEN VALIDATED by IMS GLC. While such suppliers are likely well-intentioned, IMS GLC member organizations have not yet put in place the testing process to validate these claims. IMS GLC currently grants a conformance mark to the Common Cartridge profile of QTI v1.2.1. [7]
| Date | Version | Comments |
| March 1999 | 0.5 | Internal to IMS |
| February 2000 | 1.0 public draft | |
| May 2000 | 1.0 final release | |
| August 2000 | 1.01 | |
| March 2001 | 1.1 | |
| January 2002 | 1.2 | |
| March 2003 | 1.2.1 addendum | |
| September 2003 | 2.0 charter | Initiation of working group |
| January 2005 | 2.0 final release | |
| January 2006 | 2.1 public draft | |
| July 2006 | 2.1 public draft version 2 | |
| April 2008 | 2.1 public draft addendum | |
| early 2009 | 2.1 removed from website | |
| April 2009 | 2.1 reinstated on website |
| Name | QTI version | Type of tool | Comment | |
|---|---|---|---|---|
| Alphastudy | 2.0 [8] | LMS | also supports IMS-QTI 2.0 standard, SCORM 1.2 and SCORM 2004 [8] | |
| ANGEL Learning Management Suite | 2.1 [9] | LMS | also supports IMS Common Cartridge [9] | |
| APIS QTIv2 Assessment Engine | 2.0 draft [10] | Java library & demo application. | Incomplete. Author recommends using QTITools instead. | |
| AQuRate | 2.1 [11] | authoring tool | see QTITools | |
| ASDEL | 2.1 [12] | assessment delivery system | see QTITools | |
| Assessment Tiger | 2.1 [13] | Authoring and mobile assessment delivery | Advanced QTI 2.1 authoring - mobile QTI 2.1 rendering | |
| ATutor | 1.2, 2.1 [14] | LCMS | ||
| Canvas Learning | 1.2.1 [15] | Authoring tools and SCORM compatible item renderer available as middle-ware solutions. | Creators - Can Studios contributed to the development of the QTI specification. A number of LMS systems used the Canvas Learning Player to achieve compatibility with the Becta learning platform conformance regime. The system is currently being distributed to schools in the UK as a result of this integration work. | |
| CCReader | 1.2.1 CC Profile [16] | Common Cartridge Viewer | ||
| Chamilo | 1.2 and 2.0 [17] | LMS/LCMS | export QTI 1.2 & 2.0, import QTI 2.0 (1.2 disabled by default but available) (supports SCORM 1.2) | |
| Cognero | 1.2 and 2.1 [18] | Assessment authoring and delivery system. | Cognero imports QTI 1.2 and exports QTI 1.2 and 2.1 to allow content to work with other systems. | |
| Content-e | 1.2 & 2.0 [19] | Professional authoring tool Content-e. | Imports QTI 1.2 and 2.0. | |
| DB Primary | 2.0 [20] [21] | LMS | ||
| Diploma | 1.2, 2.1 [22] | export QTI 1.2 & 2.1 | ||
| Dokeos | 1.2 and 2.0 [23] | LMS/LCMS | export QTI 1.2 & 2.0 (1.2 disabled by default but available) (supports SCORM 1.2) | |
| e-teach Q-Player | 1.2[24] | QTI 1.2 player. SCORM 1.2 and 2004 compliant | QTI 1.2 universal player - Adobe flash based | |
| it's learning | 2.1 [25] | VLE LMS | import and export questions in QTI 2.1 format | |
| ILIAS | not stated [26] | LMS | supports SCORM 1.2 and SCORM 2004 | |
| Lectora | not stated [27] | authoring tool | supports AICC, SCORM 1.2 and SCORM 2004 [28] | |
| Mathqurate | 2.1 [29] | authoring tool | see QTITools. Embedded Gecko engine and support for multiple interactions | |
| Moodle | not stated [30] | LCMS | supports adaptive questions; QTI 2.0 export is still unfinished | |
| Online Learning And Training | QTI 1.2 [31] | LCMS | QTI 2.1 compliance can be achieved with ONYX as plugin | |
| Onyx Editor (Elques) and Onyx Konverter | 1.2 and 2.1 [32] | authoring tool and konverter | exports QTI 2.1 and QTI 1.2 (for LMS OLAT only); imports QTI 2.1, Tests from Blackboard and OLAT (kind of QTI 1.2 too); free version available | |
| Onyx Player and Onyx Reporter | 2.1 [33] | modular assessment delivery system | QTI 2.1 import and export (report files); open-source; Onyx Reporter: Report Viewer for graphical visualization of QTI-Result-Files | |
| OWL Testing Software | not stated [34] | test management system | can import IMS QTI | |
| QTITools | 2.1 [35] | collection of tools and libraries | Test authoring tool Spectatus procudes QTI 2.1[36] | |
| Question Bank | 1.1[37] | Exports and imports QTI 1.1 | ||
| QuestionMark Perception | not stated [38] | authoring tool and delivery system | can export IMS QTI, an online tool provides QTI 1.2 import | |
| Question Writer 2.0 Publisher Edition | 1.2[39] | authoring tool | Exports as QTI 1.2 and SCORM 1.2 [40] | |
| Question Writer 3.5 Professional | 1.2[41] | authoring tool | Exports as QTI 1.2 and SCORM 1.2 [42] Also specific QTI Export for Pearson VUE [43] | |
| Respondus | 1.2 [44] [45] | authoring tool | QTI export | |
| RM Test Authoring System | 2.1 [46] | authoring tool | ||
| Sakai | 1.2 [47] | LMS | ||
| SToMP (Software Teaching of Modular Physics) | 2.1 [48] | assessment system | mostly unavailable as of July 2008 | |
| Studywiz | 1.2 [49] | Virtual Learning Environment Module | An optional module for creating and assigning QTI v1.2 questions to students. Available as of June 2008 | |
| Wimba Create | QTI Lite [50] | authoring tool | only export |
Other software: