Massive open online course

A massive open online course (MOOC /muːk/) is an online course aimed at unlimited participation and open access via the web.^[1] In addition to traditional course materials such as filmed lectures, readings, and problem sets, many MOOCs provide interactive user forums to support community interactions among students, professors, and teaching assistants (TAs). MOOCs are a recent and widely researched development in distance education which were first introduced in 2006 and emerged as a popular mode of learning in 2012.^[2][3]

Early MOOCs often emphasized open-access features, such as open licensing of content, structure and learning goals, to promote the reuse and remixing of resources. Some later MOOCs use closed licenses for their course materials while maintaining free access for students.^[4][5][6][7]

History

Precursors

Before the Digital Age, distance learning appeared in the form of correspondence courses in the 1890s-1920s and later radio and television broadcast of courses and early forms of e-learning. Typically fewer than five percent of the students would complete a course.^[8] The 2000s saw changes in online, or e-learning and distance education, with increasing online presence, open learning opportunities, and the development of MOOCs.^[9]

Early approaches

The first MOOCs emerged from the open educational resources (OER) movement. The term MOOC was coined in 2008 by Dave Cormier of the University of Prince Edward Island in response to a course called Connectivism and Connective Knowledge (also known as CCK08). CCK08, which was led by George Siemens of Athabasca University and Stephen Downes of the National Research Council, consisted of 25 tuition-paying students in Extended Education at the University of Manitoba, as well as over 2200 online students from the general public who paid nothing.^[11] All course content was available through RSS feeds, and online students could participate through collaborative tools, including blog posts, threaded discussions in Moodle, and Second Life meetings.^[12][13][14] Stephen Downes considers these so-called cMOOCs to be more "creative and dynamic" than the current xMOOCs, which he believes "resemble television shows or digital textbooks."^[11]

Other cMOOCs were then developed; for example, Jim Groom from The University of Mary Washington and Michael Branson Smith of York College, City University of New York hosted MOOCs through several universities starting with 2011's 'Digital Storytelling' (ds106) MOOC.^[15] These early MOOCs did not rely on posted resources, learning management systems, and video lectures, instead using structures that mixed the learning management system with more open web resources.^[16] MOOCs from private, non-profit institutions emphasized prominent faculty members and expanded existing distance learning offerings (e.g., podcasts) into free and open online courses.^[17]

Alongside the development of these open courses, other E-learning platforms emerged — such as Khan Academy, Peer-to-Peer University (P2PU), Udemy, and ALISON — which are viewed as similar to MOOCs and work outside the university system or emphasize individual self-paced lessons.^{[18][19][20][21][22]}

cMOOCs and xMOOCs

As MOOCs have evolved, there appear to be two distinct types: those that emphasize the connectivist philosophy, and those that resemble more traditional courses. To distinguish the two, Stephen Downes proposed the terms "cMOOC" and "xMOOC".^[24][25]

cMOOCs are based on principles from connectivist pedagogy indicating that material should be aggregated (rather than pre-selected), remixable, re-purposable, and feeding forward (i.e. evolving materials should be targeted at future learning).^{[26][27][28][29]} cMOOC instructional design approaches attempt to connect learners to each other to answer questions and/or collaborate on joint projects. This may include emphasizing collaborative development of the MOOC.^[30] Andrew Ravenscroft of the London Metropolitan University claimed that connectivist MOOCs better support collaborative dialogue and knowledge building.^[31][32]

xMOOCs have a much more traditional course structure typically with a clearly specified syllabus of recorded lectures and self-test problems. They employ elements of the original MOOC, but are, in effect, branded IT platforms that offer content distribution partnerships to institutions.^[25] The instructor is the expert provider of knowledge, and student interactions are usually limited to asking for assistance and advising each other on difficult points.

Emergence of MOOC providers

According to The New York Times, 2012 became "the year of the MOOC" as several well-financed providers, associated with top universities, emerged, including Coursera, Udacity, and edX.^[2][33]

During a presentation at SXSWedu in early 2013, Instructure CEO Josh Coates suggested that MOOCs are in the midst of a hype cycle, with expectations undergoing wild swings.^[35] Dennis Yang, President of MOOC provider Udemy, later made the point in an article for the Huffington Post.^[36]

Many universities scrambled to join in the "next big thing", as did more established online education service providers such as Blackboard Inc, in what has been called a "stampede." Dozens of universities in Canada, Mexico, Europe and Asia have announced partnerships with the large American MOOC providers.^[37][38] By early 2013, questions emerged about whether academia was "MOOC'd out."^[34][39] This trend was later confirmed in continuing analysis.^[40]

The industry has an unusual structure, consisting of linked groups including MOOC providers, the larger non-profit sector, universities, related companies and venture capitalists. The Chronicle of Higher Education lists the major providers as the non-profits Khan Academy and edX, and the for-profits Udacity and Coursera.^[41]

The larger non-profit organizations include the Bill & Melinda Gates Foundation, the MacArthur Foundation, the National Science Foundation, and the American Council on Education. University pioneers include Stanford, Harvard, MIT, the University of Pennsylvania, Caltech, the University of Texas at Austin, the University of California at Berkeley, and San Jose State University.^[41] Related companies investing in MOOCs include Google and educational publisher Pearson PLC. Venture capitalists include Kleiner Perkins Caufield & Byers, New Enterprise Associates and Andreessen Horowitz.^[41]

In the fall of 2011 Stanford University launched three courses.^[42] The first of those courses was Introduction Into AI, launched by Sebastian Thrun and Peter Norvig. Enrollment quickly reached 160,000 students. The announcement was followed within weeks by the launch of two more MOOCs, by Andrew Ng and Jennifer Widom. Following the publicity and high enrollment numbers of these courses, Thrun started a company he named Udacity and Daphne Koller and Andrew Ng launched Coursera. Coursera subsequently announced university partnerships with University of Pennsylvania, Princeton University, Stanford University and The University of Michigan.^[43]

In January 2013, Udacity launched its first MOOCs-for-credit, in collaboration with San Jose State University. In May 2013 the company announced the first entirely MOOC-based master's degree, a collaboration between Udacity, AT&T and the Georgia Institute of Technology, costing $7,000, a fraction of its normal tuition.^[44]

Concerned about the commercialization of online education, in 2012 MIT created the not-for-profit MITx.^[45] The inaugural course, 6.002x, launched in March 2012. Harvard joined the group, renamed edX, that spring, and University of California, Berkeley joined in the summer. The initiative then added the University of Texas System, Wellesley College and Georgetown University.

In September 2013, edX announced a partnership with Google to develop MOOC.org, a site for non-xConsortium groups to build and host courses. Google will work on the core platform development with edX partners. In addition, Google and edX will collaborate on research into how students learn and how technology can transform learning and teaching. MOOC.org will adopt Google's infrastructure.^[46] The Chinese Tsinghua University MOOC platform XuetangX.com (launched Oct. 2013) uses the Open edX platform.^[47]

Before 2013 each MOOC tended to develop its own delivery platform. EdX in April 2013 joined with Stanford University, which previously had its own platform called Class2Go, to work on XBlock SDK, a joint open-source platform. It is available to the public under the Affero GPL open source license, which requires that all improvements to the platform be publicly posted and made available under the same license.^[48] Stanford Vice Provost John Mitchell said that the goal was to provide the "Linux of online learning."^[49] This is unlike companies such as Coursera that have developed their own platform.^[50]

By November 2013, EdX offered 94 courses from 29 institutions around the world. During its first 13 months of operation (ending March 2013), Coursera offered about 325 courses, with 30% in the sciences, 28% in arts and humanities, 23% in information technology, 13% in business and 6% in mathematics.^[51] Udacity offered 26 courses. The number of courses offered has since increased dramatically: As of January 2016, Edx offers 820 courses, Coursera offers 1580 courses and Udacity offers more than 120 courses. According to FutureLearn, the British Council's Understanding IELTS: Techniques for English Language Tests has an enrollment of over 440,000 students.^[52]

In France, OpenClassrooms, which had been offering online tutorials in IT and programming languages since 1999, begins producing MOOCs in 2012. It now offers more than 1000 courses, focusing on technology and digital skills, mainly in French, but also in English and Spanish, produced either in house, or in partnership with universities and companies.

Notable providers

Provider	Type	Example institutional participants	Headquarters	Founded	Content License
Stanford Online	Non-profit	Stanford University	USA	2006	Free for registered users, personal/non-commercial usage
Coursera	Commercial	Stanford University, Princeton University, Arizona State University, University of Maryland College Park, University of Illinois at Urbana-Champaign	USA	2012	Free for registered users, different course licenses
Khan Academy	Non-profit	n/a	USA	2006	Free, No registration needed, all rights reserved.
WizIQ	Commercial	IIT Delhi, Des Moines Area Community College	India/USA	2007	Not Free, all rights reserved.
Canvas Network	Commercial	Santa Clara University, University of Utah, Université Lille 1	USA	2008	All Rights Reserved, registration required.
Peer to Peer University	Non-profit	n/a	USA	2009	Creative Commons Attribution Share Alike 4.0
Udacity	Commercial	Georgia Institute of Technology, San Jose State University, Google, Salesforce.com, Facebook, Cloudera, Nvidia, Autodesk, Cadence	USA	2012
Eliademy based on the Open Source Moodle Virtual learning environment.[53]	Commercial	Aalto University Executive Education The site is localized to more than 19 languages (including Latin), designed for mobile use.[53][54]	Finland	2012
openHPI[55][56]	n/a	launched in September 2012 by the Hasso Plattner Institute at the University of Potsdam, Germany	Germany	2012	All rights reserved
FutureLearn[57][58]	Non-profit	University of Birmingham, University of Edinburgh, King's College London, University of Leicester, University of Reading, Open University, Monash University, Trinity College Dublin, Warwick University, University of Bath, University of Southampton	UK	2012	All rights reserved.
OpenClassrooms[59][60]	Commercial	Google, Microsoft, IBM, Zendesk, École Polytechnique, CentraleSupélec	France	2007	Creative Commons licence, type BY-NC-SA
OpenLearning[61]	Commercial	University of New South Wales, Taylor's University, University of Canberra	Australia	2012
edX	Non-profit	MIT, Harvard University, Boston University, UC Berkeley, Kyoto University, Australian National University, University of Adelaide, University of Queensland, IIT Bombay, IIM Bangalore, Dartmouth College, Universidad Autonoma de Madrid, Curtin University, Cornell University	USA	2012	All rights reserved
iversity[37]	Commercial	Universidad Autonoma de Madrid, University of Florence, University of Hamburg	EU	2013
One Month	Commercial	School of Visual Arts	USA	2013
NovoEd	Commercial	Stanford University, Wharton, Princeton, Darden, Comcast, Carnegie Foundation, Universidad Católica de Chile	USA	2013
Coursmos	Commercial	Stanford University, Draper University, MIT	USA	2014
Open2Study[62][63]	Commercial	James Cook University, Griffith University, University of Wollongong, Flinders University, RMIT University, Central Institute of Technology, Sydney Institute, University of Western Sydney, Polytechnic West, Macquarie Graduate School of Management, Swinburne University of Technology, University of Newcastle, Jordan University of Science and Technology, University of Tasmania, International College of Management, Sydney, Massey University, Macquarie University, South China University of Technology, TAFE SA, Curtin University	Australia	2013
Kadenze	Commercial	Stanford University, Princeton University, UCLA, California Institute of the Arts, School of Art Institute of Chicago, Maryland Institute College of Art, California College of Art, Goldsmiths College, MassArt, Seoul Institute of the Arts, Paris College of Art, National University of Singapore, Cornish College of Art, University of Texas at Austin	USA	2015	Free for registered users, different course licenses.
POLHN	Non-profit	WHO, Pacific Ministries of Health[64]	Western Pacific Region	2005	Free courses, free software
ALISON	Commercial	N/A	Ireland	2007
Lynda.com	Commercial	N/A	USA	1995
Shaw Academy	Commercial	N/A	Ireland	2013
Udemy	Commercial	Strayer University	USA	2010
Skillshare	Commercial	N/A	USA	2010
Marketing and Networking University	Commercial	N/A	USA	2015	Business only courses

Emergence of innovative courses

Early cMOOCs such as CCK08 and ds106 used innovative pedagogy, with distributed learning materials rather than a video-lecture format, and a focus on education and learning, and digital storytelling respectively^{[11][12][13][14][15][16]}

Following the 2011 launch of three stanford xMOOCs, including Introduction Into AI, launched by Sebastian Thrun and Peter Norvig^[42] a number of other innovative courses have emerged. As of May 2014, more than 900 MOOCs are offered by US universities and colleges. As of February 2013 dozens of universities had affiliated with MOOCs, including many international institutions.^[37][65] In addition, some organisations operate their own MOOCs – including Google's Power Search.

A range of courses have emerged; "There was a real question of whether this would work for humanities and social science", said Ng. However, psychology and philosophy courses are among Coursera's most popular. Student feedback and completion rates suggest that they are as successful as math and science courses ^[66] even though the corresponding completion rates are lower.^[7]

In January 2012, University of Helsinki launched a Finnish MOOC in programming. The MOOC is used as a way to offer high-schools the opportunity to provide programming courses for their students, even if no local premises or faculty that can organize such courses exist.^[67] The course has been offered recurringly, and the top-performing students are admitted to a BSc and MSc program in Computer Science at the University of Helsinki.^[67][68] At a meeting on E-Learning and MOOCs, Jaakko Kurhila, Head of studies for University of Helsinki, Department of Computer Science, claimed that to date, there has been over 8000 participants in their MOOCs altogether.^[69]

On 18 June 2012, Ali Lemus from Galileo University^[70] launched the first Latin American MOOC titled "Desarrollando Aplicaciones para iPhone y iPad"^[71] This MOOC is a Spanish remix of Stanford University's popular "CS 193P iPhone Application Development" and had 5,380 students enrolled. The technology used to host the MOOC was the Galileo Educational System platform (GES) which is based on the .LRN project.^[72]

"Gender Through Comic Books" was a course taught by Ball State University's Christina Blanch on Instructure's Canvas Network, a MOOC platform launched in November 2012.^[73] The course used examples from comic books to teach academic concepts about gender and perceptions.^[74]

In November 2012, the University of Miami launched its first high school MOOC as part of Global Academy, its online high school. The course became available for high school students preparing for the SAT Subject Test in biology.^[75]

During the Spring 2013 semester, Cathy Davidson and Dan Ariely taught the "Surprise Endings: Social Science and Literature" a SPOC course taught in-person at Duke University and also as a MOOC, with students from Duke running the online discussions.^[2]

In the UK of summer 2013, Physiopedia ran their first MOOC regarding Professional Ethics in collaboration with University of the Western Cape in South Africa.^[76] This was followed by a second course in 2014, Physiotherapy Management of Spinal Cord Injuries, which was accredited by the World Confederation of Physical Therapy and attracted approximately 4000 participants with a 40% completion rate.^[77][78] Physiopedia is the first provider of physiotherapy/physical therapy MOOCs, accessible to participants worldwide.^[79]

In March 2013, Coursolve piloted a crowdsourced business strategy course for 100 organizations with the University of Virginia.^[80] A data science MOOC began in May 2013.^[81]

In May 2013 Coursera announced free e-books for some courses in partnership with Chegg, an online textbook-rental company. Students would use Chegg's e-reader, which limits copying and printing and could use the book only while enrolled in the class.^[82]

In June 2013, the University of North Carolina at Chapel Hill launched Skynet University,^[83] which offers MOOCs on introductory astronomy. Participants gain access to the university's global network of robotic telescopes, including those in the Chilean Andes and Australia.

In July 2013 the University of Tasmania launched Understanding Dementia, the world's first Dementia MOOC. With one of the world's highest completion rates (39%),^[84] the course was recognized in the journal Nature.^[85]

Startup Veduca^[86] launched the first MOOCs in Brazil, in partnership with the University of São Paulo in June 2013. The first two courses were Basic Physics, taught by Vanderlei Salvador Bagnato, and Probability and Statistics, taught by Melvin Cymbalista and André Leme Fleury.^[87] In the first two weeks following the launch at Polytechnic School of the University of São Paulo, more than 10,000 students enrolled.^[88][89]

Startup Wedubox (Finalist at MassChallenge 2013)^[90] launched the first MOOC in finance and third MOOC in Latam, the MOOC was created by Jorge Borrero (MBA Universidad de la Sabana) with the title "WACC and the cost of capital" it reached 2.500 students in Dec 2013 only 2 months after the launch.

In the fall 2014 Georgia Institute of Technology launched the first MOOD (massive online open degree) (Master's degree) in computer science for $7000 by partnering with Udacity and AT&T.^[91][92][93]

In September 2014, the high street retailer, Marks & Spencer partnered up with University of Leeds to construct an MOOC business course "which will use case studies from the Company Archive alongside research from the University to show how innovation and people are key to business success. The course will be offered by the UK based MOOC platform, FutureLearn.^[94]

On 16 March 2015, the University of Cape Town launched its first MOOC, Medicine and the Arts on the UK-led platform, Futurelearn.^[95]

In July 2015, OpenClassrooms, jointly with IESA Multimedia, launches first MOOC-based Bachelor degree in multimedia project management, recognized by French state.^[96]

The Pacific Open Learning Health Net, set up by the WHO in 2003, developed an online learning platform in 2004-5 for continuing development of health professionals. Courses were originally delivered by Moodle, but were looking more like other MOOCs by 2012.^[97]

Student experience and pedagogy

Students served

By June 2012 more than 1.5 million people had registered for classes through Coursera, Udacity and/or edX.^[98][99] As of 2013, the range of students registered appears to be broad, diverse and non-traditional, but concentrated among English-speakers in rich countries. By March 2013, Coursera alone had registered about 2.8 million learners.^[51] By October 2013, Coursera enrollment continued to surge, surpassing 5 million, while edX had independently reached 1.3 million.^[66]

Coursera enrollees

Country	Percentage
United States	27.7%
India	8.8%
Brazil	5.1%
United Kingdom	4.4%
Spain	4.0%
Canada	3.6%
Australia	2.3%
Russia	2.2%
Rest of world	41.9%

A course billed as "Asia's first MOOC" given by the Hong Kong University of Science and Technology through Coursera starting in April 2013 registered 17,000 students. About 60% were from "rich countries" with many of the rest from middle-income countries in Asia, South Africa, Brazil or Mexico. Fewer students enrolled from areas with more limited access to the internet, and students from the People's Republic of China may have been discouraged by Chinese government policies.^[100]

Koller stated in May 2013 that a majority of the people taking Coursera courses had already earned college degrees.^[101]

According to a Stanford University study of a more general group of students "active learners" – anybody who participated beyond just registering – found that 64% of high school active learners were male and 88% were male for undergraduate- and graduate-level courses.^[102]

A study from Stanford University's Learning Analytics group identified four types of students: auditors, who watched video throughout the course, but took few quizzes or exams; completers, who viewed most lectures and took part in most assessments; disengaged learners, who quickly dropped the course; and sampling learners, who might only occasionally watch lectures.^[102] They identified the following percentages in each group:^[103]

Course	Auditing	Completing	Disengaging	Sampling
High school	6%	27%	29%	39%
Undergraduate	6%	8%	12%	74%
Graduate	9%	5%	6%	80%

Jonathan Haber focused on questions of what students are learning and student demographics. About half the students taking US courses are from other countries and do not speak English as their first language. He found some courses to be meaningful, especially about reading comprehension. Video lectures followed by multiple choice questions can be challenging since they are often the "right questions." Smaller discussion boards paradoxically offer the best conversations. Larger discussions can be "really, really thoughtful and really, really misguided", with long discussions becoming rehashes or "the same old stale left/right debate."^[104]

MIT and Stanford University offered initial MOOCs in Computer Science and Electrical Engineering. Since engineering courses need prerequisites so at the outset upper-level engineering courses were nearly absent from the MOOC list. Now several universities are presenting undergraduate and advanced-level engineering courses.^{[105][106][107]}

Educator experience

In 2013, the Chronicle of Higher Education surveyed 103 professors who had taught MOOCs. "Typically a professor spent over 100 hours on his MOOC before it even started, by recording online lecture videos and doing other preparation", though some instructors' pre-class preparation was "a few dozen hours." The professors then spent 8–10 hours per week on the course, including participation in discussion forums.^[108]

The medians were: 33,000 students enrollees; 2,600 passing; and 1 teaching assistant helping with the class. 74% of the classes used automated grading, and 34% used peer grading. 97% of the instructors used original videos, 75% used open educational resources and 27% used other resources. 9% of the classes required a physical textbook and 5% required an e-book.^[108][109]

Unlike traditional courses, MOOCs require additional skills, provided by videographers, instructional designers, IT specialists and platform specialists. Georgia Tech professor Karen Head reports that 19 people work on their MOOCs and that more are needed.^[110] The platforms have availability requirements similar to media/content sharing websites, due to the large number of enrollees. MOOCs typically use cloud computing and are often created with authoring systems. Authoring tools for the creation of MOOCs are specialized packages of educational software like Elicitus, IMC Content Studio and Lectora that are easy-to-use and support e-learning standards like SCORM and AICC.

Completion rates

Despite their potential to support learning and education, MOOCs have a major concern related to attrition rates and course drop out. Even though the number of learners who enroll in the courses tends to be in the thousands range, only a very small portion of the enrolled learners complete the course. According to the visualizations and analysis conducted by Katy Jordan (2015),^[111] the investigated MOOCs have a typical enrollment of 25,000, even though enrollment has reached a value up to ~230,000. Jordan reports that the average completion rate for such MOOCs is approximately 15%. Early data from Coursera suggest a completion rate of 7%–9%.^[112] Coffrin et al. (2012)^[113] report the completion rates are even lower (between 3 and 5%), while they say there is a consistent and noticeable decline in the number of students who participate in the course every week. Others^{[112][114][115][116][117]} have also shown attrition rates similar to Coffrin. One example is the course Bioelectricity, in the Fall of 2012 at Duke University, where 12,725 students enrolled, but only 7,761 ever watched a video, 3,658 attempted a quiz, 345 attempted the final exam, and 313 passed, earning a certificate.^[118][119] Students paying $50 for a feature (designed to prevent cheating on exams) have completion rates of about 70%.^[120] Yang et al. (2013)^[121] suggest that even though there is a large proportion of students who drop out early on due to a variety of reasons, there is a significant proportion of the students who remain in the course and drop out later, thus causing attrition to happen over time.

Much research has investigated why students drop out of MOOC courses or what factors could contribute to them dropping out. For example, Rosé et al. (2014)^[122] investigate how three social factors make predictions on student attrition, for students who participated in the course discussion forum. The authors found that students who serve as authorities in the community seem to be more committed to the community and thus less inclined to drop out the course. In addition, students who actively participated in the course since the first week were 35% less likely to drop out of the course, compared with the average population. Lastly, the analysis of the patterns of attrition in a sub community showed that attrition was related to the engagement of the particular students with one another. One interpretation of this finding according to Rosé et al. (2014)^[122] is that while participating in MOOCs, students create virtual cohorts who progress and engage with the material in similar ways. Thus, if students start dropping out, then that might cause other students to drop out as they might perceive the environment as less supportive or engaging without their peers.

Other studies focus on exploring how motivation and self-regulated learning could be related to MOOC dropout and attrition. Carson (2002)^[123] investigated characteristics of self-directed learning in students of grades 8-12 who took online courses through a statewide online program. Two of the hypothesis that the study explored were whether there exist underlying distinct classes (categories) of self-regulated learners and if the membership in these classes was associated with measures such significantly different online course completion, online final grade, or GPA. The results show that there exist different latent classes of self-regulated learning within the population of online students, designated as high, moderate, and low self-directed learning. In addition, the results support the hypothesis that there is an association between the self-directed learning class the student belongs to with the significantly different course completion rate or course achievement (course achievement was measured by the completion of the online courses, the final online course grade and the cumulative GPA). In other words, course completion and self-directed learning in students were found to be significantly related.

One online survey published a "top ten" list of reasons for dropping out of a MOOC.^[124] The list involved reasons such as the course required too much time, or was too difficult or too basic. Reasons related to poor course design included "lecture fatigue" from courses that were just lecture videos, lack of a proper introduction to course technology and format, clunky technology and abuse on discussion boards. Hidden costs were cited, including required readings from expensive textbooks written by the instructor that also significantly limited students' access to learning material.^[7] Other non-completers were "just shopping around" when they registered, or were participating for knowledge rather than a credential. Other reasons for the poor completion rates include the workload, length and difficulty of a course.^[7] In addition, some participants participate peripherally ("lurk"). For example, one of the first MOOCs in 2008 had 2200 registered members, of whom 150 actively interacted at various times.^[125]

The effectiveness of MOOCs is an open question as completion rates are substantially less than traditional online education courses.^[126][127] Alraimi et al. (2015) explained in their research model a substantial percentage of the variance for the intention to continue using MOOCs, which is significantly influenced by perceived reputation, perceived openness, perceived usefulness, and perceived user satisfaction. Perceived reputation and perceived openness were the strongest predictors and have not previously been examined in the context of MOOCs

However research indicates that completion rates is not the right metric to measure success of MOOCs. Alternate metrics are proposed to measure effectiveness of MOOCs and online learning.^[127]

Instructional design

External video

10 Steps to Developing an Online Course: Walter Sinnott-Armstrong on YouTube, Duke University[128]

Designing, developing and running (Massive) Online Courses by George Siemens, Athabasca University[129]

Many MOOCs use video lectures, employing the old form of teaching (lecturing) using a new technology.^[126][130] Thrun testified before the President’s Council of Advisors on Science and Technology (PCAST) that MOOC "courses are 'designed to be challenges,' not lectures, and the amount of data generated from these assessments can be evaluated 'massively using machine learning' at work behind the scenes. This approach, he said, dispels 'the medieval set of myths' guiding teacher efficacy and student outcomes, and replaces it with evidence-based, 'modern, data-driven' educational methodologies that may be the instruments responsible for a 'fundamental transformation of education' itself".^[131]

Some view the videos and other material produced by the MOOC as the next form of the textbook. "MOOC is the new textbook", according to David Finegold of Rutgers University.^[132] A study of edX student habits found that certificate-earning students generally stop watching videos longer than 6 to 9 minutes. They viewed the first 4.4 minutes (median) of 12- to 15-minute videos.^[133] Some traditional schools blend online and offline learning, sometimes called flipped classrooms. Students watch lectures online at home and work on projects and interact with faculty while in class. Such hybrids can even improve student performance in traditional in-person classes. One fall 2012 test by San Jose State and edX found that incorporating content from an online course into a for-credit campus-based course increased pass rates to 91% from as low as 55% without the online component. "We do not recommend selecting an online-only experience over a blended learning experience", says Coursera's Andrew Ng.^[66]

Because of massive enrollments, MOOCs require instructional design that facilitates large-scale feedback and interaction. The two basic approaches are:

• Peer-review and group collaboration
• Automated feedback through objective, online assessments, e.g. quizzes and exams^[134] Machine grading of written assignments is also underway.^[135]

So-called connectivist MOOCs rely on the former approach; broadcast MOOCs rely more on the latter.^[136] This marks a key distinction between cMOOCs where the 'C' stands for 'connectivist', and xMOOCs where the x stands for extended (as in TEDx, edX) and represents that the MOOC is designed to be in addition to something else (university courses for example).^[137]

Assessment can be the most difficult activity to conduct online, and online assessments can be quite different from the bricks-and-mortar version.^[134] Special attention has been devoted to proctoring and cheating.^[138]

Peer review is often based upon sample answers or rubrics, which guide the grader on how many points to award different answers. These rubrics cannot be as complex for peer grading as for teaching assistants. Students are expected to learn via grading others^[139] and become more engaged with the course.^[7] Exams may be proctored at regional testing centers. Other methods, including "eavesdropping technologies worthy of the C.I.A." allow testing at home or office, by using webcams, or monitoring mouse clicks and typing styles.^[138] Special techniques such as adaptive testing may be used, where the test tailors itself given the student's previous answers, giving harder or easier questions accordingly.

"The most important thing that helps students succeed in an online course is interpersonal interaction and support", says Shanna Smith Jaggars, assistant director of Columbia University's Community College Research Center. Her research compared online-only and face-to-face learning in studies of community-college students and faculty in Virginia and Washington state. Among her findings: In Virginia, 32% of students failed or withdrew from for-credit online courses, compared with 19% for equivalent in-person courses.^[66]

Assigning mentors to students is another interaction-enhancing technique.^[66] In 2013 Harvard offered a popular class, The Ancient Greek Hero, instructed by Gregory Nagy and taken by thousands of Harvard students over prior decades. It appealed to alumni to volunteer as online mentors and discussion group managers. About 10 former teaching fellows also volunteered. The task of the volunteers, which required 3–5 hours per week, was to focus online class discussion. The edX course registered 27,000 students.^[140]

Research by Kop and Fournier^[141] highlighted as major challenges the lack of social presence and the high level of autonomy required. Techniques for maintaining connection with students include adding audio comments on assignments instead of writing them, participating with students in the discussion forums, asking brief questions in the middle of the lecture, updating weekly videos about the course and sending congratulatory emails on prior accomplishments to students who are slightly behind.^[66] Grading by peer review has had mixed results. In one example, three fellow students grade one assignment for each assignment that they submit. The grading key or rubric tends to focus the grading, but discourages more creative writing.^[104]

A. J. Jacobs in an op-ed in the New York Times graded his experience in 11 MOOC classes overall as a "B".^[142] He rated his professors as '"B+", despite "a couple of clunkers", even comparing them to pop stars and "A-list celebrity professors." Nevertheless, he rated teacher-to-student interaction as a "D" since he had almost no contact with the professors. The highest rated ("A") aspect of Jacobs' experience was the ability to watch videos at any time. Student-to-student interaction and assignments both received "B-". Study groups that didn't meet, trolls on message boards and the relative slowness of online vs. personal conversations lowered that rating. Assignments included multiple choice quizzes and exams as well as essays and projects. He found the multiple choice tests stressful and peer graded essays painful. He completed only 2 of the 11 classes.^[142][143]

Industry

MOOCs are widely seen as a major part of a larger disruptive innovation taking place in higher education.^{[144][145][146]} In particular, the many services offered under traditional university business models are predicted to become unbundled and sold to students individually or in newly formed bundles.^[147][148] These services include research, curriculum design, content generation (such as textbooks), teaching, assessment and certification (such as granting degrees) and student placement. MOOCs threaten existing business models by potentially selling teaching, assessment, and/or placement separately from the current package of services.^{[144][149][150]}

President Barack Obama has cited recent developments, including the online learning innovations at Carnegie Mellon University, Arizona State University and Georgia Institute of Technology, as having potential to reduce the rising costs of higher education.^[151]

James Mazoue, Director of Online Programs at Wayne State University describes one possible innovation:

The next disruptor will likely mark a tipping point: an entirely free online curriculum leading to a degree from an accredited institution. With this new business model, students might still have to pay to certify their credentials, but not for the process leading to their acquisition. If free access to a degree-granting curriculum were to occur, the business model of higher education would dramatically and irreversibly change.^[152]

But how universities will benefit by "giving our product away free online" is unclear.^[153]

No one's got the model that's going to work yet. I expect all the current ventures to fail, because the expectations are too high. People think something will catch on like wildfire. But more likely, it's maybe a decade later that somebody figures out how to do it and make money.

— James Grimmelmann, New York Law School professor^[153]

Principles of openness inform the creation, structure and operation of MOOCs. The extent to which practices of Open Design in educational technology^[154] are applied vary.

Attributes of major MOOC providers,^[155] with update ^[156]

Initiatives	For profit	Free to access	Certification fee	Institutional credits
edX	No	Yes	Yes	No
Coursera	Yes	Partial	Yes	Partial
Udacity	Yes	Yes	Yes	Partial
Udemy	Yes	Partial	Yes	Partial
P2PU	No	Yes	No	No

Fee opportunities

In the freemium business model the basic product – the course content – is given away free. "Charging for content would be a tragedy", said Andrew Ng. But "premium" services such as certification or placement would be charged a fee - however financial aids are given in some cases.^[51]

Course developers could charge licensing fees for educational institutions that use its materials. Introductory or "gateway" courses and some remedial courses may earn the most fees. Free introductory courses may attract new students to follow-on fee-charging classes. Blended courses supplement MOOC material with face-to-face instruction. Providers can charge employers for recruiting its students. Students may be able to pay to take a proctored exam to earn transfer credit at a degree-granting university, or for certificates of completion.^[153] Udemy allows teachers to sell online courses, with the course creators keeping 70–85% of the proceeds and intellectual property rights.^[157]

Coursera found that students who paid $30 to $90 were substantially more likely to finish the course. The fee was ostensibly for the company's identity-verification program, which confirms that they took and passed a course.^[66]

Overview of potential revenue sources for three MOOC providers^[158][159]

edX	Coursera	UDACITY
Certification	Certification Secure assessments Employee recruitment Applicant screening Human tutoring or assignment marking Enterprises pay to run their own training courses Sponsorships Tuition fees Transcript services (not disclosed to students yet)	Certification Employers paying to recruit talented students Students' résumés and job match services Sponsored high-tech skills courses

In February 2013 the American Council on Education (ACE) recommended that its members provide transfer credit from a few MOOC courses, though even the universities who deliver the courses had said that they would not.^[160] The University of Wisconsin offered multiple, competency-based bachelor's and master's degrees starting Fall 2013, the first public university to do so on a system-wide basis. The university encouraged students to take online-courses such as MOOCs and complete assessment tests at the university to receive credit. As of 2013 few students had applied for college credit for MOOC classes. Colorado State University-Global Campus received no applications in the year after they offered the option.^[161]

Academic Partnerships is a company that helps public universities move their courses online. According to its chairman, Randy Best, "We started it, frankly, as a campaign to grow enrollment. But 72 to 84 percent of those who did the first course came back and paid to take the second course."^[162]

While Coursera takes a larger cut of any revenue generated – but requires no minimum payment – the not-for-profit edX has a minimum required payment from course providers, but takes a smaller cut of any revenues, tied to the amount of support required for each course.^[163]

Benefits

Improving access to Higher Education

MOOCs are regarded by many as an important tool to widen access to Higher Education (HE) for millions of people, including those in the developing world, and ultimately enhance their quality of life. MOOCs may be regarded as contributing to the democratisation of HE, not only locally or regionally but globally as well. MOOCs can help democratise content and make knowledge reachable for everyone. Students are able to access complete courses offered by universities all over the world, something previously unattainable. With the availability of affordable technologies, MOOCs increase access to an extraordinary number of courses offered by world-renowned institutions and teachers.^[164]

Providing an affordable alternative to formal education

The costs of tertiary education continue to increase because institutions tend to bundle too many services. With MOOCs, some of these services can be transferred to other suitable players in the public or private sector. MOOCs are for large numbers of participants, can be accessed by anyone anywhere as long as they have an Internet connection, are open to everyone without entry quali cations and offer a full/complete course experience online for free.^[165][164]

Sustainable Development Goals

MOOCs can be seen as a form of open education offered for free through online platforms. The (initial) philosophy of MOOCs is to open up quality Higher Education to a wider audience. As such, MOOCs are an important tool to achieve Goal 4 of the 2030 Agenda for Sustainable Development.^[164]

Challenges and criticisms

The MOOC Guide^[166] suggests six possible challenges for cMOOCs:

1. Relying on user-generated content can create a chaotic learning environment
2. Digital literacy is necessary to make use of the online materials
3. The time and effort required from participants may exceed what students are willing to commit to a free online course
4. Once the course is released, content will be reshaped and reinterpreted by the massive student body, making the course trajectory difficult for instructors to control
5. Participants must self-regulate and set their own goals
6. Language and translation barriers

These general challenges in effective MOOC development are accompanied by criticism by journalists and academics.

Robert Zemsky (2014) argues that they have passed their peak: "They came; they conquered very little; and now they face substantially diminished prospects."^[167] Others have pointed to a backlash arising from the tiny completion rates.^[168]

Some dispute that the "territorial" dimensions of MOOCs^[169] have received insufficient discussion or data-backed analysis, namely: 1. the true geographical diversity of enrolls in/completes courses; 2. the implications of courses scaling across country borders, and potential difficulties with relevance and knowledge transfer; and 3. the need for territory-specific study of locally relevant issues and needs.

Other features associated with early MOOCs, such as open licensing of content, open structure and learning goals, and community-centeredness, may not be present in all MOOC projects.^[4]

Effects on the structure of higher education were lamented for example by Moshe Y. Vardi, who finds an "absence of serious pedagogy in MOOCs", and indeed in all of higher education. He criticized the format of "short, unsophisticated video chunks, interleaved with online quizzes, and accompanied by social networking." An underlying reason is simple cost cutting pressures, which could hamstring the higher education industry.^[170]

The changes predicted from MOOCs generated objections in some quarters. The San Jose State University philosophy faculty wrote in an open letter to Harvard University professor and MOOC teacher Michael Sandel:

Should one-size-fits-all vendor-designed blended courses become the norm, we fear two classes of universities will be created: one, well-funded colleges and universities in which privileged students get their own real professor; the other, financially stressed private and public universities in which students watch a bunch of video-taped lectures.^[171]

Cary Nelson, former president of the American Association of University Professors claimed that MOOCs are not a reliable means of supplying credentials, stating that "It’s fine to put lectures online, but this plan only degrades degree programs if it plans to substitute for them." Sandra Schroeder, chair of the Higher Education Program and Policy Council for the American Federation of Teachers expressed concern that "These students are not likely to succeed without the structure of a strong and sequenced academic program."^[172]

With a 60% majority, the Amherst College faculty rejected the opportunity to work with edX based on a perceived incompatibility with their seminar-style classes and personalized feedback. Some were concerned about issues such as the "information dispensing" teaching model of lectures followed by exams, the use of multiple-choice exams and peer-grading. The Duke University faculty took a similar stance in the spring of 2013. The effect of MOOCs on second- and third-tier institutions and of creating a professorial "star system" were among other concerns.^[135]

At least one alternative to MOOCs has advocates: Distributed open collaborative courses (DOCC) challenge the roles of the instructor, hierarchy, money and massiveness. DOCC recognizes that the pursuit of knowledge may be achieved better by not using a centralized singular syllabus, that expertise is distributed throughout all the participants and does not just reside with one or two individuals.^[173]

Another alternative to MOOCs is the Self-Paced Online Course (SPOC) which provides a high degree of flexibility. Students can decide on their own pace and with which session they would like to begin their studies. According to a report by Class Central founder Dhawal Shah, more than 800 self-paced courses have been available in 2015.^[174]

Although the purpose of MOOCs is ultimately to educate more people, recent criticisms include accessibility and a Westernized curriculum that lead to a failure to reach the same audiences marginalised by traditional methods.^[175]

MOOCs have been criticized for a perceived lack of academic rigor as well as the monetization strategies adopted by providers. In MOOCs: A University Qualification in 24 Hours? Michael Shea writes "By offering courses that are near-impossible to fail and charging up front fees for worthless certificates, Coursera is simply running a high-tech version of the kind of scams that have been run by correspondence colleges for decades."^[176]

Some believe that the MOOC movement is a fad, and/ or a good means of industrialising Higher Education (HE), and/or another manifestation of Western colonisation,^[177] whilst others see it as a threat to traditional HEIs.^[178][164]

The experience of English Language Learners (ELLs) in MOOCs

Language of instruction is one of the major barriers that ELLs face in MOOCs. In recent estimates, almost 75% of MOOC courses are presented in the English language, however, native English speakers are a minority among the world's population.^[179] This issue is mediated by the increasing popularity of English as a global language, and therefore has more second language speakers than any other language in the world.^[180] This barrier has encouraged content developers and other MOOC stakeholders to develop content in other popular languages to increase MOOC access. However, research studies show that some ELLs prefer to take MOOCs in English, despite the language challenges, as it promotes their goals of Economic, Social, and Geographic mobility.^[181] This emphasizes the need to not only provide MOOC content in other languages, but also to develop English language interventions for ELLs who participate in English MOOCs.

Areas that ELLs particularly struggle with in English MOOCs include MOOC content without corresponding visual supporting materials^[182] (e.g., an instructor narrating instruction without text support in the background), or their hesitation to participate in MOOC discussion forums.^[183] Active participation in MOOC discussion forums has been found to improve students grades, their engagement, and leads to lower dropout rates,^[184] however, ELLs are more likely to be spectators than active contributors in discussion forums.^[183]

 

Researching studies show a “complex mix of affective, socio-cultural, and educational factors” that are inhibitors to their active participation in discussion forums.^[185] As expected, English as the language of communication poses both linguistic and cultural challenges for ELLs, and they may not be confident in their English language communication abilities.^[186] Discussion forums may also be an uncomfortable means of communication especially for ELLs from Confucian cultures, where disagreement and arguing one’s points are often viewed as confrontational, and harmony is promoted.^[187] Therefore, while ELLs may be perceived as being uninterested in participating, research studies show that they do not show the same hesitation in face to face discourse.^[188][189] Finally, ELLs may come from high power distance cultures,^[190] where teachers are regarded as authority figures, and the culture of back and forth conversations between teachers and students are not a cultural norm.^[188][189] As a result, discussion forums with active participation from the instructors may cause discomfort and prevent participation for students from such cultures.

See also

• Language MOOC
• Outcome-based education
• OpenCourseWare
• Saylor Foundation
• Small private online course
• Qualifications frameworks for online learning
• Open educational resources in Canada

Sources

This article incorporates text from a free content work. Licensed under CC-BY-SA IGO 3.0 Licence statement: Making Sense of MOOCs: A Guide for Policy-Makers in Developing Countries, 17-18, 21-22, 24, Patru, Mariana; Balaji, Venkataraman, UNESCO. UNESCO. To learn how to add open-license text to Wikipedia articles, please see Wikipedia:Adding open license text to Wikipedia.

References

Further reading

Wikimedia Commons has media related to Massive Open Online Course.

• Walsh, Taylor (2011). Unlocking the Gates: How and Why Leading Universities Are Opening Up Access to Their Courses. Princeton University Press. ISBN 978-0-691-14874-8.