MOOC Completion rates matter?

A while back I came across a post by Martin Weller titled MOOC Completion rates DO matter. Because my Pocket account was overflowing with some great content (including this one), I thought it was high time that I read this article ;-).  In this short post Martin writes that completion rates do matter in MOOCs, taking the opposite view of some cMOOC folks. 

He goes on to tackle the analogy that MOOCs are like newspapers and that people don't necessarily read all sections, or even visit all sections.  As someone who doesn't really read physical newspapers that often any more (I only bought one last summer so I could get the Asterix comic that came with it), the analogy only gets me so far.

I don't know what sort of analogy is valid for MOOC participant behaviors.  After pondering this a bit, I don't think that there is one analogy that will encompass all behaviors.  At the beginning of the MOOC I think the analogy of window shopping is most appropriate for everything leading up to the conclusion of the first (or maybe even the second) week of the course.  I think that there are many people who are curious about the course and join it, regardless of their intents for the course.  Coursera and EdX have gotten a little smarter these past few months and query their users to see what their intents are for the course right at the beginning of the course.  Are they interested in just browsing the content? browsing the content and taking some quizzes? doing the assignments? going full force into the course?  I think this is smart, because at the onset of the course you have idea of what the participants in the course are intending to do (assuming that they are truthful in their answers).

This only goes so far, however.  Back in the days of Change11 I had pondered about having a nag-system (for lack of a better term) that would keep track of user logons in the system, and track their patterns of participation.  If they weren't active the system would send them a reminder email about the course, and see if they would like to unenroll, so there would be a perpetual Opt-In function for people who are not active. I think at this point I would also augment the system with highlights of upvoted posts and interesting discussions happening so as to entice people to come in and say something (or at least if they don't contribute something, they will be seen by the system as being active). Lurking isn't bad, everyone lurks from time to time, it's not possible to fully engaged all the time, in each course you take.  You do need time to let things steep.  Especially in MOOCs you might have multiple conflicting priorities and need to put the MOOC on the back burner for a few days. That said, the point of the system is to separate those who are passive participants (aka lurkers), from those who are checked out (and not coming back), and from those who are on leave (not active for a week, but intend on coming back).

Then, at the end, it would be useful to have participants self-assess.  Those who took the initial survey should be surveyed again to see if they met their own expectations, or if they did or did not meet their own levels of engagement in the course.  The other points to ponder are theses:
  • Under whose rubric do we measure completion? The course designer certainly has some ideas about what it means to complete a course, however in an open course you don't control for enrollment, so you might have some people who are very under-prepared for the course, and some where the course is too basic for them.
  • Does completion equate with learning?  These two aren't necessarily the same. Going back to the case where the participants already have the knowledge, but don't know it here's something from my own experience:  I was in two courses, one in coursera, and one in edx.  I signed up to learn something new, only to find out at the end of Week 1 that things seemed a bit basic.  I ended up taking the quizzes for these two courses in advance for subsequent weeks (they were available) and I passed with high 90s without viewing any subsequent lectures past week 1.  I completed the courses, but did I learn anything (new)?  The answer is no.
  • Who does completion matter to? I know institutions who subsidize these want to see some ROI, but ultimate, in an open course (where there is no formal grade or credit for that grade), doesn't the participant sit in the drive seat to determine whether they've completed the course or not (to their own satisfaction)?

Do completion rates matter?  I think they do, however in certain specific contexts.  Not all contexts are the same!  What do you think?




comic from: http://completelyseriouscomics.com/comics/2011-01-29-Pondering.jpg

Comments

Apostolos K. ("AK") said…
Lots of xMOOCs want people to start thinking of the institution and I think the courses are basically free samples placing the schools "product" in people's minds. For me if I'm told what the course is about, how it runs and I pass it's the kind of proof that passes for knowledge. Generally, with the parchment I'll never be asked to account for what I learned because most people consider attendance at a place of education as education itself.


Because cMOOCs are not supported by easy to identify labels there's the weight of accountability that scares people off. "What did you learn?" IS asked and because you have no parchment you better have an answer.



Time has something to do with it too. A great deal of my learning happens after a course. I process things slowly anyway and have to MAKE what I "learned" plausible to myself so it fits somewhere. Completion (as in all things) is likely less important than participation to sink things into me. Plus MOOCs are done for my own learning and I don't care to prove anything to anyone else by taking them.



Acting as a discussion forum "monitor" in a couple of MOOCs I have noticed that people will come back in if you capture their interest and reassure them the material that are "behind" on (most common defeat I've heard for dropping out) is less important than right-now participation. Be there dude!
August 29, 2014 at 6:33 PM
Post a Comment

Popular posts from this blog

Latour: Third Source of Uncertainty - Objects have agency too!

Image
Continuing on my exploration of ANT, and asynchronous and indirect dialogue with Latour - this blog post will cover the third source of uncertainty, which according to Latour, is that Objects have agency too! As with the previous blog posts, I've pulled out quotes from the book that seemed interesting, or that I reacted to in some way, and I am responding to them here. no tie can be said to be durable and made of social stuff (p. 66) This quote seems to continue Latour's assertion that there is no such thing as "social" or "social stuff" and that "social", or the meaning of needs to be negotiated and better understood.  It also continues the thought that social can only be seen from the actions of its actors, the traces they leave behind, and that these bonds are not durable because they need continuous reinforcement. I guess Social is a perishable item. Left to its own devices, a power relationship that mobilizes nothing but social skil
Read more

MOOC participation - open door policy and analytics

The other day I was reading ZML Didaktik on the topic of MOOC participants. In MOOCs, one of the big questions is why are people lurking and not participating? If more than 500 people join a MOOC, why are only 10% contributing with any amount of regularity?  On the same blog, in a previous blog post, I had commented (it was an open stream of thought really) that perhaps there should be an open enrollment period, and then if the system sees that certain participants are bellow a threshold of activity, the system may give them the option to self-identify as a lurker, or un-register from the class. This line of thought went along a view that compared to the traditional classroom; in a traditional classroom students register for the course, they can attend classes for a week and then decide whether or not they want to stay with the course or not. If they do stay with the course they know that there is a certain amount of "lurking" that they can get away with, but they do have
Read more

You've been punk'd! However, that was an educational experience

Image
It's now the end of Teaching Goes Massive: New Skills Required (aka #massiveteaching) on coursera. Well, almost, we still have a couple of days left. I guess that the lesson here is that we were (the "learners") were punk'd† by Paul-Olivier Dehaye of the Univerisity of Zurich. After that last blog post (and subsequent pickup of the post by George Siemens and others) Inside Higher Education and the Chronicle wanted to chat with me about this MOOC experience. I only had time for one of the two before things went to press, so my 15 minutes of fame went to IHE.  Both IHE and the C hronicle have written about the topic, and have received some information from Coursera on the incident.  Others have also written about it (see here , here and here ) It's surprising to me that the University, and Coursera, waited until after this thing was a big issue in order to respond in the class, and clue people into what was happening. On Wednesday (day 3 of Week 3/3 of the
Read more