General feedback and discussions on the proposed survey
The idea is not to make formative or summative assessment a requirement for MOOC participation or indeed a feature of the MOOC pedagogy.
Presumably there are learners who enrol and participate in MOOCs because they are free and open. The concept of the OERu university is to scale up the for-credit option to learners who may choose to gain formal academic credit for a MOOC course. Typically the numbers of for-credit options are capped and normal student fees apply.
The OERu will be implementing an option for participants who would like to formerly acquire credentialisation after completion of the MOOC or at some date in the future - -we are aiming to provide pathways to for MOOC learning to be formerly recognised.
The idea is that the institutional costs of assessment will be recouped by the participating institutions on a cost recovery basis -- which will be far cheaper than full tuition fees. We estimate in New Zealand that costs of assessment would not be more than around 20% of the cost of full tuition.
The OERu partners have not planned the details for the assessment model yet -- but I expect we will integrate the experience of distance education providers who have been providing assessment and credential services at a distance for a long time. I suspect e-portfolios would also be useful in providing evidence of the learning process.
Any suggestions or ideas on how to improve the formulation of the relevant questions to convey what they are intended to mean?
Thanks Wayne for your explanation. If we want to know how other institutions have assessed credit-seeking students taking a MOOC or MOOCish-type of course, why not just ask the institutions? Start putting together some keystone assessments (and related instruments) that are meaningful and relevant to the student but based on the type of MOOC being considered and go with that.
Assessment gets a little slippery because assessment and instruction are (or should be) so closely integrated - at least they will be in most MOOCs. Learners oftentimes fail to distinguish the difference between testing, evaluation, and assessment, plus they might be influenced (positively or negatively) by any of these notions based on a prior experience with a teacher. For this reason, I'm not sure if asking the learners about assessment will get the intended results (I could be wrong.).
Instead of using words like assessment, evaluation, or testing, let's just ask them if they've ever used a blog, wiki, eportfolio, etc.
If we create a questionnaire for institutions, that would be a different story.
Any other thoughts?
Absolutely - -the OERu anchor partners will definitely be speaking with the institutions who have presented MOOCs with for-credit options and find out what assessment models and approaches were used.
I also agree that valid and reliable assessment is a complex area and is closely related and part of the overall pedagogy deployed.
I agree with your sentiments by asking folk if they've ever used a blog, wiki or portfolio and am planning to include a question in this survey relating to usage / experience with this media.
Lots of work still needed in planning the OERu -- but on the positive side we are doing this and currently based on our anchor partners we will be able to provide accrediting options for OER learners in New Zealand, Australia, Canada and the US at this time.