Difference between revisions of "QA4ODFL2/Assessment/Rigour"

From WikiEducator
Jump to: navigation, search
 
(12 intermediate revisions by the same user not shown)
Line 1: Line 1:
As teachers, you probably know about the Bloom’s Taxonomy, a very important theory in teaching and learning. Figure 3 below reminds you of the six levels of the Taxonomy. If you want to learn more about the Theory you can find more information at the following link: ([https://media.citt.ufl.edu/resources/blooms/index.html/ https://media.citt.ufl.edu/resources/blooms/index.html])
+
As teachers, you probably know about the Bloom’s Taxonomy, a very important theory in teaching and learning. Figure 3 below reminds you of the six levels of the Taxonomy. If you want to learn more about the Theory you can find more information at the following link: ([https://media.citt.ufl.edu/resources/blooms/index.html /https://media.citt.ufl.edu/resources/blooms/index.html])
  
 
This theory is useful in designing teaching and learning that covers different levels of cognitive domains. In fact, it speaks to the knowledge and skills that one needs to cope with the challenges of work and life in general. For example, we do not need people who can only remember, or can only describe or explain. We need people who can do all these things and also analyse, evaluate and create. We need to cover these various cognitive skills when we design teaching and learning as much as we need to do so when we design assessment.
 
This theory is useful in designing teaching and learning that covers different levels of cognitive domains. In fact, it speaks to the knowledge and skills that one needs to cope with the challenges of work and life in general. For example, we do not need people who can only remember, or can only describe or explain. We need people who can do all these things and also analyse, evaluate and create. We need to cover these various cognitive skills when we design teaching and learning as much as we need to do so when we design assessment.
  
{| class="oeru1"
+
[[File:Bloom%27s_Revised_Taxonomy.jpg|700px]]
 +
 
 +
To ensure that you cover all the cognitive domains when you set an assessment test, you can use a matrix table like Table 5. The table shows how you can distribute the test items across the cognitive domains.
 +
 
 +
''Table 5: Matrix for analysing the cognitive levels in an assessment test''
 +
<div align="left">
 +
{| style="border-spacing:0;width:80%;"
 
|-
 
|-
!Topic
+
| style="border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;"|'''Topic'''
!Concept/ Skills
+
| style="border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;"|'''Concept/ Skills'''
!colspan="6"|Level
+
| style="border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;" colspan="6"| '''Level'''
!Number of items
+
| style="border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;"| '''Number of items'''
 
|-
 
|-
|Research problem/ Hypothesis
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="30%"| Research problem/ Hypothesis
|Understand research problem & formulate it
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="30%"| Understand research problem & formulate it
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="3%"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="3%"| 1
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="3%"|
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="3%"|
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="3%"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="3%"| 1
|2
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;" width="22%"| 2
 
|-
 
|-
|Research Topic
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Research Topic
|Rationale stating
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Rationale stating
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|3
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|3
 
|-
 
|-
|Research methodology
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Research methodology
|Types and importance
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Types and importance
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|2
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|2
|5
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|5
 
|-
 
|-
|Data instruments
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Data instruments
|Understand, create and apply
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Understand, create and apply
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|3
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|3
 
|-
 
|-
|Data analysis
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Data analysis
|Apply & create
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Apply & create
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|2
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|2
|3
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|3
 
|-
 
|-
|Report writing
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Report writing
|Understand, apply, analyse, evaluate & create
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Understand, apply, analyse, evaluate & create
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|4
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|4
 
|-
 
|-
|Total
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Total
|Understand research problem & formulate it
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|Understand research problem & formulate it
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|5
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|5
|4
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|4
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|1
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|1
|8
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|8
|20
+
| style="background-color:#bdd6ee;border:0.5pt solid #000000;padding-top:0in;padding-bottom:0in;padding-left:0.075in;padding-right:0.075in;;"|20
 
|-
 
|-
 
|}
 
|}
  
In Table 1, the numbers represent items that are under each level. For example, for methodology you have to remember, understand and apply different kinds of research methodology, and you might have to be more creative in using a particular methodology in your study. With data collection instruments you have to understand and apply some instruments, and you may have to create your own. Over the whole exercise you have quite a good balance across all the domains, and this makes your test well balanced in terms of coverage of the various cognitive levels.
+
</div>
 +
 
 +
 
 +
{{Button|text=[https://docs.google.com/document/d/1bBsqKYR4HdFR-HnpmzReS5_rXqSJgcO0/edit?usp=sharing&ouid=106951879739760621639&rtpof=true&sd=true Click here to download the word version of table 5]}}
 +
 
 +
In Table 5, the numbers represent items that are under each level. For example, for methodology you have to remember, understand and apply different kinds of research methodology, and you might have to be more creative in using a particular methodology in your study. With data collection instruments you have to understand and apply some instruments, and you may have to create your own. Over the whole exercise you have quite a good balance across all the domains, and this makes your test well balanced in terms of coverage of the various cognitive levels.
  
 
{{IDevice
 
{{IDevice
 
|theme=line
 
|theme=line
 
|type=Activity
 
|type=Activity
|title=Learning Activity 5
+
|title=Learning activity 5
 
|body=
 
|body=
#Choose any one of the assessment tasks that you have designed before for your learners. Use the matrix in Table 1 to analyse the assessment task.
+
 
 +
'''For the following questions, share one idea for improving the task in the discussion forum. Post your responses on the discussion forum on [https://forum.oeru.org/t/rigour-of-assessment/4255 QA4ODFL2 Discourse site].
 +
 
 +
#Choose any one of the assessment tasks that you have designed before for your learners. Use the matrix in Table 5 to analyse the assessment task.
 
#On the basis of your analysis, think about how you can improve the task.
 
#On the basis of your analysis, think about how you can improve the task.
#Share one idea for improving the task in the discussion forum.
+
 
 +
{{Button|text=[https://forum.oeru.org/t/rigour-of-assessment/4255 Click here to post your thoughts]}}
  
 
}}
 
}}
Line 102: Line 117:
  
 
Perhaps your task covered only one level of Blooms, or it only covered the lowest levels of remembering or understanding. Of course, you cannot cover all the domains in a single assessment task. Over a course you do want to progress to more advanced levels of cognitive demand, ideally starting with the low levels.
 
Perhaps your task covered only one level of Blooms, or it only covered the lowest levels of remembering or understanding. Of course, you cannot cover all the domains in a single assessment task. Over a course you do want to progress to more advanced levels of cognitive demand, ideally starting with the low levels.
When you improve your assessment task try to include more of the advanced levels of cognitive thinking, the applying analysing, evaluating and creating.  
+
When you improve your assessment task try to include more of the advanced levels of cognitive thinking, the applying, analysing, evaluating and creating.  
  
 
}}
 
}}

Latest revision as of 22:40, 8 October 2023

As teachers, you probably know about the Bloom’s Taxonomy, a very important theory in teaching and learning. Figure 3 below reminds you of the six levels of the Taxonomy. If you want to learn more about the Theory you can find more information at the following link: (/https://media.citt.ufl.edu/resources/blooms/index.html)

This theory is useful in designing teaching and learning that covers different levels of cognitive domains. In fact, it speaks to the knowledge and skills that one needs to cope with the challenges of work and life in general. For example, we do not need people who can only remember, or can only describe or explain. We need people who can do all these things and also analyse, evaluate and create. We need to cover these various cognitive skills when we design teaching and learning as much as we need to do so when we design assessment.

Bloom's Revised Taxonomy.jpg

To ensure that you cover all the cognitive domains when you set an assessment test, you can use a matrix table like Table 5. The table shows how you can distribute the test items across the cognitive domains.

Table 5: Matrix for analysing the cognitive levels in an assessment test

Topic Concept/ Skills Level Number of items
Research problem/ Hypothesis Understand research problem & formulate it 1 1 2
Research Topic Rationale stating 1 1 1 3
Research methodology Types and importance 1 1 1 2 5
Data instruments Understand, create and apply 1 1 1 3
Data analysis Apply & create 1 2 3
Report writing Understand, apply, analyse, evaluate & create 1 1 1 1 4
Total Understand research problem & formulate it 1 5 4 1 1 8 20


In Table 5, the numbers represent items that are under each level. For example, for methodology you have to remember, understand and apply different kinds of research methodology, and you might have to be more creative in using a particular methodology in your study. With data collection instruments you have to understand and apply some instruments, and you may have to create your own. Over the whole exercise you have quite a good balance across all the domains, and this makes your test well balanced in terms of coverage of the various cognitive levels.

Icon activity line.svg
Learning activity 5

For the following questions, share one idea for improving the task in the discussion forum. Post your responses on the discussion forum on QA4ODFL2 Discourse site.

  1. Choose any one of the assessment tasks that you have designed before for your learners. Use the matrix in Table 5 to analyse the assessment task.
  2. On the basis of your analysis, think about how you can improve the task.



Icon discussion line.svg
Reflection

Perhaps your task covered only one level of Blooms, or it only covered the lowest levels of remembering or understanding. Of course, you cannot cover all the domains in a single assessment task. Over a course you do want to progress to more advanced levels of cognitive demand, ideally starting with the low levels. When you improve your assessment task try to include more of the advanced levels of cognitive thinking, the applying, analysing, evaluating and creating.