Index

 

Table 4.1

Table 4.1 shows the unexpected responses, when a low ability person succeeds on a difficult item or a high ability person fails on an easy item. We can see that Student 996 is listed 3 times, twice for "Conclusion", and once for "Introduction". Thus, although this student was somewhat above average ability overall, these ratings were much lower than expected. If a video recording of the presentation is available, we might want to go back and watch it again to try to determine what caused the misfitting responses. It could be that this student just gave a poor introduction and conclusion, but it's also possible that these raters interpreted these rubric items somewhat differently, so we also need to investigate rater performance.

 

Table 4.1 Unexpected Responses (24 residuals sorted by u).
+-----------------------------------------------------------------+
| Cat  Score  Exp.  Resd StRes| Num  Stu Num  Rat Nu Items        |
|-----------------------------+-----------------------------------|
|  2     2     3.0  -1.0 -5.5 |  850 850  831 831  1 Introduction |
|  2     2     3.0  -1.0 -5.3 |  823 823  996 996  4 Structure    |
|  1     1     2.8  -1.8 -4.9 |  996 996  991 991  6 Conclusion   |
|  2     2     3.0  -1.0 -4.8 |  823 823  996 996  5 Explanations |
|  2     2     3.0  -1.0 -4.6 |  973 973  949 949  6 Conclusion   |
|  2     2     2.9   -.9 -4.2 |  831 831  823 823  1 Introduction |
|  2     2     2.9   -.9 -3.9 |  823 823  968 968  5 Explanations |
|  2     2     2.9   -.9 -3.9 |  991 991  790 790  8 Topic        |
|  2     2     2.9   -.9 -3.8 |  837 837  831 831  9 Overall      |
|  2     2     2.9   -.9 -3.8 |  996 996  949 949  6 Conclusion   |
|  2     2     2.9   -.9 -3.7 |  996 996  991 991  1 Introduction |
|  0     0     2.1  -2.1 -3.6 |  790 790    1 1    6 Conclusion   |
|  2     2     2.9   -.9 -3.6 |  831 831  850 850 10 Preparation  |
|  1     1     2.7  -1.7 -3.5 |  991 991  975 975  8 Topic        |
|  2     2     2.9   -.9 -3.4 |  973 973  991 991  8 Topic        |
|  0     0     2.0  -2.0 -3.3 |  975 975  790 790  3 Gestures     |
|  2     2     2.9   -.9 -3.2 |  823 823  837 837  2 Eyes         |
|  2     2     2.9   -.9 -3.2 |  831 831  823 823  8 Topic        |
|  2     2     2.9   -.9 -3.2 |  850 850  949 949  1 Introduction |
|  2     2     2.9   -.9 -3.2 |  915 915  996 996  1 Introduction |
|  2     2     2.9   -.9 -3.1 |  790 790  831 831  9 Overall      |
|  0     0     1.8  -1.8 -3.1 |  847 847    1 1    6 Conclusion   |
|  1     1     2.6  -1.6 -3.1 |  973 973    1 1    6 Conclusion   |
|  2     2     2.9   -.9 -3.1 |  991 991  790 790  6 Conclusion   |
|-----------------------------+-----------------------------------|
| Cat  Score  Exp.  Resd StRes| Num  Stu Num  Rat Nu Items        |
+-----------------------------------------------------------------+