Table 5 Bias analysis of rater and test-taker
From: Developing and evaluating a dynamic assessment of listening comprehension in an EFL context
Rater | Severity | Obsvd Score | Exp. Score | Obsvd Count | Obs-Exp Average | Bias Size | Error. | t | Infit MnSq | Candidate |
|---|---|---|---|---|---|---|---|---|---|---|
8 | -.03 | 18 | 22.5 | 14 | -.32 | .90 | .41 | 2.17 | .5 | 41 |
3 | ,10 | 24 | 26.0 | 14 | -.15 | .82 | .55 | 1.49 | .9 | 22 |
6 | .67 | 18 | 19.3 | 14 | -.09 | .23 | .41 | .56 | .4 | 54 |
3 | .10 | 44 | 46.2 | 40 | -.06 | .13 | .24 | .54 | .4 | 21 |
9 | .20 | 18 | 18.7 | 14 | -.05 | .12 | .41 | .29 | 1.9 | 20 |
8 | -.03 | 17 | 17.2 | 14 | -.02 | .04 | .41 | .10 | .4 | 42 |
3 | .10 | 72 | 72.0 | 54 | .00 | .00 | .22 | -.01 | 1.7 | 29 |
1 | .22 | 88 | 88.0 | 54 | .00 | .00 | .26 | .00 | 1.6 | 2 |
Mean (count:89) | 49.4 | 49.4 | 36.4 | .00 | -.02 | .32 | -.01 | 1.0 | Â | |
SD | 23.9 | 23.8 | 16.6 | .09 | .30 | .13 | .65 | .3 | Â | |