Table 4 Bias analysis of rater and test type
From: Developing and evaluating a dynamic assessment of listening comprehension in an EFL context
Rater | Severity | Obsvd Score | Exp. Score | Obsvd Count | Obs-Exp Average | Bias | Error | t | Infit MnSq | Test type |
|---|---|---|---|---|---|---|---|---|---|---|
5 | -.36 | 119 | 109.8 | 70 | .13 | -.47 | .24 | -1.94 | .9 | Dynamic |
6 | .67 | 333 | 314.4 | 240 | .08 | -.20 | .11 | -1.91 | .9 | Static |
11 | -.42 | 73 | 70.8 | 42 | .05 | -.22 | -.33 | -.67 | .9 | Dynamic |
10 | -.18 | 66 | 64.1 | 42 | .05 | -.14 | .28 | -.51 | 1.0 | Dynamic |
3 | .10 | 237 | 234.0 | 140 | .02 | -.08 | .17 | -.51 | 1.3 | Dynamic |
7 | -.51 | 95 | 93.1 | 56 | .03 | -.14 | .27 | -.51 | 1.1 | Dynamic |
4 | -.13 | 129 | 126.3 | 84 | .03 | -.10 | .19 | -.51 | .9 | Dynamic |
1 | .22 | 286 | 283.1 | 200 | .01 | -.04 | .12 | -.34 | 1.2 | Static |
2 | .43 | 149 | 147.4 | 126 | .01 | -.03 | .14 | -.22 | .9 | Dynamic |
8 | -.03 | 147 | 146.5 | 120 | .00 | -.01 | .14 | -.08 | .9 | Static |
9 | .20 | 77 | 76.8 | 56 | .00 | -.01 | .21 | -.04 | 1.4 | Dynamic |
9 | .20 | 234 | 234.3 | 200 | .00 | .00 | .11 | .03 | .9 | Static |
8 | -.03 | 96 | 96.4 | 70 | -.01 | .02 | .19 | .08 | .8 | Dynamic |
2 | .43 | 275 | 276.9 | 280 | -.01 | .02 | .09 | .17 | .9 | Static |
4 | -.13 | 452 | 454.2 | 360 | -.01 | .02 | .08 | .19 | 1.0 | Static |
11 | -.42 | 280 | 281.9 | 200 | -.01 | .03 | .12 | .22 | 1.1 | Static |
10 | -.18 | 173 | 174.8 | 120 | -.02 | .04 | .15 | .28 | .9 | Static |
3 | .10 | 526 | 529.2 | 360 | -.01 | .03 | .09 | .29 | 1.1 | Static |
7 | -.51 | 111 | 112.9 | 80 | -.02 | .06 | .18 | .34 | 1.0 | Static |
1 | .22 | 107 | 110.0 | 70 | -.04 | .14 | .21 | .65 | .8 | Dynamic |
5 | -.36 | 327 | 335.7 | 240 | -.04 | .09 | .10 | .91 | 1.1 | Static |
6 | .67 | 106 | 125.1 | 84 | -.23 | .59 | .17 | 3.50 | .4 | Dynamic |
Mean (count:22) | 199.9 | 199.9 | 147.3 | .00 | -.02 | .17 | -.03 | 1.0 | Â | |
SD | 124.3 | 124.3 | 96.5 | .06 | .18 | .07 | 1.02 | .2 | Â | |