Skip to main content

Table 11 Rasch summary statistics of novice ratings

From: Effects of rating criteria order on the halo effect in L2 writing assessment: a many-facet Rasch measurement analysis

  Standard (n = 1320) Reverse (n = 1320) Random (n = 1320)
Infit Outfit PTMEA Infit Outfit PTMEA Infit Outfit PTMEA
Rating criterion
 Content 1.09 1.07 .80 0.98 0.98 .80 1.03 1.02 .77
 Organization 0.91 0.90 .84 0.95 0.93 .83 0.87 0.86 .83
 Vocabulary 0.90 0.91 .76 0.97 0.97 .78 0.99 0.99 .76
 Language use 1.06 1.06 .75 1.07 1.06 .78 1.08 1.07 .76
Halo index
 Separation ratio 3.26 3.02 4.58
 Separation index (Strata) 4.68 4.36 6.44
 Reliability of separation .91 .90 .95
 Fixed-effect (all same) chi-square statistic 34.5 (df = 3, p < .001) 30.3 (df = 3, p < .001) 66.1 (df = 3, p < .001)
  1. Note. PTMEA = point-measure biserial correlation