Skip to main content

Table 4 Rasch summary statistics of expert ratings

From: Effects of rating criteria order on the halo effect in L2 writing assessment: a many-facet Rasch measurement analysis

 

Difficulty

Infit

Outfit

PTMEA

Rating criterion

 Content

0.38 (0.08)

1.06

1.05

.70

 Organization

0.85 (0.08)

1.02

0.97

.70

 Vocabulary

− 0.09 (0.08)

1.02

1.07

.57

 Language use

− 0.33 (0.08)

0.89

0.90

.66

Halo index

 Separation ratio

6.64

 

 Separation index (Strata)

9.18

 

 Reliability of trait separation

.98

 

 Fixed-effect (all same) chi-square statistic

133.5 (df = 3, p < .001)

 
  1. Note. Standard errors of measurement are presented in parentheses. PTMEA = point-measure biserial correlation