Skip to main content

Table 11 Rasch summary statistics of novice ratings

From: Effects of rating criteria order on the halo effect in L2 writing assessment: a many-facet Rasch measurement analysis

 

Standard (n = 1320)

Reverse (n = 1320)

Random (n = 1320)

Infit

Outfit

PTMEA

Infit

Outfit

PTMEA

Infit

Outfit

PTMEA

Rating criterion

 Content

1.09

1.07

.80

0.98

0.98

.80

1.03

1.02

.77

 Organization

0.91

0.90

.84

0.95

0.93

.83

0.87

0.86

.83

 Vocabulary

0.90

0.91

.76

0.97

0.97

.78

0.99

0.99

.76

 Language use

1.06

1.06

.75

1.07

1.06

.78

1.08

1.07

.76

Halo index

 Separation ratio

3.26

3.02

4.58

 Separation index (Strata)

4.68

4.36

6.44

 Reliability of separation

.91

.90

.95

 Fixed-effect (all same) chi-square statistic

34.5 (df = 3, p < .001)

30.3 (df = 3, p < .001)

66.1 (df = 3, p < .001)

  1. Note. PTMEA = point-measure biserial correlation