Language Testing in Asia

Table 5 Scale comparison across rater groups

From: Writing scale effects on raters: an exploratory study

	Binary			Analytic
	Teacher rater	Expert rater	Differences	Teacher rater	Expert rater	Differences
Time	M = 31, SD = 2.91	M = 23.75, SD = 1.29	7.25	M = 33.5, SD = 7.43	M = 26.75, SD = 4.02	6.75
Fair average	2.72	2.58	0.14	2.63	2.54	0.09
Exact agreement	30%	46.2%	16.2%	33.7%	41.2%	7.5%
Rater separation index	2.37	1.02	1.35	5.91	2.07	3.84

Back to article page