Evaluating CEFR rater performance through the analysis of spoken learner corpora

Language Testing in Asia

Table 3 Examples of rating results by Raters 1 and 2

Competency	Range		Accuracy		Fluency		Phonological control		Coherence		Holistic score
Extract\rater	R1	R2	R1	R2	R1	R2	R1	R2	R1	R2	R1	R2
1	B2+	C1	C1−	C1	C1−	C1−	B2+	C1	C1−	C1	B2+	C1
2	C1−	C1+	C1−	C1+	B2+	C1+	C1−	C1+	B2+	C1+	C1−	C1+
3	Cl−	B2+	B2+	B2+	C1−	C1−	B2+	B2+	C1−	C1−	C1−	B2+
4	C1	C1+	C1+	C1	C2−	C1	C1	C1	C1+	C1	C1+	C1
5	B2+	C1+	B2+	C1+	C1	C1+	B2+	C1	C1−	C1+	C1−	C1+