Table 5 Examples of rating results with converted numerical points by raters 1 and 2
From: Evaluating CEFR rater performance through the analysis of spoken learner corpora
Extract\rater | R1 | Holistic score | R2 | Holistic score | Holistic score disagreement |
|---|---|---|---|---|---|
1 | B2+ | 12 | C1 | 14 | 2 |
2 | C1− | 13 | C1+ | 15 | 2 |
3 | C1− | 13 | B2+ | 12 | 1 |
4 | C1+ | 15 | C1 | 14 | 1 |
5 | C1− | 13 | C1+ | 15 | 2 |