Table 6 Factors influencing the examiners’ repeatability and reproducibility

Unknown levels of language proficiency of the entire class

/

/

Influence of previously assessed clips on scoring

/

Complexity of the rubric

/

/

Limited accessibility and universality of the chosen topic

/

/

Examiners’ lack of familiarity with a student’s accent

/

Lack of clarity in the rubric

/

Poor recording quality

/

/