Skip to main content

Advertisement

We’d like to understand how you use our websites in order to improve them. Register your interest.

Comparability of Holistic/Analytic Intra-reliability in Student/Teacher Assessment of Writing

Abstract

Despite the many pedagogical benefits of self-/peer-assessment, they are not often practiced in the classroom, due to the fact that most teachers doubt learners' ability to do self-/peer-assessment accurately. Although several factors have been identified to affect self-/peer-assessment accuracy, the literature shows the rating accuracy of learners can improve if enough training is provided. Given the abovementioned supporting literature, it was hypothesized that learners, if provided with training and practice, may also have the potential to show behavior similar to that of expert-raters in terms of holistic and analytic intra-reliability. To test this hypothesis, having been trained to do self-/peer-assessment according to their group assignment, 136 English-major students conducted self-/peer-assessment of writing performance both holistically and analytically across 11 sessions. After correlating the students and raters' holistic and analytic scores and examining the variations among the correlations, it was found that students have indeed got the potential to show rating behaviors similar to those of expert raters and at times even show higher correlations. This paper closes with some implications these findings can have for theory and practice, and some new lines of research are recommended in the area investigated in this study.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Masood Siyyari.

Rights and permissions

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Cite this article

Siyyari, M. Comparability of Holistic/Analytic Intra-reliability in Student/Teacher Assessment of Writing. Language Testing in Asia 2, 59 (2012). https://doi.org/10.1186/2229-0443-2-1-59

Download citation

Keywords

  • analytic scoring
  • holistic scoring
  • peer-assessment
  • self-assessment
  • teacher assessment
  • writing skill