Articles

A case for the use of the ability-in language user-in context orientation in game-based assessment

Dynamic assessments in general, and game-based assessment (GBA) specifically, compel us to rethink prevailing language testing conceptualizations of context. Context has traditionally been portrayed with a cog...

Authors: Alexandra Lay, Elizabeth Patton and Micheline Chalhoub-Deville

University faculty members’ perspectives on English language demands in content courses and a reform of university entrance examinations in Japan: a needs analysis

This small-scale needs analysis study examined content course faculty members’ perspectives on English language demands in their courses and their perceptions of the introduction of four-skill English language...

Authors: Yasuyo Sawaki

Construct and content in context: implications for language learning, teaching and assessment in China

Context is vitally important in conceptualizing the construct and specifying the content of language learning, teaching, and assessment. In a rapidly changing globalized world, it is difficult but very importa...

Authors: Yan Jin

Assessing English reading comprehension by Chinese EFL learners in computerized dynamic assessment

Predicated on Vygotsky’s zone of proximal development (ZPD), dynamic assessment (DA) integrates teaching with assessment in a single activity by providing mediation to help learners perform beyond their indepe...

Authors: Yanfeng Yang and David D. Qian

Using keystroke logging to understand writers’ processes on a reading-into-writing test

Integrated reading-into-writing tasks are increasingly used in large-scale language proficiency tests. Such tasks are said to possess higher authenticity as they reflect real-life writing conditions better tha...

Authors: Sathena Chan

The relationships between test performance and students’ perceptions of learning motivation, test value, and test anxiety in the context of the English benchmark requirement for graduation in Taiwan’s universities

Having been influenced by the trend of internationalization of higher education, most universities in Taiwan have implemented an English benchmark requirement for graduation, which requires students to demonst...

Authors: Jessica Wu and Matt Chia-Lung Lee

Developing reading proficiency scales for EFL learners in China

Since its publication in 2001, the Common European Framework of Reference for Languages has exerted tremendous influence on language learning, teaching, and assessment in China. However, problems were also ide...

Authors: Yongqiang Zeng and Tingting Fan

An overview of differential item functioning in multistage computer adaptive testing using three-parameter logistic item response theory

As perfectly summarised by Ida Lawrence, “Testing is growing by leaps and bounds across the world. There is a realization that a nation’s well-being depends crucially on the educational achievement of its popu...

Authors: Karim Sadeghi and Zainab Abolfazli Khonbi

Markers’ criteria in assessing English essays: an exploratory study of the higher secondary school certificate (HSCC) in the Punjab province of Pakistan

Marking of essays is mainly carried out by human raters who bring in their own subjective and idiosyncratic evaluation criteria, which sometimes lead to discrepancy. This discrepancy may in turn raise issues l...

Authors: Miguel Fernandez and Athar Munir Siddiqui

Calibrating the CEFR against the China Standards of English for College English vocabulary education in China

The Common European Framework of Reference (CEFR) (Council of Europe 2001) has, over the past decade, come to be widely used as a reference tool for teaching, learning and assessment (Alderson 2002; North 2014...

Authors: Wen Zhao, Boran Wang, David Coniam and Bingxue Xie

Developing common listening ability scales for Chinese learners of English

The Common European Framework of Reference (CEFR) developed by Council of Europe has been gaining popularity since its publication in 2001, and reshaping the practice in language teaching, learning and assessm...

Authors: Lianzhen He and Dajian Chen

Developing classroom language assessment benchmarks for Japanese teachers of English as a foreign language

Since the Japanese government has called for English to be taught through English (Ministry of Education, Culture, Sports, Science and Technology, 2003), there has been increasing interest in English language ...

Authors: Yuzo Kimura, Yoshiyuki Nakata, Osamu Ikeno, Naoyuki Naganuma and Stephen Andrews

Looking beyond scores: validating a CEFR-based university speaking assessment in Mainland China

The present study examined the validity of a university-based speaking assessment (Test of Oral Proficiency in English, TOPE for short) in mainland China. The speaking assessment was developed to meet the stan...

Authors: Li Liu and Guodong Jia

Developing the China Standards of English: challenges at macropolitical and micropolitical levels

A project has recently been proposed by the National Education Examinations Authority, P. R. China, to develop a national framework of reference for English language education, provisionally called China Stand...

Authors: Yan Jin, Zunmin Wu, Charles Alderson and Weiwei Song

Using grounded theory to validate Bachman and Palmer’s (1996) strategic competence in EFL graph-writing

Research studies (e.g., Phakiti, Language Testing 25(2):237–272, 2008a; Phakiti, Language Assessment Quarterly 5(1): 20–42, 2008b; Purpura, Learner strategy use and performance on language tests: a structural ...

Authors: Fereshteh Tadayon and Hamdollah Ravand

Investigating washback to the learner from the IELTS test in the Japanese tertiary context

This study investigated the consequential validity of the International English Language Testing System (IELTS) Academic exam, specifically focusing on washback upon learners’ test preparation strategies and s...

Authors: David Allen

Consequences of test use: a case study of employers’ voice on the social impact of English certification exit requirements in Taiwan

This study investigates the social impact of a policy requiring university graduates to pass an English proficiency test by examining the consequences of test use in the workplace in Taiwan.

Authors: Yi-Ching Pan and Carsten Roever

Validity evidence of Criterion® for assessing L2 writing proficiency in a Japanese university context

While numerous articles on Criterion® have been published and its validity evidence has accumulated, test users need to obtain relevant validity evidence for their local context and develop their own validity ...

Authors: Rie Koizumi, Yo In’nami, Keiko Asano and Toshie Agawa

Genre analysis of writing tasks in Japanese university entrance examinations

English language writing is important in university entrance examinations in Japan and influences what learners and teachers do in English classes. This is especially noticeable in secondary education in Japan...

Authors: Hideo Watanabe

Factor structure of the Test of English for Academic Purposes (TEAP®) test in relation to the TOEFL iBT® test

This study examined the factor structure of the Test of English for Academic Purposes (TEAP®) test—a recently developed academic English test measuring four skills among Japanese university applicants—and comp...

Authors: Yo In’nami, Rie Koizumi and Keita Nakamura

Validity argument for the VELC Test® score interpretations and uses

Placement testing is a crucial issue in Japanese universities. In the majority of language programs, classes are streamed by proficiency levels based on students’ placement test score for efficient instruction...

Authors: Takaaki Kumazawa, Tetsuhito Shizuka, Masamichi Mochizuki and Atsushi Mizumoto

Developing evidence for a validity argument for an English placement exam from multi-year test performance data

This study investigated the factor structure and factorial invariance of an English Placement Exam (EPE) from 1998 to 2011 to provide evidence for both the appropriateness of the test scores interpretations an...

Authors: James M. Sims and Antony John Kunnan

How interactive discussions support writing development: the application of Dynamic Assessment for learning Chinese rhetoric

This study examined the use of student-teacher interactions through dynamic assessment (DA) to diagnose and promote the learner’s comprehension on Chinese writing patterns. Debates over the uses of standardize...

Authors: Yu-Ting Kao

Chinese university students’ perceptions of assessment tasks and classroom assessment environment

Classroom assessment tasks and environment are central to supporting student learning, yet are under-studied at the tertiary level, especially in China’s test-driven culture. This study explores the relationsh...

Authors: Liying Cheng, Yongfei Wu and Xiaoqian Liu

An analysis of the differences among L2 listening comprehension test formats

The present study aims to investigate which variables affect English as a foreign language (EFL) students’ listening comprehension test performance. It examines two types of variables: (1) test formats and (2)...

Authors: Kei Mihara

Raising the bar: language testing experience and second language motivation among South Korean young adolescents

Drawing on second language (L2) motivation constructs modelled on Dörnyei’s (2009) L2 Motivational Self System, this study explores the relationship between language testing experience and the motivation to le...

Authors: John F Haggerty and Janna Fox

Test-taker perception of what test items measure: a potential impact of face validity on student learning

High-stakes tests have an immense washback effect on what students learn and affect the content of student learning. However, if students fail to recognize the abilities that the test developers intend to meas...

Authors: Takanori Sato and Naoki Ikeda

Assessing in-class participation for EFL: considerations of effectiveness and fairness for different learning styles

This study investigates the effectiveness and fairness of teacher-led assessment of students’ in-class participation and its effect on actual participation levels and language test scores, taking into account ...

Authors: Peter R Crosthwaite, Daniel R Bailey and Ashley Meeker

How language proficiency contributes to Chinese students’ academic success in Korean universities

The present study investigated the key determinants of Chinese students’ academic success in terms of GPA and the number of credit hours earned in Korean Universities. The determinants investigated included ge...

Authors: Wei Yan and Liying Cheng

An enduring lens for a continuing problem: Close analysis of conceptually scored cloze items

This paper provides an example of close analysis of student attempts to fill the gaps that comprise a cloze test. Such analysis may assist diagnosis of the difficulties that groups of students experience with spe...

Authors: John M O’Toole, Junyu Cheng and Gjyn O’Toole

Rubrics in the classroom: do teachers really follow them?

For language teachers, using rubrics has become the norm in assessing performance-based work. When using rubrics, one question stakeholders have is to what extent teachers are true to the rubrics. For classroo...

Authors: Heejeong Jeong

Rater reliability and score discrepancy under holistic and analytic scoring of second language writing

Previous studies comparing holistic scoring to analytic scoring of second language writing have given mixed results. Some of them suffer from methodological drawbacks, such as limited writing sample size, limi...

Authors: Bo Zhang, Yunnan Xiao and Juan Luo

The effect of a national education policy on language test performance: a fairness perspective

Project 211 is one of the most important educational policies in China, which aims at selecting a small number of “key universities” for sustainable development in the 21st century. These selecte...

Authors: Xiaomei Song and Lianzhen He

Language for Specific Purpose (LSP) performance assessment in Asian call centres: strong and weak definitions

LSP performance assessment has become a special focus for language testers in recent years where experts have debated how testing tools and processes can be strengthened to more accurately and more validly ass...

Authors: Jane E Lockwood

Computer-delivered or face-to-face: effects of delivery mode on the testing of second language speaking

The use of computers has increased in speaking assessments; however, there are concerns about how the absence of an interlocutor affects performance on speaking tests.

Authors: Yujia Zhou

Self-assessment as academic community building: a study from a Japanese liberal arts university

Student self-assessment has been heralded as a way of increasing student ownership of the learning process, enhancing metacognative awareness of their learning progress as well as promoting learner autonomy. I...

Authors: Chris C Hale

The number of options in multiple choice items in language tests: does it make any difference? Evidence from Thailand

The overall study from which findings are presented gave stem-equivalent short answer and multiple choice tests of English structure and reading to students at Prince of Songkla University, Thailand. A compari...

Authors: Inadaphat Thanyapa and Michael Currie

(Un)reliability of equivalent forms of the Taiwanese tour guide English tests

The aim of this study was to determine whether large variations in the pass rates of different versions of the Taiwanese tour guides' English test were due to inherent differences in the difficulty of the test...

Authors: Peter J Gilks

Chinese test takers' attitudes towards the Versant English Test: a mixed-methods approach

This study investigated Chinese test takers' attitudes towards the Versant English Test (VET), an automated spoken English test developed by Pearson Knowledge Technologies. Based on previous attitudinal studie...

Authors: Jinsong Fan

The role of reading and writing in summarization as an integrated task

In order to complete summarization tasks L2 learners need to demonstrate both reading and writing abilities. Thus, understanding the role of these abilities is necessary for interpreting performance on such ta...

Authors: Jiuliang Li

Assessing English speaking skills of prospective teachers at entry and graduation level in teacher education program

The development of Spoken English in Pakistani teachers training institutions working in public sector has never been assessed. This study explores the extent of improvement in English speaking skills among pr...

Authors: Muhammad Sarwar, Muhammad Alam, Shafqat Hussain, Ashfaque Ahmad Shah and Mehlah Jabeen

Developing and evaluating a dynamic assessment of listening comprehension in an EFL context

This study addressed a need to examine and improve current assessments of listening comprehension (LC) of university EFL learners. These assessments adopted a traditional approach where test-takers listened to...

Authors: Sahbi Hidri

Erratum to: The negative influences of exam-oriented education on Chinese high school students: backwash from classroom to child

Authors: Robert Kirkpatrick and Yuebing Zang

Editorial – language testing in Asia

Authors: Robert Kirkpatrick

Retraction Note: An Investigation into the Iranian EFL Language Learners' Attitudes on TOEFL iBT

Authors: Kamal Heidari Soureshjani, Parisa Riahipour and Arezoo Safikhani

Reliability assessment and construct validation of translation competence questionnaire (TCQ) in Iran

The present study investigates the construct validation of Translation Competence Questionnaire (TCQ) in the context of Iran. For this purpose, one hundred ninety seven EFL learners, whose major was translatio...

Authors: Seyyed Mohammad Alavi and Hamed Ghaemi

Relationship between types of distractor and difficulty of multiple-choice vocabulary tests in sentential context

This study compares the effect of different kinds of distractors on the level of difficulty of multiple-choice (MC) vocabulary tests in sentential contexts. This type of test is widely used in practical testin...

Authors: Yuko Hoshino

Doubts on the validity of correlation as a validation tool in second language testing research: the case of cloze testing

The statistical analysis technique of correlation has extensively been used in second/foreign language testing research for a variety of purposes. Most commonly, the technique has been used to validate newly c...

Authors: Karim Sadeghi

The Myanmar university entrance examination

This study examines the English section of the university entrance examination in Myanmar in terms of validity, reliability, practicality, and washback. The study highlights the significance of the matriculati...

Authors: Robert Kirkpatrick and Hmone Lian Hlaing

Toward a sociocultural approach to feedback provision in L2 writing classrooms: the alignment of dynamic assessment and teacher error feedback

Feedback is a key component of teaching second language writing. As the field of second language writing instruction has recently placed greater emphasis on sociocultural considerations, issues related to the ...

Authors: Parva Panahi, Parviz Birjandi and Behrooz Azabdaftari