Language Testing in Asia

Table 2 Agreement rates: Korean data

From: Test-taker perception of what test items measure: a potential impact of face validity on student learning

Item #	6	6	7	7	7	8	8	9	9
Intention	⑦	⑨	⑦	⑧	⑨	①	②	①	⑧
Rate	61.2	83.7	66.3	12.2	82.7	71.4	88.8	24.5	60.2
Item #	11	11	14	14	15	15	17	19	19
Intention	③	④	③	④	③	⑤	⑩	③	⑤
Rate	60.2	46.9	69.4	45.9	66.3	88.8	5.1	80.6	49.0
Item #	20	22	23	23	25	27	30	30	31
Intention	⑩	③	③	④	③	③	③	④	③
Rate	11.2	77.6	76.5	51.0	84.7	35.7	82.7	70.4	84.7
Item #	31	32	32	33	35	35	36A	36A	36B
Intention	④	③	⑤	⑩	③	④	②	③	①
Rate	64.3	70.4	90.8	7.1	80.6	43.9	52.0	37.8	48.0
Item #	36B	36B	37A	37B	37C	37C	Mean
Intention	②	③	⑩	③	③	⑤
Rate	76.5	40.8	6.1	84.7	68.4	71.4	59.1

Intention = the ability that the KICE intended to measure (the numbers corresponding to those in Additional file 1). Rate = percentage of the Korean participants who judged the item to be measuring the abilities as intended by the KICE

Back to article page