Skip to main content

Table 2 Specifications, accuracy rates, and other information regarding the English items in the 2002 and 2005 senior high school tests*

From: Application of diffusion of innovation theory to educational accountability: the case of EFL education in Japan

 

2002 Test: 1994–2002 Course of Study

(n = 31,189)

2005 Test: 2003–2012 Course of Study

(n = 29,880)

Item no.

Main skill to be measured

Ability to be tested

Item Type

Mean % of those who answered the item correctly

Expected mean accuracy rate

Mean % of those who answered the item correctly

Expected mean accuracy rate

1–3

Listening

Ability to respond when spoken to

MC**

64.4

67.5

61.9

65.8

4–6

 

Ability to comprehend the details of a spoken text

MC

58.6

65

58.6

66.7

7–10

 

Ability to comprehend the main points of a spoken text

MC

62.1

62.3

65.2

63.2

11–12

Reading

Ability to comprehend the details of a written text

MC

64.9

62.5

66.5

63.7

13–15

 

Ability to comprehend the main points of a written text

MC

69.5

60.0

66.9

61.7

16–17

 

Ability to understand the logical development of a written text

MC

55.9

57.5

65.5

60

18–19

 

Ability to understand the writer’s intention

MC

70.9

62.5

60.6

65.0

20

Writing

Ability to write a coherent text of more than three sentences

Open-ended

22.8

45.0

23.4

45

21–23

 

Ability to fill in blanks with appropriate words or phrases

Open-ended

52.9

55.0

47.8

55.0

24–26

 

Ability to write a sentence using scrambled words

Open-ended

51.4

55.8

50.2

60.8

  1. * Means were calculated based on data presented in NIER (2004, 2007), with number of students taken into consideration
  2. ** MC: Multiple choice