|
2011
|
2012
|
2013
|
2014
|
---|
Order
|
St. no.
|
Measure
|
St. No.
|
Measure
|
St. no.
|
Measure
|
St. no.
|
Measure
|
---|
1
|
18*
|
2.71
|
14*
|
1.93
|
10*
|
1.73
|
14*
|
1.55
|
2
|
25*
|
2.54
|
16*
|
1.73
|
1*
|
1.50
|
16*
|
1.46
|
3
|
24*
|
2.28
|
3*
|
1.53
|
7*
|
1.30
|
3*
|
1.21
|
4
|
26
|
2.08
|
15
|
1.47
|
16
|
1.19
|
2
|
1.13
|
5
|
14
|
1.84
|
10
|
1.33
|
4*
|
1.09
|
4
|
.94
|
6
|
15
|
1.66
|
5*
|
1.32
|
5*
|
1.04
|
17*
|
.89
|
7
|
17
|
1.61
|
4*
|
1.20
|
14*
|
.72
|
19*
|
.45
|
8
|
28*
|
1.60
|
17*
|
1.19
|
2
|
.69
|
11*
|
.41
|
9
|
16*
|
1.55
|
8
|
.76
|
11*
|
.67
|
1
|
.39
|
10
|
8*
|
1.51
|
2*
|
.72
|
8*
|
.39
|
5*
|
.36
|
11
|
22
|
1.42
|
18*
|
.53
|
9
|
.24
|
18*
|
.27
|
12
|
12
|
1.10
|
20
|
.30
|
6
|
.15
|
20
|
.16
|
13
|
21
|
1.08
|
12
|
.19
|
12
|
.08
|
13*
|
− .01
|
14
|
1*
|
.87
|
11
|
.15
|
13*
|
− .02
|
10
|
− .03
|
15
|
3*
|
.80
|
13
|
.12
|
3
|
− .29
|
6
|
− .05
|
16
|
23
|
.65
|
19
|
.03
|
15
|
− .73
|
15
|
− .08
|
17
|
11
|
.63
|
6*
|
− .14
| | |
8
|
− .20
|
18
|
6
|
.44
|
1
|
− .48
| | |
9
|
− .41
|
19
|
4
|
.30
|
9
|
− .72
| | |
12
|
− .47
|
20
|
27
|
.27
|
7
|
− 1.82
| | |
7
|
− 1.01
|
21
|
5
|
.24
| | | | | | |
22
|
19
|
.14
| | | | | | |
23
|
13*
|
− .05
| | | | | | |
24
|
7
|
− .08
| | | | | | |
25
|
10
|
− .33
| | | | | | |
26
|
20
|
− .70
| | | | | | |
27
|
9
|
− .94
| | | | | | |
28
|
2
|
− 1.52
| | | | | | |
- The scripts written by students with “*” are selected and used in stage 3 of the study. The criteria of essay selection were adopted as follows:
- 1) 9 essays of each year covering four levels were selected;
- 2) Level distribution was three essays for level 1, another three for level 2, two for level 3, and one for level 4
- 3) The 4 levels were identified as follows: those with the three highest logit values in each administration were classified into level 1. The two with the logit values closest to the mean (one was higher and the other lower) were classified into level 3. The three essays in the very middle of level 1 and level 3 were classified into level 2. If the number of the essays between levels 1 and 3 was odd, then the one with a smaller logit value was chosen, as in the case of 2011 and 2012. The one with a logit value slightly lower than 0 was classified into level 4