Language Testing in Asia

Table 6 Attribute-level agreement rate among SMEs

From: Educational L2 constructs and diagnostic measurement

	All SMEs (N = 7)			SME 1, 2, 3
	Fleiss kappa	z statistic	p value	Fleiss kappa	z statistic	p value
VOC	0.381	9.074	0	0.604	5.44	0
GRM	0.216	5.151	0	0.777	6.99	0
EXP	0.234	5.564	0	0.54	4.858	0
INF	0.416	9.914	0	0.673	6.053	0
SUM	0.287	6.832	0	0.533	4.794	0
SEQ	0.664	15.817	0	0.871	7.843	0
Average	0.366	–	–	0.666	–	–

< 0.00 = poor, < 0.20 = slight, 0.21–0.40 = fair, 0.41–0.60 = moderate, 0.61–0.80 = substantial, 0.81–.1.00 = perfect (Landis & Koch, 1977, p. 165)

Back to article page