Validity of the listening module of international English language testing system: multiple sources of evidence

Alavi, Sayyed Mohammad; Kaivanpanah, Shiva; Masjedlou, Ali Panahi

doi:10.1186/s40468-018-0057-4

Language Testing in Asia

Table 9 Differential item functioning through CDM

From: Validity of the listening module of international English language testing system: multiple sources of evidence

Items	Chi-square	Df	P	DIF/non-DIF CDM	P-Holm	DIF/non-DIF Holm	UA	Effect size
1	2.56	2	0.27	Non-DIF	1.00	Non-DIF	0.07	Moderate
2	17.98	2	0.00	DIF	0.00	DIF	0.14	Large
3	2.53	2	0.28	Non-DIF	1.00	Non-DIF	0.08	Moderate
4	9.03	2	0.01	DIF	0.33	Non-DIF	0.12	Large
5	5.67	2	0.05	Non-DIF	1.00	Non-DIF	0.09	Large
6	5.20	2	0.07	Non-DIF	1.00	Non-DIF	0.07	Moderate
7	5.16	2	0.07	Non-DIF	1.00	Non-DIF	0.08	Moderate
8	22.64	2	0.00	DIF	0.00	DIF	0.17	Large
9	9.84	2	0.00	DIF	0.24	Non-DIF	0.06	Moderate
10	21.78	2	0.00	DIF	0.00	DIF	0.17	Large
11	5.50	2	0.06	Non-DIF	1.00	Non-DIF	0.10	Large
12	1.55	2	0.46	Non-DIF	1.00	Non-DIF	0.05	Weak
13	2.50	2	0.28	Non-DIF	1.00	Non-DIF	0.08	Moderate
14	37.75	2	0.00	DIF	0.00	DIF	0.11	Large
15	0.15	2	0.92	Non-DIF	1.00	Non-DIF	0.06	Moderate
16	0.36	2	0.83	Non-DIF	1.00	Non-DIF	0.01	Weak
17	4.85	2	0.08	Non-DIF	1.00	Non-DIF	0.07	Moderate
18	18.64	2	0.00	DIF	0.00	DIF	0.10	Large
19	1.27	2	0.52	Non-DIF	1.00	Non-DIF	0.05	Weak
20	16.21	2	0.00	DIF	0.01	DIF	0.14	Large
21	7.00	2	0.03	DIF	0.87	Non-DIF	0.10	Large
22	2.26	2	0.32	Non-DIF	1.00	Non-DIF	0.06	Moderate
23	0.09	2	0.95	Non-DIF	1.00	Non-DIF	0.01	Weak
24	2.01	2	0.36	Non-DIF	1.00	Non-DIF	0.06	Moderate
25	1.34	2	0.51	Non-DIF	1.00	Non-DIF	0.01	Weak
26	9.44	2	0.00	DIF	0.28	Non-DIF	0.09	Large
27	1.68	2	0.43	Non-DIF	1.00	Non-DIF	0.01	Weak
28	3.22	2	0.19	Non-DIF	1.00	Non-DIF	0.06	Moderate
29	0.68	2	0.70	Non-DIF	1.00	Non-DIF	0.03	Weak
30	5.78	2	0.05	Non-DIF	1.00	Non-DIF	0.10	Large
31	5.96	2	0.05	Non-DIF	1.00	Non-DIF	0.08	Moderate
32	0.06	2	0.96	Non-DIF	1.00	Non-DIF	0.00	Weak
33	7.44	2	0.02	DIF	0.72	Non-DIF	0.07	Moderate
34	3.32	2	0.18	Non-DIF	1.00	Non-DIF	0.06	Moderate
35	0.06	2	0.96	Non-DIF	1.00	Non-DIF	0.00	Weak
36	11.13	2	0.00	DIF	0.12	Non-DIF	0.1322	Large
37	2.92	2	0.23	Non-DIF	1.00	Non-DIF	0.0547	Weak
38	4.62	2	0.09	Non-DIF	1.00	Non-DIF	0.0792	Moderate
39	4.44	2	0.10	Non-DIF	1.00	Non-DIF	0.0724	Moderate
40	0.40	2	0.81	Non-DIF	1.00	Non-DIF	0.0176	Weak

Back to article page