Can the National Center Test in Japan be replaced by commercially available private English tests of four skills? In the case of TOEFL Junior Comprehensive
© The Author(s). 2017
Received: 10 July 2017
Accepted: 8 September 2017
Published: 23 October 2017
The National Center Test is a test that high school graduates take in order to be matriculated into the majority of universities in Japan. Its English section (NCT), though, is scheduled to be replaced by commercially available private English tests of four skills (reading, listening, speaking, writing) due to the fact that NCT currently measures only the receptive skills of reading and listening. A concern has been raised, however, regarding the score comparability between NCT and those tests of four skills. Thus, this study was conducted in order to examine to what extent the score of NCT and TOEFL Junior Comprehensive (JC)—one of the commercially available private English tests of four skills—correlate with each other and to what extent their test constructs overlap from the viewpoint of L2 competence structure.
One hundred forty-four twelfth graders in Japan took NCT and JC. Pearson’s correlations and an exploratory factor analysis (maximum likelihood) were conducted. Moreover, confirmatory factor analyses and chi-square difference tests were performed in order to compare several models.
The results show that the scores of the two tests are highly correlated with each other, indicating that JC can be a proper candidate to replace NCT. Moreover, an exploratory factor analysis revealed that all of the six scores can be subsumed under a single factor. According to the results of a series of confirmatory factor analyses and chi-square difference tests, the correlated skill model was shown to be the best fit model, but the unitary model was almost equally a good fit as well.
The results overall indicate that, regardless of tests and skills to measure, English proficiency as a general construct may determine the major portion of these scores. This poses the question of whether, in order to assess learners’ English proficiency, all four skills need to be measured separately.
In Japan, most high school students who wish to be matriculated in universities are required to take a common examination titled the National Center Test for university entrance examinations. Commencing in 1990, its English section (NCT; henceforth) started with a reading section only, to which the listening section was added in 2006. After 20 years of implementation, however, NCT is scheduled to be replaced by commercially available private tests due to the criticism of its incapability to measure four skills (reading, listening, speaking, writing) despite the fact that the ministry’s curriculum guidelines stipulate that these skills are expected to be acquired in a balanced manner in English education in school (Ministry of Education 2010).
Commercially available private tests of four skills
Business Language Testing Service
Eiken Foundation of Japan (n.d.-a)
Cambridge English exams
Cambridge English Language Assessment (2017)
Eiken Test in Practical English Proficiency
Eiken Foundation of Japan (n.d.-b)
Global Test of English Communication
Global Test of English Communication Academic
Global Test of English Communication Computer Based Testing
Global Test of English Communication Corporate Test Edition
Global Test of English Communication Junior
International English Language Testing System
British Council, IDP: IELTS Australia, and Cambridge English Language Assessment (2017)
Pearson Test of English Academic
Test of English for Academic Purposes
Eiken Foundation of Japan (n.d.-c)
Test of English for Academic Purposes Computer Based Testing
Eiken Foundation of Japan (n.d.-d)
Test of English as a Foreign Language Internet-Based Testing
Educational Testing Service (2017a)
Test of English as a Foreign Language Junior Comprehensive
TOEFL Junior Comprehensive
Educational Testing Service (2017b)a
Test of English for International Communication
TOEIC (LR & SW)
Educational Testing Service (2017c)
United Nations Associations Test of English
United Nations Associations of Japan (n.d.)
Among these, TOEFL Junior Comprehensive (JC; henceforth) was listed as one of the prospective candidates as a replacement for NCT (Eigo yonginou shikaku kentei kondankai 2016). However, a concern has been raised regarding the degree of correspondence in scores between these tests and NCT for three reasons. Firstly, whereas NCT measures only the receptive skills, others additionally measure productive skills. Secondly, whereas NCT strictly follows the guidelines on high school curriculum published by the Ministry of Education, Culture, Sports, Science, and Technology (MEXT; henceforth), others have no such constraints (see In’nami et al. 2016). GTEC CBT, TEAP, and TEAP CBT are developed specifically geared toward Japanese high school students, so their test constructs loosely follow the guidelines; however, GTEC CBT also asks questions beyond them (Benesse 2000–2017), and TEAP (CBT) does not refer to this issue at all (Eiken Foundation of Japan n.d.-c, n.d.-d), implying that their restrictions are not as rigorous as that on NCT. Finally, the aim of these two tests significantly differ from each other: JC aims to “measure the full range of language uses that students encounter in English-medium school settings” (So et al. 2015, p. 4) whereas that of NCT is to “improve the selection of candidates for admission to Japanese universities, and thereby to promote education at universities, high schools, and other educational institutions” (National Center for University Entrance Examinations 2015, p. 1). These three issues pose a question of whether not only the total scores but also the test constructs are comparable between them. Therefore, the current study was conducted with the aim to examine the concurrent validity of NCT and JC, namely, to what extent the scores of these two tests correlate with each other and to what extent the test constructs of these tests overlap from the viewpoint of L2 competence structure.
Structure of L2 competence
A unitary or unidimensional model: L2 learners have only a single construct of L2 competence, which can explain all of test scores, regardless of skills or knowledge to be measured. For example, all of the test scores of four skills are subsumed under a single factor of L2 proficiency (Fig. 1; squares represent observed variables whereas circles represent unobserved latent variables, henceforth).
An uncorrelated model: Rather than one, multiple constructs exist among L2 learners and each of them separately subsumes the test scores purported to measure the same construct, but those factors are uncorrelated. For example, the scores of the listening test and reading test are subsumed under a factor of receptive skills whereas those of the speaking test and writing test are subsumed under a factor of productive skills, but the two factors of receptive skills and productive skills are unrelated and, thus, not correlated with each other (Fig. 2). This validates such a claim that receptive skills and productive skills need to be measured separately on the assumption that each of them develops independently.
A correlated model: Similar to the uncorrelated model, multiple constructs exist among L2 learners; however, the unobserved latent factors are correlated with each other. For example, the two factors of receptive skills and productive skills are connected with a line with arrowheads at both ends (Fig. 3). This also validates such a claim that receptive skills and productive skills need to be measured separately because, although they develop in tandem rather than independently, their development is still not perfectly synchronized.
A higher-order, second-order, or hierarchical model: Similar to the correlated model, multiple constructs exist among L2 learners; however, instead of directly connecting those factors, they are subsumed under another unobserved latent factor placed on the higher level. For example, the two factors of receptive skills and productive skills (first-order factors) are connected with another factor of L2 proficiency newly added on the right (Fig. 4; please note that the lines are single arrow-headed this time). This model also validates such a claim that receptive skills and productive skills need to be measured separately because, although they are both affected by another higher factor, how the factor influences each of them is not related to each other; thus, their development is not perfectly synchronized either.
Although the past literature has not reached an agreement concerning which model best explains L2 competence, at least, the unitary model and the uncorrelated model have been scantly supported thus far. As one of the proponents of the former, Oller (1979, 1983) reported a series of proofs that a single trait (Oller himself does not define what the trait is in a clear and consistent manner though) could explain the major portions (over 70%) of the total variance of various tests, including TOEFL PBT. He goes so far as to say, “the current practice of many ESL programs, textbooks, and curricula of separating listening, speaking, and reading and writing activities is probably not just pointless but in fact detrimental” (p. 458). However, his argument has been refuted, partly owing to the fact that he used principal component analysis (see Fouly et al. 1990, for the criticism), which prompted studies onward to adopt confirmatory factor analysis and exploratory factor analysis with the Schmid-Leiman procedure instead, resulting in negating at least the strong version of the unitary model.
Most of the literature since the 1980s advocates adopting either the correlated model or the higher-order model, which are statistically indistinguishable from each other when the number of first-order factors is three (for examples, see Fouly et al. 1990; Sasaki 1996; Shin 2005). Fouly et al. (1990) examined the scores of various tests, including TOEFL PBT, collected from 334 university students in the USA with diverse L1s, and found that the three-correlated-factor model and the higher-order model were equally well fit. Similarly, Sasaki (1996) analyzed scores of several English tests taken by 160 Japanese university students and concluded that both the higher-order model and the correlated model equally fit. Shin (2005) investigated scores of TOEFL PBT and SPEAK (Speaking Proficiency in English Assessment Kit) taken by 738 participants divided into three different levels based on their English proficiency, which resulted in the higher-order model with three first-order factors of listening, speaking, and writing modes being the best model across the three groups, i.e., regardless of their proficiency. Investigating to what extent two distinct assessments measured the same language ability construct taken by 1224 English learners in the fourth grade in California, Llosa (2007) also found a model with three first-order factors (listening and speaking, reading, writing) under a higher-order factor (English proficiency) to be the best fit. More recently, In’nami et al. (2016) analyzed the factor structure of TEAP and compared it to that of TOEFL iBT. The higher-order model was found to be the best fit for TEAP, and also, the test constructs were similar between these two tests, both measuring academic English skills.
When the number of first-order factor is as few as two, the higher-order factor is not even susceptible to verification, and a decision is often made based on some other criteria. As one of the earliest studies that used confirmatory factor analysis, Bachman and Palmer (1981) compared over 20 models using the data of speaking and reading collected via three distinct methods for each from 75 Mandarin native speakers aged between 19 and 35 residing in the USA. They found that the correlated model with two factors and the higher-order model were equally well fit but, based on the fact that the former is simpler with one less factor, concluded the former to be the best choice. Another study conducted by Bachman and Palmer (1982) examined the three traits of communicative competence (grammatical, pragmatic, and sociolinguistic) collected via four methods with 116 participants aged between 17 and 67 with various L1s residing in the USA and reached the conclusion that the higher-order model is superior to the correlated model based on the results of chi-square tests (However, see Fouly et al. (1990), for criticism on Bachman and Palmer’s studies.). More recently, In’nami and Koizumi (2012) analyzed TOEIC scores of four listening and five reading subskills collected from 569 EFL learners, most of whom were Japanese university students. Among several models that they tested, they found the correlated two-factor model (listening and reading) to be the best fit. Due to the identification problem, the higher-order model was not considered.
Somewhat more pertinent to the present study in terms of the same TOEFL tests of four skills, a series of large-scale studies with 2720 participants have been conducted to explore the factor structure of TOEFL iBT (Sawaki et al. 2008, 2009; Stricker and Rock 2008). They commonly adopted the higher-order model with four first-order factors of four skills, which is in line with the TOEFL score convention to report each skill-based score along with a single composite score. Lastly, Gu (2015) is perhaps the only study that has examined the factor structure of JC (although its pilot form), in which a total of 436 EFL learners aged 11–15 took the test. Using item-level raw scores, three models were compared: the unitary model, the correlated four-factor model (reading, listening, speaking, writing), and the higher-order model with those four first-order factors. The results show that the higher-order model was the best fit with a high-order factor being assumed as general learning ability.
All in all, the accumulation of the past literature leads to the hypothesis that the structure of L2 competence is most likely to be either a correlated model with several first-order factors or a higher-order model subsuming them.
National Center Test
All of the Japanese high school students and graduates who wish to be matriculated in public universities and most private universities take the same test concurrently on the same day nationwide once a year in January. Among over 1100 four-year and junior colleges in Japan, around 850, including all of the national and public universities, currently require applicants to take the test (National Center for University Entrance Examinations n.d.-a), and over 550,000 applicants, comprising over a half of new high school graduates, take the multiple-choice tests of various subjects (National Center for University Entrance Examinations n.d.-b). The test items are made strictly in accordance with the guidelines on the high school curriculum stipulated by MEXT.
Structure of NCT
No. of questions
Testing time (min)
As far as the author knows, there are only few studies that investigated the correlations of scores between NCT and other commercially available private tests (Eiken Foundation of Japan 2015; Otsu 2013, 2014; Yamanishi 2001). For instance, Otsu (2014) analyzed the relationships of scores between TOEIC, TOEFL PBT, and NCT and found that its correlation was 0.80 between TOEIC and NCT and 0.70 between TOEFL and NCT. However, the number of participants was as few as 63 and 28, respectively, and their TOEIC and TOEFL scores were self-reported. Besides, the time lag between when they took those tests and NCT was not controlled for. Thus, the reliability of the scores is not ensured. Also, the English proficiency of the participants was skewed to advanced level, so they may not represent the typical sample. Remedying these shortcomings, Eiken Foundation of Japan (2015) analyzed the data in a more robust procedure. As many as around 1000 participants took TEAP and Eiken 3 or 4 months after they took NCT. The study found that the correlation between NCT and TEAP is 0.80 and that between NCT and Eiken is 0.89. However, none of the tests examined in those abovementioned studies (i.e., TOEIC, TOEFL PBT, TEAP, and Eiken) contained speaking or writing scores even if the test had those sections; thus, it is unknown to what extent the scores derived from the accumulation of four skills correlates with NCT scores, which is currently an issue of more importance. Finally, as far as the author knows, the factor structure of NCT has not been examined in any of the previous studies thus far.
TOEFL Junior Comprehensive
Structure of JC
No. of questions
Testing time (min)
Because the speaking and writing section scores will not be equated, the scores are not strictly comparable … To avoid any incorrect impression on the part of stakeholders that the speaking and writing scores are comparable across forms, as the reading and listening section scores are, it was decided that the speaking and writing scales would be made clearly distinguishable from the reading and listening scales. (p. 17)
Following this concept, instead of total scaled scores, overall score levels compatible with CEFR (see Tannenbaum and Baron 2015, for details) are reported in JC ranging from 1 to 6 (see Papageorgiou et al. 2015, for details). The use of different scoring scales for receptive skills (reading and listening) and productive skills (speaking and writing) imply that at least these two constructs need to be separately posited in the model.
The test is conducted via computers, and all of the questions are displayed on a computer screen. Some of the test items in the speaking and writing sections are integrated with listening. Unfortunately, the test became defunct at the end of 2016.1 , 2 Although GC&T (Global Communication & Testing), the organization that operated JC in Japan, has a single data set that explored the relationship between JC scores and NCT scores, they are not publicized, thus inaccessible (personal communication, June 23, 2017).
How are the scores of NCT and JC correlated with each other?
Which of the five models (unitary, uncorrelated skill, correlated skill, uncorrelated test, and correlated test) best represents the test constructs of NCT and JC?
Descriptive statistics of two NCTs on the national level and the number of participants
No. of participants
Score conversions of JC
Raw scores (X)
X − 140
X − 140
X/4 × 5
X/4 × 5
Descriptive statistics and correlations
Descriptive statistics of NCT and JC
Results of correlation matrix
An exploratory factor analysis
Because all of the six scores were highly correlated, an exploratory factor analysis was conducted in order to detect the number of latent factors, using raw scores. Although strong correlations were observed between reading and total scores of NCT (r = .99) and between listening and total scores of JC (r = .90), since total scores were excluded for factor analysis, none of the variables tested in a factor analysis had a correlation of over 0.8. Also, the determinant was 0.01. Thus, multicollinearity was not at issue. A Bartlett’s test was significant at p < .001, indicating that it is significantly different from an identity matrix. The value of Kaiser-Meyer-Olkin statistic was 0.917, verifying the sampling adequacy. No univariate or multivariate outlier was detected using z scores and Mahalanobis distance (max = 20.309), respectively. All of the values for skewness and kurtosis fall within the range of |3.30| (z score at p < .01), securing univariate normality (Tabachnick and Fidell 2007). Mardia’s normalized estimate of multivariate kurtosis was 0.871, which is well below 5, securing multivariate normality (Byrne 2016).
Results of exploratory factor analysis
Confirmatory factor analyses
First of all, the two uncorrelated models (Figs. 9 and 11) were rejected as they were unidentified. Although this issue was solved by setting the weight of another regression path as one, such a treatment is not theoretically supported, and additionally, the models were found to be a poor fit (p < .001). Thus, these models are not considered further.
Results of model fits
χ 2 /df
0.048 [0, 0.112]
0 [0, 0.097]
0.053 [0, 0.119]
Unstandardized regression weights of unitary model
NCT reading <− English proficiency
NCT listening <− English proficiency
JC reading <− English proficiency
JC listening <− English proficiency
JC speaking <− English proficiency
JC writing <− English proficiency
Unstandardized regression weights of correlated skill model
NCT reading <− receptive skills
NCT listening <− receptive skills
JC reading <− receptive skills
JC listening <− receptive skills
JC speaking <− productive skills
JC writing <− productive skills
Unstandardized regression weights of correlated test model
NCT reading <− NCT
NCT listening <− NCT
JC reading <− JC
JC listening <− JC
JC speaking <− JC
JC writing <− JC
Variances of unitary model
Variances of correlated skill model
Variances of correlated test model
Squared multiple correlations
Table 9 also shows that the correlated test model was also as well fit as the unitary model for all of the indices except RMSEA at 0.053 > 0.05. A chi-square difference test indicates that the degree of fit of these two models are not significantly different from each other (χ 2 difference = 0.746, df difference = 1, p = .388). The correlation between the two latent factors of NCT and JC was 0.98.
RQ1: How are the scores of NCT and JC correlated with each other?
The correlation of scores between NCT and JC turned out to be all high. The high correlation of the total scores (r = .86) indicates that JC could have been a proper candidate to replace NCT for their total scores (however, see In’nami et al., 2016, for a criticism of such a claim). This figure is somewhat compatible with those found in past studies that investigated correlations between NCT scores and other commercially available tests (r = .70 for TOEFL, r = .80 for TOEIC and TEAP, r = .89 for Eiken) (Eiken Foundation of Japan 2015; Otsu 2014). These results imply that whether the test follows the restriction of the guidelines on high school curriculum published by the MEXT exerts little impact on the test results. However, the unique contribution of the present study lies in the fact that this is perhaps the first study that proved that this applies to a commercially available test of not only two receptive skills but also those measuring four skills. Unfortunately, JC has already stopped its operation and, thus, cannot be a replacement for NCT. Still, the high compatibility between NCT and JC scores may be a good omen for other four-skill tests without the curriculum restriction to be named as prime candidates to replace NCT. To be cautious, however, such verifications need to be empirically tested in future studies. That is partly because the difficulty of those tests may not be compatible from the perspective of preparation. It is relatively easy to prepare for NCT because (a) the test content falls within the scope of curriculum guidelines, which limits the coverage of what to study; (b) a large number of exercise books are constantly published; and (c) the test becomes open to the public once the test is over every year, and the accumulation of the questions used in the past makes it easy to anticipate the types of questions to be asked. In contrast, those other tests of four skills lack all or at least one of these three points. Perhaps the test with the least disadvantage is Eiken because numerous exercise books are published, and it publicizes the questions used on the website; still, it is without the restriction of the curriculum guidelines, making it rather difficult to anticipate what to study for the test. All in all, more studies are expected to be conducted to see the compatibilities of the scores of those tests and NCT.
RQ2: Which of the five models (unitary, uncorrelated skill, correlated skill, uncorrelated test, and correlated test) best represents the test constructs of NCT and JC?
In the present study, the unitary model and the correlated test model were equally well fit according to the chi-square difference test. However, when two models are equally well fit, the model should be chosen based upon the principle of parsimony. That is to say, the simpler model with more degrees of freedom (unitary model) should be preferred over a more saturated model with fewer degrees of freedom (correlated test model). Together with the fact that the RMSEA value was over 0.05 in the correlated test model, this model should be rejected. This indicates that these two tests are not only similar but also even close to being identical in terms of their test constructs; thus, they do not warrant being distinguished from each other by test types. The high correlation between the two factors of tests (r = .98) in the model also corroborates this decision because previous studies adopted the correlation of over 0.9 as a criterion to detect extremely highly correlated factors as they are statistically indistinguishable. In fact, based on this notion, Gu (2015) discarded the correlated four-factor model.
Furthermore, the two models, the unitary model and the correlated skill model, were equally well fit. The chi-square difference test showed the latter was marginally better than the former if the conventional alpha level of 0.05 is adopted. Actually, some of the figures in Table 9 indicate the superiority of the latter (e.g., CFI = 0.995 vs 1, TLI = 0.992 vs 1, RMSEA = 0.048 vs 0). However, because the P value was only slightly lower than 0.05 (p = .044), if the more restricted alpha level is adopted (even at 0.04), both models fit equally well. Then, following the principle of parsimony, the unitary model should be chosen over the correlated skill model. Additionally, the two latent factors are estimated to be correlated at as high as 0.93, and for the abovementioned reason, these two factors are statistically indistinguishable.
It should be noted that, in In’nami et al. (2016), the unitary model was found to be the best fit both for TEAP and TOEFL iBT when the endogenous (observed) variables were skill-based scores: reading, listening, speaking, and writing of TEAP and TOEFL iBT, and claimed that this evidence indirectly supported the higher-order structures. However, an important difference should be noted between their study and the current one. At least for TEAP, In’nami et al. rejected the correlated model with two first-order factors of receptive skills and productive skills due to the low TLI value (0.718). On the contrary, in the current study, it was exactly this model that was found to be the best choice (TLI = 1), which indirectly negates the possibility of the higher-order model.
Thus, depending upon what perspective to take, either the unitary model or the correlated skill model can be the best candidate. If the correlated skill model is to be adopted in line with numerous previous studies that examined the factor structure of language competence, this study suggests that at least receptive skills and productive skills warrant being measured separately. (Due to the fact that a single variable was obtained for speaking and writing, this study does not avail to claim that each of these two skills should be measured separately.) However, if the unitary model is to be adopted, this is quite an unexpected result because the model has been almost uniformly rejected in most of the past literature on empirical grounds. This study is most likely the first study to analyze the factor structure of NCT, so there is no study to refer to; however, at least one study, Gu (2015), examined that of JC, so it warrants comparing with the current study.
Gu (2015) speculated that those test items that require integrative skills to tackle may load on multiple factors, tested a model that allowed cross-loadings, but found that this model was not tenable as all of the loadings on the secondary factors turned out to be non-significant. Such a verification was possible because the analysis was done on the item level. Here, although speculatively, lies the reason for the discrepancy in the models to be adopted in the two studies. Perhaps, on each item level, the loading on the secondary factor is too weak to be significant, but as a composite score of a few items on multiple factors, their effects may have become significant, which may explain why the correlations among the first-order factors of the four skills were all highly correlated at around 0.9, and thus, the correlated model was consequently discarded in Gu’s study. It should be noted that, in contrast to Gu’s study, the present study adopted even broader categories of two factors for the first order: receptive skills and productive skills, and this practice even likely facilitates blurring the boundaries between first-order factors. In JC, some of the test items in the speaking and writing sections are integrated with listening. Thus, the receptive skill (of listening) is also measured in productive skills (of speaking and writing). Unfortunately, the uncorrelated/correlated models in which receptive skills are also loaded on JC speaking and writing were unidentified in this study. However, setting the regression weights from productive skills to both JC speaking and writing at 1 in the uncorrelated model, the estimated value from receptive skills to JC speaking and to JC writing turned out to be significant at 0.435 (p < .001) and 0.475 (p < .001), respectively. Thus, although tentatively, the abovementioned hypothesis is supported.
As a final note, Alderson (1991) claims that, when exploring the nature of language proficiency, a homogeneous group should be recruited because test takers with a variety of background of ethnics, cultures, languages, and education may yield different outcomes, leading to confounding results. Sasaki (1996) also posits that learning contexts may exert on disproportionate development of each skill. The present study followed Alderson's (1991) advice, but this practice, of course, comes at the expense of generalizability; thus, the results of the present study cannot be generalized beyond Japanese high school students. Then, it is somewhat surprising that the unitary model could be adopted for them because, generally speaking, English education in Japan tends to emphasize receptive skills over productive skills partly owing to the fact that the NCT measures only the former. However, the results of the present study indicate that even productive skills develop relatively evenly with receptive skills among Japanese high school students, which is in line with Sasaki (1996). All in all, this study showed that what Sasaki found among Japanese university students may be applicable even among Japanese high school students.
Assuming that all of the six sections in the two tests are measuring a single construct, a question one could ask is, in order to assess learners’ English proficiency, do receptive skills and productive skills need to be measured separately? Since the communality of NCT reading was 0.81, 81% of NCT reading scores can be explained by a single factor. JC speaking had the lowest communality, but still, it was over a half (0.52). Then, it is possible to claim that, by assessing learners only through NCT reading, we can quite confidently surmise their English proficiency.
Nevertheless, this paper was written without any intention to propose that only reading should be assessed for university entrance examinations in Japan. Such a practice will naturally lead English classes to heavily focus on reading only, possibly via the Grammar Translation Method. In order to foster communicative skills in a balanced manner among students, including productive skills, tasks in which students utilize all four skills should be implemented. For that sake, the washback effect imposed by such a high-stake test as NCT is useful, if not indispensable. It is sincerely hoped that, through implementing the system to require all students to take the tests of four skills for university entrance examination, English education in Japan will cultivate all four skills among students more than ever.
Readers may wonder why a defunct test was chosen and claim that a test still in use should be targeted instead. The abolishment of the test was announced after a large portion of data were already collected, all of a sudden by ETS. So this incident unpredictably happened.
The deadline was postponed until the end of March 2017 for some exceptional cases, including the present study.
First of all, I would like to express my deepest gratitude to Atsushi Mizumoto and Yo In’nami who gave me valuable comments on statistical procedures and also to Neal Snape for proofreading the paper. Second, this study was not feasible without the technical help of Kazuma Shigeno for his technical help and the help of the five staffers at GC&T, Sota Hori, Kotaro Kurihara, Naoko Ohno, Hiromi Ando, and especially Mikihiko Takawa; so I greatly appreciate their continuous support. Lastly, I thank all of the participants and the high school principals who kindly allowed me to recruit students at their schools and, not to mention, the editor and anonymous reviewers for their constructive feedback and patience.
This study was supported by KAKENHI (JP15K02789).
NK singly designed the study, collected the data, performed the statistical analysis, drafted the manuscript, and approved the final manuscript.
The author declares that he has no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Alderson, C. J. (1991). Language testing in the 1990s: how far have we come? How much further have we to go? In S. Anivan (Ed.), Current developments in language testing (pp. 1–26). Singapore: SEAMEO Regional Language Centre.Google Scholar
- Bachman, L. F., & Palmer, A. S. (1981). The construct validation of the FSI oral interview. Language Learning, 31(1), 67–86.View ArticleGoogle Scholar
- Bachman, L. F., & Palmer, A. S. (1982). The construct validation of some components of communicative proficiency. TESOL Quarterly, 16(4), 449. https://doi.org/10.2307/3586464.
- Benesse. (1997a-2017a). GTEC. Retrieved from http://www.benesse.co.jp/gtec/
- Benesse. (1997b-2017b). GTEC CTE. Retrieved from http://www.benesse.co.jp/gtec/cte_company/index.html
- Benesse. (2000–2017). GETC CBT. Retrieved from http://www.benesse-gtec.com/cbt/.
- Benesse. (n.d.-a). GTEC daigakuban 4-ginouka start no oshirase flier. Tokyo, Japan.Google Scholar
- Benesse. (n.d.-b). GTEC Junior. Retrieved from http://www.benesse-gtec.com/jr/
- British Council, IDP: IELTS Australia, & Cambridge English Language Assessment. (2017). IELTS. Retrieved from https://www.ielts.org/
- Byrne, B. M. (2016). Structural equation modeling with AMOS: basic concepts, applications, and programming (3rd ed.). New York: Routledge.Google Scholar
- Cambridge English Language Assessment. (2017). Cambridge English. Retrieved from http://www.cambridgeenglish.org/
- Educational Testing Service. (2017a). TOEFL iBT. Retrieved from https://www.ets.org/toefl
- Educational Testing Service. (2017b). TOEFL Junior. Retrieved from https://www.ets.org/toefl_junior/
- Educational Testing Service. (2017c). TOEIC. Retrieved from https://www.ets.org/toeic/
- Eigo yonginou shikaku kentei kondankai. (2016). Eigo yonginou shiken jyouhou site. Retrieved from http://4skills.jp/qualification/comparison.html
- Eiken Foundation of Japan. (2015). Daigakunyushi centersiken tono soukanchousa: Jitsuyoueigo ginoukentei to TEAP de jissi. Retrieved from Tokyo, Japan: https://www.eiken.or.jp/teap/info/2015/pdf/20151007_pressrelease_testresearch.pdf
- Eiken Foundation of Japan. (n.d.-a). BULATS. Retrieved from http://www.eiken.or.jp/bulats/
- Eiken Foundation of Japan. (n.d.-b). Eiken. Retrieved from http://www.eiken.or.jp/eiken/
- Eiken Foundation of Japan. (n.d.-c). TEAP. Retrieved from http://www.eiken.or.jp/teap/
- Eiken Foundation of Japan. (n.d.-d). TEAP CBT. Retrieved from http://www.eiken.or.jp/teap/
- Fouly, K. A., Bachman, L. F., & Cziko, G. A. (1990). The divisibility of language competence: a confirmatory approach. Language Learning, 40(1), 1–21. dx.doi.org/10.1111/j.1467-1770.1990.tb00952.x.View ArticleGoogle Scholar
- GC&T. (n.d.). TOEFL Junior Comprehensive Test naiyou. Retrieved from https://gc-t.jp/toefljunior/comprehensive/test/detail/
- Gu, L. (2015). Language ability of young English language learners: definition, configuration, and implications. Language Testing, 32(1), 21–38. https://doi.org/10.1177/0265532214542670.
- In’nami, Y., Koizumi, R., & Nakamura, K. (2016). Factor structure of the Test of English for Academic Purposes (TEAP®) test in relation to the TOEFL iBT® test. Language Testing in Asia, 6(1). https://doi.org/10.1186/s40468-016-0025-9.
- In'nami, Y., & Koizumi, R. (2012). Factor structure of the revised TOEIC test: a multiple-sample analysis. Language Testing, 29(1), 131–152. https://doi.org/10.1177/0265532211413444.
- Llosa, L. (2007). Validating a standards-based classroom assessment of English proficiency: a multitrait-multimethod approach. Language Testing, 24(4), 489–515. https://doi.org/10.1177/0265532207080770.
- Ministry of Education, C., Sports, Science and Technology. (2010). Koutou gakkou gakushuu shidou yoryo eiyakuban (kariyaku). Retrieved from http://www.mext.go.jp/a_menu/shotou/new-cs/youryou/eiyaku/__icsFiles/afieldfile/2011/04/11/1298353_9.pdf
- Mizumoto, A. (2014). Sokuteino datouseito shinraisei -yuidatano hissujyouken towa. In O. Takeuchi & A. Mizumoto (Eds.), Gaikokugo kyouiku kenkyu handbook -kaiteiban (pp. 17–31). Tokyo: Shohakusha.Google Scholar
- National Center for University Entrance Examinations. (2015). National Center for University Entrance Examinations Annual Report. Retrieved from Tokyo, Japan: http://www.dnc.ac.jp/albums/abm.php?f=abm00006725.pdf&n=2015大学入試センター英版.pdf
- National Center for University Entrance Examinations. (2016). Heisei 28 nendo daigaku nyushi center shiken jisshi kekka no gaiyou. Retrieved from http://www.dnc.ac.jp/albums/abm.php?f=abm00006898.pdf&n=別添2:[試験情報]平成28年度大学入試センター試験実施結果の概要.pdf
- National Center for University Entrance Examinations. (2017). Heisei 29 nendo daigaku nyushi center shiken jisshi kekka no gaiyou. Retrieved from http://www.dnc.ac.jp/albums/abm.php?f=abm00009105.pdf&n=別添2:【修正・試験情報】平成29年度大学入試センター試験実施結果の概要%2B%2B-%2Bコピー.pdf
- National Center for University Entrance Examinations. (n.d.-a). Center shiken sanka daigaku jyouhou. Retrieved from http://www.dnc.ac.jp/center/daigaku_jouhou.html
- National Center for University Entrance Examinations. (n.d.-b). Shiganshasuu jyukenshasuu touno suii. Retrieved from http://www.dnc.ac.jp/data/suii/suii.html
- Oller, J. W. J. (1979). Language tests at school: A pragmatic approach. London: Longman.Google Scholar
- Oller, J. W. J. (1983). Evidence for a general language factor: an expectancy grammar. In J. W. J. Oller (Ed.), Issues in language testing research (pp. 3–10). Rowley: Newbury House.Google Scholar
- Otsu, T. (2013). Monitor chousasha jyukensha ni okeru eigohyoujyunka test no seiseki. Heisei 24 nendo listening test no jisshikekka ya seikatou wo kensyoushi sono kaizenwo hakarutameno chousakenkyuu ni kannsuru houkokusho, 89–95.Google Scholar
- Otsu, T. (2014). Hyoujyunka eigoshiken to center shiken eigokamoku tokuten tono kankei bunseki. Retrieved from Tokyo, Japan: http://antlers.rd.dnc.ac.jp/~otsu/doc/jart2014_p66-69.pdf
- Papageorgiou, S., Xi, X., Morgan, R., & So, Y. (2015). Developing and validating band levels and descriptors for reporting overall examinee performance. Language Assessment Quarterly, 12(2), 153–177. https://doi.org/10.1080/15434303.2015.1008480.
- Pearson. (2014). PTE Academic. Retrieved from http://pearsonpte.com/
- Pearson. (n.d.). Progress. Retrieved from http://product.pearsonelt.com/progress/
- Sasaki, M. (1996). Second language proficiency, foreign language aptitude, and intelligence: quantitative and qualitative analyses (Vol. 6): Peter Lang Pub Incorporated.Google Scholar
- Sawaki, Y., Stricker, L. J., & Oranje, A. H. (2008). Factor structure of the TOEFL Internet-based test (iBT): exploration in a field trial sample. Retrieved from Princeton, NJ: http://onlinelibrary.wiley.com/doi/10.1002/j.2333-8504.2008.tb02095.x/epdf
- Sawaki, Y., Stricker, L. J., & Oranje, A. H. (2009). Factor structure of the TOEFL Internet-based test. Language Testing, 26(1), 005–030. https://doi.org/10.1177/0265532208097335.
- Shin, S.-K. (2005). Did they take the same test? Examinee language proficiency and the structure of language tests. Language Testing, 22(1), 31–57. https://doi.org/10.1191/0265532205lt296oa.
- So, Y., Wolf, M. K., Hauck, M. C., Mollaun, P., Rybinski, P., Tumposky, D., & Wang, L. (2015). TOEFL Junior design framework (RR-15-13). Retrieved from Princeton, NJ: http://onlinelibrary.wiley.com/doi/10.1002/ets2.12058/epdf
- Stricker, L. J., & Rock, D. A. (2008). Factor structure of the TOEFL Internet-based test across subgroups. Retrieved from Princeton, NJ: https://www.ets.org/Media/Research/pdf/RR-08-66.pdf
- Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Needham Heights: Allyn and Bacon.Google Scholar
- Tannenbaum, R. J., & Baron, P. A. (2015). Mapping scores from the TOEFL Junior Comprehensive test onto the Common European Framework of Reference (CEFR). Retrieved from Princeton, NJ: https://www.ets.org/Media/Research/pdf/RM-15-13.pdf
- United Nations Associations of Japan. (n.d.). Kokuren Eiken. Retrieved from http://www.kokureneiken.jp/
- Yamanishi, T. (2001). Eiken syutokukyuu to daigaku nyuushi center shiken eigokamoku no tensuu tono soukankankei. STEP Bulletin, 13, 26–42.Google Scholar