The relationships between test performance and students’ perceptions of learning motivation, test value, and test anxiety in the context of the English benchmark requirement for graduation in Taiwan’s universities
© The Author(s). 2017
Received: 1 March 2017
Accepted: 23 May 2017
Published: 8 June 2017
Having been influenced by the trend of internationalization of higher education, most universities in Taiwan have implemented an English benchmark requirement for graduation, which requires students to demonstrate their English ability at a specified Common European Framework of Reference for Languages (CEFR) level through taking a standardized English language test (e.g., GEPT, IELTS, TOEFL iBT). This practice has been increasingly criticized for failing to achieve its intended goals of enhancing students’ English language proficiency and increasing students’ career mobility. Therefore, there is an urgent need to explore the consequences of using standardized tests in support of the policy.
To this end, this study investigated students’ views of the graduation policy in three universities where students are required to take the General English Proficiency Test (GEPT) prior to graduation. Structural equation modeling was employed to find the best fitting model that illustrates the complex interrelationships among test performance, students’ perceptions of the requirement, test value, test anxiety, and learning motivation.
The findings show that university students, regardless of English proficiency, generally hold a positive attitude towards the English graduation benchmark policy. Results further reveal that the Intermediate group shows more positive attitudes towards the graduation requirement than the High-Intermediate group. SEM results show that the attitudes of university students towards the English graduation requirement positively impact their perceived test value and their learning motivation. However, there is no significant relationship between the attitudes towards the policy and test performance.
The findings contribute to our understanding of university students as the major stakeholders who defined the context of test use.
KeywordsLearning motivation Structural equating modeling Test consequences
In 2005, the Ministry of Education (MoE) began implementing the English graduation benchmark policy in universities across Taiwan, with the aim to encourage college students to pass a credible standardized English test before graduation. Behind the policy lies the belief that taking a standardized test helps students to prove their English competence, prepare for future employment or advanced studies, and also increase their competitive edge in the global environment. Authors like Shohamy (2000) and McNamara (2001) have asserted that language testing serves the function of gate-keeping in many contexts. Similarly, in the context of Taiwan’s higher education, language testing has been utilized as a tool to enforce the power of the English graduation benchmark policy.
At present, more than 90% of universities in Taiwan have implemented the English graduation benchmark policy, with each university setting its own benchmark standard. As students from different universities exhibit varying levels of English competence, it is very difficult for the government to formulate uniform standards. However, the MoE’s adoption of the Common European Framework of Reference for Languages (CEFR) provided institutions, schools, and the general public with a reference for various levels of language competence and testing requirements (Council of Europe 2001). According to the CEFR, language ability is divided into six levels, specifically A1, A2, B1, B2, C1, and C2, in ascending order from low to high competence. Most of the universities require that their students pass an English test equivalent to the CEFR B1 level upon graduation, whereas the top five universities set their graduation benchmark at the CEFR B2 level. Starting in 2016, National Taiwan University, Taiwan’s most prestigious university, has set the benchmark at the CEFR C1 level for its English major students.
Most universities accept either Test of English for International Communication (TOEIC) or General English Proficiency Test (GEPT) scores as proof of their students’ English proficiency. Each university sets its own requirement if students fail to pass the graduation benchmark. Some schools require that students retake the test until they pass, some ask students to participate in additional training if they fail the test twice, and others set various “backdoor policies,” such as requiring students who fail to sign up for an extra course as a required condition for graduating (Chen 2014). Although the graduation benchmark policy is widely implemented across Taiwan, regulations and problems stemming from the policy have become highly controversial, causing dissatisfaction among students and teachers as they demand to have the policy reexamined (Her et al. 2013; Chang 2005).
The English graduation benchmark policy has attracted the interest of scholars in Taiwan, and some studies have investigated the effectiveness of implementing such a policy. Among existent studies, Chen and Liu (2007), Liao (2010), and Shih (2008) use questionnaires and interviews to compare the learning motivation of students before and after the implementation of the benchmark policy. Their findings show that the policy has helped students develop a more positive attitude towards English learning, with over 50% of the students affirming the positive effect of the policy. In other words, the students surveyed generally agree that implementation of the policy has increased their motivation for learning English. Huang (2010) found that students show relatively low anxiety towards the benchmark policy. Students enrolled in a school without the policy tend to show a higher anxiety than those who are required to pass the benchmark tests.
At present, there are still relatively few studies focusing on the English graduation benchmark policy, learning motivation, and test anxiety, and since the number of studied samples could be larger, more empirical research is needed to show that the policy helps to promote English learning motivation. Data show that college students in Taiwan spend a total of 1 billion new Taiwan dollars (about USD30 million) every 4 years on taking English standardized tests, but the effectiveness of these tests is limited, and there is no evidence that taking English standardized tests helps to increase students’ learning motivation or English communication skills (Her et al. 2013).
This study seeks to contribute to this area of research. By sampling a greater number of students, we hope to better understand how students view this policy. Moreover, since learning motivation is a complicated cognitive factor (Cheng et al. 2014), the English graduation benchmark policy is not only related to learning motivation but also reflects students’ attitudes towards English standardized tests, and how they feel about their English proficiency. To provide a more comprehensive analysis of students’ views on the English graduation benchmark policy, this study will consider relevant factors such as students’ learning motivation, their views on the importance of English tests, test anxiety, test performance, and the inter-relationships among them.
Motivation and performance
Motivation is a complex psychological trait; it is a hidden force within people that drives them to take action. “Learning motivation” can be defined as an internal thought process that triggers learners to achieve specific physiological or psychological goals and devote their effort voluntarily, while maintaining momentum throughout the learning process (Stipek et al. 1995). In general, motivation is considered one of the most important factors in determining a student’s second language performance. However, the actual correlation between learning motivation and performance has not been accurately determined, and a precise definition of this construct is still lacking (Dörnyei 2001). Regarding this, Eccles and Wigfield (2002) have summarized many theories on the relationship between motivation and performance, including intrinsic motivation theory, self-determination theory, flow theory, and goals theory. They also integrated theories of expectation and value construction, such as attribution theory, expectancy-value theory, self-worth theory, and theories integrating motivation and cognition.
Among these theories, a popular topic of research today is self-determination theory (SDT), proposed by Deci and Ryan in 1985. They discussed how when an inherent positive belief persists in an individual, the person will work diligently to achieve their committed goal. In the process, the three inherent needs of human beings—namely autonomy, competence, and psychological relatedness—are fulfilled, which will bring about optimal progress and development for the individual. Ryan and Deci (2000) suggest that both intrinsic and extrinsic motivation can stimulate individual behavior and performance. While intrinsic motivation drives a person to continuously pursue better performance based on his or her interest in the subject and the desire to meet the needs of competence and autonomy, extrinsic motivation is often driven by some actual form of reward, which is considered outside the realm of self-determination, and only through internalization, integration, and regulation does it become part of the self-determination process.
Relationships among attitudes, motivation, test anxiety, and test performance
Although there is still considerable controversy surrounding the SDT theory proposed by Ryan and Deci, Cheng et al. (2014) agreed with Ryan and Brown (2005) that compared to other motivation theories, the SDT principle is more applicable to the discussion of the relationship between learning motivation and high-stakes testing. Ryan and Weinstein (2009) used the SDT theory to explain the effect of high-stakes testing on teachers and learners. In high-stakes testing, the motivation for success in learners is not static, but may vary according to people, time, environment, and other factors. Regardless of whether the test-taker has a set purpose for taking the test, the inherently complex nature between the test-taker and the test may influence motivation as well. Ryan and Brown (2005) argued that the policy of test taking is predicated on the grounds of using reward, punishment, and pressure on self-esteem to motivate learning. Noels (2005) suggested that the social and cultural contexts outside the classroom can greatly influence the motivation for learning a second or foreign language. The effect is even more evident when the purposes of the test or the stakes involved vary (e.g., entrance examination, placement test, immigration test). This can lead to different levels of test anxiety and can possibly become a construct-irrelevant variance.
Research confirms that a person’s attitude directly influences motivation and behavior (Ajzen 1985; Fishbein and Ajzen 1975). Ajzen (1985) proposed the Theory of Planned Behavior, suggesting that an individual’s actions are not only influenced by his or her preference for certain people, things, events, and the subjective norm of society and others but also affected by the individual’s desire to complete an action and the perceived behavioral control towards resources and opportunities.
A person’s attitude towards specific things and events is also likely to affect motivation and anxiety. Pyun (2013) studied the relationship between task-based language learning and learning motivation and anxiety. The results showed that learner attitude and anxiety show significant negative correlation, while learner attitude and motivation show significant positive correlation. Test anxiety typically surfaces during certain cognitive performances for test takers, such as when they compare themselves with their peers, worry about the consequence of failing a test, experience low self-confidence, or are excessively worried about testing and assessment (In’nami 2006; Liu 2008). Different levels of test anxiety can be attributed to the individual’s family background, social environment, and the teaching methods he or she is used to. For example, parents who expect outstanding test results from their children may be putting excessive pressure on them (Bodas and Ollendick 2005). Considering these points of view, test anxiety can negatively impact test performance, impeding test takers from achieving their full potential and strength (Elkhafaifi 2005; Meijer 2001). Many studies have shown a negative correlation between test anxiety and academic performance (Chapell et al. 2005; Ruthig et al. 2004; Putwain 2007).
Test anxiety also affects test takers’ performance on foreign language tests, as shown by a study carried out by Tsai (2010). She reported that there was significant negative correlation (γ = −.49) between test anxiety and performance from the results of the listening section of the GEPT Intermediate Level Test. Her conclusion echoes Kunnan’s (1995) view that the complex interaction between social and cognitive factors may influence the test results of students in different testing scenarios, depending on differences in test purpose and the stakes involved in the local context.
However, Cheng et al. pointed out that these inferences need to be confirmed by further research and different statistical methods. Moreover, the study’s “test purpose” was filled in by respondents who completed the questionnaire and not defined specifically as “English graduation benchmark.” Authors (2016) used the theoretical framework of Cheng et al., but included questions related to “English graduation benchmark policy” in the questionnaire. The study explored the views of 1620 students from two universities in northern Taiwan on the English graduation benchmark policy, as well as the relationships among learning motivation, test value, test anxiety, and test performance. The structural equation model (SEM) was applied to test the complex relationships among variables. The findings of their study show that university students generally hold a positive attitude towards the English graduation benchmark policy. SEM results show that the attitudes of university students towards the English graduation benchmark policy positively impact their perceived test value and their learning motivation.
Based on the preliminary results, authors (2016) suggest that their study serves the purpose of examining the consequences of using the GEPT as a benchmark test for graduation in the context of Taiwan’s higher education. Yet, with regard to one limitation acknowledged by the researchers themselves, their study only used data from students of two universities that have established passing the GEPT High-Intermediate Level Test (equivalent to the CEFR B2) as their English graduation benchmark requirement. They speculated that the sampled students tend to show a stronger learning motivation and more autonomous learning behavior than the university students who have lower levels of English proficiency; thus, their attitudes towards the graduation benchmark policy are also more positive and optimistic. Therefore, they suggest that to confirm the findings of their study, more data needs to be gathered from other universities that use different levels of the GEPT as their graduation benchmark requirement. Although the High-Intermediate group data could be divided into passers and non-passers in order to examine whether results might vary due to students’ English proficiency, we considered it to be more effective if the results between two different GEPT levels could be compared directly because over 30% of the High-Intermediate non-passers are very likely to pass the GEPT Intermediate based on the results of the GEPT vertical scaling studies (e.g., Wu and Liao 2010). Therefore, following the procedures employed in the previous study which used the GEPT High Intermediate data, the present study collected new data from one university that uses the Intermediate Level of the GEPT as its graduation benchmark requirement. By comparing the results from these two studies that used different levels of the GEPT and involved students who have different levels of English proficiency, we hope to obtain more insights into the context of using the GEPT scores to fulfill the graduation requirement and to justify the consequences of using the GEPT to encourage university students to learn more English. Given that the two studies were conducted by the same researchers and the latter one was carried out on the basis of the former with respect to the validation of the research instrument and the model to explain the relationship among students’ attitudes’ towards the GEPT, learning motivation, test value, test anxiety, and test performance, this paper will report these two studies as one single study.
Research questions and hypotheses
What are students’ attitudes towards the English benchmark policy for graduation in Taiwan’s universities? Are there differences between the High Intermediate group and the Intermediate group?
What are the relationships between students’ attitudes towards the graduation benchmark policy, their test performance (i.e., raw scores), and their perceptions of learning motivation, test value, and test anxiety? Are there differences between the High Intermediate group and the Intermediate group?
As mentioned earlier, the study was carried out on the basis of the previous research (Authors 2016) with respect to the validation of the research instrument and the model to explain the relationship among the variables. Although the previous research based on the GEPT High-Intermediate data has been published (in Chinese), for the sake of clarity and coherence, a summary of the research procedures which introduces the research instruments and explains how the best-fit model was established is provided below. As for the other details of the previous study, they are not included here due to text length limitation. Having said so, the key findings of the previous study are discussed and compared with those of the new study which used the GEPT Intermediate data. By doing so, we hope that we can provide more insights when addressing the research questions.
Two measurement instruments were used: the General English Proficiency Test (GEPT) and the questionnaire on learning motivation, test value, and test anxiety.
The General English Proficiency Test (GEPT) is a five-level criterion-referenced EFL testing system, which targets English learners in Taiwan at all levels, from junior high school upwards. The development of the GEPT was started as an in-house project of the Language Training and Testing Center (LTTC). Later, it was partially funded by Taiwan’s Ministry of Education with the aims of promoting life-long learning and introducing positive washback effect on the learning and teaching of English. Since its launch in 2000, the GEPT has been administered independently by the LTTC. Currently, the GEPT is the largest standardized English language test in Taiwan, which is taken by approximately 500,000 test takers at over 100 test sites around the country each year. Numerous evidence of validity has been demonstrated to support the use of the GEPT as a valid indicator of learners’ English language proficiency (e.g., Chan et al. 2014; Liao 2016; Weir et al. 2013; Wu 2016). Currently, GEPT scores are not only considered as proof of English ability by government offices, schools, and employers domestically, but also increasingly recognized by universities around the world, including prestigious institutions in Hong Kong, Japan, France, Germany, the UK, and the US, as a means of measuring the English language ability of Taiwanese learners who are interested in pursuing further study overseas.
The test content of the GEPT is not only linked to the local English curriculum but also takes account of local cultural and social references. The levels of the GEPT, which are also linked with the CEFR empirically, are roughly equivalent to CEFR A2–C1 (e.g., Wu and Wu 2010; Wu 2011).
The GEPT was designed as a skill-based test battery assessing both receptive (listening and reading) and productive (speaking and writing) skills. The test places equal weight on each of the four test components and has general level descriptors and skill-area level descriptors. Each GEPT level is administered in two stages. Test-takers who pass listening and reading (160 out of 240 score points) are allowed to register for speaking and writing (80 out of 100 score points). Those who pass both stages will automatically receive both a score report and a Certificate of General English Proficiency. More details about the GEPT and associated research are available at http://www.gept.org.tw.
This questionnaire was adapted from the questionnaire used in the study by Cheng et al. (2014). However, with the aim to avoid negative associations students might have with “graduation benchmark” and “test anxiety,” the study dispersed questions related to these two dimensions in the section related to test value. Cheng et al. in 2009 studied a sample of 538 test takers of the GEPT High-Intermediate Level Test, and the questionnaire proved to have good reliability and validity. Some of their questionnaire items were included in the questionnaire for this study, for example, “I study English for the satisfaction I gain from learning new things,” “I study English for the purpose of finding an ideal job,” and “I am under a lot of pressure to get good scores on this test.” With a focus on attitudes towards the English graduation benchmark, the questionnaire in the study aimed to reflect students’ views on the implementation of the benchmark policy; thus, items such as “I think it is reasonable to require college students to pass the GEPT High-Intermediate Level Test” and “I understand that my university encourages students to take the GEPT in order to enhance their English proficiency” were created. After piloting, the final version of the questionnaire contains 43 questions, of which 11 are related to test value, 8 related to the benchmark policy, 4 related to test anxiety, and 20 related to learning motivation. The questionnaire uses the six-point Likert-type scale. The higher the number on the scale, the more important the students think the test is, the more positive the attitude towards the benchmark policy, the higher the test anxiety, and the stronger the learning motivation. The questionnaire was conducted in Chinese.
Items, factor loadings, explained variance, and Cronbach’s α
1. How important is my GEPT score for applying to graduate schools.
2. How important is my GEPT score for gaining professional certification.
3. How important is my GEPT score for obtaining an academic award/scholarship.
4. How important is my GEPT score for obtaining a job.
5. How important is my GEPT score for studying/working abroad.
1. I understand that my university encourages students to take the GEPT in order to enhance their English proficiency.
2. I think it is reasonable to require college students to pass the GEPT High-Intermediate Level Test.
3. I think the GEPT is fair and reliable.
4. I agree that Taiwan should develop its own English proficiency tests, for instance the GEPT.
5. I think my university should not require students to take the GEPT.
1. I am under a lot of pressure to get good scores on this GEPT.
2. The GEPT listening section makes me feel anxious.
3. The GEPT reading section makes me feel anxious.
I study English…
1. Because I enjoy reading English literature.
2. For the satisfaction I gain from learning new things.
3. Because I want to know more about English communities and their way of life.
4. Because I like to understand difficult topics in English.
5. For the satisfaction I feel when I am completing a difficult task in English.
6. For the excitement I feel when hearing English.
I study English…
1. Because I want to speak more than one language.
2. Because I think it helps my personal development.
3. Because I want to be able to speak English.
4. Because I would like to perform better at school or at work.
5. Because I want to get a better job.
Cumulative explained variance
Next, we used SEM to conduct reliability and validity analysis and to explore possible relationships between the latent variables. SEM can be used to test the theoretical assumptions between observed variables and latent variables and to verify whether hypothetical relationships between observed variables can be supported by empirical data. In general, a model can be established based on previous research, theory, general knowledge, or a hypothesis proposed by the researcher. The correlation-covariance matrix of the estimated model and that of the observed data are then compared, using the chi-squared test to test the difference between the two. The smaller the chi-squared value is, the greater the indication that the data fit the model, meaning the model reflects the observed data more accurately.
Parameter calibration and model-fit analysis
To achieve a parsimonious model, we removed the paths that did not reach statistical significance from the hypothetical model, and according to the modification index (MI), added a correlation path between the residuals of intrinsic motivation and extrinsic motivation. Intrinsic motivation and extrinsic motivation were originally two sub-latent variables of learning motivation; thus, one way of modifying the model was to add a higher-level latent variable (learning motivation) to the two variables, while another possibility was to add a new correlation coefficient between the residuals of latent variables. In an attempt to better understand the impact of the graduation benchmark on intrinsic and extrinsic motivation, we decided on the latter and modified the model accordingly (Fig. 3).
Fit results for competing models
Modified model for High-Intermediate group
The smaller the better
The smaller the better
Reliability and validity analysis
CR (construct reliability) and AVE (average variance extracted)
The GEPT Intermediate data were collected in 2016 to confirm the model which has been established based on the results obtained from the study with the High Intermediate data (Authors, 2016). The new data was collected from one university in northern Taiwan that uses the GEPT Intermediate Level Test as its English graduation benchmark. A total of 624 respondents answered the same questionnaire used by the High Intermediate group, of which 570 were valid samples, giving the questionnaire an effective return rate of 91% (282 male, 50%; 288 female, 50%).
Comparison summary of questionnaire responses between groups
GEPT test scores
Parameter calibration and model-fit analysis
Fit results for GEPT Intermediate data
Modified model for Intermediate group
Students’ attitudes towards graduation policy as a predictor
Have a significant positive effect on test value
Have a significant positive effect on extrinsic motivation
Have a significant positive effect on test performance
Have a significant positive effect on intrinsic motivation
Have a significant negative effect on test anxiety
Students’ perception of test value as a predictor
Has a significant positive effect on extrinsic motivation
Has a significant positive effect on intrinsic motivation
Has a significant positive effect on test performance
Has a significant positive effect on test anxiety
Students’ learning motivation as a predictor
Extrinsic motivation predicts test performance positively
Intrinsic motivation predicts test performance positively
Interrelationship between test anxiety and learning motivation
Test anxiety influences extrinsic motivation
Extrinsic motivation influences test anxiety
Test anxiety influences intrinsic motivation
Intrinsic motivation influences test anxiety
Has a significant negative effect on test performance
Examining the effect of the students’ attitudes towards the policy on the various latent variables for the Intermediate group, it can be seen that attitudes towards the policy have a significant positive effect on the perceived test value, with a path coefficient of .53; attitudes towards the policy also have a positive effect on both the extrinsic and intrinsic motivation, with a path coefficient of .62 and .56 respectively. Among the two, the effect on extrinsic motivation is slightly higher than that on intrinsic motivation. There is no significant correlation between attitudes towards the policy and test performance. In terms of test anxiety, results show attitudes towards the policy have a positive effect on test anxiety (β = .21), meaning that students with a more positive attitude towards the policy tend to experience a increased level of anxiety when taking the test.
The interaction effect between test value and other latent variables was also examined: Test value has a positive effect on test anxiety (β = .22), but shows no significant relationship with intrinsic motivation and extrinsic motivation. As for the effect of learning motivation on test performance, results show that only extrinsic motivation has a positive effect (β = .17) on test performance, while there is no significant relationship between intrinsic motivation and test performance. In other words, in order to improve students’ performance on English tests, it is important to increase their extrinsic learning motivation. In addition, there is no relationship between test anxiety and learning motivation. Results also show there is a significant negative effect (β = −.29) of test anxiety on test performance. The various relationships among learning motivation, test anxiety, and test performance in this study echo those reported by Cheng et al. in their findings.
Conclusions and discussion
This section discusses the results drawn from the two studies corresponding to the research questions.
RQ1: What are students’ attitudes towards the English benchmark policy for graduation in Taiwan’s universities? Are there differences between the High-Intermediate group and the Intermediate group?
The findings show that university students, regardless of whether they belonged to the High-Intermediate group or the Intermediate group, generally hold a positive attitude towards the English graduation benchmark policy, which is consistent with the results reported by Chen and Liu (2007), Liao (2010), and Shih (2008). Results further reveal that the Intermediate group shows more positive attitudes towards the graduation requirement than the High-Intermediate group. In addition, students’ attitudes towards the graduation requirement have affected students’ perceptions of test value, test performance, and learning motivation in a positive manner. In the aspect of learning motivation, the results of our study show that students’ extrinsic motivation is stronger than intrinsic motivation for learning English. A study by Wu and Lin (2009) discussing college students’ motivation for English learning showed that “instrumental motivation” scored the highest among different types of motivation. This finding echoes the sociological viewpoint of instrumental motivation proposed by Gardner (1985), which refers to how learners study a language for the purpose of progress and development, such as career advancement or further studies. Items in this study that are related to extrinsic motivation include “I study English for the purpose of finding a better job” and “because I would like to perform better at school or at work.”
Despite the similarities in students’ attitudes towards the graduation requirement between the two groups, results show the Intermediate group’s attitudes towards the policy have a positive effect on test anxiety (β = .21), whereas the High-Intermediate group’s attitudes towards the policy have a negative effect on test anxiety (β = −.17). This suggests that students with a lower level of English proficiency are more sensitive to the pressure from the graduation requirement and more likely to experience an increased level of anxiety when taking the test. In view of this, schools and teachers should be aware of the risk of increasing students’ anxiety when implementing the graduation benchmark requirement.
RQ 2: What are the relationships between students’ attitudes towards the graduation benchmark policy, their test performance, and their perceptions of learning motivation, test value, and test anxiety? Are there differences between the High-Intermediate group and the Intermediate group?
SEM results show that the attitudes of university students towards the English graduation benchmark policy positively impact their perceived test value and their learning motivation. However, there is no significant relationship between the attitudes towards the policy and test performance. The attitudes of students towards the English benchmark policy have a positive effect on their motivation for learning English, and this motivation is in turn reflected in their behavior. According to the theory of planned behavior (Ajzen 1985), in order for students to take the initiative to study English and improve their English ability, it is important to change their attitudes towards learning English, making it fun and interesting rather than for the sole purpose of passing the GEPT and meeting the graduation requirement.
In addition, the results show that test value has a positive effect on test anxiety. Students who feel that the test results are more important for the purpose of obtaining a degree, a scholarship, or a job are more likely to feel anxious when facing a test. However, the results concerning the relationship between students’ attitudes towards the graduation requirement and test anxiety are more complicated. Among the High-Intermediate group, students who had a positive attitude towards the English graduation benchmark were less likely to feel anxious in the face of the test. On the contrary, a positive relationship between students’ attitudes towards the graduation requirement and test anxiety was evident among the Intermediate group. In other words, among the Intermediate group, those who perceived the graduation requirement more positively felt more anxious about the test. Regardless of test groups, test anxiety has a negative effect on test performance; students who were more anxious about the test showed poorer performance (Cassady and Johnson 2002). In this regard, we suggest that schools provide relevant resources to help students, especially those students with lower levels of English proficiency, to reduce their test anxiety, for example, inviting the testing organization behind the GEPT to provide more information about how to prepare for the test or give mock tests.
Another noticeable difference between the two ability groups lies in the aspect of motivation. While the Intermediate group students were inclined to be driven by extrinsic motivation, the High-Intermediate group students tended to be more intrinsically motivated. The finding is consistent with Maslow’s hierarchy of needs (1943 and 1954) in that before learners can be intrinsically motivated, they must first be provided with external rewards such as good grades. In view of this, the English graduation benchmark requirement can be considered a useful measure to motivate students to learn, especially for those who are at a lower level of English proficiency. But, it is absolutely insufficient for schools to simply impose the graduation requirement upon their students. More importantly, schools must provide necessary remedial course programs to help the less proficient students to build their confidence in improving their English proficiency and at the same time in coping with the graduation benchmark requirement. Different from the Intermediate group students, the High-Intermediate group students may not need a graduation benchmark requirement to encourage them to learn more English because they are willing and eager to learn new material for self-actualization. However, their schools should ensure that students’ English learning experience is more meaningful, and they can learn deeper to fully understand it.
Finally, schools should be aware that implementing the English graduation benchmark policy is only one of many ways of assessing students’ English ability and not the sole reason to set up English courses. At the same time, we believe universities should consider the differences in students’ background, learning objectives, and learning status when establishing the English graduation benchmark policy. Since students possess different qualifications, personal traits, and some may not have kept up with the school’s curriculum in their learning process, they should be allowed to set their own expectations and English learning goals according to their ability, resources, and opportunities. In short, although the implementation of the English graduation benchmark policy is based on good intentions, as shown by related studies (Her et al. 2014), applying a fixed standard established by the school or the department may not be suitable for every student.
The questionnaire used in this study was adapted from the questionnaire “Learning Motivation, Test Anxiety and English Test Performance” designed by Cheng et al. (2014). We then compared the result of this study with that of Cheng et al. and attempted to discuss possible reasons for various similarities and differences. Both studies show that the test purpose is positively correlated with learning motivation and test anxiety and that test value is positively correlated with learning motivation. However, the result of our study showed that test value is positively correlated with test anxiety, while Cheng et al. showed that there was no significant correlation between test value and anxiety. This difference may be due to the fact that the latter study analyzed the results of all three tests, namely Taiwan’s GEPT, China’s CET, Canada’s CAEL, as a whole instead of individually. Another reason may be due to the distinct traits of the sampled body. The GEPT samples gathered by Cheng et al. were from students who passed the listening and reading tests and formed a homogeneous ability group, while the present study did not limit the samples to those who passed the listening and reading tests and can be considered a more heterogeneous group.
Although the two studies are the first attempt that draws on a large sample of university students to explore the complex relationships among the English graduation benchmark policy, test value, learning motivation, test anxiety, and test performance, it has a number of limitations. First, these studies only used data of students from three universities that have established passing the GEPT High-Intermediate Level Test (equivalent to the CEFR B2) and the GEPT Intermediate Level Test (equivalent to the CEFR B1), as their English graduation benchmark policy. The sampled students, especially the High-Intermediate group, tend to show a strong learning motivation and autonomous learning behavior; thus, their attitudes towards the graduation benchmark policy are also positive and optimistic. Consequently, more data are needed to support whether the findings of this study can be applied to universities that use other forms of English proficiency testing tools as their graduation benchmark requirement. In view of this, we suggest that future researchers can gather data from a large sample of universities that use the other two levels of the GEPT, i.e., elementary (equivalent to the CEFR A2) and advanced (equivalent to the CEFR C1), or other tests (e.g., TOEIC, IELTS) as their graduation benchmark requirement. Second, in addition to using SEM to analyze the relationships among latent variables, hierarchical linear modeling (HLM) can also be applied when there is a larger amount of data. Factors such as the student’s department and school can be integrated into the analysis, as these factors are important elements that are likely to influence one’s attitude towards the English graduation benchmark policy. Third, open-ended questions should be included in the questionnaire to gain a more comprehensive understanding of the views of university students towards the English graduation benchmark policy, as well as how their English learning process is influenced by the implementation of this policy.
This research was funded by The Language Training and Testing Center (LTTC, Taipei, Taiwan). The authors thank the LTTC for supporting this study and providing administrative assistance in data collection.
Both authors were responsible for the research design, literature review, and data interpretation. The first author wrote the manuscript; the co-author analyzed the data and checked and edited the manuscript. Both authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Ajzen, I. (1985). From intentions to actions: a theory of planned behavior. In J. Kuhl & J. Beckman (Eds.), Action-control: from cognition to behavior (pp. 11–39). Heidelberg: Springer.View ArticleGoogle Scholar
- Authors. (2016). 探究大學英語能力畢業門檻與學習動機、測驗焦慮、測驗表現之關係 [An exploratory study on the relationships among student attitudes towards the English graduation benchmark policy, learning motivation, test anxiety, and test performance]. English Teaching & Learning, 40(3, (Fall 2016)), 61–86.Google Scholar
- Bodas, J., & Ollendick, T. H. (2005). Test anxiety: a cross-cultural perspective. Clinical Child and Family Psychology Review, 8(1), 65–88.View ArticleGoogle Scholar
- Cassady, J. C., & Johnson, R. E. (2002). Cognitive test anxiety and academic performance. Contemporary Educational Psychology, 27, 270–295.View ArticleGoogle Scholar
- Chan, S. H. C., Wu, R. Y. F., & Weir, C. J. (2014). Examining the context and cognitive validity of the GEPT advanced writing task 1: a comparison with real-life academic writing tasks. LTTC-GEPT Research Report No. RG-03. Taipei: LTTC.Google Scholar
- Chang, W. C. (2005). 台灣的英語教育:現況與省思 [Taiwan’s English language education: present and future]. Educational Resources and Research, 69, 129–144.Google Scholar
- Chapell, M. S., Blanding, Z. B., Silverstein, M. E., Takahashi, M., Newman, B., Gubi, A., & McCann, N. (2005). Test anxiety and academic performance in undergraduate and graduate students. Journal of Educational Psychology, 97, 268–274.View ArticleGoogle Scholar
- Chen, S. C. (2014). 全球化下的臺灣英文教育:政策、教學及成果 [English education in Taiwan in the age of globalization: policy, practice and results]. Educators and Professional Development, 31(2), 7–20.Google Scholar
- Chen, S. W., & Liu, G. Z. (2007). The impact of English exit policy on motivation and motivated learning behaviors (Proceedings of the twenty-fourth international conference on English teaching and learning in the Republic of China, pp. 104–110). Taipei: Crane.Google Scholar
- Cheng, L., Klinger, D., Fox, J., Doe, C., Jin, Y., & Wu, J. (2014). Motivation and test anxiety in test performance across three testing contexts: the CAEL, CET and GEPT. TESOL Quarterly, 48, 300–330.View ArticleGoogle Scholar
- Council of Europe. (2001). Common European framework of reference for languages: learning, teaching, assessment. Cambridge: Cambridge University Press.Google Scholar
- Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. New York: Plenum.View ArticleGoogle Scholar
- Dörnyei, Z. (2001). New themes and approaches in second language motivation research. Annual Review of Applied Linguistics, 21, 43–59.View ArticleGoogle Scholar
- Eccles, J. S., & Wigfield, A. (2002). Motivational belief, values, and goals. Annual Review of Psychology, 53, 109–132.View ArticleGoogle Scholar
- Elkhafaifi, H. (2005). Listening comprehension and anxiety in the Arabic language classroom. Modern Language Journal, 89, 206–222.View ArticleGoogle Scholar
- Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: an introduction to theory and research. Reading, MA: Addison-Wesley.Google Scholar
- Fornell, C. R., & Larcker, F. F. (1981). Structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18, 39–51.View ArticleGoogle Scholar
- Gardner, R. C. (1985). Social psychological and second language learning: the role of attitudes and motivation. London, Ontario, Canada: Edward Arnold.Google Scholar
- Her, O. S., Chou, C., Su, S. W., Chiang, K. H., & Chen, Y. H. (2013). 我國大學英語畢業門檻政策之檢討 [A critical review of the English benchmark policy for graduation in Taiwan’s universities]. Education Policy Forum, 86(3), 1–30.Google Scholar
- Her, O. S., Liao, Y. H., & Chiang, K. H. (2014). 論現行大學英語畢業門檻的適法性─以政大法規為實例的論證 [The appropriateness of the English benchmark requirement for graduation in Taiwan’s universities––the case of National Chengchi University]. NCCU Law Review, 139, 1–64.Google Scholar
- Huang, L. H. (2010). 英檢畢業門檻對大學生的英語焦慮、英語學習動機、英語學習策略之影響研究 [English graduation threshold among the college students’ EFL anxiety, motivation and learning strategies]. Hualien, Taiwan: Tzu Chi University.Google Scholar
- In’nami, Y. (2006). The effects of test anxiety on listening performance. System, 34, 317–340.View ArticleGoogle Scholar
- Kunnan, A. J. (1995). Test taker characteristics and test performance. Cambridge, England: Cambridge University Press.Google Scholar
- Liao, Y. H. (2010). 技專校院學生英語畢業門檻之態度初探 [An exploratory investigation of attitude towards the English benchmark policy for graduation among technological and vocational university students]. Journal of National Huwei University of Science & Technology, 29(3), 41–60.Google Scholar
- Liao, Y. F. (2016). Investigating the score dependability and decision dependability of the GEPT listening test: a multivariate generalizability theory approach. English Teaching & Learning, 40(1), 79–111.Google Scholar
- Liu, M. (2008). An exploration of Chinese EFL learners’ unwillingness to communicate and foreign language anxiety. Modern Language Journal, 92, 71–86.View ArticleGoogle Scholar
- Maslow, A. (1943). A theory of human motivation. Psychological Review, 50, 370–396.View ArticleGoogle Scholar
- Maslow, A. (1954). Motivation and personality. New York: Harper.Google Scholar
- McNamara, T. (2001). Language assessment as social practice: challenges for research. Language Testing, 18(4), 333–349.View ArticleGoogle Scholar
- Meijer, J. (2001). Learning potential and anxious tendency: test anxiety as a bias factor in educational testing. Anxiety, Stress and Coping, 14, 337–362.View ArticleGoogle Scholar
- Noels, K. A. (2005). Orientations to learning German: heritage language learning and motivational substrates. Canadian Modern Language Review, 62, 285–312.View ArticleGoogle Scholar
- Putwain, D. W. (2007). Test anxiety in UK schoolchildren: prevalence and demographic patterns. British Journal of Educational Psychology, 77, 579.View ArticleGoogle Scholar
- Pyun, D. O. (2013). Attitude toward task-based language learning: a study of College Korean language learners. Foreign Language Annals, 46, 108–121.View ArticleGoogle Scholar
- Ruthig, J. C., Perry, R. P., Hall, N. C., & Hladkyj, S. (2004). Optimism and attributional retraining: longitudinal effects on academic achievement, test anxiety, and voluntary course withdrawal in college students. Journal of Applied Social Psychology, 34, 709–730.View ArticleGoogle Scholar
- Ryan, R. M., & Brown, K. W. (2005). Legislating competence: high-stakes testing policies and their relations with psychological theories and research. In A. J. Elliot & C. S. Dweck (Eds.), Handbook of competence and motivation (pp. 354–372). New York, NY: Guilford Press.Google Scholar
- Ryan, R. M., & Deci, E. L. (2000). Intrinsic and extrinsic motivations: classic definitions and new directions. Contemporary Educational Psychology, 25, 54–67.View ArticleGoogle Scholar
- Ryan, R. M., & Weinstein, N. (2009). Undermining quality teaching and learning: a self-determination theory perspective on high-stakes testing. Theory and Research in Education, 7, 224–233.View ArticleGoogle Scholar
- Shih, C. M. (2008). Critical language testing: a case study of the General English Proficiency Test. English Teaching & Learning, 32(3), 1–34.Google Scholar
- Shohamy, E. (2000). The power of tests: a critical perspective on the uses of tests. London: Longman.Google Scholar
- Stipek, D., Feiler, R., Daniels, D., & Milburn, S. (1995). Effects of different instructional approaches on young children’s achievement and motivation. Child Development, 66, 209–223.View ArticleGoogle Scholar
- Tsai, C. R. (2010). 英語聽力表現與英語能力、學習動機、聽力焦慮以及後設認知之關係研究 [EFL learners’ listening performance: its relationship to English proficiency, motivation, listening anxiety, and metacognitive awareness] (Unpublished master dissertation). Taipei, Taiwan: The University of Taipei.Google Scholar
- Weir, C., Chan, S. H., & Nakatsuhara, F. (2013). Examining the criterion-related validity of the GEPT advanced reading and writing tests: comparing GEPT with IELTS and real-life academic performance. LTTC-GEPT Research Report No. RG-01. Taipei: LTTC.Google Scholar
- Wu, R.Y.F. (2011). Establishing the validity of the General English Proficiency Test reading component through a critical evaluation on alignment with the Common European Framework of Reference. Unpublished doctoral thesis, University of Bedfordshire.Google Scholar
- Wu, J. (2016). A socio-cognitive approach to assessing speaking and writing: the GEPT experience. JLTA (Japan Language Testing Association) Journal, 19, 3–11.Google Scholar
- Wu, R. Y. F., & Liao, C. H. Y. (2010). Establishing a common score scale for the GEPT Elementary, Intermediate, and High-Intermediate Level listening and reading tests. In T. Kao & Y. Lin (Eds.), A new look at language teaching and testing: English as subject and vehicle—selected papers from the 2009 LTTC International Conference on English Language Teaching and Testing (pp. 309–329). Taipei: Language Training and Testing Center.Google Scholar
- Wu, Y. S., & Lin, C. P. (2009). 大學生英語學習環境、學習動機與學習策略的關係之研究 [A study of the relationship among English learning environment, learning motivation and learning strategies of college students]. Journal of Taipei Municipal University of Education: Education, 40(2), 181–222.Google Scholar
- Wu, J. R. W., & Wu, R. Y. F. (2010). Relating the GEPT reading comprehension tests to the CEFR. In W. Martyniuk (Ed.), Aligning tests with the CEFR, Studies in Language Testing 33 (pp. 204–224). Cambridge: Cambridge University Press.Google Scholar