This study investigated the impact of 26 EFL college students’ familiarity levels with the visual information of TOEIC listening test items on test scores and test performance procedure. Data collected measured students’ degree of familiarity with the visuals via a pre-test and their listening test scores, and responses to the post-test questionnaire were analyzed. To analyze the data, one-way ANOVA was conducted to locate the interdependency between the students’ familiarity levels with visuals and their test scores. Results found that there was no statistically significant differences in test scores regardless of the students’ levels of familiarity with the visuals. Additionally, the correlations between the familiarity with the visuals and the students’ test scores were low. However, the students experienced difficulties with unfamiliar visuals while taking the test. These findings indicate that, although test-takers’ familiarity with visuals does not predict their listening test scores, there is a need to tailor the visuals when developing listening test-items.

Scores on the Test of English for International Communication Listening and Reading (TOEIC LR) have been used for rolling-based university admissions in South Korea. Because this test is not designed for that purpose by the testing organization, there may be a need to explore the validity of TOEIC LR score use for admission purposes. Accordingly, this study investigated how admissions officers in South Korea perceived TOEIC LR scores and their uses and why they used the scores for admission purposes. We adopted a sequential mixed-method design (Creswell & Clark, 2011) involving three phases of data collection: (1) analysis of application handbooks to identify the questionnaire survey target, (2) a survey of faculty (n = 20) involved in admissions, and (3) semi-structured interviews with selected participants (n = 5) to delve into their questionnaire responses. The findings were that (a) almost half of the universities in Korea were implementing special admissions and accepted the scores on the recognized English tests; (b) use of the test lacks validity because most of the admissions officers did not view the test scores as an indicator of English proficiency and academic aptitude; (c) approximately half of the admissions officers viewed the scores as a reflection of an applicant’s effort, test-taking skills learned at language institutes, and former residence in English-speaking countries; and (d) the TOEIC LR scores were used due to a lack of other English tests as well as social pressure such as test fees and testing site availability.

This study investigated the test scores and student responses about placement in the General Education English Program by level and major. Using composite scores of College Scholastic Ability Test for English (CSAT) and the in-house speaking test (SEPT), the study placed students into four levels (2–5). It also categorized 1,847 students into three groups: Humanities and Social Science (HS), Business Administration and Law (BL), and Science and Engineering (SE). Higher levels showed significant differences in oral proficiency while having similar results on the CSAT. Lower levels attained similar scores on the SEPT but represented a vast range of CSAT scores. Participants across all levels understood the purpose of the placement test, perceived the content of the SEPT as appropriate, and positively responded toward the accuracy of placement. HS and BL scored higher on the test than SE, confirming the contrast between engineering and non-engineering majors. HS, however, showed more positive evaluation on the accuracy of placement than BL and SE. Across groups and levels, all participants opposed exclusively using CSAT in course placement. This study discusses utilizing data by various variables to enhance differentiated instruction and to meet unique needs of students at all levels with different majors; it also addresses using CSAT scores as the exclusive criterion.

The research on washback of a test has little been carried out in Korea while it has been flourishing in language testing researchers overseas. This paper investigates whether the advent of NEAT has affected the perception of test takers and the teaching/learning practices in English classrooms of Korea. In addition, we also want to investigate the relationship between variables such as perception of test users, teaching/learning practices, and test scores. We carried out a survey with 601 students who were seated at NEAT administered in April 2013 as well as 3,267 third-year high school students who had no experience on NEAT. The analyses revealed some evidence to support that NEAT has an effect on the perception of the participants. However, the analyses also revealed that NEAT was not effective to appeal for a change in teaching and learning practices in English classrooms in Korea.

The purpose of this study was to investigate inter- and intra- rater reliability in an interview and a computerized oral test. It was also examined whether rater characteristics influenced on their reliability and biases, and finally the scores of both tests were compared with those of the Versant test using an automated computer rating system. For the study, the data from 21 Korean university students and 18 Korean or native speakers of English raters with various characteristics were collected. Some of the main findings from the study were as follows. First, rater severity was significantly different in each test, but each rater consistently graded on both tests suggesting lower inter-rater reliability and higher intra-rater reliability. Secondly, rater severity was impacted by the rater characteristics such as mother tongue, gender, age, and major. Lastly, there existed a positive correlation among the scores of the three tests, indicating that the scores of human beings and computers are strongly related.