The purpose of this study was to investigate how the English speaking ability of Korean EFL college students was affected by their interactions with Talk-to-ChatGPT while taking an ‘English Interview’ class. Thirty pieces of English conversation scripts with thirty chatbot conversations created by five students were collected for analysis. Two online text analysis programs, Quillbot including word counter and grammar checker and T.E.R.A.(Text Ease and Readability Assessor), were used for data analysis. The findings of data analysis revealed that 1) The average length of the sentences and words spoken by the participants has increased through English speaking practice using Talk-to-ChatGPT, and 2) There was no significant change in text ease and readability, and coherence of students’ utterances through English speaking practice using a chatbot while there were differences depending on their English proficiency levels. 3) Students A, B, and D, who had relatively low levels of English proficiency, showed a slight increase in syntactic accuracy and semantic clarity in their English interview practice. Based on the study findings, pedagogical implications for the effective use of AI-based apps or programs in English speaking classes were presented.

The present study aimed to explore how pre-service teacher’s individual regulatory focus orientation, currently emerging as an interesting learner variable for language learning, could influence their Englishspeaking abilities. English teaching demonstration videos of 67 pre-service teachers were analyzed in terms of pronunciation, accuracy, and fluency. The regulatory focus orientations of participants were evaluated using a questionnaire. The results of data analysis, using multiple regression analysis, indicated that promotion-focus orientation was a significant positive predictor for pronunciation, fluency (words per minute, ratio of dysfluency), and accuracy (lexical errors, ratio of error-free AS-units). On the other hand, prevention-focus orientation did not emerge as a statistically significant factor affecting accuracy. However, it was observed to have a negative influence on both pronunciation and fluency. In light of the research findings that highlight the favorable impact of a promotion-focus orientation, suggestions were made for future teacher training programs aimed at enhancing the English proficiency of pre-service teachers.

This study investigated the feasibility of adopting an automatic scoring system (ASS) in a domestic English-speaking education context. Scope, test items, assessment criteria, scoring methods, and reporting strategies of six overseas English-speaking tests utilizing ASSs were examined. Moreover, a comparative analysis was conducted to identify disparities between ASS-based and non-ASS-based speaking tests. Findings were: 1) some ASS-based tests utilized ASS technology throughout the assessment, while others adopted a hybrid scoring system involving human raters; 2) compared to non-ASS-based tests, ASS-based tests used more test items targeting low-level skills such as sound and forms but fewer test items targeting conversation and discourse level skills; 3) pronunciation, fluency, and vocabulary were widely employed as evaluation criteria with sparse use of organization, content, and task completion in most ASS-based tests; 4) differences were minimal in assessment criteria application and score calculation between ASS-based and non-ASS-based tests; and 5) some ASS-based tests provided criteria-specific results and feedback with total scores and proficiency levels.

The purpose of this study is to compare the effects of input- and output-based planning (reading a sample passage vs. writing a draft) on the oral performance of L2 learners with low-proficiency. In this study, 16 Korean female junior college students of low English proficiency were divided into two different planning groups. The reading group was required to read a sample passage of the given topic, designed to encourage “noticing” and “focus on form” using input enhancement, while the writing group was asked to write a draft of their speech, using only their own L2 knowledge. After such planning activities, both groups recorded their assigned speaking tasks using Kakao Talk. Eight planning activities and oral performances were completed over the period of the semester. In order to compare the effects of input- and output-based planning on the improvement of overall proficiency, pre- and post-tests, in which the students produced the same narratives, were analyzed using Mann-Whitney U and Wilcoxon signed-rank tests. Furthermore, this study explored any difference in speaking performance after each type of planning and what the learners were actually doing during planning time. The results showed that output-based planning had positive effects on speaking performance and its repeated practice led to the improvement of overall proficiency.

The present study investigated students’ preferences for the types of tasks used to assess English speaking performance. It further examined whether students’ task type preferences affected their perceptions of test effectiveness. One hundred eighty-two high school students responded to a self-report questionnaire. A series of frequency analysis and paired samples t-tests were used for the analysis. The results showed that students’ most preferred task types and their least preferred ones overlapped with each other, suggesting that the task types of English-speaking performance tests used in schools are limited. The four key reasons determining students’ task type preferences were identified, including task difficulty, emotional comfort, practical value, and interest. In addition, the results indicated that students’ task type preferences could affect their perceptions of task effectiveness. Overall, the results suggest the need for developing more varied task types for English-speaking performance tests as well as helping students become familiar with English speaking performance tasks. Pedagogical implications were discussed along with study limitations.

This study aimed to investigate the effects of voice recording as a speaking assignment on Korean EFL nursing students’ speaking confidence and perceptions of speaking assignment. The participants of the study were 22 nursing students who took college English course and were divided into two groups. One was an experimental group performing voice recording assignment for speaking practice during 5 weeks and the other was a control group that did not receive treatment by the researcher. Speaking confidence questionnaire and in-depth interview were used to collect the data in this study. The result of this study showed that there was some statistically significant achievement of the participants’ speaking confidence after speaking assignment of voice recording performed by them. In addition, the participants had positive reaction to the experience of the assignment. This suggests that voice recording assignment encourages students to have their speaking confidence and helps them to overcome speaking difficulties in EFL environment.

The present study examines the features of communicative functions in middle school English textbooks, identifying whether or not they are presented based on the spiral structure. It also compares the communicative functions of 15 different middle school English textbooks and investigates whether the National English Listening Tests (NELTs) reflect the communicative functions presented in the textbooks. Two corpora were compiled using the 15 middle school English textbooks and the NELTs, and they were analyzed using WordSmith Tools. The results show that all the textbooks included communicative functions that the National Curriculum recommends; however, the textbooks presented a limited number of functions. Nonetheless, the communicative functions were presented relatively in a spiral way. The majority number of communicative functions in the textbooks and the NELTs were similar to each other, but there were some functions in the tests that were not covered in the textbooks. These results imply that more diverse communicative functions should be included in textbooks in order to help improve students’ communicative competence. The communicative functions not presented in the textbooks should not be included in the NELTs.

The purpose of this study was to investigate inter- and intra- rater reliability in an interview and a computerized oral test. It was also examined whether rater characteristics influenced on their reliability and biases, and finally the scores of both tests were compared with those of the Versant test using an automated computer rating system. For the study, the data from 21 Korean university students and 18 Korean or native speakers of English raters with various characteristics were collected. Some of the main findings from the study were as follows. First, rater severity was significantly different in each test, but each rater consistently graded on both tests suggesting lower inter-rater reliability and higher intra-rater reliability. Secondly, rater severity was impacted by the rater characteristics such as mother tongue, gender, age, and major. Lastly, there existed a positive correlation among the scores of the three tests, indicating that the scores of human beings and computers are strongly related.

This study investigated the effects of pairing based on English proficiency and gender on high school students’ speaking task performance. A total of 16 high school students - 4 female advanced, 4 female intermediate, 4 male advanced, and 4 male intermediate learners - performed two information gap tasks spotting differences between two pictures, once with a same-level learner and once with a different-level learner. Their performance was analyzed in terms of degree of task completion, amount of utterances and fluency. The results showed (a) advanced level learners performed the task more accurately, more fluently, and in higher length when they were paired with advanced level learners than paired with lower level learners, although the differences were not significant; (b) For intermediate level learners, male students demonstrated a better performance when paired with higher level learners, but female students performed better when paired with the same level learners. The findings are discussed with regard to more feasible and more effective ways of grouping for pair work in high school English classes.

A continuing challenge for English educators and policy makers in Korea is how to provide the right amount of good English education in an effective and efficient way, to help achieve the needed level of English communication skills. No efforts would turn out successful if the amount and the quality of public English education did not meet people's expectations. In order to plan and implement successful English education policies, it is necessary to figure out what kind of English education and how much of it are needed for Korean people. The current study aims to investigate what levels of English speaking proficiency Korean people perceive they need. The study first reviews some widely-used international English oral proficiency standards, then, compares those with the level descriptions of the Korea’s national curriculum of English. To gather information on the current level of English speaking proficiency, and the expected level of English speaking proficiency, 356 teachers (123 elementary school, 114 middle school, 119 high school), 696 students (179 elementary school, 222 middle school, 295 high school), and 650 parents (164 elementary, 212 middle school, 274 high school) from all the 16 district education authorities, were surveyed and interviewed. The results are presented with the discussion of the future directions of English education in Korea.

This study investigates secondary school English teachers’ perceptions and psychological burdens involved in the implementation of the speaking and writing tests of the National English Ability Test, which is being developed by the Korean Ministry of Education, Science and Technology. The study surveyed 138 secondary school English teachers in Seoul. Although more than half of the teachers were aware of the new test, 18% of the surveyed teachers were not aware of the fact that speaking and writing skills would be assessed in the new test. Also, 22.7% of the teachers were opposed to the productive skills test. More than half (56.2%) of the teachers felt some psychological burdens toward the inclusion of the speaking/writing tests. Although the teachers admitted that serving as raters for the new test would help improve their teaching, the majority of them were reluctant to participate in the actual rating process. The teachers felt that the difficulty of subjective rating and the lack of time for the speaking and writing tests were serious problems in implementing the new test. The teachers were sensitive toward the students’ test anxiety. They also indicated that they feel a strong psychological burden when making judgments on the students' performances. Implications and suggestions are made based on the findings.

The purpose of this paper is to examine features of English speaking contests and preparation activities by contest-takers through the Internet, It focuses on the following issues: (1) test-takers' perceptions of tests, (2) appropriateness of test-takers' preparation activities, (3) learners autonomy in the test preparation process. The source of data in this study was collected from the websites hosting contests as well as a portal site (www.naver.com) allowing for information exchange on speaking contests. In the data analysis, key words or phrases were categorized and counted by frequency. It was found that there were perceptional differences between the intent of the testing institutions and students' preparation in the Internet. It is suggested that contest participants need to acquire sufficient information on preparation activities and test-taking strategies from the testing institutions.

This study aims to investigate the major themes and contents of studies on teaching English as an EFL in elementary schools in Korea since TEFLES (Teaching English as a Foreign Language in the Elementary School) was first introduced in elementary schools as a regular subject under the 7th National Curriculum in 1997. For the purpose of the study, a total of 218 research was examined in terms of the research methods, topics and main contents, and implications. The results of the study show that more than a half of the research was oriented toward quantitative approach. In addition, the main foci were the effects of certain tasks, pronunciation, dramatization, the use of a variety of multimedia materials on elementary school students" speaking skills. However, a large number of studies dealt with speaking skills in an integrated manner with other factors such as language skills, motivation, interests, and confidence. On the basis of the results, pedagogical implications on the teaching of speaking skills are suggested.

This study examines the effects of Korean EFL learners’ motivation and anxiety on their English speaking skills with a structural equation approach. The participants of the study are 193 college students enrolled in English conversation classes. The questionnaire on learning orientations, attitudes toward the community of native speakers of English, motivational intensity, class satisfaction and anxiety are given to the college students and their English speaking skills are assessed in terms of IATEFL’s criteria: Range, ease of speech, attitude, delivery, and interaction. Reliability and factor analysis are employed to confirm the internal consistency of questionnaire items and the validity of construct, and a structural equation model is run to examine the relation of Korean EFL learners’ affective aspects to their English speaking skills. The findings of the study are as follows: (1) while Korean learners’ attitudes toward native speakers of English and their community do not contribute to their desire to learn English, their learning orientations are found to affect their desire to learn English. (2) class satisfaction and desire to learn English are found to affect learners’ efforts to learn English, while anxiety is found to negatively contribute to leaners’ motivation intensity. (3) both integrative orientation and anxiety have direct effects on English speaking skills, integrative orientation affirmatively but anxiety negatively. Based on the findings, some suggestions are given for effective second language learning and teaching.

This study investigates the nature and the validity of the PhonePass SET-10 test designed to measure test-takers’ English oral proficiency using the automated computer technology. For this study, the data from 84 Korean college students were collected: students’ TEPS scores, PhonePass SET-10 results as well as the results from the survey developed to measure their attitudes toward the new format of English speaking test. Based on the analysis of the study, it is found out that there exists a positive correlation between the TEPS scores and the PhonePass SET-10 results of the participants, indicating that in fact the computer-based automated evaluating system can significantly contribute to assessing students’ English oral proficiency while the items and the purpose of the test administration are relatively limited. It is also reported that the participants of this study showed positive attitudes toward the PhonePass SET-10 with a hope that the newly developed speaking test will help them further their English study.

The Sociolinguistic Journal of Korea, 13(1). The purpose of this study is to explore the possibility of interface research between English discourse studies and speaking assessment. Assessment expertise has already been interfaced with discourse-based studies to develop and validate oral proficiency tests of English. One of the important developments in language assessment over recent years is the introduction of qualitative discourse research methodologies to design, describe, and validate direct or semi-direct tests of speaking. This paper explored assessment research in the areas of the following discourse studies: interactional sociolinguistics, ethnography of communication, variation analysis, conversation analysis, critical discourse analysis. This review of discourse-related assessment literature showed that discourse studies have much potential for the validation tasks of current oral proficiency tests. Possible areas of discourse studies related to the new era of process-oriented language assessment were discussed.