This study investigated the feasibility of adopting an automatic scoring system (ASS) in a domestic English-speaking education context. Scope, test items, assessment criteria, scoring methods, and reporting strategies of six overseas English-speaking tests utilizing ASSs were examined. Moreover, a comparative analysis was conducted to identify disparities between ASS-based and non-ASS-based speaking tests. Findings were: 1) some ASS-based tests utilized ASS technology throughout the assessment, while others adopted a hybrid scoring system involving human raters; 2) compared to non-ASS-based tests, ASS-based tests used more test items targeting low-level skills such as sound and forms but fewer test items targeting conversation and discourse level skills; 3) pronunciation, fluency, and vocabulary were widely employed as evaluation criteria with sparse use of organization, content, and task completion in most ASS-based tests; 4) differences were minimal in assessment criteria application and score calculation between ASS-based and non-ASS-based tests; and 5) some ASS-based tests provided criteria-specific results and feedback with total scores and proficiency levels.

1. 서론
2. 자동 말하기 채점(Automated Speaking Scoring) 기술
3. 연구 방법
    3.1. 분석 대상
    3.2. 분석 절차 및 방법
4. 결과
    4.1. 시험별 자동채점기술 적용 방식
    4.2. 평가문항 유형
    4.3. 평가 준거
    4.4. 채점 방식
    4.5. 평가 결과 제공 방식
5. 논의 및 결론
REFERENCES

• 이진화(Professor, Department of English Education, Chung-Ang University) | Lee Jin-Hwa
• 최윤덕(Assistant Professor, Department of English Education, Chungnam National University) | Choi YunDeok Corresponding Author
• 성민창(Assistant Professor, Department of English Education, Gyeongin National University of Education) | Sung Min-Chang
• 김혜영(Professor, Department of English Education, Chung-Ang University) | Kim Heyoung