논문 상세보기

사회언어학 연구를 위한 한국어 미세조정 언어모델 KCI 등재

Fine-tuned Korean Language Models for Sociolinguistic Studies

  • 언어KOR
  • URLhttps://db.koreascholar.com/Article/Detail/437668
구독 기관 인증 시 무료 이용이 가능합니다. 6,100원
사회언어학 (The Sociolinguistic Journal of Korea)
한국사회언어학회 (The Sociolinguistic Society of Korea)
초록

This paper aims to test deep-learning-based Korean language models’ capacity to learn and detect social registers embedded in speech data, specifically age, gender, and regional dialects. A comprehensive understanding of linguistic phenomena requires contextualizing speech based on speakers’ age, gender, and geographic background, along with the processing of syntactic structures. To bridge the gap between human language understanding and model processing, we fine-tuned three representative Korean language models—KR-BERT, KoELECTRA-base, and KLUE-RoBERTa-base—using transcribed data from 4,000 hours of speech by middle-aged and elderly Korean speakers. The findings reveal that KoELECTRA-base outperformed the other two models across all social registers, which is likely attributed to its larger vocabulary and parameters size. Among the dialects, the Jeju dialect showed the highest accuracy in inference, which is attributed to its distinctiveness, making it easier for the models to detect. In addition to the fine-tuning process, we have made our fine-tuned models publicly available to support researchers interested in Korean computational sociolinguistics.

목차
Abstract
1. 서론
2. 배경
    2.1. 사회언어학적 배경
    2.2. 전산언어학적 배경
3. 방법
    3.1. 데이터
    3.2. 실험
4. 결과
    4.1. 연령
    4.2. 성
    4.3. 지역
5. 논의
    5.1. 의의
    5.2. 한계
6. 결론
참고문헌
저자
  • 노강산(Graduate Student, College of Liberal Arts, Korea University; 145 Anam-ro, Seongbuk-gu, Seoul 02841, South Korea) | Noh Kangsan
  • 김수연(Professor, College of Liberal Arts, Sejong University; 209 Neungdong-ro, Gwangjin-gu, Seoul 05006, South Korea) | Soo-Yeon Kim
  • 최혜원(Professor, College of Liberal Arts, Ewha Womans University; 52 Ewhayeodae-gil, Seodaemun-gu, Seoul 03760, South Korea) | Hye-Won Choi
  • 장하연(Assistant Professor, College of Liberal Arts, Sungkyunkwan University; 25-2 Sungkyunkwan-ro, Jongno-gu, Seoul 03063, South Korea) | Hayeun Jang
  • 송상헌(Associate Professor, College of Liberal Arts, Korea University; 145 Anam-ro, Seongbuk-gu, Seoul 02841, South Korea) | Sanghoun Song Corresponding author