이 연구의 목적은 예비 지구과학 교사들이 선다형 문항 제작 실습 프로그램에 참여하는 과정에서 드러나는 문 항 제작 역량의 발달 양상을 이해하는 것이다. 이를 위해 예비 지구과학 교사 15명이 선다형 문항 제작 과정 중 공동 검토 과정에서 나타나는 논의에 초점을 맞춰 그 특징을 분석하였다. 구성주의 근거 이론을 토대로 3단계의 코딩을 수 행한 결과, 36개의 초기 코드, 12개의 초점 코드, 5개의 이론적 코드가 도출되었다. 코딩 범주에 근거하여 논의의 특징 을 규정하는 검토 문화와 문항에 대한 관점을 두 축으로 설정하였으며, 이로부터 수험생의 문제풀이, 조심스레 한 걸음 떼기, 짙어지는 담화를 주제로 하는 세 가지 이야기를 구성하였다. 또한 프로그램 동안 일관되게 드러나는 문항 제작 역량의 한계를 다다르지 못한 노정에 대한 네 번째 이야기로 서술하였다. 문항 제작 과정에서 드러나는 평가 전문성은 예비교사의 정체성 발달과 관련되어 있으며, 본 연구에서 적용한 개발한 프로그램의 효과와 의의 및 프로그램의 개발과 개선을 위한 시사점을 논의하였다.

This study investigated the effects of reducing the number of options in multiple-choice items on the psychometric characteristics of the English section of the NAEA (National Assessment of Educational Achievement). The purpose of the NAEA is to measure educational progress and achievement and it is administered to all sixth, ninth, and eleventh grade Korean students annually. The English section for the ninth graders is the focus of this study; it is made up of thirty-four five-option multiple-choice items and six constructed-response items. A five-option, multiple-choice English test was converted to a four- and a three-option version by eliminating the least and the second least frequently chosen options. Item difficulty, item discrimination, guessing, reliability, and information function were computed as a function of the number of options. This study employed the 3-parameter IRT model. Results showed that there were no significant differences among the three means of item difficulty as well as item discrimination indices; however, the inspection of the test information function indicated that the five-option version generally yielded the highest amount of test information function over the ability scale. Results indicate that streamlined three- or four-option versions are not likely to function as well as the five-option version at the test level.

The demand for test-taking has become an inevitable element of Korean secondary EFL learners’ academic lives in which learners strive to excel in the high-stakes examoriented milieu. However, current knowledge of practitioners, such as those of teachers and administrators, may be insufficient for ascertaining if the learners actually undergo the test-taking process they anticipate and assess what they aim to test. In contrast to the product-oriented view where the primary interest is on the outcome (i.e., scores or stanine levels), the purpose of the present study was to explore 165 Korean high school learners’ test-taking process via questionnaires with proficiency and item type as the grouping variables. There was avid use of conventional reading strategies among the high proficiency learners and test management strategies among the lower proficiency learners. Results present implications for teaching learners not only to become testwise, but also to work consistently towards building reading skills and adopt long-term learning strategies.

This study addresses the relationship between individual differences regarding self-concept, measured by Self Concept Clarity (SCC) scale and Relational-Interdependent Self-Construal and relationships (RISC) scale, and diverse affective consequences after choice behavior. We hypothesized that lower self-concept clarity and higher relational interdependence would be related to increased susceptibility to choice context–for example, how a choice set is constructed based on one’s initial preference. We examined how variations in a choice set can produce different affective consequences after making choices, and investigated the underlying neural mechanism using fMRI. In this experiment, participants first rated their preferences for art posters, and made a series of choices from a presented set. After the choice task, they completed post-choice measures including preferences for the chosen posters, as well as measures of their self-concept clarity and relational interdependence. Our behavioral results demonstrated that when participants faced more conflicting choice context, self-concept clarity was related to more positive affective consequences after choice, whereas relational interdependence was correlated with a lower second-rated attractiveness of the chosen option. The neuroimaging analysis of choice-making revealed that self-concept clarity and the degree of their relational interdependence served as modulators in shaping how one perceives and experiences the same decision-making process. These results have theoretical and practical importance in that it is one of the first studies investigating the influence of the individual differences regarding self-concept on value-based decision making process among diverse choice set contexts.

The researchers’ experiential knowledge demonstrates that the task of predicting and controlling the difficulty level of the multiple-choice items of the College Scholastic Ability Test (CSAT) for English is substantially left to the subjective judgment of experienced item writers. The present study accordingly recognizes a need to identify item difficulty predictors and build an item difficulty prediction model to handle this pertinent issue. While taking separate interest in constructing a model for the multiplechoice reading subset of the CSAT, the study was conducted by identifying item difficulty predictor variables from previous research, and by validating the candidate predictors via questionnaires by highly experienced teacher-raters when asked to analyze reading items from the English reading subset of the preliminary CSAT (i.e., yun-hap-hak-ryuk-pyung-ga) administered in March 2009. Using multiple regression technique and maximum likelihood estimation, an item difficulty prediction model was generated. In order to check validity and applicability of the prediction model, the hypothetical model was finally tested on a subsequent version of the test administered in September 2009. This type of model building is expected to guide test developers design an item pool in accordance with special needs, such as to construct multiple test forms, which have similar mean difficulties.

이 논문은 2009년과 2010년 2년간 치러진 中等漢文科敎師任用試驗중 1차 한문 선택형 시험을 대상으로 삼아 출제의 근거가 되는 出題基準을 검토하고, 출제 기준에 맞게 출제되었는지 그 현황을 분석한 후, 提言한 것이다. 출제 기준은 출제자로 인한 편파성 시비와 영역별 비중의 차별을 드러낸 이전 임용시험의 잘못을 시정하려는 의도에서 나온 것으로, 전국에 있는 漢文敎育科의 敎育課程속에서 10개의 기본이수과목을 추려내고 과목마다 1∼3개의 평가 영역 을 두어 공부한 내용을 빠뜨리지 않고 골고루 출제하고자 한 점에서 의의가 있었다. 출제 현황은 이수과목이나 평가 영역을 중심으로 보면, 대체로 공평하게 출제하 려고 한 점이 인정되나 2009년의 시험이 역대산문선독보다 한시선독에 관심이 두 어졌고, 2010년 시험에서 한시선독보다 역대산문선독이 선호되는 일면도 발견되 었다. 이 측면에서의 불균형 은 출제 상황의 제반 여건에서 빚어진 것으로서 차후 에 다시 바뀔 수 있으므로 별 문제가 되지 않겠지만 문항 출제에 중요한 역할을 하는 地文의 장르에 대한 편중은 문제의 소지가 없지 않았다. 2009년의 경우에 산문 장르가 전체의 46∼47%, 2010년의 경우에도 산문 장르가 전체의 45∼46% 출제되어 특정 장르의 비중이 과도하다는 느낌을 받았다. 물론 산문이 한문학에서 차지하는 범위가 광대하고 출제하기 용이하다는 장점 이 있기는 하지만 그렇다고 출제 문항의 地文이 특정한 장르로 편중되는 것이 정 당화될 수는 없다. 출제 기준에서 기본이수과목별 출제비율이 경서강독, 한시선독, 한문소설선독, 역대산문선독 모두 대등한 것처럼 1차 한문 선택형 시험 40문항(80 점)에서 장르별 출제비율도 특정한 장르에 편중되지 않게 하여야 한다. 1차 한문 선택형 시험이 중등 한문과 교사가 되려는 수험생에게 중요한 만큼 원전 독해력과 그것을 교실 수업현장에 적용하는 능력을 갖춘 자를 교사로 선발 하는 시험이 되도록 난이도를 보다 높이고 출제범위에 얽매이지 말며 수험생이 접해보지 못한 지문이 많이 출제되게 해야 할 터다.

This study compares the differences between a multiple-choice (MC) and an open-ended (OE) reading comprehension test in a within-subject design to investigate test validity by comparing the two methods. A total of 70 Korean undergraduates participated in the present study. After taking a cloze test, participants read a passage, returned it and took two types of reading comprehension tests. Results showed that there was a statistical difference between the two test methods in a within-subjects design, which agrees with previous between-subjects studies. The higher scores on the MC format were attributed to three reasons: memory constraint, the nature of the task, and test-taking strategy. Further analysis indicated that both proficiency level groups were significantly affected by the test methods. Moreover, both the MC and OE tests significantly separated the two proficiency levels. Information from a survey provides more information regarding differences between the two test methods.