This study compared aural and written modes of presentation for the two item types, to explore the effects of question/option presentation mode and item type on EFL learners’ listening comprehension performance and their perception. One hundred and fifteen Korean college students who were divided into three different proficiency groups participated in the study. The participants took a listening test which consisted of dialogue-completion and Q&A multiple-choice items in the aural and written modes, followed by a survey on their perceptions, and a stimulated recall interview. The results showed that the least proficient group was more critically affected by the mode than the other two groups. The least proficient group performed significantly better in the written mode than in the aural mode, while they received similar scores on the two item types. The major factors that caused the discrepancy among the groups were memory capacity in the aural mode and reading ability in the written mode. The implications and suggestions on listening test development are discussed.