This study investigates the effects of a college EFL reading course on learners’ language proficiency and critical thinking habits. Two cloze tests and the K Critical Disposition Test were administered to treatment and control groups at the beginning and end of the semester, and TOEIC scores were used to validate the proficiency measures. The treatment group also completed an end-of-semester questionnaire on perceived course impact. Both groups showed significant proficiency gains, but the treatment group did not show greater improvement than the control group. However, only the treatment group exhibited significant development in critical dispositions. A comparison of assessment results and self-reported perceptions suggests that learners’ judgments may not reliably reflect actual learning outcomes. These findings suggest that while deep reflection and discussion on English texts can enhance critical dispositions, achieving gains in proficiency and critical thinking simultaneously within a single course appears difficult. They also suggest the necessity of incorporating learning-based assessments into program evaluations to supplement subjective evaluations.