Since the introduction of criterion-referenced evaluation into the English Section of the 2018 College Scholastic Aptitude Test (CSAT), it has become more important than ever to maintain the same level of its difficulty each year. This study was designed to examine whether 2017 and 2018 CSAT reading passages do not differ in terms of text difficulty. Both unidimensional and multidimensional indices Coh-Metrix (Version 3.0) provides were used in this study. Descriptive indices involved the respective count and length of sentences and words. As unidimensional indices, the Coh-Metrix L2 Readability score as well as the Flesch Reading Ease and Flesch-Kincaid Grade Level scores was measured. Indices for text easibility at different discourse levels (the surface structure, the textbase, the situation model, and the genre and rhetorical structure) were also included. Results showed that there were no significant differences between 2017 and 2018 passages. Compared with other easibility components (narrativity, syntactic simplicity, word concreteness, and deep cohesion), referential cohesion was rather low in both 2017 and 2018. Some pedagogical implications are also provided.