Since Japanese was taught in secondary schools as a second language, the Korean educational system has faced the decrease in the number of students who take Japanese classes. In such a situation, we need to break out of traditional teaching methods and seek new directions. This research focuses particularly on the assessment and analyzes the items of the regular tests in Korean secondary schools, checking out whether those items are in accordance with the national curriculum and learning objectives. In addition, it is examined whether the intention of evaluators is appropriately tested and whether those items follow the evaluation guides. The results showed that regular assessments were far from enhancing communication proficiency when they were compared with the proportion of language contents for communication proficiency in the Korean SAT. Furthermore, as regards to validity, it was found that many items did not observe the evaluation guidelines of national curriculum and did not fulfill evaluators’ intention. Pedagogical implications will be discussed.