In accordance with the stipulations of the STCW Convention, simulation training has been enforced in order to develop practical skills so as to prevent accidents by predetermining the risks in special marine environments. Simulation training is a useful way to acquire navigation abilities, and can continuously measure the ability of a trainee by applying an appropriate evaluation. However, the result of training is evaluated by the instructor's subjective judgment without quantitative criteria. Therefore, this study aims to quantitatively evaluate the effectiveness of simulation training. For this purpose, evaluation items were derived by analyzing legal standards, earlier studies, and the current status of MET institutions. The simulations were then performed three times in the same scenarios and analyzed the results. As a result, it has been shown that the objectively analyzed ability to keep the route and to make safe passage with other vessel, as well as subjectively evaluated ability by the apprentice officer has been improved as training progressed. Through the evaluation of simulation training results, it can be derived that simulation education needs supplementation, and can be provided as a basic form of data to quantify the evaluation results of the simulation training in the future.