효과 크기를 이용한 적정 시험횟수 및 시제수량 결정방법 제안
In defense acquisition system, testing and evaluation is a very important procedure that can ensure the completeness of capability while deciding whether to mass-produce or purchase weapons systems. But it always includes realistic restrictions that involve a variety of stakeholders, but lack of time, resources, and budget. Therefore, in the process of planning a test and evaluation, proper number of prototypes and reliability of test results, along with test items and evaluation criteria, are frequently discussed as sensitive agendas. In reality, however, rather than statistical judgments, the number of prototypes and tests are determined by business logic such as duration and budget. Otherwise, most theoretical studies do not adequately reflect the business logic of test assessment. In this study, we propose a number of prototype and tests method that can statistically reasonably verify the performance of the inorganic system considering the characteristics of each test and evaluation project. To this end, we consider the theory related to determining the number of prototypes and tests, and present examples by separating whether to secure the magnitude of effects that have a significant impact on statistical judgment. This study could contribute to the development of empirical methodologies that can adequately coordinate reality and theory in the field of defense test evaluation while ensuring statistical reliability of test evaluation results.