Establishing a framework, to explain the path to safety accidents considering major safety management factors such as physical conditions including on-site activities and workplace, as well as human factors as to labor, supervisors, or managers, would be effective as the basis to control project's risks by preventing disasters. Therefore, this study aimed to clarify the mechanism in safety management and disaster occurrence. In order to accomplish the purpose, it identified and classified the factors related to accidents, reviewed the causal relationships among them, and suggested the influence diagram. The results of this research are expected to contribute to reinforcing the preventive management, and facilitating the development of integrated site control system based on safety risks.