This study highlights empirically the relationship among major constructs such as accident, fear and anxiety emotion, self-efficacy, and negative spillover of work, focused on the railway drivers. The differentiated factor of this study is in that the experience of accident was posed as exogenous variable. Hypothesis tests based on 201 samples verified that the experience of accidents showed a significant effect on negative spillover of work mediated by fear and anxiety, with moderating effect of self-efficacy between fear and anxiety and negative spillover of work. However, the moderating effect was shown as increasing the degree of negative spillover of work, since the drivers recognized their fear and anxiety accrued by accident experience as uncontrollable. This finding suggests the need for mitigating driver's negative emotion - fear and anxiety - through an introduction of practice such as exemption of settlement obligation in accident site and lowering of the penalty for accident responsibility.