This study measured the in-plane and out-of-plane deflections of a beam using image processing technology. The deflections and rotation obtained from the vision-based measurement were compared with those from the traditional, current measurement method using three wired potentiometers. The results of this study indicated that the proposed vision-based measurement system was successfully applied to evaluating the out-of-plane deflections of a beam including the vertical in-plane deflection.