This study introduces an efficient image-based three-dimension motion tracking system for civil structures. The proposed system consists of hardware (four camcorders, a commercial PC and frame grabber) and software. The effective software and measurement scheme are developed to obtain the dynamic motion with six degrees of freedom. Several laboratory tests were conducted to verify the effectiveness of the proposed system with the maximum error of less than 3%.