Bridge inspection based unmanned aerial vehicle (UAV) has received considerable attention due to its several advantages such as reliability and safety as well as saving time and cost. An unmanned inspection equipment for bridge inspection is composed of UAV and imaging devices such as RGB cameras and infrared cameras. However, many challenging issues should be solved in order to apply this technology to the field. In this paper, an UAV based crack detection method is investigated. To detect the cracks, the image processing techniques with deep learning algorithm are used. To build the spatial information of aging bridge, 3D point cloud based background model is generated.