It is important that structure's exact damage analysis and decision-making for recovery when natural disasters cause damage on SOC structure. There are many related studies using geo-spatial data like satellite and aerial images. Recently the interest has increasing about utilizing UAV(Unmanned aerial vehicle). But there are little studies related it. Therefore, we present the extraction method of the shape changes of structure damage using UAV images.