The purpose of this paper is to find an limitation to detect the defect of damaged asphalt pavement structures for infrared thermography. We use heat source of a natural light to detect the defect efficiently. The heat source was applied to the asphalt specimens. Four asphalt specimens were used: one was the asphalt containing depth of 1cm internal timber, two was the asphalt containing depth of 2cm internal void, Three was the asphalt containing depth of 3cm internal timber and four was not the asphalt containing internal timber. It was found that the depth of 3cm internal timber could be detected by this method. In addition, we used the image processing to make the damage zone displayed clear in the image obtained from the thermographic operation.