Three CNN (Convolutional Neural Network) models of GoogLeNet, VGGNet, and Alexnet were evaluated to select the best deep learning based image analysis mothod that can detect pavement distresses of pothole, spalling, and punchout on expressway. Education data was obtained using pavement surface images of 11,056km length taken by Gopro camera equipped with an expressway patrol car. Also, deep learning framework of Caffe developed by Berkeley Vision and Learning Center was evaluated to use the three CNN models with other frameworks of Tensorflow developed by Google, and CNTK developed by Microsoft. After determing the optimal CNN model applicable for the distress detection, the analyzed images and corresponding GPS locations, distress sizes (greater than distress length of 150mm), required repair material quantities are trasmitted to local maintenance office using LTE wireless communication system through ICT center in Korea Expressway Corporation. It was found out that the GoogLeNet, AlexNet, and VGG-16 models coupled with the Caffe framework can detect pavement distresses by accuracy of 93%, 86%, and 72%, respectively. In addition to four distress image groups of cracking, spalling, pothole, and punchout, 22 different image groups of lane marking, grooving, patching area, joint, and so on were finally classified to improve the distress detection rate.