This paper proposes a deep learning-based underground object classification technique incorporated with phase analysis of ground penetrating radar (GPR) for enhancing the underground object classification capability. Deep convolutional neural network (CNN) using the combination of the B- and C-scan images has recently emerged for automated underground object classification. However, it often leads to misclassification because arbitrary underground objects may have similar signal features. To overcome the drawback, the combination of B- and C-scan images as well as phase information of GPR are simultaneously used for CNN in this study, enabling to have more distinguishable signal features among various underground objects. The proposed technique is validated using in-situ GPR data obtained from urban roads in Seoul, South Korea. The validation results show that the false alarm is significantly reduced compared to the CNN results using only B- and C-scan images.

Pavement condition deteriorates due to various environmental issues. This can be seen on the pavement surface as a form of distress. A crack can be considered as a typical form of pavement distress in which it may reveal a critical condition of the road. Therefore, automatic and accurate detection of pavement crack and segmentation are crucial for pavement condition assessment and maintenance.

For effective human-robot interaction, robots need to understand the current situation context well, but also the robots need to transfer its understanding to the human participant in efficient way. The most convenient way to deliver robot’s understanding to the human participant is that the robot expresses its understanding using voice and natural language. Recently, the artificial intelligence for video understanding and natural language process has been developed very rapidly especially based on deep learning. Thus, this paper proposes robot vision to audio description method using deep learning. The applied deep learning model is a pipeline of two deep learning models for generating natural language sentence from robot vision and generating voice from the generated natural language sentence. Also, we conduct the real robot experiment to show the effectiveness of our method in human-robot interaction.

In the ground environment, mobile robot research uses sensors such as GPS and optical cameras to localize surrounding landmarks and to estimate the position of the robot. However, an underwater environment restricts the use of sensors such as optical cameras and GPS. Also, unlike the ground environment, it is difficult to make a continuous observation of landmarks for location estimation. So, in underwater research, artificial markers are installed to generate a strong and lasting landmark. When artificial markers are acquired with an underwater sonar sensor, different types of noise are caused in the underwater sonar image. This noise is one of the factors that reduces object detection performance. This paper aims to improve object detection performance through distortion and rotation augmentation of training data. Object detection is detected using a Faster R-CNN.

Recently, smart factories have attracted much attention as a result of the 4th Industrial Revolution. Existing factory automation technologies are generally designed for simple repetition without using vision sensors. Even small object assemblies are still dependent on manual work. To satisfy the needs for replacing the existing system with new technology such as bin picking and visual servoing, precision and real-time application should be core. Therefore in our work we focused on the core elements by using deep learning algorithm to detect and classify the target object for real-time and analyzing the object features. We chose YOLO CNN which is capable of real-time working and combining the two tasks as mentioned above though there are lots of good deep learning algorithms such as Mask R-CNN and Fast R-CNN. Then through the line and inside features extracted from target object, we can obtain final outline and estimate object posture.

본 연구는 물리적 수리·수문모형의 적용이 제한적인 감조하천에서의 수위예측을 목적으로 하고 있으며, 이를 위해 한강 잠수교를 대상으로 딥러닝 오픈소스 소프트웨어 라이브러리인 TensorFlow를 활용하여 LSTM 모형을 구성하고 2011년부터 2017년까지의 10분 단위의 잠수교 수위, 팔당 댐 방류량과 한강하구 강화대교지점의 예측조위 자료를 이용하여 모형학습(2011~2016) 및 수위예측(2017)을 수행하였다. 모형 매개변수는 민감도 분석을 통해 은닉층의 개수는 6개, 학습속도는 0.01, 학습횟수는 3000번로 결정하였으며, 모형 학습 시 학습정보의 시간적 양을 결정하는 중요한 매개변수인 시퀀스길이는 1시간, 3시간, 6시간으로 변화시키며 모의하였다. 최종적으로 선행시간에 따른 모의 예측능력을 평가하기 위해 LSTM 모형의 예측 선행시간을 6개(1 ~ 24시간)로 구분하여 실측수위와 예측수위와의 비교·분석을 수행한 결과, LSTM 모형의 최적의 성능을 내 는 결과는 시퀀스길이를 1시간으로 하였을 때로 분석되었으며, 특히 선행시간 1시간에 대한 예측정확도는 RMSE는 0.065 m, NSE는 0.99로 실 측수위에 매우 근접한 예측 결과를 나타내었다. 또한 시퀀스길이에 상관없이 선행시간이 길어질수록 모형의 예측 정확도는 2017년 전기간에 걸쳐 평균적으로 RMSE 0.08 m에서 0.28 m로 오차가 증가하였으며, NSE는 0.99에서 0.74로 감소하였다.

최근 다수의 분야에서 딥 러닝을 통한 연구 성과들이 사람의 판단력에 근접하는 결과를 보여주고 있다. 그리고 게임 산업에서는 온라인 커뮤니티, SNS의 활성화가 게임 흥행 여부를 결정할 정도로 중요성이 높아지고 있다. 본 연구는 딥 러닝을 이용해 온라인 커뮤니티, SNS에서 활동할 수 있는 시스템을 구성하고, 온라인 공간에서 사람들이 작성한 텍스트를 읽고 그에 대한 반응을 생성하고 스케쥴에 따라 트위터에 올리는 것을 목표로 한다. 순환 신경망(Recurrent Neural Network)을 이용해 텍스트를 생성하고 글 작성 스케쥴을 생성하는 모델들을 구성했고, 생성한 시각에 맞춰 모델들에 뉴스 제목을 입력해 댓글을 출력 받고 트위터에 작성하는 프로그램을 구현했다. 본 연구 결과는 온라인 게임 커뮤니티 활성화, Q&A 서비스 등에 적용이 가능할 것으로 예상된다.

영상 인식 기술은 평면 영상에 대해서 많이 연구되고 그 성능 또한 발전하고 있다. 그러나 평면 영상이 아닌 구면 파노라마 영상과 다양한 환경에서 주어지는 특수한 형태의 영상에 대한 인식은 평면과 다르게 기하학적인 왜곡으로 인해서 많은 어려움이 따른다. 본 논문에서는 평면영상의 인식 기술에서 최근 각광받는 훈련을 통한 신경망 인식 기법이 구면 파노라마 영상의 인식에서도 쓰일 수 있음을 보인다. 또한 구면 영상에 대한 기존 신경망 모델의 인식률을 높이기 위해서 큐브맵 변환을 활용하는 방법을 제시한다.

Recently, there have been many studies to classify the image-based damage of bridge using the deep learning and to evaluate the condition. These attempts are one of the ways to overcome limitations of visual inspection through inspectors, and it is also aimed to reduce the cost of necessary maintenance budget by enabling accurate and rapid damage assessment of rapidly growing old facilities and difficult parts of visual inspection. However, it is possible to classify and quantitatively express simple damage (one damage classification such as cracks) with image information (big data) of bridges, but classification and quantification of complex damage can be done by using one deep learning is a limit. Therefore, this study presents considerations and a method to be used for damage detection on the image basis using deep learning.

This paper presents the applicability and reliability of the crack detection technique of concrete structures developed based on the use of digital image analysis technologies through on - site tests. The problem of aging of infrastructure is a serious threat to the national and national security and there is a growing interest in the development and application of effective inspection and maintenance techniques for related infrastructure. Therefore, instead of the existing traditional manpower-based infrastructure inspection and maintenance techniques, which involve lots of time and money consumption and reliability of results, research using digital image analysis technology is actively being carried out.

This paper proposes real-time image-based damage detection method for concrete structures using deep learning. The proposed method is composed of three steps: (1) collection of a large volume of images containing damage information from internet, (2) development of a deep learning model (i.e., convolutional neural network (CNN)) using collected images, and (3) automatic selection of damage images using the trained deep learning model. The whole procedure of the proposed method has been applied to some figures taken in a real structure. This method is expected to facilitate the regular inspection and speed up the assessment of detailed damage distribution the without losing accuracy.

This paper proposes a deep learning-based crack evaluation technique using hybrid images. The use of the hybrid images combining vision and infrared images are able to improve crack detectability while minimizing false alarms. In particular, large-scale infrastructures can be inspected by an UAV-mounted hybrid image scanning (HIS)　system, and the corresponding huge amount of data is typically difficult to be analyzed by experts. To automate such making-decision process, deep convolutional neural network is used in this study. As the very first stage, a lab-scale HIS system is developed using a scanning zig and experimentally validated using a concrete specimen with various-size cracks. The test results reveal that macro- and micro-cracks are successfully and automatically detected with minimizing false-alarms.

In this paper, we propose Intelligent Driver Assistance System (I-DAS) for driver safety. The proposed system recognizes safety and danger status by analyzing blind spots that the driver cannot see because of a large angle of head movement from the front. Most studies use image pre-processing such as face detection for collecting information about the driver's head movement. This not only increases the computational complexity of the system, but also decreases the accuracy of the recognition because the image processing system dose not use the entire image of the driver's upper body while seated on the driver's seat and when the head moves at a large angle from the front. The proposed system uses a convolutional neural network to replace the face detection system and uses the entire image of the driver's upper body. Therefore, high accuracy can be maintained even when the driver performs head movement at a large angle from the frontal gaze position without image pre-processing. Experimental result shows that the proposed system can accurately recognize the dangerous conditions in the blind zone during operation and performs with 95% accuracy of recognition for five drivers.

The conventional method for estimating compressive strength of concrete has been suggested by considering only 1 to 3 influential factors. In this study, seven influential mixture factors (Water-Cement Ratio, Water, Cement, Fly ash, Blast furnace slag, Curing temperature, and humidity) of papers opened for 10 years were collected at three conferences in order to know tendency of data. The purpose of this paper is to estimate compressive strength more accurately by applying it to algorithm of the Deep learning.

As the importance of maintenance of reinforced concrete structures spreads, interest in the durability of structures is increasing. Among them, carbonation of concrete is one of the main deterioration factors of reinforced concrete structures. For quantitative evaluation of carbonation, many researchers are predicting carbonation considering water-cement ratio and environmental requirements. In this study, we studied the parameters based on the concrete made of ordinary Portland cement in the existing experimental data. The depth of carbonation deduced from the learning is applied to the carbonation by applying the deep learning.

This paper suggests the method of the spherical signature description of 3D point clouds taken from the laser range scanner on the ground vehicle. Based on the spherical signature description of each point, the extractor of significant environmental features is learned by the Deep Belief Nets for the urban structure classification. Arbitrary point among the 3D point cloud can represents its signature in its sky surface by using several neighborhood points. The unit spherical surface centered on that point can be considered to accumulate the evidence of each angular tessellation. According to a kind of point area such as wall, ground, tree, car, and so on, the results of spherical signature description look so different each other. These data can be applied into the Deep Belief Nets, which is one of the Deep Neural Networks, for learning the environmental feature extractor. With this learned feature extractor, 3D points can be classified due to its urban structures well. Experimental results prove that the proposed method based on the spherical signature description and the Deep Belief Nets is suitable for the mobile robots in terms of the classification accuracy.