Future autonomous vehicles need to recognize the ego lanes required for lane change and the side left and right lanes differently. Therefore, multi-lane recognition is needed. In this study, using the YOLO network, mainly used for object recognition, the proposed method recognizes the ego, left and right side lanes as different objects and identifies the correct lanes. As a result of the performance evaluation on the TuSimple test data, the proposed method recognized the ego lanes and the left and right side lanes differently. It showed very stable lane recognition results. And by detecting lanes that do not exist in the ground truth of TuSimple data, the proposed method is very robust in lanes detection. Nevertheless, studies related to learning data reinforcement in which lanes are located in the center or at the left and right edges of the image and accurate network learning for lanes are needed.

In this study, the multi-lane detection problem is expressed as a CNN-based regression problem, and the lane boundary coordinates are selected as outputs. In addition, we described lanes as fifth-order polynomials and distinguished the ego lane and the side lanes so that we could make the prediction lanes accurately. By eliminating the network branch arrangement and the lane boundary coordinate vector outside the image proposed by Chougule’s method, it was possible to eradicate meaningless data learning in CNN and increase the fast training and performance speed. And we confirmed that the average prediction error was small in the performance evaluation even though the proposed method compared with Chougule’s method under harsher conditions. In addition, even in a specific image with many errors, the predicted lanes did not deviate significantly, meaningful results were derived, and we confirmed robust performance.

We need data such as the number of lanes for lane change on the road as well as environmental and object recognition of the road for the autonomous vehicle of the future. This study proposed an algorithm that recognizes the left and right lanes and the center lane while driving differently from the black box image taken from a car. In general, deep learning does not recognize lanes individually but recognizes all lanes as only one lane. Therefore, using YOLO's object recognition function, the left and right lanes and the center lane were detected as different lanes, and a heuristic method was applied to recognize multi-lanes as more correct lanes. As a result of the performance evaluation, we confirmed that the proposed method detects the lane more accurately than Fast R-CNN and only YOLOv2.