We need data such as the number of lanes for lane change on the road as well as environmental and object recognition of the road for the autonomous vehicle of the future. This study proposed an algorithm that recognizes the left and right lanes and the center lane while driving differently from the black box image taken from a car. In general, deep learning does not recognize lanes individually but recognizes all lanes as only one lane. Therefore, using YOLO's object recognition function, the left and right lanes and the center lane were detected as different lanes, and a heuristic method was applied to recognize multi-lanes as more correct lanes. As a result of the performance evaluation, we confirmed that the proposed method detects the lane more accurately than Fast R-CNN and only YOLOv2.