As the development of autonomous vehicles becomes realistic, many automobile manufacturers and components producers aim to develop ‘completely autonomous driving’. ADAS (Advanced Driver Assistance Systems) which has been applied in automobile recently, supports the driver in controlling lane maintenance, speed and direction in a single lane based on limited road environment. Although technologies of obstacles avoidance on the obstacle environment have been developed, they concentrates on simple obstacle avoidances, not considering the control of the actual vehicle in the real situation which makes drivers feel unsafe from the sudden change of the wheel and the speed of the vehicle. In order to develop the ‘completely autonomous driving’ automobile which perceives the surrounding environment by itself and operates, ability of the vehicle should be enhanced in a way human driver does. In this sense, this paper intends to establish a strategy with which autonomous vehicles behave human-friendly based on vehicle dynamics through the reinforcement learning that is based on Q-learning, a type of machine learning. The obstacle avoidance reinforcement learning proceeded in 5 simulations. The reward rule has been set in the experiment so that the car can learn by itself with recurring events, allowing the experiment to have the similar environment to the one when humans drive. Driving Simulator has been used to verify results of the reinforcement learning. The ultimate goal of this study is to enable autonomous vehicles avoid obstacles in a human-friendly way when obstacles appear in their sight, using controlling methods that have previously been learned in various conditions through the reinforcement learning.

The Expanded Guide Circle (EGC) method has been originally proposed as the guidance navigation method for improving the efficiency of the remote operation using the sensory information. The previous algorithm is, however, concerned only for the omni-directional mobile robot, so it needs to suggest a suitable one for a mobile robot with non-holonomic constraints. The ego-kinematic transform is a method to map points of R2 into the ego-kinematic space which implicitly represents non-holonomic constraints for admissible paths. Thus, robots with non-holonomic constraints in the ego-kinematic space can be considered as “free-flying object”. In this paper, we propose an effective obstacle avoidance method for mobile robots with non-holonomic constraints by applying EGC method in the ego-kinematic space using the ego-kinematic transformation. This proposed method shows that it works better for non-holonomic mobile robots such as differential-drive robot than the original one. The simulation results show its effectiveness of performance.

Collision avoidance is a fundamental and important task of an autonomous mobile robot for safe navigation in real environments with high uncertainty. Obstacles are classified into static and dynamic obstacles. It is difficult to avoid dynamic obstacles because the positions of dynamic obstacles are likely to change at any time. This paper proposes a scheme for vision-based avoidance of dynamic obstacles. This approach extracts object candidates that can be considered moving objects based on the labeling algorithm using depth information. Then it detects moving objects among object candidates using motion vectors. In case the motion vectors are not extracted, it can still detect the moving objects stably through their color information. A robot avoids the dynamic obstacle using the dynamic window approach (DWA) with the object path estimated from the information of the detected obstacles. The DWA is a well known technique for reactive collision avoidance. This paper also proposes an algorithm which autonomously registers the obstacle color. Therefore, a robot can navigate more safely and efficiently with the proposed scheme.

We propose a novel real-time obstacle avoidance method for rescue robots. This method, named the ELA(Emergency Level Around), permits the detection of unknown obstacles and avoids collisions while simultaneously steering the mobile robot toward safe position. In the ELA, we consider two sensor modules, PSD(Position Sensitive Detector) infrared sensors taking charge of obstacle detection in short distance and LMS(Laser Measurement System) in long distance respectively. Hence if a robot recognizes an obstacle ahead by PSD infrared sensors first, and judges impossibility to overcome the obstacle based on driving mode decision process, the order of priority is transferred to LMS which collects data of radial distance centered on the robot to avoid the confronted obstacle. After gathering radial information, the ELA algorithm estimates emergency level around a robot and generates a polar histogram based on the emergency level to judge where the optimal free space is. Finally, steering angle is determined to guarantee rotation to randomly direction as well as robot width for safe avoidance. Simulation results from wandering in closed local area which includes various obstacles and different conditions demonstrate the power of the ELA.