논문 상세보기

다중 에이전트 강화학습을 이용한 RC보 최적설계 기술개발 KCI 등재

Development of Optimal Design Technique of RC Beam using Multi-Agent Reinforcement Learning

  • 언어KOR
  • URLhttps://db.koreascholar.com/Article/Detail/421800
구독 기관 인증 시 무료 이용이 가능합니다. 4,000원
한국공간구조학회지 (JOURNAL OF THE KOREAN ASSOCIATION FOR AND SPATIAL STRUCTURES)
한국공간구조학회 (Korean Association for Spatial Structures)
초록

Reinforcement learning (RL) is widely applied to various engineering fields. Especially, RL has shown successful performance for control problems, such as vehicles, robotics, and active structural control system. However, little research on application of RL to optimal structural design has conducted to date. In this study, the possibility of application of RL to structural design of reinforced concrete (RC) beam was investigated. The example of RC beam structural design problem introduced in previous study was used for comparative study. Deep q-network (DQN) is a famous RL algorithm presenting good performance in the discrete action space and thus it was used in this study. The action of DQN agent is required to represent design variables of RC beam. However, the number of design variables of RC beam is too many to represent by the action of conventional DQN. To solve this problem, multi-agent DQN was used in this study. For more effective reinforcement learning process, DDQN (Double Q-Learning) that is an advanced version of a conventional DQN was employed. The multi-agent of DDQN was trained for optimal structural design of RC beam to satisfy American Concrete Institute (318) without any hand-labeled dataset. Five agents of DDQN provides actions for beam with, beam depth, main rebar size, number of main rebar, and shear stirrup size, respectively. Five agents of DDQN were trained for 10,000 episodes and the performance of the multi-agent of DDQN was evaluated with 100 test design cases. This study shows that the multi-agent DDQN algorithm can provide successfully structural design results of RC beam.

목차
Abstract
1. 서론
2. RC 보 설계를 위한 강화학습 환경
3. 다중 에이전트 강화학습의 개요
4. 다중 에이전트 강화학습을 이용한RC보 최적 설계
5. 결론
감사의 글
References
저자
  • 강주원(영남대학교 건축학부 교수, 공학박사) | Kang Joo-Won (School of Architecture, Yeungnam University)
  • 김현수(종신회원, 선문대학교 건축학부 교수, 공학박사) | Kim Hyun-Su (Division of Architecture, Sunmoon University) Corresponding author