논문 상세보기

다중에이전트 강화학습 기반 복근보 자동설계 모델 개발 KCI 등재

Development of Multi-Agent RL-Based Automated Design Model for Doubly Reinforced Beams

  • 언어KOR
  • URLhttps://db.koreascholar.com/Article/Detail/442110
구독 기관 인증 시 무료 이용이 가능합니다. 4,000원
한국공간구조학회지 (JOURNAL OF THE KOREAN ASSOCIATION FOR AND SPATIAL STRUCTURES)
한국공간구조학회 (Korean Association for Spatial Structures)
초록

Reinforcement learning (RL) is successfully applied to various engineering fields. RL is generally used for structural control cases to develop the control algorithms. On the other hand, a machine learning (ML) is adopted in various research to make automated structural design model for reinforced concrete (RC) beam members. In this case, ML models are developed to produce results that are as similar to those of training data as possible. The ML model developed in this way is difficult to produce better results than the training data. However, in reinforcement learning, an agent learns to make decisions by interacting with an environment. Therefore, the RL agent can find better design solution than the training data. In the structural design process (environment), the action of RL agent represent design variables of RC beam. Because the number of design variables of RC beam section is many, multi-agent DQN (Deep Q-Network) was used in this study to effectively find the optimal design solution. Among various versions of DQN, Double Q-Learning (DDQN) that not only improves accuracy in estimating the action-values but also improves the policy learned was used in this study. American Concrete Institute (318) was selected as the design codes for optimal structural design of RC beam and it was used to train the RL model without any hand-labeled dataset. Six agents of DDQN provides actions for beam with, beam depth, bottom rebar size, number of bottom rebar, top rebar size, and shear stirrup size, respectively. Six agents of DDQN were trained for 5,000 episodes and the performance of the multi-agent of DDQN was evaluated with 100 test design cases that is not used for training. Based on this study, it can be seen that the multi-agent RL algorithm can provide successfully structural design results of doubly reinforced beam.

목차
Abstract
1. 서론
2. MARL을 이용한 RC 복근보 단면설계 자동화
3. MARL을 이용한 RC 복근보 최적설계
4. 결론
감사의 글
References
저자
  • 김현수(선문대학교 건축학부 교수, 공학박사) | Kim Hyun-Su (Division of Architecture, Sunmoon University) Corresponding author
  • 신수진(선문대학교 건축학부 학사과정) | Shin Su Jin (Division of Architecture, Sunmoon University)
  • 김수찬(선문대학교 건축학부 학사과정) | Kim Su Chan (Division of Architecture, Sunmoon University)
  • 김태웅(선문대학교 건축학부 학사과정) | Kim Taeung (Division of Architecture, Sunmoon University)
  • 안시현(선문대학교 건축학부 학사과정) | An Si Hyeon (Division of Architecture, Sunmoon University)