Reinforcement learning (RL) is successfully applied to various engineering fields. RL is generally used for structural control cases to develop the control algorithms. On the other hand, a machine learning (ML) is adopted in various research to make automated structural design model for reinforced concrete (RC) beam members. In this case, ML models are developed to produce results that are as similar to those of training data as possible. The ML model developed in this way is difficult to produce better results than the training data. However, in reinforcement learning, an agent learns to make decisions by interacting with an environment. Therefore, the RL agent can find better design solution than the training data. In the structural design process (environment), the action of RL agent represent design variables of RC beam. Because the number of design variables of RC beam section is many, multi-agent DQN (Deep Q-Network) was used in this study to effectively find the optimal design solution. Among various versions of DQN, Double Q-Learning (DDQN) that not only improves accuracy in estimating the action-values but also improves the policy learned was used in this study. American Concrete Institute (318) was selected as the design codes for optimal structural design of RC beam and it was used to train the RL model without any hand-labeled dataset. Six agents of DDQN provides actions for beam with, beam depth, bottom rebar size, number of bottom rebar, top rebar size, and shear stirrup size, respectively. Six agents of DDQN were trained for 5,000 episodes and the performance of the multi-agent of DDQN was evaluated with 100 test design cases that is not used for training. Based on this study, it can be seen that the multi-agent RL algorithm can provide successfully structural design results of doubly reinforced beam.

As digital transformation accelerates, platform business has become a core business model in modern society. Platform business has a network effect where the winner takes all. For this reason, it is crucial for a company's pricing policy to attract as many customers as possible in the early stages of business. Telecommunication service companies are experiencing stagnant growth due to the saturation of the smartphone market and intensifying competition in rates, but the burden of maintaining communication networks is increasing due to the rapid increase in traffic caused by domestic and foreign CSPs. This study aims to understand the dynamic characteristics of the telecommunications market by focusing on pricing policy. To this end, we analyzed how ISPs, CSPs, and consumers react to changes in pricing policy based on the prisoner's dilemma theory. The analysis of the dynamic characteristics of the market was conducted through simulation using the Agent-Based Model.

As digital transformation accelerates, platform business has become a core business model in modern society. Platform business has a network effect where the winner takes all. For this reason, it is crucial for a company's pricing policy to attract as many customers as possible in the early stages of business. Telecommunication service companies are experiencing stagnant growth due to the saturation of the smartphone market and intensifying competition in rates, but the burden of maintaining communication networks is increasing due to the rapid increase in traffic caused by domestic and foreign CSPs. This study aims to understand the dynamic characteristics of the telecommunications market by focusing on pricing policy. To this end, we analyzed how ISPs, CSPs, and consumers react to changes in pricing policy based on the prisoner's dilemma theory. The analysis of the dynamic characteristics of the market was conducted through simulation using the Agent-Based Model.

In the manufacturing industry, dispatching systems play a crucial role in enhancing production efficiency and optimizing production volume. However, in dynamic production environments, conventional static dispatching methods struggle to adapt to various environmental conditions and constraints, leading to problems such as reduced production volume, delays, and resource wastage. Therefore, there is a need for dynamic dispatching methods that can quickly adapt to changes in the environment. In this study, we aim to develop an agent-based model that considers dynamic situations through interaction between agents. Additionally, we intend to utilize the Q-learning algorithm, which possesses the characteristics of temporal difference (TD) learning, to automatically update and adapt to dynamic situations. This means that Q-learning can effectively consider dynamic environments by sensitively responding to changes in the state space and selecting optimal dispatching rules accordingly. The state space includes information such as inventory and work-in-process levels, order fulfilment status, and machine status, which are used to select the optimal dispatching rules. Furthermore, we aim to minimize total tardiness and the number of setup changes using reinforcement learning. Finally, we will develop a dynamic dispatching system using Q-learning and compare its performance with conventional static dispatching methods.

Spare part management is very important to products that have large number of parts and long lifecycle such as automobile and aircraft. Supply chain must support immediate procurement for repair. However, it is not easy to handle spare parts efficiently due to huge stock keeping units. Qualified forecasting is the basis for the supply chain to achieve the goal. In this paper, we propose an agent based modeling approach that can deal with various factors simultaneously without mathematical modeling. Simulation results show that the proposed method is reasonable to describe demand generation process, and consequently, to forecast demand of spare parts in long-term perspective.