실제세계에서 데이터 수집의 비용과 한계를 고려할 때, 시뮬레이션 생성 환경은 데이터 생성 과 다양한 시도에 있어 효율적인 대안이다. 이 연구에서는 Unity ML Agent를 로그라이크 장 르에 적합한 강화학습 모델로 구현하였다. 간단한 게임에Agent를 이식하고, 이 Agent가 적을 인식하고 대응하는 과정을 코드로 작성하였다. 초기 모델은 조준사격의 한계를 보였으나 RayPerceptionSensor-Component2D를 통해 Agent의 센서 정보를 직접 제공함으로써, Agent가 적을 감지하고 조준 사격을 하는 능력을 관찰할 수 있었다. 결과적으로, 개선된 모델 은 평균3.81배 향상된 성능을 보여주었으며, 이는 Unity ML Agent가 로그라이크 장르에서 강화학습을 통한 데이터 수집이 가능함을 입증한다.

Collecting large amounts of data in the real world is expensive and has clear limitations. Simulation-generated environments, on the other hand, offer the opportunity to efficiently generate the necessary data and to try different things easily and quickly. In this research, we utilized one of the tools that addresses these challenges, by the Unity Machine Learning tool, to study an efficient automation model that responds to the characteristics of the rogue-like genre. For testing purposes, we implemented a simple game, implanted an agent into the main character of the game, and fed the agent with code to shoot and avoid hostile. The implemented ML Agent successfully recognized the hostile targets and responded by shooting and dodging them. However, instead of learning to prioritize the hostile targets over time by reinforcing itself and shooting the high-risk targets first, it consistently fired in only one of the 360-degree directions given to it at the beginning, which we didn’t expected, so we improved the code. By utilizing the RayPerceptionSensor-Component2D element to directly feed the agent's sensors with information about hostile targets, we found that the agent was able to utilize its ray sensor to detect them and make much more precise aimed shots. In fact, it outperformed the original model by an average of 3.81x, proving that Unity ML Agentcan collect data through reinforcement learning in the roguelike genre.

1. Introduction
    1.1 Unity Machine Learning Agents
    1.2 Genre Characteristics of Rogue-likeGames
    1.3 Potential Applications in Rogue-like
2. Related Research
    2.1 Comparing the performance ofreinforcement learning algorithms ina 2D Rogue-like game using UnityML-Agents
    2.2 Reinforcement learning and applyingthe A3C algorithm using Unity 3Dand the ML-Agents Toolkit
3. Environment Implement
    3.1 Feature Improvements and FinalExperiments
4. Conclusion
Reference
국문초록
Author Biography

• Se Yeon KIM(Department of Game Design and Development, Sangmyung University, Seoul 03016, Korea) | 김세연
• Mu Jip KIM(Department of Game Design and Development, Sangmyung University, Seoul 03016, Korea) | 김무집
• Seok-Kyoo KIM(Department of Game Design and Development, Sangmyung University, Seoul 03016, Korea) | 김석규 Corresponding author