This study aimed to enhance the safety of autonomous bus services by systematically identifying safety-related factors and establishing priorities based on real-world operating environments. An expert survey was conducted using a autonomous bus currently operating in Pangyo Zero City as a case study. Building on the concept of the Operational Design Domain, a two-layer safety framework was developed consisting of four primary categories (Layer 1): physical infrastructure, operating conditions, communication environment, and weather conditions, and their corresponding detailed elements (Layer 2). A fuzzy Analytic Hierarchy Process(AHP) analysis revealed that physical infrastructure had the highest relative importance, with key safety-critical factors identified as intersection type, construction work zone, lane markings, and adverse weather. Subsequently, a strength, weakness, opportunity and threat (SWOT) analysis was employed to propose short-, mid-, and long-term strategic actions, including the enhancement of object recognition functions based on advanced camera sensor fusion, reinforcement of safety driver and onboard safety personnel systems, and establishment of infrastructure pre-notification systems for construction and maintenance activities. This study provides a quantitative prioritization of safety factors for autonomous bus services and links these findings to a practical technology and policy roadmap, contributing to the enhancement of safety and development of commercialization strategies for future autonomous public transportation services.