Simulating realistic surgeon decisions and actions in immersive medical distance education with XR and AI

This research aims to improve distance education in orthopedic surgery by leveraging extended reality (XR) and artificial intelligence (AI). It focuses on skill acquisition, feedback, and behavioral training in clinical settings. The study involved 57 experts and included surveys, interviews, and literature reviews to explore how these technologies can improve medical education, focusing on the Challenge Point Framework (CPF). A cognitive task analysis was performed with six experts to refine the XR and AI system, ensuring it aligns with competency-based educational standards for orthopedic surgery. The findings highlight the importance of XR and AI in higher education, promoting the democratization of XR educational tools. The study also examines CPF algorithms for training in total knee replacement (TKR) surgery within virtual environments, aiming to improve mathematical modeling and explore how humans and AI can collaborate in surgical practices. The research seeks to develop customized XR applications for different educational areas, providing a framework for using XR and AI in TKR training. This initiative aims to change how orthopedic education is delivered, enhancing the training experience for surgical professionals. By applying activity theory, the study plans to create an engaging learning experience that enhances both knowledge and practical skills in the field.