Analysis of Marker and SLAM-based Tracking for Advanced Augmented Reality (AR)-based Flight Simulation [1]

Augmented reality (AR)-based flight simulation reshapes how pilots are trained, offering an immersive environment where commercial
and fighter pilots can be trained at low cost with minimal use of fuel and safety concerns. This study conducts a pioneering comparative analysis of marker-based tracking and SLAM technologies within the Microsoft HoloLens 2 platform, mainly focusing on their efficacy in landing manoeuvre simulations. Our investigation incorporates an experimental setup where marker-based tracking overlays interactive video tutorials onto a simulated cockpit, enhancing the realism and effectiveness of landing procedures. The experiment demonstrates that marker-based systems ensure high precision within 5 cm and 15 cm from the HoloLens 2 camera, proving indispensable for procedural training that requires exact overlay precision. Conversely, the native SLAM algorithm, while lacking the same level of precision, offers flexibility and adaptability by accurately mapping the cockpit and superimposing virtual information in dynamic, markerless conditions. The study juxtaposes these technologies, revealing a trade-off between precision and adaptability, and suggests an integrative approach to leverage their respective strengths. Our findings provide pivotal insights for developers and training institutions to optimize AR flight simulation training, contributing to advanced, immersive pilot training programs.