RECONSTRUÇÃO 3D BASEADA EM FOTOGRAMETRIA PARA REALIDADE MISTA EM AMBIENTES VIRTUAIS DE SIMULAÇÃO INTERATIVA

INTRODUCTION: Mixed reality (MR) is a comprehensive term that encompasses both virtual and augmented reality, creating a spectrum between the real and virtual worlds. Augmented reality overlays interactive features on the real world, while virtual reality completely immerses users in a virtual environment. Photogrammetry, a technology that reconstructs 3D models from overlapping photos, enables MR devices to display real-world objects and environments. AIMS: The objective is to develop a prototype application that composes interactive virtual environments using reconstructed models. MATERIALS AND METHODS: The literature review enabled the identification of better methods for obtaining photogrammetrized models by comparing and evaluating the quality between two software options: Meshroom and Polycam. Using Unity, Mixed Reality Toolkit 2 (MRTK 2), and OBJImporter. RESULTS: A functional prototype was developed, allowing users to select and interact with multiple simulations, showcasing both the environment and its individual objects. Furthermore, the prototype allows users to import custom environments for further exploration. FINAL CONSIDERATIONS: This research worked on the utilization of photogrammetry and mixed reality, primarily on the HoloLens 2 MR device, but with a focus on ensuring retro and multi-platform compatibility. The study’s conclusion reveals the challenges inherent in producing immersive MR simulations and convincing 3D reconstructions. The selection of photogrammetry software has proven beneficial for different applications, and opportunities for further improvements have been identified.

KEYWORDS: Mixed reality; Augmented reality; Photogrammetry; interactive virtual environments.