We tested our approach on several datasets of which a point cloud composed of 2.3 billion points, representing the heritage site of the castle of Jehay (Belgium). Finally, we provide a full semantic VR data integration enhanced through developed shaders for future spatio-semantic queries. Then, we provide an open-source solution using Unity with a user interface for VR point cloud interaction and visualisation. We then build an octree data structure leveraged through out-of-core algorithms to load in real time and continuously only the points that are in the VR user's field of view. First, we develop a semi-automatic segmentation approach to provide semantic descriptors (mainly classes) to groups of points. The emphasis is put on leveraging open-source frameworks for an easy replication of the findings. In this paper, the main focus is on the direct classification and integration of massive 3D point clouds in a virtual reality (VR) environment. Indeed, this can lead to an efficient workflow from 3D capture to 3D immersive environment creation without the need to derive 3D model, and lengthy optimization pipelines. With the increasing volume of 3D applications using immersive technologies such as virtual, augmented and mixed reality, it is very interesting to create better ways to integrate unstructured 3D data such as point clouds as a source of data. A conclusion will be drawn and a short outlook into the ongoing course of the AURA project will be given. Furthermore, the usage of auralization for touristic purposes will be investigated using artificial intelligence for an audience preference analysis. The results of a digital survey will be laid out and the conception and implementation of a first auralized prototype using a hand-modeled 3D object from the Great Hall of the Konzerthaus Berlin will be demonstrated. This paper gives insights into current digitalization and auralization techniques. Each will be digitally recreated and auralized before they are then used to conduct case studies. The project aims to create auralized applications for three music venues in each of the project countries, namely the Konzerthaus Berlin, the Teatro del Maggio in Florence, and the Opera House Lviv. This paper presents the progress implemented during the AURA project, funded by the Creative-Europe program with project partners from Germany, Italy, and Ukraine.
0 kommentar(er)
