UAV-BASED 3D VIRTUAL TOUR CREATION

Lately, improvements in game engines have increased the interest in virtual reality (VR) technologies, that engages users with an artificial environment, and have led to the adoption of VR systems to display geospatial data. Because of the ongoing COVID-19 pandemic, and thus the necessity to stay at home, VR tours became very popular. In this paper, we tried to create a three-dimensional (3D) virtual tour for Gebze Technical University (GTU) Southern Campus by transferring high-resolution unmanned air vehicle (UAV) data into a virtual domain. UAV data is preferred in various applications because of its high spatial resolution, low cost and fast processing time. In this application, the study area was captured from different modes and altitudes of UAV flights with a minimum ground sampling distance (GSD) of 2.18 cm using a 20 MP digital camera. The UAV data was processed in Structure from Motion (SfM) based photogrammetric evaluation software Agisoft Metashape and high-quality 3D textured mesh models were generated. Image orientation was completed using an optimal number of ground control points (GCPs), and the geometric accuracy was calculated as ±8 mm (~0.4 pixels). To create the VR tour, UAV-based mesh models were transferred into the Unity game engine and optimization processes were carried out by applying occlusion culling and space subdivision algorithms. To improve the visualization, 3D object models such as trees, lighting poles and arbours were positioned on VR. Finally, textual metadata about buildings and a player with a first-person camera were added for an informative VR experience.

A History of Video Games

<p>This research begins with the premise that while video-games have become a pervasive cultural force over the last four decades, there is still a dearth of educational and historical material regarding the emergence of video game home consoles and their content. Games have an extensive history, dating back to early radar displays and oscilloscopes of the 1960s (Tennis for Two, 1958) and early home video game consoles of the 1970s (Magnavox Odyssey, 1972). From the JAMMA (Japanese Amusement Machine and Marketing Association) arcade standard of the 80s to the high powered processors of Sonys PS4, video games have come a long way and left a wealth of audio-visual material in their wake. Much of this material, however, is archived and engaged within a traditional manner: through text books or museum exhibitions (Games Master, ACMI 2015). Through interactive design however, this data can be made easily comprehensible and accessible as interactive data-visualisation content. This design research project explores processes of data visualization, interactive design and video game production to open up video game history and communicate its developmental stages in a universally accessible manner. Though there has been research conducted utilising game engines for visualizations in other fields (from landscape architecture to bio-medical science) it has rarely been used to visualize the history of gaming itself. This visualization (utilising the Unreal Engine and incorporating historical video content) creates an accessible preservation and catalogue of video game history, and an interactive graphical interface that allows users to easily learn and understand the history of console development and the processes that lead video games to their current state.</p>

A History of Video Games

<p>This research begins with the premise that while video-games have become a pervasive cultural force over the last four decades, there is still a dearth of educational and historical material regarding the emergence of video game home consoles and their content. Games have an extensive history, dating back to early radar displays and oscilloscopes of the 1960s (Tennis for Two, 1958) and early home video game consoles of the 1970s (Magnavox Odyssey, 1972). From the JAMMA (Japanese Amusement Machine and Marketing Association) arcade standard of the 80s to the high powered processors of Sonys PS4, video games have come a long way and left a wealth of audio-visual material in their wake. Much of this material, however, is archived and engaged within a traditional manner: through text books or museum exhibitions (Games Master, ACMI 2015). Through interactive design however, this data can be made easily comprehensible and accessible as interactive data-visualisation content. This design research project explores processes of data visualization, interactive design and video game production to open up video game history and communicate its developmental stages in a universally accessible manner. Though there has been research conducted utilising game engines for visualizations in other fields (from landscape architecture to bio-medical science) it has rarely been used to visualize the history of gaming itself. This visualization (utilising the Unreal Engine and incorporating historical video content) creates an accessible preservation and catalogue of video game history, and an interactive graphical interface that allows users to easily learn and understand the history of console development and the processes that lead video games to their current state.</p>

Different Levels of Complexity for Integrating Textured Extra-terrestrial Elevation Data in Game Engines for Educational Augmented and Virtual Reality Applications

Elevation and visual data from Chang’E-2, Mars Viking, and MOLA were transformed into 3D models and environments using unity and unreal engine to be implemented in augmented (AR) and virtual reality (VR) applications, respectively. The workflows for the two game development engines and the two purposes overlap, but have significant differences stemming from their intended usage: both are used in educational settings, but while the AR app has to run on basic smartphones that students from all socio-economic backgrounds might have, the VR requires high-end PCs and can therefore make use of respective devices’ potential. Hence, the models for the AR app are reduced to the necessary components and sizes of the highest mountains on Luna and Mars, whereas the VR app contains several models of probe landing sites on Mars, a landscape containing the entire planet at multiple levels of detail and a complex environment. Both applications are enhanced for educational use with annotations and interactive elements. This study focuses on the transfer of scientific data into game development engines for the use in educational settings using the example of scales in extra-terrestrial environments.

Virtual Reality Application of the Fortress Al Zubarah in Qatar Including Performance Analysis of Real-Time Visualisation

Technological advancements in the area of Virtual Reality (VR) in the past years have the potential to fundamentally impact our everyday lives. VR makes it possible to explore a digital world with a Head-Mounted Display (HMD) in an immersive, embodied way. In combination with current tools for 3D documentation, modelling and software for creating interactive virtual worlds, VR has the means to play an important role in the conservation and visualisation of cultural heritage (CH) for museums, educational institutions and other cultural areas. Corresponding game engines offer tools for interactive 3D visualisation of CH objects, which makes a new form of knowledge transfer possible with the direct participation of users in the virtual world. However, to ensure smooth and optimal real-time visualisation of the data in the HMD, VR applications should run at 90 frames per second. This frame rate is dependent on several criteria including the amount of data or number of dynamic objects. In this contribution, the performance of a VR application has been investigated using different digital 3D models of the fortress Al Zubarah in Qatar with various resolutions. We demonstrate the influence on real-time performance by the amount of data and the hardware equipment and that developers of VR applications should find a compromise between the amount of data and the available computer hardware, to guarantee a smooth real-time visualisation with approx. 90 fps (frames per second). Therefore, CAD models offer a better performance for real-time VR visualisation than meshed models due to the significant reduced data volume.

3D sound spatialization with game engines: the virtual acoustics performance of a game engine and a middleware for interactive audio design

This study analyses one of the most popular game engines and an audio middleware to reproduce sound according to sound propagation physics. The analysis focuses on the transmission path between the sound source and the receiver. Even if there are several ready-to-use real-time auralization platforms and software, game engines' use with this aim is a recent study area for acousticians. However, audio design needs with game engines and the limits of their basic releases require additional tools (plugins and middleware) to improve both the quality and realism of sound in virtual environments. The paper discusses the use of Unreal Engine 4 and Wwise's 3D audio production methods in a set of different test environments. It assesses their performance in regard to a commercial geometrical acoustics software. The results show that the investigated version of the game engine and its sound assets are insufficient to simulate real-world cases and that significant improvements can be achieved with use of the middleware.

AethelmE, HTML5 Game Engine with Multiple Canvas Elements

Game engine is software which ease the game development. As the processor power technology evolved and the HTML5 (HyperText Markup Language 5) specification are developed, browsers nowadays can natively (without any need for external plug-in) display animations and multimedia files (audio and video) using JavaScript as the programming language. Some of the features which are used in this research are HTML5‘s canvas and audio elements. The problem is that none of the existing free HTML5 game engines is able to support multiple canvas elements. This research will create a game engine, called AethelmE, which support multiple canvas elements as its unique feature. This game engine is also able to support sprite transformation, browsers compatibility, external asset loading, and audio format compatibility. This research successfully resulted in creating an HTML5 game engine which supports multiple canvas elements. It also supports all the scopes, with a small exception on sound format compatibility. Moreover, this research conducted a performance comparison testing of multiple HTML5 game engines, from which can be concluded that multiple canvas elements does not give significant performance gain compared to a single canvas.

Adapting Game Engines to Curved Spaces

Curved spaces are very un-intuitive to our eyes trained on Euclidean geometry. Games provide an interesting way to explore these strange worlds. Games are written with the help of modeling tools and game engines based on Euclidean geometry. This paper addresses the problem of adapting 3D game engines to the rules of curved spaces. We consider the conversion of Euclidean objects, geometric calculations, transformation pipeline, lighting and physical simulation. Finally, we identify where existing game engines should be modified.