DEVELOPMENT OF A 3D CADASTRE AUGMENTED REALITY AND VISUALIZATION IN MALAYSIA

This paper discusses the capabilities of cadastre augmented reality (AR) and three-dimensional (3D) visualization in enhancing the stratified property visibility and information of the current strata plan in Malaysia. Currently, 2D information representation from the 2D+1D cadastre system is seen to be insufficient in serving real land management of the 3D aspect and property. Hence, toward a better digital 3D strata/property registration and land administration system in Malaysia, this study has explored the process in utilizing AR and 3D model to the current strata plan to enhance digital strata information contents and enabling the virtual strata plan presentation. The software used to develop the AR application smartphone was Unity3D software while Autodesk Revit applied to develop the 3D model and preparation of strata information. The interesting findings has been shown in this study. First result showed 3D models and strata parcel’s attribute that has been developed for AR digital content preparation. Secondly, this 3D-AR processes can continuously gather of user’s ambient information, conduct real-world recognition, and obtain real-world perception through smartphone device. Lastly, with utilization of AR technology in strata, it provides a more information to the strata plan without needing to change the current format of strata plan as the information are being displayed virtually onto the reality. With the integration of augmented reality and 3D visualization, the documentation of stratified properties in strata plan is potential to be enhanced from 2D planimetric to 3D representation. overlaid 3D model of the stratified property and standard strata information virtually on the present strata plan which has created an enhanced reality. This can allow the information to be viewed by more stakeholders with less restriction by using smartphone device.

VERBUM – virtual enhanced reality for building modelling (virtual technical tour in digital twins for building conservation)

The digital transformation of the construction sector is also involving cultural and architectural heritage conservation management to solve criticalities of information exchange in refurbishment/restoration, from the preliminary steps until the execution and monitoring of interventions. Nevertheless, time and resources required to complete digital models (point clouds, 3D meshes and HBIM model) are extensive and this can cause interruption of knowledge communication among professionals. The VERBuM project (Virtual Enhanced Reality For Building Modelling) aims at investigating how a central Virtual Technical Tour (VTT), would guarantee a continuous stream of information when other disruptive technologies are integrated in the process and their related products are linked to the VTT. The use of a VTT, based on 360° photos, may fill time and resources gaps as it is a rapid up-to-date and high-fidelityto-reality tool. The fostering of the paradigmatic change in refurbishment/restoration process requires the development of all-in-one digital environments for digital twinning of cultural and architectural heritage and its assessment, aware of potentialities and criticalities to be overcame. The research moves from stakeholders’ information requirements to implement the VERBuM process supported by the central VTT, editable via cloud-based platform (VERBuM product) to exchange digital contents, uploaded in different file format, but consulted in VR by all the involved actors via web services, without any software product installation. The tool has been evaluated via SWOT analysis supported by Task-Technology Fit (TTF) model and users’ perceptions. The results provide mitigation measures of threats related to distrust in use of VTT within working groups and fruition of point clouds, meshes and BIM models, possible via WebGL-based libraries.

Virtual Reality as a Tool for Public Consultations in Spatial Planning and Management

Planning and management of urban space that involves the local community the process is key to optimal management of the surroundings, in line with social needs. Social isolation imposed because of the COVID-19 pandemic considerably reduces the possibility of conducting public consultations. This study hypothesized that such consultations can be carried out using new visualisation technologies in the virtual reality (VR) area. Owing to the development of new technologies, innovative services can be created which make it easier for recipients to absorb new content. To this end, the ArchitektVR application was developed, which uses enhanced reality for public consultations concerning planned land development. 3D visualisation with VR enables the presentation of various aspects of area development in a clear form, understandable to an average user with no specialist qualifications. It facilitates the presentation and creation of multiple variants/scenarios for the future shape of the area. The research assumptions were tested for a disused area of a water body. According to preliminary tests, the use of virtual reality could provide a new form of communication between decision-makers and citizens. Effective and easy-to-understand visualisations might provide encouragement to participate in local matters and enable citizens to make better decisions. 3D visualisation enabled concerned individuals to assess the potential development of a selected area fragment without an in-person visit, either in the field or to an office. This is of particular importance in relation to the COVID-19 pandemic and sanitary restrictions.

Intraoperative Perfusion Assessment in Enhanced Reality Using Quantitative Optical Imaging: An Experimental Study in a Pancreatic Partial Ischemia Model

To reduce the risk of pancreatic fistula after pancreatectomy, a satisfactory blood flow at the pancreatic stump is considered crucial. Our group has developed and validated a real-time computational imaging analysis of tissue perfusion, using fluorescence imaging, the fluorescence-based enhanced reality (FLER). Hyperspectral imaging (HSI) is another emerging technology, which provides tissue-specific spectral signatures, allowing for perfusion quantification. Both imaging modalities were employed to estimate perfusion in a porcine model of partial pancreatic ischemia. Perfusion quantification was assessed using the metrics of both imaging modalities (slope of the time to reach maximum fluorescence intensity and tissue oxygen saturation (StO2), for FLER and HSI, respectively). We found that the HSI-StO2 and the FLER slope were statistically correlated using the Spearman analysis (R = 0.697; p = 0.013). Local capillary lactate values were statistically correlated to the HSI-StO2 and to the FLER slope (R = −0.88; p < 0.001 and R = −0.608; p = 0.0074). HSI-based and FLER-based lactate prediction models had statistically similar predictive abilities (p = 0.112). Both modalities are promising to assess real-time pancreatic perfusion. Clinical translation in human pancreatic surgery is currently underway.

Quantitative serosal and mucosal optical imaging perfusion assessment in gastric conduits for esophageal surgery: an experimental study in enhanced reality

Introduction/objective Gastric conduit (GC) is used for reconstruction after esophagectomy. Anastomotic leakage (AL) incidence remains high, given the extensive disruption of the gastric circulation. Currently, there is no reliable method to intraoperatively quantify gastric perfusion. Hyperspectral imaging (HSI) has shown its potential to quantify serosal StO2. Confocal laser endomicroscopy (CLE) allows for automatic mucosal microcirculation quantification as functional capillary density area (FCD-A). The aim of this study was to quantify serosal and mucosal GC’s microperfusion using HSI and CLE. Local capillary lactate (LCL) served as biomarker. Methods GC was formed in 5 pigs and serosal StO2% was quantified at 3 regions of interest (ROI) using HSI: fundus (ROI-F), greater curvature (ROI-C), and pylorus (ROI-P). After intravenous injection of sodium-fluorescein (0.5 g), CLE-based mucosal microperfusion was assessed at the corresponding ROIs, and LCLs were quantified via a lactate analyzer. Results StO2 and FCD-A at ROI-F (41 ± 10.6%, 3.3 ± 3.8, respectively) were significantly lower than ROI-C (68.2 ± 6.7%, p value: 0.005; 18.4 ± 7, p value: 0.01, respectively) and ROI-P (72 ± 10.4%, p value: 0.005; 15.7 ± 3.2 p value: 0.001). LCL value at ROI-F (9.6 ± 4.7 mmol/L) was significantly higher than at ROI-C (2.6 ± 1.2 mmol/L, p value: 0.04) and ROI-P (2.6 ± 1.3 mmol/L, p value: 0.04). No statistically significant difference was found in all metrics between ROI-C and ROI-P. StO2 correlated with FCD-A (Pearson’s r = 0.67). The LCL correlated negatively with both FCD-A (Spearman’s r = − 0.74) and StO2 (Spearman’s r = − 0.54). Conclusions GC formation causes a drop in serosal and mucosal fundic perfusion. HSI and CLE correlate well and might become useful intraoperative tools.

New Digital Realities – Blending our Reality with Virtuality

New digital reality as a spectrum of technologies and experiences that digitally simulate and extend reality in one way or another across different human senses has received considerable attention in recent years. In particular, we have witnessed great advances in mixed reality (MR) technologies, such as Virtual Reality (VR) and Augmented Reality (AR) technology, which provide enormous potential for application domains like training, simulation, education, entertainment, health, and sports. However, also other forms of digitally enhanced reality (XR) supports novel forms of immersion and experiences while generating, visualizing and interacting with digital content either displayed in fully-immersive virtual environments or superimposed into our view of the real world, and will significantly change the way we work, travel, play, and communicate. Consequently, we face dramatic changes in interactive media creation, access, and perception. In this special issue, we solicit work that addresses novel interaction design, interfaces, and implementation of new digital reality in which our reality is blended with the virtuality with a focus on users’ needs, joy, and visions.