Research and Development of Three-Dimensional Brain Augmented Reality System Based on PACS and Medical Image Characteristics

Author(s):  
Yufei Pang ◽  
Xin Jing ◽  
Wang Zhao
2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Chengjun Chen ◽  
Zhongke Tian ◽  
Dongnian Li ◽  
Lieyong Pang ◽  
Tiannuo Wang ◽  
...  

Purpose This study aims to monitor and guide the assembly process. The operators need to change the assembly process according to the products’ specifications during manual assembly of mass customized production. Traditional information inquiry and display methods, such as manual lookup of assembly drawings or electronic manuals, are inefficient and error-prone. Design/methodology/approach This paper proposes a projection-based augmented reality system (PBARS) for assembly guidance and monitoring. The system includes a projection method based on viewpoint tracking, in which the position of the operator’s head is tracked and the projection images are changed correspondingly. The assembly monitoring phase applies a method for parts recognition. First, the pixel local binary pattern (PX-LBP) operator is achieved by merging the classical LBP operator with the pixel classification process. Afterward, the PX-LBP features of the depth images are extracted and the randomized decision forests classifier is used to get the pixel classification prediction image (PCPI). Parts recognition and assembly monitoring is performed by PCPI analysis. Findings The projection image changes with the viewpoint of the human body, hence the operators always perceive the three-dimensional guiding scene from different viewpoints, improving the human-computer interaction. Part recognition and assembly monitoring were achieved by comparing the PCPIs, in which missing and erroneous assembly can be detected online. Originality/value This paper designed the PBARS to monitor and guide the assembly process simultaneously, with potential applications in mass customized production. The parts recognition and assembly monitoring based on pixels classification provides a novel method for assembly monitoring.


Author(s):  
Leidy Diana Díaz Nieto ◽  
Sonia Patricia Nieto Aguirre

Resumen El propósito de este documento es describir un campo de la realidad virtual, la realidad aumentada, término que hace referencia a una tecnología que está adquiriendo gran importancia en diferentes áreas por sus diversas aplicaciones y novedad. El objetivo de un sistema con realidad aumentada es combinar la imagen registrada por un usuario del mundo real a través de un dispositivo, con elementos tridimensionales procesados a través de una computadora. Esta característica permite a la tecnología de la realidad aumentada convertirse en un instrumento útil en áreas como educación, publicidad, desarrollo y comercialización en la industria, así como en entretenimiento, medicina y otras ciencias; se fundamenta en la combinación de otras tecnologías y es partícipe en la generación de técnicas de interacción hombre-máquina. Palabras ClaveEducación, multimedia, realidad aumentada, tecnología emergente.   Abstract The purpose of this paper is to describe a field of virtual reality, augmented reality, a term that refers to a technology that is gaining importance in different areas for various applications and novelty. The goal of an augmented reality system is to combine the image recorded by a real-world user through a device with three-dimensional elements processed through a computer. This feature allows the augmented reality technology into a useful tool in areas such as education, publicity, development and marketing in the industry as well as entertainment, medicine and other sciences, is based on a combination of other technologies and is participating techniques to generate human-machine interaction. KeywordsEducation, multimedia, augmented reality, emerging technology


2018 ◽  
Vol 3 (1) ◽  
pp. 34-48
Author(s):  
Leelavathi Rajamanickam ◽  
◽  
Kate Lam Woon Yee ◽  

The objective of having this journal is to analyze about the field of Augmented Reality (AR), the upcoming three-dimensional (3D) virtual objects into real-time three-dimensional (3D) environment in the education environment. Apart from the education application, there are also medical, manufacturing, entertainment and military applications that have been explored. This article describes the features of Augmented Reality system by including types of augmented reality and the benefits from it. Life of the lecturer and student getting bored day by day without any new sort of teaching approaches. Basically, this research paper summarizes the current efforts and address these issues. Hence, discussion about the future direction and areas for Augmented Reality in the field of education. direction and areas for Augmented Reality in the field of education. A new way of learning and teaching can definitely increase the interest of the parties. This research paper provides a starting point for anyone who interested in changing the classic ways of educations into a technological one filled with AR.


Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3061
Author(s):  
Alice Lo Valvo ◽  
Daniele Croce ◽  
Domenico Garlisi ◽  
Fabrizio Giuliano ◽  
Laura Giarré ◽  
...  

In recent years, we have assisted with an impressive advance in augmented reality systems and computer vision algorithms, based on image processing and artificial intelligence. Thanks to these technologies, mainstream smartphones are able to estimate their own motion in 3D space with high accuracy. In this paper, we exploit such technologies to support the autonomous mobility of people with visual disabilities, identifying pre-defined virtual paths and providing context information, reducing the distance between the digital and real worlds. In particular, we present ARIANNA+, an extension of ARIANNA, a system explicitly designed for visually impaired people for indoor and outdoor localization and navigation. While ARIANNA is based on the assumption that landmarks, such as QR codes, and physical paths (composed of colored tapes, painted lines, or tactile pavings) are deployed in the environment and recognized by the camera of a common smartphone, ARIANNA+ eliminates the need for any physical support thanks to the ARKit library, which we exploit to build a completely virtual path. Moreover, ARIANNA+ adds the possibility for the users to have enhanced interactions with the surrounding environment, through convolutional neural networks (CNNs) trained to recognize objects or buildings and enabling the possibility of accessing contents associated with them. By using a common smartphone as a mediation instrument with the environment, ARIANNA+ leverages augmented reality and machine learning for enhancing physical accessibility. The proposed system allows visually impaired people to easily navigate in indoor and outdoor scenarios simply by loading a previously recorded virtual path and providing automatic guidance along the route, through haptic, speech, and sound feedback.


2021 ◽  
Vol 45 (5) ◽  
Author(s):  
Yuri Nagayo ◽  
Toki Saito ◽  
Hiroshi Oyama

AbstractThe surgical education environment has been changing significantly due to restricted work hours, limited resources, and increasing public concern for safety and quality, leading to the evolution of simulation-based training in surgery. Of the various simulators, low-fidelity simulators are widely used to practice surgical skills such as sutures because they are portable, inexpensive, and easy to use without requiring complicated settings. However, since low-fidelity simulators do not offer any teaching information, trainees do self-practice with them, referring to textbooks or videos, which are insufficient to learn open surgical procedures. This study aimed to develop a new suture training system for open surgery that provides trainees with the three-dimensional information of exemplary procedures performed by experts and allows them to observe and imitate the procedures during self-practice. The proposed system consists of a motion capture system of surgical instruments and a three-dimensional replication system of captured procedures on the surgical field. Motion capture of surgical instruments was achieved inexpensively by using cylindrical augmented reality (AR) markers, and replication of captured procedures was realized by visualizing them three-dimensionally at the same position and orientation as captured, using an AR device. For subcuticular interrupted suture, it was confirmed that the proposed system enabled users to observe experts’ procedures from any angle and imitate them by manipulating the actual surgical instruments during self-practice. We expect that this training system will contribute to developing a novel surgical training method that enables trainees to learn surgical skills by themselves in the absence of experts.


2019 ◽  
Vol 18 (6) ◽  
pp. e2690 ◽  
Author(s):  
F. Porpiglia ◽  
E. Checcucci ◽  
D. Amparore ◽  
F. Piramide ◽  
P. Verri ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document