Projection-based augmented reality system for assembly guidance and monitoring

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Chengjun Chen ◽  
Zhongke Tian ◽  
Dongnian Li ◽  
Lieyong Pang ◽  
Tiannuo Wang ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Assembly Process ◽  
Pixel Classification ◽  
Content Type ◽  
Depth Images ◽  
Augmented Reality System ◽  
Customized Production ◽  
Assembly Guidance ◽  
Randomized Decision Forests

Purpose This study aims to monitor and guide the assembly process. The operators need to change the assembly process according to the products’ specifications during manual assembly of mass customized production. Traditional information inquiry and display methods, such as manual lookup of assembly drawings or electronic manuals, are inefficient and error-prone. Design/methodology/approach This paper proposes a projection-based augmented reality system (PBARS) for assembly guidance and monitoring. The system includes a projection method based on viewpoint tracking, in which the position of the operator’s head is tracked and the projection images are changed correspondingly. The assembly monitoring phase applies a method for parts recognition. First, the pixel local binary pattern (PX-LBP) operator is achieved by merging the classical LBP operator with the pixel classification process. Afterward, the PX-LBP features of the depth images are extracted and the randomized decision forests classifier is used to get the pixel classification prediction image (PCPI). Parts recognition and assembly monitoring is performed by PCPI analysis. Findings The projection image changes with the viewpoint of the human body, hence the operators always perceive the three-dimensional guiding scene from different viewpoints, improving the human-computer interaction. Part recognition and assembly monitoring were achieved by comparing the PCPIs, in which missing and erroneous assembly can be detected online. Originality/value This paper designed the PBARS to monitor and guide the assembly process simultaneously, with potential applications in mass customized production. The parts recognition and assembly monitoring based on pixels classification provides a novel method for assembly monitoring.

scholarly journals Realidad Aumentada: Un sendero por descubrir [Augmented reality: A path to discovery]

2010 ◽  
Author(s):  
Leidy Diana Díaz Nieto ◽  
Sonia Patricia Nieto Aguirre
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Real World ◽  
Three Dimensional ◽  
Emerging Technology ◽  
Human Machine Interaction ◽  
Augmented Reality System ◽  
Augmented Reality Technology ◽  
Machine Interaction

Resumen El propósito de este documento es describir un campo de la realidad virtual, la realidad aumentada, término que hace referencia a una tecnología que está adquiriendo gran importancia en diferentes áreas por sus diversas aplicaciones y novedad. El objetivo de un sistema con realidad aumentada es combinar la imagen registrada por un usuario del mundo real a través de un dispositivo, con elementos tridimensionales procesados a través de una computadora. Esta característica permite a la tecnología de la realidad aumentada convertirse en un instrumento útil en áreas como educación, publicidad, desarrollo y comercialización en la industria, así como en entretenimiento, medicina y otras ciencias; se fundamenta en la combinación de otras tecnologías y es partícipe en la generación de técnicas de interacción hombre-máquina. Palabras ClaveEducación, multimedia, realidad aumentada, tecnología emergente.   Abstract The purpose of this paper is to describe a field of virtual reality, augmented reality, a term that refers to a technology that is gaining importance in different areas for various applications and novelty. The goal of an augmented reality system is to combine the image recorded by a real-world user through a device with three-dimensional elements processed through a computer. This feature allows the augmented reality technology into a useful tool in areas such as education, publicity, development and marketing in the industry as well as entertainment, medicine and other sciences, is based on a combination of other technologies and is participating techniques to generate human-machine interaction. KeywordsEducation, multimedia, augmented reality, emerging technology

scholarly journals A Study on Technological Education with Augmented Reality

2018 ◽  
Vol 3 (1) ◽  
pp. 34-48
Author(s):  
Leelavathi Rajamanickam ◽  
◽  
Kate Lam Woon Yee ◽  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Research Paper ◽  
Technological Education ◽  
Learning And Teaching ◽  
Augmented Reality System ◽  
Education Environment ◽  
Starting Point ◽  
Military Applications ◽  
Future Direction

The objective of having this journal is to analyze about the field of Augmented Reality (AR), the upcoming three-dimensional (3D) virtual objects into real-time three-dimensional (3D) environment in the education environment. Apart from the education application, there are also medical, manufacturing, entertainment and military applications that have been explored. This article describes the features of Augmented Reality system by including types of augmented reality and the benefits from it. Life of the lecturer and student getting bored day by day without any new sort of teaching approaches. Basically, this research paper summarizes the current efforts and address these issues. Hence, discussion about the future direction and areas for Augmented Reality in the field of education. direction and areas for Augmented Reality in the field of education. A new way of learning and teaching can definitely increase the interest of the parties. This research paper provides a starting point for anyone who interested in changing the classic ways of educations into a technological one filled with AR.

An Automatic Interaction Method Using Part Recognition Based on Deep Network for Augmented Reality Assembly Guidance

2018 ◽  
Author(s):  
Xuyue Yin ◽  
Xiumin Fan ◽  
Jiajie Wang ◽  
Rui Liu ◽  
Qiang Wang
Keyword(s):  
Neural Network ◽  
Augmented Reality ◽  
Real Time ◽  
Deep Neural Network ◽  
Back Propagation ◽  
User Interaction ◽  
Guidance System ◽  
Assembly Process ◽  
Interaction Method ◽  
Assembly Guidance

Assembly process of complex electromechanical products can be quite complicated and time consuming because of high quality demands. Aiming at improving the efficiency of the manual assembly process, this paper proposes an automatic interaction method using part recognition for augmented reality (AR) assembly guidance, which improves both the accuracy of part picking and the interaction efficiency of AR guidance system. Taking sample images of similar parts as input and part types as output, a deep neural network model Part R-CNN for part recognition is build based on Faster R-CNN and is further fine-tuned by back propagation. By recognizing the assembly part, the augmented assembly guidance information of the corresponding parts assembly process is triggered in real-time without direct user interaction. Experimental results show that the deep neural network based part recognition method reaches 94% on mean average precision and the average recognition speed is 200ms per image frame. The average speed of AR guidance content triggering is about 20fps. All system performance satisfies the accuracy and real-time requirements of the AR-aided assembly system.

Development of helmet mold design system using 3D anthropometric analysis

2019 ◽  
Vol 32 (3) ◽  
pp. 446-456
Author(s):  
Yeonghoon Kang ◽  
Sungmin Kim
Keyword(s):  
Human Body ◽  
Three Dimensional ◽  
Design System ◽  
Standard Normal Distribution ◽  
Body Scan ◽  
Content Type ◽  
Vertex Point ◽  
Standard Normal ◽  
Customized Production ◽  
Scan Data

Purpose The purpose of this paper is to develop a software can generate helmet mold from three-dimensional (3D) human body scan data. Design/methodology/approach An algorithm has been developed to divide data into arbitrary number of groups considering the width, length and height of head using the standard normal distribution theory. A basic helmet mold is generated automatically based on the shape of representative convex hull for each group. Findings It is possible to analyze the 3D human body scan data of groups with various characteristics and apply them to mass customized production of helmet. Practical implications This methodology can be applied for designing other products related to the head shape such as goggles and masks by varying the measurement items of the head. Social implications This methodology will enable mass customized production centered on consumers in the production and design of various equipment and goods to be worn on the head. Originality/value An algorithm has been developed to define the vertex point, which is the limit of scan data, for the analysis of 3D human body scan data scan data. In addition, a system was developed that can mass-produce customized products by effectively dividing groups while taking into account the physical characteristics of consumers.

Enhancing users involvement in architectural design using mobile augmented reality

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Bassam Shouman ◽  
Ayman Ahmed Ezzat Othman ◽  
Mohamed Marzouk
Keyword(s):  
Augmented Reality ◽  
Construction Projects ◽  
Architectural Design ◽  
Positive Impact ◽  
Three Dimensional ◽  
User Involvement ◽  
Wall Material ◽  
Mobile Augmented Reality ◽  
Content Type ◽  
Design Alternatives

PurposeMobile augmented reality (MAR) is one of the advanced three-dimensional (3D) representation tools that has been recently utilized in the construction industry. This paper aims to assess a user’s involvement levels through MAR application that has been experimented against traditional involvement techniques through an existing facility, plan re-designing scenario.Design/methodology/approachThrough reviewing related literature studies in the MAR field, an application has been developed that can superimpose real design alternatives on paper-based markers, allowing for flexible wall positioning, interior and exterior wall material application. As such, an enhanced user involvement experience is created. To measure user involvement levels, the application is experimented with 33 participants having the British University in Egypt’s library building as a case study, followed by survey questionnaires to gather and evaluate user responses.FindingsThe results of the analyzed data using SPSS indicated that MAR showed a positive impact on enhancing user involvement and better understanding of design projects. It also allowed users to produce different design alternatives in comparison to the traditional involvement approaches where users showed low design interaction and understanding.Originality/valueThe interactive features of the proposed application facilitate implementing ideas in design of construction projects that require user involvement.

Game-based evacuation drill using augmented reality and head-mounted display

2016 ◽  
Vol 13 (3) ◽  
pp. 186-201 ◽  
Author(s):  
Junya Kawai ◽  
Hiroyuki Mitsuhara ◽  
Masami Shishibori
Keyword(s):  
Augmented Reality ◽  
Virtual Worlds ◽  
Three Dimensional ◽  
Simulation Games ◽  
Content Type ◽  
Head Mounted Display ◽  
Visual Reality ◽  
Pros And Cons ◽  
Disaster Education ◽  
Evacuation Drills

Purpose Evacuation drills should be more realistic and interactive. Focusing on situational and audio-visual realities and scenario-based interactivity, the authors have developed a game-based evacuation drill (GBED) system that presents augmented reality (AR) materials on tablet computers. The paper's current research purpose is to improve visual reality (AR materials) in our GBED system. Design/methodology/approach The author's approach is to develop a new GBED system that superimposes digital objects [e.g. three-dimensional computer graphics (3DCG) elements] onto real-time vision using a marker-based AR library, a binocular opaque head-mounted display (HMD) and other current easily available technologies. Findings The findings from a trial experiment are that the new GBED system can improve visual reality and is appropriate for disaster education. However, a few problems remain for practical use. Research limitations/implications When using the GBED system, participants (i.e. HMD wearers) can suffer from 3D sickness and have difficulty in moving. These are important safety problems in HMD-based systems. Social implications The combination of AR and HMDs for GBEDs (i.e. integrating virtual and real worlds) will raise questions about its merits (pros and cons). Originality/value The originality of the research is the combination of AR and an HMD to a GBED, which has previously been realized primarily as simulation games in virtual worlds. The authors believe that our research has the potential to expand disaster education.

A variational model for 3D tolerance analysis with manufacturing signature and operating conditions

2018 ◽  
Vol 38 (1) ◽  
pp. 10-19 ◽  
Author(s):  
Andrea Corrado ◽  
Wilma Polini ◽  
Giovanni Moroni ◽  
Stefano Petrò
Keyword(s):  
Three Dimensional ◽  
Reference Value ◽  
Tolerance Analysis ◽  
Geometrical Model ◽  
Operating Conditions ◽  
Variational Model ◽  
Assembly Process ◽  
Functional Requirements ◽  
Content Type ◽  
Mechanical Assemblies

Purpose The purpose of this work is to present a variational model able to deal with form tolerances and assembly conditions. The variational model is one of the methods proposed in literature for tolerance analysis, but it cannot deal with form tolerances and assembly conditions that may influence the functional requirements of mechanical assemblies. Design/methodology/approach This work shows how to manage the actual surfaces generated by the manufacturing process and the operating conditions inside the variational model that has been modified to integrate the manufacturing signature left on the surfaces of the parts and the operating conditions that arise during an actual assembly, such as gravity and friction. Moreover, a geometrical model was developed to numerically simulate what happens in a real assembly process and to give a reference value. Findings The new variational model was applied to a three-dimensional case study. The obtained results were compared to those of the geometrical model and to those of the variational model to validate the new model and to show the improvements. Research limitations/implications The proposed approach may be extended to other models of literature. However, its limitation is that it is able to deal with a sphere–plane contact. Practical implications Tolerance analysis is a valid tool to foresee geometric interferences among the components of an assembly before getting the physical assembly. It involves a decrease in the manufacturing costs. Originality/value The main contributions of the study are the insertion of a systematic pattern characterizing the features manufactured by a process, assembly operating conditions and development of a geometrical model to reproduce what happens in a real assembly process.

Sign in / Sign up

Export Citation Format

Share Document