scholarly journals Product Blind Area Assembly Method Based on Augmented Reality and Machine Vision

Author(s):  
Zenglei Wang ◽  
Yuxiang Yan ◽  
Dechuan Han ◽  
Xiaoliang Bai ◽  
Shusheng Zhang

In the manual assembly of the blind area, the worker's line of sight is blocked, and the real-time state of the parts to be assembled cannot be seen, which has a great impact on the efficiency and accuracy of the assembly. Aiming at this problem, a blind zone assembly method based on machine vision and augmented reality(AR) is proposed. Firstly, the ellipse is used as the marker point. The object to be assembled in the blind area is indirectly tracked by the detection and positioning of the ellipse, and the AR visualization guide assembly is then performed by projection and the assembly is precisely guided using the principle of local error amplification. Finally, the blind zone assembly experiment based on machine vision and augmented reality is designed to verify the effectiveness of the method. The experimental results show that this method can significantly improve the efficiency of assembly work in blind areas and can effectively reduce the assembly error rate.

2020 ◽  
Vol 72 ◽  
pp. 350-356 ◽  
Author(s):  
Nhu Q. Nguyen ◽  
Stefano M. Priola ◽  
Joel M. Ramjist ◽  
Daipayan Guha ◽  
Yuta Dobashi ◽  
...  

2015 ◽  
Vol 738-739 ◽  
pp. 694-698
Author(s):  
Xiao Dong Wang ◽  
Qi Liu ◽  
Wei Zhang

Based on the principle of machine vision technology, we designed a methodto detect the outline dimensions of automotive airbag quickly and accurately. We Used CCD camera obtain the airbag image, through the image processing method ofsmooth filtering andgray-scale transformationto complete pre-processing, finally applied Canny edge detection operator to extract the boundary of the airbag contour features,and then took the template matching methodto detect assemble error of the airbag image whether meet the requirement.The results show that the detection method have a higher precision, and the time is very short, it can improve the sampled positioningerror detection for the all checks image recognition detection, suitable for application in real-time online detection of airbag assembly line.


2020 ◽  
Vol 4 (3-4) ◽  
pp. 151-161
Author(s):  
Daniela Mitterberger ◽  
Kathrin Dörfler ◽  
Timothy Sandy ◽  
Foteini Salveridou ◽  
Marco Hutter ◽  
...  

AbstractAugmented bricklaying explores the manual construction of intricate brickwork through visual augmentation, and applies and validates the concept in a real-scale building project—a fair-faced brickwork facade for a winery in Greece. As shown in previous research, robotic systems have proven to be very suitable to achieve various differentiated brickwork designs with high efficiency but show certain limitations, for example, in regard to spatial freedom or the usage of mortar on site. Hence, this research aims to show that through the use of a craft-specific augmented reality system, the same geometric complexity and precision seen in robotic fabrication can be achieved with an augmented manual process. Towards this aim, a custom-built augmented reality system for in situ construction was established. This process allows bricklayers to not depend on physical templates, and it enables enhanced spatial freedom, preserving and capitalizing on the bricklayer’s craft of mortar handling. In extension to conventional holographic representations seen in current augmented reality fabrication processes that have limited context-awareness and insufficient geometric feedback capabilities, this system is based on an object-based visual–inertial tracking method to achieve dynamic optical guidance for bricklayers with real-time tracking and highly precise 3D registration features in on-site conditions. By integrating findings from the field of human–computer interfaces and human–machine communication, this research establishes, explores, and validates a human–computer interactive fabrication system, in which explicit machine operations and implicit craftsmanship knowledge are combined. In addition to the overall concept, the method of implementation, and the description of the project application, this paper also quantifies process parameters of the applied augmented reality assembly method concerning building accuracy and assembly speed. In the outlook, this paper aims to outline future directions and potential application areas of object-aware augmented reality systems and their implications for architecture and digital fabrication.


2013 ◽  
Vol 427-429 ◽  
pp. 763-769
Author(s):  
Jian Gang Wang ◽  
Zhan Jun Yan ◽  
Wen Qiang Li

A binocular display can satisfy competition mechanism of biological vision system and improve display precision. A binocular optical system is designed with waveguide holography (WGH) for small size and light weight. A superimposed holographic volume grating can split the image bearing lights into two equal intensity light beams. The out-coupling waveguide holographic gratings for the left and right eyes can implement image extension and imaging display. The simulation and experimental results reveal that excellent optical performances can be achieved for little distortion of less than 0.05%(nearly zero), light weight of about only 32g, and compact size. The display information can also be overlaid the outside scenes in eyeglass augmented reality and Machine Vision Display applications.


2021 ◽  
pp. 155633162110285
Author(s):  
Andrew Hersh ◽  
Smruti Mahapatra ◽  
Carly Weber-Levine ◽  
Tolulope Awosika ◽  
John N. Theodore ◽  
...  

Augmented reality (AR) navigation refers to novel technologies that superimpose images, such as radiographs and navigation pathways, onto a view of the operative field. The development of AR navigation has focused on improving the safety and efficacy of neurosurgical and orthopedic procedures. In this review, the authors focus on 3 types of AR technology used in spine surgery: AR surgical navigation, microscope-mediated heads-up display, and AR head-mounted displays. Microscope AR and head-mounted displays offer the advantage of reducing attention shift and line-of-sight interruptions inherent in traditional navigation systems. With the U.S. Food and Drug Administration’s recent clearance of the XVision AR system (Augmedics, Arlington Heights, IL), the adoption and refinement of AR technology by spine surgeons will only accelerate.


Measurement ◽  
2019 ◽  
Vol 145 ◽  
pp. 234-243 ◽  
Author(s):  
Weiqiang Wang ◽  
Yi Luo ◽  
Kun Yang ◽  
Chunxue Shang

Author(s):  
Yue Li ◽  
Eugene Ch’ng ◽  
Sue Cobb ◽  
Simon See

The use of virtual reality (VR) and augmented reality (AR) in connected environments is rarely explored but may become a necessary channel of communication in the future. Such environments would allow multiple users to interact, engage, and share multi-dimensional data across devices and between the spectrum of realities. However, communication between the two realities within a hybrid environment is barely understood. We carried out an experiment with 52 participants in 26 pairs, within two environments of 3D cultural artifacts: 1) a Hybrid VR and AR environment (HVAR) and 2) a Shared VR environment (SVR). We explored the differences in perceived spatial presence, copresence, and social presence between the environments and between users. We demonstrated that greater presence is perceived in SVR when compared with HVAR, and greater spatial presence is perceived for VR users. Social presence is perceived greater for AR users, possibly because they have line of sight of their partners within HVAR. We found positive correlations between shared activity time and perceived social presence. While acquainted pairs reported significantly greater presence than unacquainted pairs in SVR, there were no significant differences in perceived presence between them in HVAR.


Sign in / Sign up

Export Citation Format

Share Document