Examining the Fidelity of On-the-Fly Assembly Inspection With a Low-Cost RGB-D Camera

Author(s):  
Rafael Radkowski ◽  
Jarid Ingebrand

This paper examines the fidelity of a commodity range camera for assembly inspection in use cases such as augmented reality-based assembly assistance. The objective of inspection is to determine whether a part is present and correctly aligned. In our scenario, shortly after the mechanics assembled the part, which is denoted as on-the-fly inspection. Our approach is based on object tracking and a subsequent discrepancy analysis. Object tracking determines the presence, position, and orientation of parts. The discrepancy analysis facilitates to determine whether the parts are correctly aligned. In comparison to a naive position and orientation difference approach, the discrepancy analysis incorporates the dimensions of parts, which increases the alignment fidelity. To assess this, an experiment was conducted in order to determine the accuracy range. The results indicate a sufficient accuracy for larger parts a noticeable improvement in comparison to the naive approach.

2016 ◽  
Author(s):  
Danilo H. F. Menezes ◽  
Thiago D. Mendonca ◽  
Wolney M. Neto ◽  
Hendrik T. Macedo ◽  
Leonardo N. Matos

2015 ◽  
Vol 1 (1) ◽  
pp. 534-537 ◽  
Author(s):  
T. Mentler ◽  
C. Wolters ◽  
M. Herczeg

AbstractIn the healthcare domain, head-mounted displays (HMDs) with augmented reality (AR) modalities have been reconsidered for application as a result of commercially available products and the needs for using computers in mobile context. Within a user-centered design approach, interviews were conducted with physicians, nursing staff and members of emergency medical services. Additionally practitioners were involved in evaluating two different head-mounted displays. Based on these measures, use cases and usability considerations according to interaction design and information visualization were derived and are described in this contribution.


2021 ◽  
Vol 11 (3) ◽  
pp. 1038
Author(s):  
Sara Condino ◽  
Giuseppe Turini ◽  
Virginia Mamone ◽  
Paolo Domenico Parchi ◽  
Vincenzo Ferrari

Simulation for surgical training is increasingly being considered a valuable addition to traditional teaching methods. 3D-printed physical simulators can be used for preoperative planning and rehearsal in spine surgery to improve surgical workflows and postoperative patient outcomes. This paper proposes an innovative strategy to build a hybrid simulation platform for training of pedicle screws fixation: the proposed method combines 3D-printed patient-specific spine models with augmented reality functionalities and virtual X-ray visualization, thus avoiding any exposure to harmful radiation during the simulation. Software functionalities are implemented by using a low-cost tracking strategy based on fiducial marker detection. Quantitative tests demonstrate the accuracy of the method to track the vertebral model and surgical tools, and to coherently visualize them in either the augmented reality or virtual fluoroscopic modalities. The obtained results encourage further research and clinical validation towards the use of the simulator as an effective tool for training in pedicle screws insertion in lumbar vertebrae.


2021 ◽  
Vol 116 (10) ◽  
pp. 701-706
Author(s):  
Maximilian Vogt ◽  
Mauritz Möller ◽  
Claus Emmelmann

Abstract Augmented-Reality-basierte digitale Assistenzsysteme werden bereits erfolgreich im industriellen Kontext eingesetzt, um die Arbeitskräfte bei manuellen Tätigkeiten zu unterstützen. Die Nutzung in der additiven Fertigung wurde allerdings noch nicht umfassend untersucht. Angelehnt an das klassische Technologiemanagement wurde ein methodisches Vorgehen entwickelt, um anwendungsspezifische Use Cases für die Additive Fertigung zu adaptieren.


Author(s):  
Bing Yi ◽  
Renkai Sun ◽  
Long Liu ◽  
Yongfeng Song ◽  
Yinggui Zhang

Abstract It is a challenge for the dynamic inspection of railway route for freight car transporting cargo that out-of-gauge. One possible way is using the inspection frame installed in the inspection train to simulate the whole procedure for cargo transportation, which costs a lot of manpower and material resources as well as time. To overcome the above problem, this paper proposes an augmented reality (AR) based dynamic inspection method for visualized railway routing of freight car with out-of-gauge. First, the envelope model of the dynamic moving train with out-of-gauge cargo is generated by using the orbital spectrum of the railway, and the envelope model is matched with a piece of homemade calibration equipment located on the position of the railway that needs to be inspected. Then, the structure from motion (SFM) algorithm is used to reconstruct the environment where the virtual envelope model occludes the buildings or equipment along the railway. Finally, the distance function is adopted to calculate the distance between the obstacle and the envelope of the freight car with out-of-gauge, determining whether the freight car can pass a certain line. The experimental results show that the proposed method performs well for the route selection of out-of-gauge cargo transportation with low cost, high precision, and high efficiency. Moreover, the digital data of the environments along the railway and the envelope of the freight car can be reused, which will increase the digitalization and intelligence for route selection of out-of-gauge cargo transportation.


Sign in / Sign up

Export Citation Format

Share Document