Computer Vision-Based Augmented Reality for Guiding Manual Assembly

1997 ◽  
Vol 6 (3) ◽  
pp. 292-317 ◽  
Author(s):  
Rajeev Sharma ◽  
Jose Molineros
Keyword(s):  
Computer Vision ◽  
Augmented Reality ◽  
Assembly Planning ◽  
Prototype System ◽  
Specific Marker ◽  
Current State ◽  
Visual Enhancement ◽  
Assembly Sequences ◽  
Mechanical Object ◽  
The Right

Augmented reality (AR) has the goal of enhancing a person's perception of the surrounding world, unlike virtual reality (VR) that aims at replacing the perception of the world with an artificial one. An important issue in AR is making the virtual world sensitive to the current state of the surrounding real world as the user interacts with it. For providing the appropriate augmentation stimulus at the right position and time, the system needs some sensor to interpret the surrounding scene. Computer vision holds great potential in providing the necessary interpretation of the scene. While a computer vision-based general interpretation of a scene is extremely difficult, the constraints from the assembly domain and specific marker-based coding scheme are used to develop an efficient and practical solution. We consider the problem of scene augmentation in the context of a human engaged in assembling a mechanical object from its components. Concepts from robot assembly planning are used to develop a systematic framework for presenting augmentation stimuli for this assembly domain. An experimental prototype system, VEGAS (Visual Enhancement for Guiding Assembly Sequences), is described, that implements some of the AR concepts for guiding assembly using computer vision.

Computer Vision-Based Augmented Reality System for Assembly Interaction

2010 ◽  
Vol 37-38 ◽  
pp. 263-269 ◽  
Author(s):  
Han Wu He ◽  
Yue Ming Wu ◽  
De Tao Zheng ◽  
Yong Rao
Keyword(s):  
Computer Vision ◽  
Augmented Reality ◽  
Research Effort ◽  
Hand Tracking ◽  
Intensity Difference ◽  
Human Hand ◽  
Hand Position ◽  
Prototype System ◽  
Augmented Reality System ◽  
Traditional Approaches

A research effort aimed at creating a computer vision-based augmented reality assembly system is presented. The architecture of this system for assembly interaction is described. To realize intuitive human-computer interaction, a computer vision-based hand tracking and gesture recognition approach is applied. This approach uses the color-based method to segment the hand from background, and locate the hand position by the marker attached on hand, and then recognizes the gesture according to the geometry constraint of human hand. In comparison with the traditional approaches, this new method does not require a stationary camera, and is not sensitive with intensity difference. So, it provides a real time performance and is easy to realize. Moreover, occlusion identification is studied in this paper to raise the real and virtual objects combination effect. Finally, a prototype system is provided to demonstrate the effectiveness and robustness of the presented approaches.

Modern Technology for Image processing and Computer vision -A Review

2018 ◽  
Vol 1 (2) ◽  
pp. 17-23
Author(s):  
Takialddin Al Smadi
Keyword(s):  
Image Processing ◽  
Computer Vision ◽  
Augmented Reality ◽  
Video Compression ◽  
Video Processing ◽  
Vision System ◽  
Citrus Fruit ◽  
Modern Technology ◽  
Image And Video Processing ◽  
Depth Video

This survey outlines the use of computer vision in Image and video processing in multidisciplinary applications; either in academia or industry, which are active in this field.The scope of this paper covers the theoretical and practical aspects in image and video processing in addition of computer vision, from essential research to evolution of application.In this paper a various subjects of image processing and computer vision will be demonstrated ,these subjects are spanned from the evolution of mobile augmented reality (MAR) applications, to augmented reality under 3D modeling and real time depth imaging, video processing algorithms will be discussed to get higher depth video compression, beside that in the field of mobile platform an automatic computer vision system for citrus fruit has been implemented ,where the Bayesian classification with Boundary Growing to detect the text in the video scene. Also the paper illustrates the usability of the handed interactive method to the portable projector based on augmented reality.   © 2018 JASET, International Scholars and Researchers Association

Structural Analysis of Product and Computer-Aided Assembly Planning in AssemBL Software Package

2018 ◽  
pp. 11-33
Author(s):  
A. N. Bozhko
Keyword(s):  
Computer Aided Design ◽  
State Of The Art ◽  
Graph Model ◽  
Design System ◽  
Assembly Planning ◽  
Complex Products ◽  
Assembly Sequences ◽  
Computer Aided ◽  
Cad Cam ◽  
Aided Design

Computer-aided design of assembly processes (Computer aided assembly planning, CAAP) of complex products is an important and urgent problem of state-of-the-art information technologies. Intensive research on CAAP has been underway since the 1980s. Meanwhile, specialized design systems were created to provide synthesis of assembly plans and product decompositions into assembly units. Such systems as ASPE, RAPID, XAP / 1, FLAPS, Archimedes, PRELEIDES, HAP, etc. can be given, as an example. These experimental developments did not get widespread use in industry, since they are based on the models of products with limited adequacy and require an expert’s active involvement in preparing initial information. The design tools for the state-of-the-art full-featured CAD/CAM systems (Siemens NX, Dassault CATIA and PTC Creo Elements / Pro), which are designed to provide CAAP, mainly take into account the geometric constraints that the design imposes on design solutions. These systems often synthesize technologically incorrect assembly sequences in which known technological heuristics are violated, for example orderliness in accuracy, consistency with the system of dimension chains, etc.An AssemBL software application package has been developed for a structured analysis of products and a synthesis of assembly plans and decompositions. The AssemBL uses a hyper-graph model of a product that correctly describes coherent and sequential assembly operations and processes. In terms of the hyper-graph model, an assembly operation is described as shrinkage of edge, an assembly plan is a sequence of shrinkages that converts a hyper-graph into the point, and a decomposition of product into assembly units is a hyper-graph partition into sub-graphs.The AssemBL solves the problem of minimizing the number of direct checks for geometric solvability when assembling complex products. This task is posed as a plus-sum two-person game of bicoloured brushing of an ordered set. In the paradigm of this model, the brushing operation is to check a certain structured fragment for solvability by collision detection methods. A rational brushing strategy minimizes the number of such checks.The package is integrated into the Siemens NX 10.0 computer-aided design system. This solution allowed us to combine specialized AssemBL tools with a developed toolkit of one of the most powerful and popular integrated CAD/CAM /CAE systems.

Integrative Approach in Law Understanding: the History of the Origin of Ideas and the Current State

2020 ◽  
Vol 2 (1) ◽  
pp. 115-130
Author(s):  
R. R. Palekha ◽  
Keyword(s):  
Central Place ◽  
Scientific Basis ◽  
Integrative Approach ◽  
Current State ◽  
History Of ◽  
Legal Thinking ◽  
Reliable Knowledge ◽  
The Right ◽  
Fat Formulation

Introduction. Right understanding is the most live, interesting and, at the same time, the uncertain and changeable area of researches which takes the central place as in the general theory of the right, and gains the increasing value in industry jurisprudence that is connected with its considerable teoretiko-methodological and applied potential which is shown in spheres of lawmaking and law-enforcement activity. Thus, right understanding represents research tools of the subject of knowledge which allow to study all range legal and, the based on them, state phenomena for the purpose of obtaining reliable knowledge of state and legal reality. In this regard integrative approach in right understanding which has rich history of the formation and development is of special interest, allows to perceive the right as integrally complete phenomenon, as much as possible retrieves its regulatory abilities and, provides achievement of criteria of scientific research: comprehensiveness, objectivity, historicism. Materials and Methods. In article an attempt of the analysis of integrative approach in right understanding from a position of history of origin of his ideas and assessment of the current state is made. A result of studying of scientific literature, generalization and comparison of the different points of view fat formulation of author’s determination of category “right understanding” and submission of the evidence-based integrative theory of right understanding which as much as possible conforms to requirements of time and has essential regulatory and guarding potential. Results. In article the category right understanding is comprehensively considered, different integrative theories of right understanding from a position of their origin and development are submitted, the value of modern integrative approach in right understanding is shown, perspectives of its further development are evaluated. Discussion and Conclusion. The author comes to the conclusion about the theoretical and methodological consistency and inevitability of the integrative approach in law understanding, which acts as a scientifically grounded type of legal thinking capable of comprehending the law on a truly scientific basis.

scholarly journals Augmented Reality in Orthopedic Surgery Is Emerging from Proof of Concept Towards Clinical Studies: a Literature Review Explaining the Technology and Current State of the Art

2021 ◽  
Author(s):  
Fabio A. Casari ◽  
Nassir Navab ◽  
Laura A. Hruby ◽  
Philipp Kriechling ◽  
Ricardo Nakamura ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Orthopedic Surgery ◽  
Relevant Literature ◽  
Comprehensive Overview ◽  
Basic Principles ◽  
Clinical Procedures ◽  
Current State ◽  
Tremendous Progress ◽  
Orthopedic Oncology ◽  
Technological Developments

Abstract Purpose of Review Augmented reality (AR) is becoming increasingly popular in modern-day medicine. Computer-driven tools are progressively integrated into clinical and surgical procedures. The purpose of this review was to provide a comprehensive overview of the current technology and its challenges based on recent literature mainly focusing on clinical, cadaver, and innovative sawbone studies in the field of orthopedic surgery. The most relevant literature was selected according to clinical and innovational relevance and is summarized. Recent Findings Augmented reality applications in orthopedic surgery are increasingly reported. In this review, we summarize basic principles of AR including data preparation, visualization, and registration/tracking and present recently published clinical applications in the area of spine, osteotomies, arthroplasty, trauma, and orthopedic oncology. Higher accuracy in surgical execution, reduction of radiation exposure, and decreased surgery time are major findings presented in the literature. Summary In light of the tremendous progress of technological developments in modern-day medicine and emerging numbers of research groups working on the implementation of AR in routine clinical procedures, we expect the AR technology soon to be implemented as standard devices in orthopedic surgery.

scholarly journals Personalized Augmented Reality Based Tourism System: Big Data and User Demographic Contexts

2021 ◽  
Vol 11 (13) ◽  
pp. 6047
Author(s):  
Soheil Rezaee ◽  
Abolghasem Sadeghi-Niaraki ◽  
Maryam Shakeri ◽  
Soo-Mi Choi
Keyword(s):  
Big Data ◽  
Augmented Reality ◽  
User Study ◽  
Spatial Information ◽  
Ease Of Use ◽  
Tourist Attraction ◽  
Gender And Education ◽  
Time Distance ◽  
Data Source ◽  
The Right

A lack of required data resources is one of the challenges of accepting the Augmented Reality (AR) to provide the right services to the users, whereas the amount of spatial information produced by people is increasing daily. This research aims to design a personalized AR that is based on a tourist system that retrieves the big data according to the users’ demographic contexts in order to enrich the AR data source in tourism. This research is conducted in two main steps. First, the type of the tourist attraction where the users interest is predicted according to the user demographic contexts, which include age, gender, and education level, by using a machine learning method. Second, the correct data for the user are extracted from the big data by considering time, distance, popularity, and the neighborhood of the tourist places, by using the VIKOR and SWAR decision making methods. By about 6%, the results show better performance of the decision tree by predicting the type of tourist attraction, when compared to the SVM method. In addition, the results of the user study of the system show the overall satisfaction of the participants in terms of the ease-of-use, which is about 55%, and in terms of the systems usefulness, about 56%.

scholarly journals A Systematic Survey of ML Datasets for Prime CV Research Areas—Media and Metadata

Data ◽  
2021 ◽  
Vol 6 (2) ◽  
pp. 12
Author(s):  
Helder F. Castro ◽  
Jaime S. Cardoso ◽  
Maria T. Andrade
Keyword(s):  
Machine Learning ◽  
Computer Vision ◽  
Qualitative Analysis ◽  
Continuous Growth ◽  
Scientific Databases ◽  
Extensive Survey ◽  
Research Areas ◽  
Current State ◽  
Global View ◽  
Cooperative Production

The ever-growing capabilities of computers have enabled pursuing Computer Vision through Machine Learning (i.e., MLCV). ML tools require large amounts of information to learn from (ML datasets). These are costly to produce but have received reduced attention regarding standardization. This prevents the cooperative production and exploitation of these resources, impedes countless synergies, and hinders ML research. No global view exists of the MLCV dataset tissue. Acquiring it is fundamental to enable standardization. We provide an extensive survey of the evolution and current state of MLCV datasets (1994 to 2019) for a set of specific CV areas as well as a quantitative and qualitative analysis of the results. Data were gathered from online scientific databases (e.g., Google Scholar, CiteSeerX). We reveal the heterogeneous plethora that comprises the MLCV dataset tissue; their continuous growth in volume and complexity; the specificities of the evolution of their media and metadata components regarding a range of aspects; and that MLCV progress requires the construction of a global standardized (structuring, manipulating, and sharing) MLCV “library”. Accordingly, we formulate a novel interpretation of this dataset collective as a global tissue of synthetic cognitive visual memories and define the immediately necessary steps to advance its standardization and integration.

scholarly journals Jan van Eyck's Perspectival System Elucidated Through Computer Vision

2021 ◽  
Vol 4 (2) ◽  
pp. 1-8
Author(s):  
Gilles Simon
Keyword(s):  
Computer Vision ◽  
Augmented Reality ◽  
3D Reconstruction ◽  
Degrees Of Freedom ◽  
Human Vision ◽  
Vanishing Points ◽  
Two Degrees Of Freedom ◽  
Creative Media

It is generally accepted that Jan van Eyck was unaware of perspective. However, an a-contrario analysis of the vanishing points in five of his paintings, realized between 1432 and 1439, unveils a recurring fishbone-like pattern that could only emerge from the use of a polyscopic perspective machine with two degrees of freedom. A 3D reconstruction of Arnolfini Portrait compliant with this pattern suggests that van Eyck's device answered a both aesthetic and scientific questioning on how to represent space as closely as possible to human vision. This discovery makes van Eyck the father of today's immersive and nomadic creative media such as augmented reality and synthetic holography.

Sign in / Sign up

Export Citation Format

Share Document