MIVAS: A Multi-Modal Immersive Virtual Assembly System

Author(s):  
Huagen Wan ◽  
Shuming Gao ◽  
Qunsheng Peng ◽  
Guozhong Dai ◽  
Fengjun Zhang

Evaluation and planning of assembly processes in virtual environments have become an active research area in engineering community. However, planning of complex assemblies in virtual environments, especially large-scale virtual environments, is still hindered by limitations like unnatural user interaction, insufficient frame rates, and deficiencies in processing of assembly constraints. In this paper, we present MIVAS, a Multi-modal Immersive Virtual Assembly System. By viewing the virtual assembly system as a finite state machine, we incorporate tracked devices, force feedback dataglove, voice commands, human sounds, fully immersive 4-sided CAVE, together with optimization techniques for both complex assembly models and assembly operations to provide for engineers an intuitive and natural way of assembly evaluation and planning. Testing scenarios on disassembling different components of an intelligent hydraulic excavator are described. Special attention is paid upon such technical issues as interface between CAD packages and the CAVE virtual environment, natural and intuitive user interaction including realistic virtual hand interaction and force feedback, intelligent navigation for assembly operations, and real-time display of complex assemblies.

2003 ◽  
Vol 03 (02) ◽  
pp. 379-398 ◽  
Author(s):  
HUAGEN WAN ◽  
SHUMING GAO ◽  
QUNSHENG PENG ◽  
YIYU CAI

Evaluation and planning of assembly processes in virtual environments, especially large-scale virtual environments, have attracted much attention in the engineering community. However, the planning of complex assemblies in virtual environments is still hindered by limitations like insufficient frame rates, unnatural user interaction, as well as deficiencies in the processing of assembly constraints. This paper discusses some optimization techniques for the assembly planning of complex assemblies in a large-scale virtual environment such as CAVE. Specifically, the real-time display of complex assemblies, the natural and intuitive assembly operations, and a real-time collision detection algorithm for the assembly applications are presented.


2013 ◽  
Vol 10 (4) ◽  
pp. 1531-1538
Author(s):  
Mahmoud M. Ismail ◽  
Ibrahim M. El-henawy

In this paper, a hybridization of two different swarm intelligent approaches, stochastic diffusion search, and particle swarm optimization techniques is presented  for solving integer programming problems. The hybrid implementation allows us to avoid certain drawbacks and weaknesses of each algorithm, which means that we are able to find an optimal solution in an acceptable computational time. Our hybrid implementation allows the IP algorithm to reach the optimal solution in a considerably shorter time than is needed to solve the model using the entire dataset directly within the model. Our hybrid approach outperforms the results obtained by each technique separately. It is able to find the optimal solution in a shorter time than each technique on its own, and the results are highly competitive with the state-of-the-art in large-scale optimization. Furthermore, according to our results, combining the PSO with SDS approach for solving IP problems appears to be an interesting research area in combinatorial optimization. 


2010 ◽  
Vol 426-427 ◽  
pp. 371-375
Author(s):  
Dan Zhang ◽  
Guang Ming Jiao ◽  
Dun Wen Zuo ◽  
Jian Xie ◽  
J.P. Li ◽  
...  

Aiming at the shortcomings of traditional assembly process design and immersive virtual assembly system, the architecture of Desktop Virtual Assembly System (DVAS) for interactive assembly process planning is presented. The key technologies such as data conversion and reconstruction of assembly models, assembly intention recognition and assembly control navigation are studied. The lightweight storage of assembly models’ data and the intelligent constraints recognition are realized. The problem of assembly operations resulted from the lack of immersion is solved by movement navigation. The algorithms were proposed and applied to the DVAS prototype, and an application case is studied to demonstrate the effectiveness of the system.


2007 ◽  
Vol 10-12 ◽  
pp. 460-465 ◽  
Author(s):  
Yue Dong Lang ◽  
Ying Xue Yao ◽  
Ping Jun Xia ◽  
G.H. Liu

Due to big structure and complex process for some large-scale products (such as planes and rockets), the workers have to try many times and move around in the products to accomplish the assembly operations for high-precision requirements. Thus, the efficiency is low and the cost is high in the assembly process. To deal with that, the virtual assembly (VA) system for large-scale products is developed in this paper. First a new VA environment considering human activity is set up, and then a hierarchical assembly process list (HAPL) model and a dynamic constraint recognition algorithm is proposed to realize exact placement for large-scale products in VA system. Finally, the method is verified by the development VA system which successfully applied in the process of satellite assembly. Moreover, the method can be used in the common VA systems for assembly planning.


2018 ◽  
Vol 38 (2) ◽  
pp. 173-181
Author(s):  
QingHui Wang ◽  
Zhong-Dong Huang ◽  
JingRong Li ◽  
Jia-Wu Liu

Purpose Realistic force sensation can help operators better feel and manipulate parts for virtual assembly (VA). Moreover, for VA of mechanical parts, it is necessary to consider their tolerance levels so as to apply proper assembly forces. Out of the three common assembly fit types, the type of clearance fit is the focus of virtual manual assembly, as parts with such fit type require precise force feedback to assist users’ assembly operations. Design/methodology/approach This study proposes a novel force rendering model for VA of mechanical parts with clearance fits. By decomposing an actual assembly operation into three consecutive states, the corresponding forces are formulated. Findings A prototype system is designed and developed to implement the model, and comparative case studies are conducted to investigate the users’ performance with the other three common approaches, namely, a typical WIMP (window-icon-menu-pointer) interface with CAD software, a physics simulation with collision detection and the approach that combines physics simulation and geometric constraints restriction. The results have shown that the proposed model is more realistic by providing continuous and realistic force feedback to the users. Originality/value The users’ feeling of immersion and their operational efficiency are greatly enhanced with the force sensation provided.


2011 ◽  
Vol 1 (2) ◽  
Author(s):  
Rabinarayan Sathpathy ◽  
Rajani Kanta Chhotray ◽  
Sabyasachi Pattnaik

No global 3D model of the environment needs to be assembled, a process which can be extremely cumbersome and error prone for large scale scenes e.g. the global registration of multiple local models can accumulate a great amount of error, while it also presumes a very accurate extraction of the underlying geometry. On the contrary, neither any such accurate geometric reconstruction of the individual local 3D models nor a very precise registration between them is required by our framework in order that it can produce satisfactory results. This paper presents an application of LP based MRF optimization techniques and also we have turned our attention to a different re­ search topic: the proposal of novel image based modeling and rendering methods, which are capable of automatically reproducing faithful (i.e. photorealistic) digital copies of complex 3D virtual environments, while also allowing the virtual exploration of these environments at interactive frame rates.


2010 ◽  
Vol 29-32 ◽  
pp. 1046-1050 ◽  
Author(s):  
Cheng Jun Chen ◽  
Yun Feng Wu ◽  
Niu Li

To verify the accessibility and workspace of tool operation in virtual assembly system, this paper presented a tool-part operation method based on force feedback. According to characters of common tool-part operations, standard fastening tools and parts were modeled using features and parameters at initial stage. Then operator was enabled to conduct different kinds of fastening and unfastening operations in virtual assembly system by three steps namely identification, interactive positioning and operation. With feedback force, the operator can feel corresponding motion constraints of tool during virtual fastening and unfastening operation, so the immersion of virtual assembly operation is promoted.


2021 ◽  
Vol 13 (3) ◽  
pp. 1274
Author(s):  
Loau Al-Bahrani ◽  
Mehdi Seyedmahmoudian ◽  
Ben Horan ◽  
Alex Stojcevski

Few non-traditional optimization techniques are applied to the dynamic economic dispatch (DED) of large-scale thermal power units (TPUs), e.g., 1000 TPUs, that consider the effects of valve-point loading with ramp-rate limitations. This is a complicated multiple mode problem. In this investigation, a novel optimization technique, namely, a multi-gradient particle swarm optimization (MG-PSO) algorithm with two stages for exploring and exploiting the search space area, is employed as an optimization tool. The M particles (explorers) in the first stage are used to explore new neighborhoods, whereas the M particles (exploiters) in the second stage are used to exploit the best neighborhood. The M particles’ negative gradient variation in both stages causes the equilibrium between the global and local search space capabilities. This algorithm’s authentication is demonstrated on five medium-scale to very large-scale power systems. The MG-PSO algorithm effectively reduces the difficulty of handling the large-scale DED problem, and simulation results confirm this algorithm’s suitability for such a complicated multi-objective problem at varying fitness performance measures and consistency. This algorithm is also applied to estimate the required generation in 24 h to meet load demand changes. This investigation provides useful technical references for economic dispatch operators to update their power system programs in order to achieve economic benefits.


Sign in / Sign up

Export Citation Format

Share Document