scholarly journals A Methodology for Multi-Camera Surface-Shape Estimation of Deformable Unknown Objects

Robotics ◽  
2018 ◽  
Vol 7 (4) ◽  
pp. 69 ◽  
Author(s):  
Evgeny Nuger ◽  
Beno Benhabib

A novel methodology is proposed herein to estimate the three-dimensional (3D) surface shape of unknown, markerless deforming objects through a modular multi-camera vision system. The methodology is a generalized formal approach to shape estimation for a priori unknown objects. Accurate shape estimation is accomplished through a robust, adaptive particle filtering process. The estimation process yields a set of surface meshes representing the expected deformation of the target object. The methodology is based on the use of a multi-camera system, with a variable number of cameras, and range of object motions. The numerous simulations and experiments presented herein demonstrate the proposed methodology’s ability to accurately estimate the surface deformation of unknown objects, as well as its robustness to object loss under self-occlusion, and varying motion dynamics.

Robotics ◽  
2020 ◽  
Vol 9 (3) ◽  
pp. 50
Author(s):  
Tomohiro Oka ◽  
Jorge Solis ◽  
Ann-Louise Lindborg ◽  
Daisuke Matsuura ◽  
Yusuke Sugahara ◽  
...  

Our research aims at developing a meal-assistance robot with vision system and multi-gripper that enables frail elderly to live more independently. This paper presents a development of a chopstick-type gripper for a meal-assistance robot, which is capable of adapting its shape and contact force with the target food according to the size and the stiffness. By solely using position control of the driving motor, the above feature is enabled without relying on force sensors. The gripper was designed based on the concept of planar 2-DOF under-actuated mechanism composed of a pair of four-bar chains having a torsion spring at one of the passive joints. To clarify the gripping motion and relationship among the contact force, food’s size and stiffness, and gripping position, kineto-elasto-static analysis of the mechanism was carried out. It was found from the result of the analysis that the mechanism was able to change its gripping force according to the contact position with the target object, and this mechanical characteristic was utilized in its grasp planning in which the position for the gripping the object was determined to realize a simple control system, and sensitivity of the contact force due to the error of the stiffness value was revealed. Using a three-dimensional (3D) printed prototype, an experiment to measure the gripping force by changing the contact position was conducted to validate the mechanism feature that can change its gripping force according to the size and the stiffness and the contact force from the analysis results. Finally, the gripper prototype was implemented to a 6-DOF robotic arm and an experiment to grasp real food was carried out to demonstrate the feasibility of the proposed grasp planning.


2003 ◽  
Vol 47 (03) ◽  
pp. 187-193 ◽  
Author(s):  
Ken Takagi ◽  
Junya Dobashi

We describe a theoretical approach to a distorted plate penetrating calm water surface as a flow model of the water impact in rough seas. Further simplifications are employed so that the structure of ship is modeled by a tandem mass and spring system and a sequence of circular hollows is used as a bottom shape of the body instead of the surface shape of short crested waves. The results show that the model-scale ship experiences much larger stress at the local structure because of the influence of trapped air. Some results for the full-scale ship show that the three-dimensional effect, that is, the shape of sea surface deformation, is dominant for the cushioning of the impact force, and the trapped air affects some of this effect according to the magnitude of P and the natural period of the local structure.


Sensors ◽  
2019 ◽  
Vol 19 (7) ◽  
pp. 1583 ◽  
Author(s):  
Lei Yin ◽  
Xiangjun Wang ◽  
Yubo Ni

Three-dimensional (3D) reconstruction using line structured light vision system commonly cooperates with motion restraint devices, such as parallel guide rail push-broom devices. In this study, we propose a visual positioning method to eliminate the motion constraint. An extended orthogonal iteration algorithm for visual positioning is proposed to obtain the precise position of the line structured light binocular camera system during movement. The algorithm uses the information acquired by the binocular camera, and produces a better positioning accuracy than the traditional vision localization algorithm. Furthermore, a global optimization method is proposed to calculate the poses of the camera relative to the world coordinate system at each shooting position. This algorithm effectively reduces the error accumulation and pose drift during visual positioning, and 3D information of the surface can be measured via the proposed free-moving line structured light vision system. The simulation and physical experiments performed herein validate the proposed method and demonstrate the significant improvement in the reconstruction accuracy: when the test distance is 1.5 m, the root mean square error of the point cloud is within 0.5 mm.


Sensors ◽  
2019 ◽  
Vol 19 (23) ◽  
pp. 5309
Author(s):  
Fuqiang Zhou ◽  
Yuanze Chen ◽  
Mingxuan Zhou ◽  
Xiaosong Li

The binocular vision system is widely used in three-dimensional measurement, drone navigation, and many other fields. However, due to the high cost, large volume, and inconvenient operation of the two-camera system, it is difficult to meet the weight and load requirements of the UAV system. Therefore, the study of mirror binocular with single camera was carried out. Existing mirror binocular systems place the catadioptric components in front of the lens, which makes the volume of measurement system still large. In this paper, a catadioptric postposition system is designed, which places the prism behind the lens to achieve mirror binocular imaging. The influence of the post prism on the focal length and imaging surface of the optical system is analyzed. The feasibility of post-mirror binocular imaging are verified by experiments, and it is reasonable to compensate the focal length change by changing the back focal plane position. This research laid the foundation for the subsequent research on the 3D reconstruction of the novel mirror binocular system.


2021 ◽  
Vol 11 (20) ◽  
pp. 9724
Author(s):  
Junuk Cha ◽  
Muhammad Saqlain ◽  
Changhwa Lee ◽  
Seongyeong Lee ◽  
Seungeun Lee ◽  
...  

Three-dimensional human pose and shape estimation is an important problem in the computer vision community, with numerous applications such as augmented reality, virtual reality, human computer interaction, and so on. However, training accurate 3D human pose and shape estimators based on deep learning approaches requires a large number of images and corresponding 3D ground-truth pose pairs, which are costly to collect. To relieve this constraint, various types of weakly or self-supervised pose estimation approaches have been proposed. Nevertheless, these methods still involve supervision signals, which require effort to collect, such as unpaired large-scale 3D ground truth data, a small subset of 3D labeled data, video priors, and so on. Often, they require installing equipment such as a calibrated multi-camera system to acquire strong multi-view priors. In this paper, we propose a self-supervised learning framework for 3D human pose and shape estimation that does not require other forms of supervision signals while using only single 2D images. Our framework inputs single 2D images, estimates human 3D meshes in the intermediate layers, and is trained to solve four types of self-supervision tasks (i.e., three image manipulation tasks and one neural rendering task) whose ground-truths are all based on the single 2D images themselves. Through experiments, we demonstrate the effectiveness of our approach on 3D human pose benchmark datasets (i.e., Human3.6M, 3DPW, and LSP), where we present the new state-of-the-art among weakly/self-supervised methods.


2019 ◽  
Vol 287 ◽  
pp. 08001
Author(s):  
Syuhei Kurokawa ◽  
Yuuki Utsunomiya ◽  
Terutake Hayashi ◽  
Tetsuya Taguchi ◽  
Ryota Matsuoka

A three-dimensional probe is mounted on a specialized gear measuring machine whose measurement target is limited on the working flanks. The newly developed measuring machine has a coordinate measuring mechanism, aiming to be a highly versatile and relatively inexpensive measuring machine. According to our previous research, in addition to the working tooth surface, shape data of the root, bottom and tip profiles can be acquired with a single measurement operation. However, the target object for which this developed method has been applied was only the external cylindrical gear. In this paper, we applied and expanded the development method to the internal cylindrical gear and the evaluation of the axial displacement in the same cross-sectional scanning of the internal helical gear are performed.


2021 ◽  
pp. 004051752098238
Author(s):  
Siyuan Li ◽  
Zhongde Shan ◽  
Dong Du ◽  
Li Zhan ◽  
Zhikun Li ◽  
...  

Three-dimensional composite preform is the main structure of fiber-reinforced composites. During the weaving process of large-sized three-dimensional composite preform, relative rotation or translation between the fiber feeder and guided array occurs before feeding. Besides, the weaving needles can be at different heights after moving out from the guided array. These problems are mostly detected and adjusted manually. To make the weaving process more precise and efficient, we propose machine vision-based methods which could realize accurate estimation and adjustment of the relative position-pose between the fiber feeder and guided array, and make the needles pressing process automatic by recognizing the position of the weaving needles. The results show that the estimation error of relative position-pose is within 5%, and the rate of unrecognized weaving needles is 2%. Our proposed methods improve the automation level of weaving, and are conducive to the development of preform forming toward digital manufacturing.


2019 ◽  
Vol 2019 ◽  
pp. 1-14
Author(s):  
Gang Xu ◽  
Guangwei Zhao ◽  
Jing Chen ◽  
Shuqi Wang ◽  
Weichao Shi

The value of the tangential velocity on the Boundary Value Problem (BVP) is inaccurate when comparing the results with analytical solutions by Indirect Boundary Element Method (IBEM), especially at the intersection region where the normal vector is changing rapidly (named nonsmooth boundary). In this study, the singularity of the BVP, which is directly arranged in the center of the surface of the fluid computing domain, is moved outside the computational domain by using the Desingularized Boundary Integral Equation Method (DBIEM). In order to analyze the accuracy of the IBEM/DBIEM and validate the above-mentioned problem, three-dimensional uniform flow over a sphere has been presented. The convergent study of the presented model has been investigated, including desingularized distance in the DBIEM. Then, the numerical results were compared with the analytical solution. It was found that the accuracy of velocity distribution in the flow field has been greatly improved at the intersection region, which has suddenly changed the boundary surface shape of the fluid domain. The conclusions can guide the study on the flow over nonsmooth boundaries by using boundary value method.


2019 ◽  
Vol 93 (12) ◽  
pp. 2651-2660 ◽  
Author(s):  
Sergey Samsonov

AbstractThe previously presented Multidimensional Small Baseline Subset (MSBAS-2D) technique computes two-dimensional (2D), east and vertical, ground deformation time series from two or more ascending and descending Differential Interferometric Synthetic Aperture Radar (DInSAR) data sets by assuming that the contribution of the north deformation component is negligible. DInSAR data sets can be acquired with different temporal and spatial resolutions, viewing geometries and wavelengths. The MSBAS-2D technique has previously been used for mapping deformation due to mining, urban development, carbon sequestration, permafrost aggradation and pingo growth, and volcanic activities. In the case of glacier ice flow, the north deformation component is often too large to be negligible. Historically, the surface-parallel flow (SPF) constraint was used to compute the static three-dimensional (3D) velocity field at various glaciers. A novel MSBAS-3D technique has been developed for computing 3D deformation time series where the SPF constraint is utilized. This technique is used for mapping 3D deformation at the Barnes Ice Cap, Baffin Island, Nunavut, Canada, during January–March 2015, and the MSBAS-2D and MSBAS-3D solutions are compared. The MSBAS-3D technique can be used for studying glacier ice flow at other glaciers and other surface deformation processes with large north deformation component, such as landslides. The software implementation of MSBAS-3D technique can be downloaded from http://insar.ca/.


Sign in / Sign up

Export Citation Format

Share Document