Improved Tactile Perception of 3D Geometric Bumps Using Coupled Electrovibration and Mechanical Vibration Stimuli

2020 ◽  
Author(s):  
Xiaoying Sun ◽  
Chen Zhang ◽  
Guohong Liu

Abstract At present, the tactile perception of 3D geometric bumps (such as sinusoidal bumps, Gaussian bumps, triangular bumps, etc.) on touchscreens is mainly realized by mapping the local gradients of rendered virtual surfaces to lateral electrostatic friction, while maintaining the constant normal feedback force. The latest study has shown that the recognition rate of 3D visual objects with electrovibration is lower by 27$\%$ than that using force-feedback devices. Based on the custom-designed tactile display coupling with electrovibration and mechanical vibration stimuli, this paper proposes a novel tactile rendering algorithm of 3D geometric bumps, which simultaneously generates the lateral and the normal perceptual dimensions. Specifically, a mapping relationship with the electrostatic friction proportional to the gradient of 3D geometric bumps is firstly established. Then, resorting to the angle between the lateral friction force and the normal feedback force, a rendering model of the normal feedback force using mechanical vibration is further determined. Compared to the previous works with electrovibration, objective evaluations with 12 participants showed that the novel version significantly improved recognition rates of 3D bumps on touchscreens.

Author(s):  
Zoltán Szabó ◽  
Eniko T. Enikov

With the emergence of augmented and virtual-reality based information delivery technologies the gap between availability of communication devices for visually impaired people and sighted people is emerging. The current study describes a communication tool which provides a reading platform for visually impaired people by means of a haptic display. In this paper the development and human subject study based evaluation of an electromagnetic microactuator-array based virtual tactile display is presented. The actuator array is comprised of a 4 by 5 array of micro voice-coil actuators (tactors) providing vibrotactile stimulation on the user’s fingertip. The size and performance of the actuators is evaluated against the thresholds of human tactile perception. It is demonstrated that a 2.65 mm (diameter) × 4 mm (height) generic tactor is suitable for practical applications in dynamic tactile displays. The maximum force of the actuator was 30 mN generated at current levels of 200 mA. At a stroke of 4.5 mm, the force is reduced to 10 mN. The peak force was generated at a displacement of 1.5 mm. A total of 10 alpha-numeric symbols were displayed to the users via dynamically changing the location of the vibrating point in a predefined sequence, thus creating a tactile perception of continuous curve. Users were asked to sketch out the perceived symbols. Each subject carried out three experiments. The first experiment exposed all subjects to ten different characters. Data obtained from human subject tests suggest that users perceive most shapes accurately, however the existence of jump discontinuities in the flow of presentation of the curves lowers recognition efficiency most likely due to loss of sensation of solid reference point. Characters containing two or more discontinuous lines such as ‘X’ were more difficult to recognize in comparison to those described with a single line such as ‘P’, or ‘Z’. Analysis of the average character recognition rate from 10 volunteers concluded that any presented character was identified correctly in 7 out 10 tests. The second test included characters that were reused from the first experiment. Users had improved their character recognition performance as a consequence of repeated exposure and learning. A final set of experiments concluded that recognition of groups of characters, forming words, is the least efficient and requires further perfecting. Recommendations for improvements of the recognition rate are also included.


2020 ◽  
Vol 13 (4) ◽  
pp. 733-744 ◽  
Author(s):  
Guohong Liu ◽  
Chen Zhang ◽  
Xiaoying Sun

Author(s):  
Ziwei Wang ◽  
Zi Huang ◽  
Yadan Luo

Image captioning aims to describe an image with a concise, accurate, and interesting sentence. To build such an automatic neural captioner, the traditional models align the generated words with a number of human-annotated sentences to mimic human-like captions. However, the crowd-sourced annotations inevitably come with data quality issues such as grammatical errors, wrong identification of visual objects and sub-optimal sentence focus. During the model training, existing methods treat all the annotations equally regardless of the data quality. In this work, we explicitly engage human consensus to measure the quality of ground truth captions in advance, and directly encourage the model to learn high quality captions with high priority. Therefore, the proposed consensus-oriented method can accelerate the training process and achieve superior performance with only supervised objective without time-consuming reinforcement learning. The novel consensus loss can be implemented into most of the existing state-of-the-art methods, boosting the BLEU-4 performance by maximum relative 12.47% comparing to the conventional cross-entropy loss. Extensive experiments are conducted on MS-COCO Image Captioning dataset demonstrating the proposed human consensus-oriented training method can significantly improve the training efficiency and model effectiveness.


Author(s):  
Daniel Danso Essel ◽  
Ben-Bright Benuwa ◽  
Benjamin Ghansah

Sparse Representation (SR) and Dictionary Learning (DL) based Classifier have shown promising results in classification tasks, with impressive recognition rate on image data. In Video Semantic Analysis (VSA) however, the local structure of video data contains significant discriminative information required for classification. To the best of our knowledge, this has not been fully explored by recent DL-based approaches. Further, similar coding findings are not being realized from video features with the same video category. Based on the foregoing, a novel learning algorithm, Sparsity based Locality-Sensitive Discriminative Dictionary Learning (SLSDDL) for VSA is proposed in this paper. In the proposed algorithm, a discriminant loss function for the category based on sparse coding of the sparse coefficients is introduced into structure of Locality-Sensitive Dictionary Learning (LSDL) algorithm. Finally, the sparse coefficients for the testing video feature sample are solved by the optimized method of SLSDDL and the classification result for video semantic is obtained by minimizing the error between the original and reconstructed samples. The experimental results show that, the proposed SLSDDL significantly improves the performance of video semantic detection compared with state-of-the-art approaches. The proposed approach also shows robustness to diverse video environments, proving the universality of the novel approach.


Author(s):  
Jianwei Du ◽  
Zhengguang Xu ◽  
Zhichun Mu ◽  
Yuan Yan Tang ◽  
Limin Cui ◽  
...  

This paper proposes the fractal features for glycyrrhiza fingerprint of medicinal herbs, to obtain the intrinsic mode functions (IMFs) from high to low frequency by using empirical mode decomposition (EMD). The EMD fractal features are extracted through computing the fractal dimensions of each IMF. The novel approach is applied to the recognition of the three types of glycyrrhiza fingerprints. Experiments show that EMD fractal features have better recognition rate than that of the traditional ones in the case of concentration-change, i.e. the number of peak and peak drift of sample which has slight changes. An existing method to extract the fractal features for fingerprint of medicinal herbs based on wavelet transform, which is called fractal-wavelet features, was presented. This method has anti-jamming property against the change of samples concentration. However, the recognition rate based on fractal-wavelet features is not satisfactory when fingerprint of medicinal herbs has some slight concentrations changes, the number of peak and peak drift of samples are processed in the special situation.


Author(s):  
Kylie Gomes ◽  
Scott Betza ◽  
Sara Lu Riggs

Objective To evaluate the effects that movement, cue complexity, and the location of tactile displays on the body have on tactile change detection. Background Tactile displays have been demonstrated as a means to address data overload by offloading the visual and auditory modalities. However, change blindness—the failure to detect changes in a stimulus when changes coincide with another event or disruption in stimulus continuity—has been demonstrated to affect the tactile modality and may be exacerbated during movement. The complexity of tactile cues and locations of tactile displays on the body may also affect the detection of changes in tactile patterns. Limitations to tactile perception need to be examined. Method Twenty-four participants performed a tactile change detection task while sitting, standing, and walking. Tactile cues varied in complexity and included low, medium, and high complexity cues presented to the arm or back. Results Movement adversely affects tactile change detection as hit rates were the highest while sitting, followed by standing and walking. Cue complexity affected tactile change detection: Low complexity cues resulted in higher detection rates compared with medium and high complexity cues. The arms exhibited better change detection performance than the back. Conclusion The design of tactile displays should consider the effect of movement. Cue complexity should be minimized and decisions about the location of a tactile display should take into account body movements to support tactile perception. Application The findings can provide design guidelines to inform tactile display design for data-rich, complex domains.


2005 ◽  
Vol 38 (1) ◽  
pp. 260-265
Author(s):  
Myoung-Jong Yoon ◽  
Kee-Ho Yu ◽  
Tae-Kyu Kwon ◽  
Nam-Gyun Kim

Author(s):  
Sergey N. Zenkin ◽  

In the work of the French writer Michel Tournier, the novel The Golden Drop (1985) stands out for the massive presence within its plot of various visual images – photographs, drawings, mannequins, etc.; the hero, a young Algerian immigrant in France, develops in relation to those images. Their interaction can be described ideologically in the sense of postcolonial theory or through the opposition of the “symbolic” Islamic culture and the “figurative” European one; however, the author of the novel outlines his own, original concept of a visual image associated with the personality of the subject, but escaping his control due to its serial multiplicity. In this specific aspect, Tournier practically works out the problem of the intradiegetic image – a visual image included in a narrative plot. Encountering visual objects, some of which depict himself, the hero of Tournier’s novel remains unchanged, does not undergo any “education”, does not acquire, as a result of his adventures, either an ideal image or an ideal sign-symbol. Arriving from afar, he still does not recognize himself as a participant in European history, indicated in the novel by allusions to the student revolution of 1968


Sign in / Sign up

Export Citation Format

Share Document