Realistic talking face animation with speech-induced head motion

2021 ◽  
Author(s):  
Sandika Biswas ◽  
Sanjana Sinha ◽  
Dipanjan Das ◽  
Brojeshwar Bhowmick
Author(s):  
Walid Karam ◽  
Chafic Mokbel ◽  
Hanna Greige ◽  
Guido Aversano ◽  
Catherine Pelachaud ◽  
...  
Keyword(s):  

2016 ◽  
Vol 4 (2) ◽  
pp. 96-103 ◽  
Author(s):  
S. J. Graham ◽  
S. Ranieri ◽  
S. Boe ◽  
J. E. Ween ◽  
F. Tam ◽  
...  

2020 ◽  
Vol 30 (10) ◽  
pp. 5544-5559 ◽  
Author(s):  
Jonathan D Power ◽  
Charles J Lynch ◽  
Babatunde Adeyemo ◽  
Steven E Petersen

Abstract This article advances two parallel lines of argument about resting-state functional magnetic resonance imaging (fMRI) signals, one empirical and one conceptual. The empirical line creates a four-part organization of the text: (1) head motion and respiration commonly cause distinct, major, unwanted influences (artifacts) in fMRI signals; (2) head motion and respiratory changes are, confoundingly, both related to psychological and clinical and biological variables of interest; (3) many fMRI denoising strategies fail to identify and remove one or the other kind of artifact; and (4) unremoved artifact, due to correlations of artifacts with variables of interest, renders studies susceptible to identifying variance of noninterest as variance of interest. Arising from these empirical observations is a conceptual argument: that an event-related approach to task-free scans, targeting common behaviors during scanning, enables fundamental distinctions among the kinds of signals present in the data, information which is vital to understanding the effects of denoising procedures. This event-related perspective permits statements like “Event X is associated with signals A, B, and C, each with particular spatial, temporal, and signal decay properties”. Denoising approaches can then be tailored, via performance in known events, to permit or suppress certain kinds of signals based on their desirability.


PLoS ONE ◽  
2014 ◽  
Vol 9 (8) ◽  
pp. e104989 ◽  
Author(s):  
Xiang-zhen Kong ◽  
Zonglei Zhen ◽  
Xueting Li ◽  
Huan-hua Lu ◽  
Ruosi Wang ◽  
...  

2021 ◽  
pp. 104093
Author(s):  
Aparna R. Gullapalli ◽  
Nathaniel E. Anderson ◽  
Rohit Yerramsetty ◽  
Carla L. Harenski ◽  
Kent A. Kiehl

2021 ◽  
Vol 11 (15) ◽  
pp. 6975
Author(s):  
Tao Zhang ◽  
Lun He ◽  
Xudong Li ◽  
Guoqing Feng

Lipreading aims to recognize sentences being spoken by a talking face. In recent years, the lipreading method has achieved a high level of accuracy on large datasets and made breakthrough progress. However, lipreading is still far from being solved, and existing methods tend to have high error rates on the wild data and have the defects of disappearing training gradient and slow convergence. To overcome these problems, we proposed an efficient end-to-end sentence-level lipreading model, using an encoder based on a 3D convolutional network, ResNet50, Temporal Convolutional Network (TCN), and a CTC objective function as the decoder. More importantly, the proposed architecture incorporates TCN as a feature learner to decode feature. It can partly eliminate the defects of RNN (LSTM, GRU) gradient disappearance and insufficient performance, and this yields notable performance improvement as well as faster convergence. Experiments show that the training and convergence speed are 50% faster than the state-of-the-art method, and improved accuracy by 2.4% on the GRID dataset.


Author(s):  
Miguel Fabián Romero Rondón ◽  
Lucile Sassatelli ◽  
Ramón Aparicio-Pardo ◽  
Frédéric Precioso

2020 ◽  
Vol 0 (0) ◽  
Author(s):  
Jingxia Lin

AbstractTypological shift in lexicalizing motion events has hitherto been observed cross-linguistically. While over time, Chinese has shown a shift from a dominantly verb-framed language in Old Chinese to a strongly satellite-framed language in Modern Standard Mandarin, this study presents the Chinese dialect Wenzhou, which has taken a step further than Standard Mandarin and other Chinese dialects in becoming a thoroughly satellite-framed language. On the one hand, Wenzhou strongly disfavors the verb-framed pattern. Wenzhou not only has no prototypical path verbs, but also its path satellites are highly deverbalized. On the other hand, Wenzhou strongly prefers the satellite-framed pattern, to the extent that it very frequently adopts a neutral motion verb to head motion expressions so that path can be expressed via satellites and the satellite-framed pattern can be syntactically maintained. The findings of this study are of interest to intra-linguistic, diachronic and cross-linguistic studies of the variation in encoding motion events.


Sign in / Sign up

Export Citation Format

Share Document