An Efficient 3D Synthetic Model Generation Pipeline for Human Pose Data Augmentation

Author(s):  
Kathan Vyas ◽  
Le Jiang ◽  
Shuangjun Liu ◽  
Sarah Ostadabbas
2019 ◽  
Vol 21 (Supplement_3) ◽  
pp. iii19-iii19 ◽  
Author(s):  
P Lohmann ◽  
M A Elahmadawy ◽  
J Werner ◽  
M Rapp ◽  
G Ceccon ◽  
...  

Abstract BACKGROUND Radiomics derived from different imaging modalities is gaining increasing interest in the field of neuro-oncology. Besides MRI, amino acid PET radiomics may also improve the to date challenging, clinically relevant diagnostic problem of differentiating pseudoprogression (PsP) from tumor progression (TP). To this end, we here explored the potential of O-(2-[18F]fluoroethyl)-L-tyrosine (FET) PET radiomics to discriminate between PsP and TP. MATERIAL AND METHODS Thirty-five newly diagnosed IDH-wildtype glioblastoma patients with MRI findings suspicious for TP within 12 weeks after completion of chemoradiation with temozolomide underwent an additional dynamic FET PET scan. FET PET tumor volumes were segmented using a tumor-to-brain ratio (TBR) ≥ 1.6. The static PET parameters TBRmax and TBRmean, as well as the dynamic parameter time-to-peak (TTP), were calculated. For radiomics analysis, the number of datasets for model generation was increased using data augmentation techniques. Subsequently, 70 datasets were available for model generation. Prior to further processing, patients were randomly assigned to a discovery and a validation dataset in a ratio of 70/30, with balanced distribution of PsP and TP diagnoses. Forty-two radiomics features (4 shape-based, 6 first- and 32 second-order features) were obtained using the software LifeX (lifexsoft.org). Afterwards, a z-score transformation was performed for data normalization. For feature selection, recursive feature elimination using random forest regressors was performed. For the final model generation, the number of parameters was limited to three to avoid data overfitting. Different algorithms for model calculation were compared, and the diagnostic accuracy was assessed using leave-one-out cross-validation. Finally, the resulting models were applied to the validation dataset to evaluate model robustness. RESULTS Eighteen patients were diagnosed with TP, and 17 patients had PsP. Diagnoses were based on a neuropathological confirmation or clinicoradiological follow-up (26% and 74%, respectively). The diagnostic accuracy of the best single FET PET parameter was 75% (TBRmax). Combining TBRmax and TTP increased the diagnostic accuracy to 83%. Other combinations of static and dynamic FET PET parameters, however, did not further increase the accuracy. The highest diagnostic accuracy of 92% was achieved by a three-parameter model combining the FET PET parameter TTP with two radiomics features. The model demonstrated its robustness in the validation dataset with a diagnostic accuracy of 86%. CONCLUSION The results suggest that FET PET radiomics improves the diagnostic accuracy for discerning PsP and TP considerably. Given the clinical significance of differentiating PSP and TP, prospective multicenter studies are warranted. FUNDING Wilhelm-Sander Stiftung and the DAAD GERSS Program, Germany


Author(s):  
Yanrui Bin ◽  
Xuan Cao ◽  
Xinya Chen ◽  
Yanhao Ge ◽  
Ying Tai ◽  
...  

Symmetry ◽  
2020 ◽  
Vol 12 (7) ◽  
pp. 1116 ◽  
Author(s):  
Jun Sun ◽  
Mantao Wang ◽  
Xin Zhao ◽  
Dejun Zhang

In this paper, we study the problem of monocular 3D human pose estimation based on deep learning. Due to single view limitations, the monocular human pose estimation cannot avoid the inherent occlusion problem. The common methods use the multi-view based 3D pose estimation method to solve this problem. However, single-view images cannot be used directly in multi-view methods, which greatly limits practical applications. To address the above-mentioned issues, we propose a novel end-to-end 3D pose estimation network for monocular 3D human pose estimation. First, we propose a multi-view pose generator to predict multi-view 2D poses from the 2D poses in a single view. Secondly, we propose a simple but effective data augmentation method for generating multi-view 2D pose annotations, on account of the existing datasets (e.g., Human3.6M, etc.) not containing a large number of 2D pose annotations in different views. Thirdly, we employ graph convolutional network to infer a 3D pose from multi-view 2D poses. From experiments conducted on public datasets, the results have verified the effectiveness of our method. Furthermore, the ablation studies show that our method improved the performance of existing 3D pose estimation networks.


2020 ◽  
Vol 43 ◽  
Author(s):  
Myrthe Faber

Abstract Gilead et al. state that abstraction supports mental travel, and that mental travel critically relies on abstraction. I propose an important addition to this theoretical framework, namely that mental travel might also support abstraction. Specifically, I argue that spontaneous mental travel (mind wandering), much like data augmentation in machine learning, provides variability in mental content and context necessary for abstraction.


Author(s):  
Alex Hernández-García ◽  
Johannes Mehrer ◽  
Nikolaus Kriegeskorte ◽  
Peter König ◽  
Tim C. Kietzmann

Sign in / Sign up

Export Citation Format

Share Document