Image segmentation fusion using weakly supervised trace-norm multi-task learning method

2018 ◽  
Vol 12 (7) ◽  
pp. 1079-1085 ◽  
Author(s):  
Xianpeng Liang ◽  
De-Shuang Huang
Author(s):  
Bo Shao ◽  
Yeyun Gong ◽  
Junwei Bao ◽  
Jianshu Ji ◽  
Guihong Cao ◽  
...  

Semantic parsing is a challenging and important task which aims to convert a natural language sentence to a logical form. Existing neural semantic parsing methods mainly use <question, logical form> (Q-L) pairs to train a sequence-to-sequence model. However, the amount of existing Q-L labeled data is limited and hard to obtain. We propose an effective method which substantially utilizes labeling information from other tasks to enhance the training of a semantic parser. We design a multi-task learning model to train question type classification, entity mention detection together with question semantic parsing using a shared encoder. We propose a weakly supervised learning method to enhance our multi-task learning model with paraphrase data, based on the idea that the paraphrased questions should have the same logical form and question type information. Finally, we integrate the weakly supervised multi-task learning method to an encoder-decoder framework. Experiments on a newly constructed dataset and ComplexWebQuestions show that our proposed method outperforms state-of-the-art methods which demonstrates the effectiveness and robustness of our method.


Author(s):  
Zaid Al-Huda ◽  
Donghai Zhai ◽  
Yan Yang ◽  
Riyadh Nazar Ali Algburi

Deep convolutional neural networks (DCNNs) trained on the pixel-level annotated images have achieved improvements in semantic segmentation. Due to the high cost of labeling training data, their applications may have great limitation. However, weakly supervised segmentation approaches can significantly reduce human labeling efforts. In this paper, we introduce a new framework to generate high-quality initial pixel-level annotations. By using a hierarchical image segmentation algorithm to predict the boundary map, we select the optimal scale of high-quality hierarchies. In the initialization step, scribble annotations and the saliency map are combined to construct a graphic model over the optimal scale segmentation. By solving the minimal cut problem, it can spread information from scribbles to unmarked regions. In the training process, the segmentation network is trained by using the initial pixel-level annotations. To iteratively optimize the segmentation, we use a graphical model to refine segmentation masks and retrain the segmentation network to get more precise pixel-level annotations. The experimental results on Pascal VOC 2012 dataset demonstrate that the proposed framework outperforms most of weakly supervised semantic segmentation methods and achieves the state-of-the-art performance, which is [Formula: see text] mIoU.


Symmetry ◽  
2018 ◽  
Vol 10 (9) ◽  
pp. 385 ◽  
Author(s):  
Yoosoo Jeong ◽  
Seungmin Lee ◽  
Daejin Park ◽  
Kil Park

Recently, there have been many studies on the automatic extraction of facial information using machine learning. Age estimation from front face images is becoming important, with various applications. Our proposed work is based on the binary classifier, which only determines whether two input images are clustered in a similar class, and trains the convolutional neural networks (CNNs) model using the deep metric learning method based on the Siamese network. To converge the results of the training Siamese network, two classes, for which age differences are below a certain level of distance, are considered as the same class, so the ratio of positive database images is increased. The deep metric learning method trains the CNN model to measure similarity based on only age data, but we found that the accumulated gender data can also be used to compare ages. From this experimental fact, we adopted a multi-task learning approach to consider the gender data for more accurate age estimation. In the experiment, we evaluated our approach using MORPH and MegaAge-Asian datasets, and compared gender classification accuracy only using age data from the training images. In addition, from the gender classification, we found that our proposed architecture, which is trained with only age data, performs age comparison by using the self-generated gender feature. The accuracy enhancement by multi-task learning, for the simultaneous consideration of age and gender data, is discussed. Our approach results in the best accuracy among the methods based on deep metric learning on MORPH dataset. Additionally, our method is also the best results compared with the results of the state of art in terms of age estimation on MegaAge Asian and MORPH datasets.


Sign in / Sign up

Export Citation Format

Share Document