Cross-domain meta-learning for bug finding in the source codes with a small dataset

Author(s):  
Jongho Shin
2021 ◽  
Vol 15 ◽  
Author(s):  
Jianwei Zhang ◽  
Xubin Zhang ◽  
Lei Lv ◽  
Yining Di ◽  
Wei Chen

Background: Learning discriminative representation from large-scale data sets has made a breakthrough in decades. However, it is still a thorny problem to generate representative embedding from limited examples, for example, a class containing only one image. Recently, deep learning-based Few-Shot Learning (FSL) has been proposed. It tackles this problem by leveraging prior knowledge in various ways. Objective: In this work, we review recent advances of FSL from the perspective of high-dimensional representation learning. The results of the analysis can provide insights and directions for future work. Methods: We first present the definition of general FSL. Then we propose a general framework for the FSL problem and give the taxonomy under the framework. We survey two FSL directions: learning policy and meta-learning. Results: We review the advanced applications of FSL, including image classification, object detection, image segmentation and other tasks etc., as well as the corresponding benchmarks to provide an overview of recent progress. Conclusion: FSL needs to be further studied in medical images, language models, and reinforcement learning in future work. In addition, cross-domain FSL, successive FSL, and associated FSL are more challenging and valuable research directions.


2021 ◽  
pp. 107646
Author(s):  
Yong Feng ◽  
Jinglong Chen ◽  
Jingsong Xie ◽  
Tianci Zhang ◽  
Haixin Lv ◽  
...  

2021 ◽  
Author(s):  
Zhenyue Gao ◽  
Jianqiang Xue ◽  
Jianxing Zhang ◽  
Wendong Xiao

Abstract Accurate sensing and understanding of gestures can improve the quality of human-computer interaction, and has great theoretical significance and application potentials in the fields of smart home, assisted medical care, and virtual reality. Device-free wireless gesture recognition based on WiFi Channel State Information (CSI) requires no sensors, and has a series of advantages such as permission for non-line-of-sight scenario, low cost, preserving for personal privacy and working in the dark night. Although most of the current gesture recognition approaches based on WiFi CSI have achieved good performance, they are difficult to adapt to the new domains. Therefore, this paper proposes ML-WiGR, an approach for device-free gesture recognition in cross-domain applications. ML-WiGR applies convolutional neural networks (CNN) and long short-term memory (LSTM) neural networks as the basic model for gesture recognition to extract spatial and temporal features. Combined with the meta learning training mechanism, the approach dynamically adjusts the learning rate and meta learning rate in training process adaptively, and optimizes the initial parameters of a basic model for gesture recognition, only using a few samples and several iterations to adapt to new domain. In the experiments, we validate the approach under a variety of scenarios. The results show that ML-WiGR can achieve comparable performance against existing approaches with only a small number of samples for training in cross domains.


2021 ◽  
Vol 11 (24) ◽  
pp. 12037
Author(s):  
Xiaoyu Hou ◽  
Jihui Xu ◽  
Jinming Wu ◽  
Huaiyu Xu

Counting people in crowd scenarios is extensively conducted in drone inspections, video surveillance, and public safety applications. Today, crowd count algorithms with supervised learning have improved significantly, but with a reliance on a large amount of manual annotation. However, in real world scenarios, different photo angles, exposures, location heights, complex backgrounds, and limited annotation data lead to supervised learning methods not working satisfactorily, plus many of them suffer from overfitting problems. To address the above issues, we focus on training synthetic crowd data and investigate how to transfer information to real-world datasets while reducing the need for manual annotation. CNN-based crowd-counting algorithms usually consist of feature extraction, density estimation, and count regression. To improve the domain adaptation in feature extraction, we propose an adaptive domain-invariant feature extracting module. Meanwhile, after taking inspiration from recent innovative meta-learning, we present a dynamic-β MAML algorithm to generate a density map in unseen novel scenes and render the density estimation model more universal. Finally, we use a counting map refiner to optimize the coarse density map transformation into a fine density map and then regress the crowd number. Extensive experiments show that our proposed domain adaptation- and model-generalization methods can effectively suppress domain gaps and produce elaborate density maps in cross-domain crowd-counting scenarios. We demonstrate that the proposals in our paper outperform current state-of-the-art techniques.


2021 ◽  
Vol 336 ◽  
pp. 06007
Author(s):  
Yuying Shao ◽  
Lin Cao ◽  
Changwu Chen ◽  
Kangning Du

Because of the large modal difference between sketch image and optical image, and the problem that traditional deep learning methods are easy to overfit in the case of a small amount of training data, the Cross Domain Meta-Network for sketch face recognition method is proposed. This method first designs a meta-learning training strategy to solve the small sample problem, and then proposes entropy average loss and cross domain adaptive loss to reduce the modal difference between the sketch domain and the optical domain. The experimental results on UoM-SGFS and PRIP-VSGC sketch face data sets show that this method and other sketch face recognition methods.


Plant Methods ◽  
2021 ◽  
Vol 17 (1) ◽  
Author(s):  
Jing Nie ◽  
Nianyi Wang ◽  
Jingbin Li ◽  
Kang Wang ◽  
Hongkun Wang

Abstract Background Due to the high cost of data collection for magnetization detection of media, the sample size is limited, it is not suitable to use deep learning method to predict its change trend. The prediction of physical and chemical properties of magnetized water and fertilizer (PCPMWF) by meta-learning can help to explore the effects of magnetized water and fertilizer irrigation on crops. Method In this article, we propose a meta-learning optimization model based on the meta-learner LSTM in the field of regression prediction of PCPMWF. In meta-learning, LSTM is used to replace MAML’s gradient descent optimizer for regression tasks, enables the meta-learner to learn the update rules of the LSTM, and apply it to update the parameters of the model. The proposed method is compared with the experimental results of MAML and LSTM to verify the feasibility and correctness. Results The average absolute percentage error of the meta-learning optimization model of meta-learner LSTM is reduced by 0.37% compared with the MAML model, and by 4.16% compared with the LSTM model. The loss value of the meta-learning optimization model in the iterative process drops the fastest and steadily compared to the MAML model and the LSTM model. In cross-domain experiments, the average accuracy of the meta-learning optimized model can still reach 0.833. Conclusions In the case of few sample, the proposed model is superior to the traditional LSTM model and the basic MAML model. And in the training of cross-domain datasets, this model performs best.


2021 ◽  
Vol 217 ◽  
pp. 106829
Author(s):  
Yong Feng ◽  
Jinglong Chen ◽  
Zhuozheng Yang ◽  
Xiaogang Song ◽  
Yuanhong Chang ◽  
...  

2018 ◽  
Vol 126 ◽  
pp. 9-18 ◽  
Author(s):  
Abbas Raza Ali ◽  
Bogdan Gabrys ◽  
Marcin Budka

Sign in / Sign up

Export Citation Format

Share Document