transfer learning
Recently Published Documents


TOTAL DOCUMENTS

7800
(FIVE YEARS 6004)

H-INDEX

66
(FIVE YEARS 31)

Author(s):  
Shu Jiang ◽  
Zuchao Li ◽  
Hai Zhao ◽  
Bao-Liang Lu ◽  
Rui Wang

In recent years, the research on dependency parsing focuses on improving the accuracy of the domain-specific (in-domain) test datasets and has made remarkable progress. However, there are innumerable scenarios in the real world that are not covered by the dataset, namely, the out-of-domain dataset. As a result, parsers that perform well on the in-domain data usually suffer from significant performance degradation on the out-of-domain data. Therefore, to adapt the existing in-domain parsers with high performance to a new domain scenario, cross-domain transfer learning methods are essential to solve the domain problem in parsing. This paper examines two scenarios for cross-domain transfer learning: semi-supervised and unsupervised cross-domain transfer learning. Specifically, we adopt a pre-trained language model BERT for training on the source domain (in-domain) data at the subword level and introduce self-training methods varied from tri-training for these two scenarios. The evaluation results on the NLPCC-2019 shared task and universal dependency parsing task indicate the effectiveness of the adopted approaches on cross-domain transfer learning and show the potential of self-learning to cross-lingual transfer learning.


Diagnosis of COVID-19 pneumonia using patients’ chest X-Ray images is new but yet important task in the field of medicine. Researchers from different parts of the globe have developed many deep learning models to classify COVID-19. The performance of feature extraction and classifier plays a vital role in the recognizing the different patterns in the image. The pivotal process is the extraction of optimum features from the chest X-Ray images. The main goal of this study is to design an efficient hybrid algorithm that integrates the robustness of MobileNet (using transfer learning approach) to extract features and Support Vector Machine (SVM) to classify COVID-19. Experiments were conducted to test the proposed algorithm and it was found to have a high classification accuracy of 95%.


Author(s):  
Fan Xu ◽  
Yangjie Dan ◽  
Keyu Yan ◽  
Yong Ma ◽  
Mingwen Wang

Chinese dialects discrimination is a challenging natural language processing task due to scarce annotation resource. In this article, we develop a novel Chinese dialects discrimination framework with transfer learning and data augmentation (CDDTLDA) in order to overcome the shortage of resources. To be more specific, we first use a relatively larger Chinese dialects corpus to train a source-side automatic speech recognition (ASR) model. Then, we adopt a simple but effective data augmentation method (i.e., speed, pitch, and noise disturbance) to augment the target-side low-resource Chinese dialects, and fine-tune another target ASR model based on the previous source-side ASR model. Meanwhile, the potential common semantic features between source-side and target-side ASR models can be captured by using self-attention mechanism. Finally, we extract the hidden semantic representation in the target ASR model to conduct Chinese dialects discrimination. Our extensive experimental results demonstrate that our model significantly outperforms state-of-the-art methods on two benchmark Chinese dialects corpora.


2022 ◽  
Vol 309 ◽  
pp. 118458
Author(s):  
Chenxi Hu ◽  
Jun Zhang ◽  
Hongxia Yuan ◽  
Tianlu Gao ◽  
Huaiguang Jiang ◽  
...  

Author(s):  
Malathy Jawahar ◽  
L. Jani Anbarasi ◽  
Prassanna Jayachandran ◽  
Manikandan Ramachandran ◽  
Fadi Al-Turjman

Diagnosis of COVID-19 pneumonia using patients’ chest X-Ray images is new but yet important task in the field of medicine. Researchers from different parts of the globe have developed many deep learning models to classify COVID-19. The performance of feature extraction and classifier plays a vital role in the recognizing the different patterns in the image. The pivotal process is the extraction of optimum features from the chest X-Ray images. The main goal of this study is to design an efficient hybrid algorithm that integrates the robustness of MobileNet (using transfer learning approach) to extract features and Support Vector Machine (SVM) to classify COVID-19. Experiments were conducted to test the proposed algorithm and it was found to have a high classification accuracy of 95%.


Handwritten documents in an Enterprise Resource Planning (ERP) system can come from different sources and usually have different designs, sizes, and subjects (i.e. bills, checks, invoices, etc.). Given these documents were filled manually, they have to be inspected to detect various kinds of issues (missing signature or stamp, missing name, etc.) before being saved in the ERP system or processed by an OCR engine. In this paper, the authors present a transfer learning approach to detect issues in scanned handwritten documents, using an award-winning deep convolutional neural network (InceptionV3) and different machine learning algorithms such as Logistic Regression (LR), Support Vector Machine (SVM) and Naive Bayes (NB). The experiment shows that the combination of InceptionV3 and LR got an accuracy of 91.8% for missing stamp detection. This can allow using this approach in an ERP system as an automatic verification procedure in a document processing flow.


Sign in / Sign up

Export Citation Format

Share Document