Using Pre-trained Language Model to Enhance Active Learning for Sentence Matching

Active learning is an effective method to substantially alleviate the problem of expensive annotation cost for data-driven models. Recently, pre-trained language models have been demonstrated to be powerful for learning language representations. In this article, we demonstrate that the pre-trained language model can also utilize its learned textual characteristics to enrich criteria of active learning. Specifically, we provide extra textual criteria with the pre-trained language model to measure instances, including noise, coverage, and diversity. With these extra textual criteria, we can select more efficient instances for annotation and obtain better results. We conduct experiments on both English and Chinese sentence matching datasets. The experimental results show that the proposed active learning approach can be enhanced by the pre-trained language model and obtain better performance.

Automatic text summarization of konkani texts using pre-trained word embeddings and deep learning

<span lang="EN-US">Automatic text summarization has gained immense popularity in research. Previously, several methods have been explored for obtaining effective text summarization outcomes. However, most of the work pertains to the most popular languages spoken in the world. Through this paper, we explore the area of extractive automatic text summarization using deep learning approach and apply it to Konkani language, which is a low-resource language as there are limited resources, such as data, tools, speakers and/or experts in Konkani. In the proposed technique, Facebook’s fastText <br /> pre-trained word embeddings are used to get a vector representation for sentences. Thereafter, deep multi-layer perceptron technique is employed, as a supervised binary classification task for auto-generating summaries using the feature vectors. Using pre-trained fastText word embeddings eliminated the requirement of a large training set and reduced training time. The system generated summaries were evaluated against the ‘gold-standard’ human generated summaries with recall-oriented understudy for gisting evaluation (ROUGE) toolkit. The results thus obtained showed that performance of the proposed system matched closely to the performance of the human annotators in generating summaries.</span>

Utilization of Transfer Learning Model in Detecting COVID-19 cases from Chest X-Ray Images

Diagnosis of COVID-19 pneumonia using patients’ chest X-Ray images is new but yet important task in the field of medicine. Researchers from different parts of the globe have developed many deep learning models to classify COVID-19. The performance of feature extraction and classifier plays a vital role in the recognizing the different patterns in the image. The pivotal process is the extraction of optimum features from the chest X-Ray images. The main goal of this study is to design an efficient hybrid algorithm that integrates the robustness of MobileNet (using transfer learning approach) to extract features and Support Vector Machine (SVM) to classify COVID-19. Experiments were conducted to test the proposed algorithm and it was found to have a high classification accuracy of 95%.