Transfer Learning for Toxoplasma gondii Recognition

ABSTRACT Toxoplasma gondii, one of the world’s most common parasites, can infect all types of warm-blooded animals, including one-third of the world’s human population. Most current routine diagnostic methods are costly, time-consuming, and labor-intensive. Although T. gondii can be directly observed under the microscope in tissue or spinal fluid samples, this form of identification is difficult and requires well-trained professionals. Nevertheless, the traditional identification of parasites under the microscope is still performed by a large number of laboratories. Novel, efficient, and reliable methods of T. gondii identification are therefore needed, particularly in developing countries. To this end, we developed a novel transfer learning-based microscopic image recognition method for T. gondii identification. This approach employs the fuzzy cycle generative adversarial network (FCGAN) with transfer learning utilizing knowledge gained by parasitologists that Toxoplasma is banana or crescent shaped. Our approach aims to build connections between microscopic and macroscopic associated objects by embedding the fuzzy C-means cluster algorithm into the cycle generative adversarial network (Cycle GAN). Our approach achieves 93.1% and 94.0% detection accuracy for ×400 and ×1,000 Toxoplasma microscopic images, respectively. We showed the high accuracy and effectiveness of our approach in newly collected unlabeled Toxoplasma microscopic images, compared to other currently available deep learning methods. This novel method for Toxoplasma microscopic image recognition will open a new window for developing cost-effective and scalable deep learning-based diagnostic solutions, potentially enabling broader clinical access in developing countries. IMPORTANCE Toxoplasma gondii, one of the world’s most common parasites, can infect all types of warm-blooded animals, including one-third of the world’s human population. Artificial intelligence (AI) could provide accurate and rapid diagnosis in fighting Toxoplasma. So far, none of the previously reported deep learning methods have attempted to explore the advantages of transfer learning for Toxoplasma detection. The knowledge from parasitologists is that the Toxoplasma parasite is generally banana or crescent shaped. Based on this, we built connections between microscopic and macroscopic associated objects by embedding the fuzzy C-means cluster algorithm into the cycle generative adversarial network (Cycle GAN). Our approach achieves high accuracy and effectiveness in ×400 and ×1,000 Toxoplasma microscopic images.

Download Full-text

A Novel Transfer Learning Approach for Toxoplasma Gondii Microscopic Image Recognition by Fuzzy Cycle Generative Adversarial Network

10.1101/567891 ◽

2019 ◽

Cited By ~ 1

Author(s):

Sen Li ◽

Aijia Li ◽

Diego Alejandro Molina Lara ◽

Jorge Enrique Gómez Marín ◽

Mario Juhas ◽

...

Keyword(s):

Developing Countries ◽

Deep Learning ◽

Toxoplasma Gondii ◽

Transfer Learning ◽

Image Recognition ◽

Diagnostic Methods ◽

Microscopic Image ◽

Generative Adversarial Network ◽

Microscopic Images ◽

Adversarial Network

AbstractToxoplasma gondii, one of the world’s most common parasites, can infect all types of warm-blooded animals, including one-third of the world’s human population. Most current routine diagnostic methods are costly, time-consuming, and labor-intensive. Although T.gondii can be directly observed under the microscope in tissue or spinal fluid samples, this form of identification is difficult and requires well trained professionals. Nevertheless, the traditional identification of parasites under the microscope is still performed by a large number of laboratories. Novel, efficient and reliable methods of T.gondii identification are therefore needed, particularly in developing countries. To this end, we developed a novel transfer learning based microscopic image recognition method for T.gondii identification. This approach employs Fuzzy Cycle Generative Adversarial Network (FCGAN) with transfer learning utilizing knowledge gained by the parasitologists that Toxoplasma is in banana or crescent shaped form. Our approach aims to build connection between micro and macro associated objects by embedding fuzzy C-means cluster algorithm into Cycle Generative Adversarial Network (Cycle GAN). Our approach achieves 93.1% and 94.0% detection accuracy for 400X and 1000X Toxoplasma microscopic images respectively. We show the high accuracy and effectiveness of our approach in the newly collected unlabeled Toxoplasma microscopic images, comparing to other current available deep learning methods. This novel method for Toxoplasma microscopic image recognition will open a new window for developing cost-effective and scalable deep learning based diagnostic solution, potentially enabling broader clinical access in developing countries.

Download Full-text

Electronic component detection based on image sample generation

Soldering & Surface Mount Technology ◽

10.1108/ssmt-08-2020-0036 ◽

2021 ◽

Vol ahead-of-print (ahead-of-print) ◽

Author(s):

Hao Wu ◽

Quanquan Lv ◽

Jiankang Yang ◽

Xiaodong Yan ◽

Xiangrong Xu

Keyword(s):

Deep Learning ◽

Printed Circuit Board ◽

Training Model ◽

Circuit Board ◽

Electronic Components ◽

Generative Adversarial Network ◽

Content Type ◽

Real Samples ◽

Adversarial Network ◽

Defect Recognition

Purpose This paper aims to propose a deep learning model that can be used to expand the number of samples. In the process of manufacturing and assembling electronic components on the printed circuit board in the surface mount technology production line, it is relatively easy to collect non-defective samples, but it is difficult to collect defective samples within a certain period of time. Therefore, the number of non-defective components is much greater than the number of defective components. In the process of training the defect detection method of electronic components based on deep learning, a large number of defective and non-defective samples need to be input at the same time. Design/methodology/approach To obtain enough electronic components samples required for training, a method based on the generative adversarial network (GAN) to generate training samples is proposed, and then the generated samples and real samples are used to train the convolutional neural networks (CNN) together to obtain the best detection results. Findings The experimental results show that the defect recognition method using GAN and CNN can not only expand the sample images of the electronic components required for the training model but also accurately classify the defect types. Originality/value To solve the problem of unbalanced sample types in component inspection, a GAN-based method is proposed to generate different types of training component samples and then the generated samples and real samples are used to train the CNN together to obtain the best detection results.

Download Full-text

Deep TEC: Deep Transfer Learning with Ensemble Classifier for Road Extraction from UAV Imagery

Remote Sensing ◽

10.3390/rs12020245 ◽

2020 ◽

Vol 12 (2) ◽

pp. 245 ◽

Cited By ~ 6

Author(s):

J. Senthilnath ◽

Neelanshi Varia ◽

Akanksha Dokania ◽

Gaotham Anand ◽

Jón Atli Benediktsson

Keyword(s):

Remote Sensing ◽

Deep Learning ◽

Transfer Learning ◽

Ensemble Classifier ◽

Urban Region ◽

Road Extraction ◽

Learning Methods ◽

Generative Adversarial Network ◽

The Road ◽

Adversarial Network

Unmanned aerial vehicle (UAV) remote sensing has a wide area of applications and in this paper, we attempt to address one such problem—road extraction from UAV-captured RGB images. The key challenge here is to solve the road extraction problem using the UAV multiple remote sensing scene datasets that are acquired with different sensors over different locations. We aim to extract the knowledge from a dataset that is available in the literature and apply this extracted knowledge on our dataset. The paper focuses on a novel method which consists of deep TEC (deep transfer learning with ensemble classifier) for road extraction using UAV imagery. The proposed deep TEC performs road extraction on UAV imagery in two stages, namely, deep transfer learning and ensemble classifier. In the first stage, with the help of deep learning methods, namely, the conditional generative adversarial network, the cycle generative adversarial network and the fully convolutional network, the model is pre-trained on the benchmark UAV road extraction dataset that is available in the literature. With this extracted knowledge (based on the pre-trained model) the road regions are then extracted on our UAV acquired images. Finally, for the road classified images, ensemble classification is carried out. In particular, the deep TEC method has an average quality of 71%, which is 10% higher than the next best standard deep learning methods. Deep TEC also shows a higher level of performance measures such as completeness, correctness and F1 score measures. Therefore, the obtained results show that the deep TEC is efficient in extracting road networks in an urban region.

Download Full-text

Classification of Space Objects by Using Deep Learning with Micro-Doppler Signature Images

Sensors ◽

10.3390/s21134365 ◽

2021 ◽

Vol 21 (13) ◽

pp. 4365

Author(s):

Kwangyong Jung ◽

Jae-In Lee ◽

Nammoon Kim ◽

Sunjin Oh ◽

Dong-Wook Seo

Keyword(s):

Transfer Learning ◽

Data Augmentation ◽

Doppler Frequency ◽

Extraction Methods ◽

Classification Performance ◽

Reconstruction Method ◽

Generative Adversarial Network ◽

Adversarial Network ◽

Space Objects ◽

Target Characteristics

Radar target classification is an important task in the missile defense system. State-of-the-art studies using micro-doppler frequency have been conducted to classify the space object targets. However, existing studies rely highly on feature extraction methods. Therefore, the generalization performance of the classifier is limited and there is room for improvement. Recently, to improve the classification performance, the popular approaches are to build a convolutional neural network (CNN) architecture with the help of transfer learning and use the generative adversarial network (GAN) to increase the training datasets. However, these methods still have drawbacks. First, they use only one feature to train the network. Therefore, the existing methods cannot guarantee that the classifier learns more robust target characteristics. Second, it is difficult to obtain large amounts of data that accurately mimic real-world target features by performing data augmentation via GAN instead of simulation. To mitigate the above problem, we propose a transfer learning-based parallel network with the spectrogram and the cadence velocity diagram (CVD) as the inputs. In addition, we obtain an EM simulation-based dataset. The radar-received signal is simulated according to a variety of dynamics using the concept of shooting and bouncing rays with relative aspect angles rather than the scattering center reconstruction method. Our proposed model is evaluated on our generated dataset. The proposed method achieved about 0.01 to 0.39% higher accuracy than the pre-trained networks with a single input feature.

Download Full-text

An Imbalanced Image Classification Method for the Cell Cycle Phase

Information ◽

10.3390/info12060249 ◽

2021 ◽

Vol 12 (6) ◽

pp. 249

Author(s):

Xin Jin ◽

Yuanwen Zou ◽

Zhongbing Huang

Keyword(s):

Cell Cycle ◽

Deep Learning ◽

Image Classification ◽

Classification Accuracy ◽

Data Augmentation ◽

Cycle Phase ◽

Generative Adversarial Network ◽

Adversarial Network ◽

Cellular Life

The cell cycle is an important process in cellular life. In recent years, some image processing methods have been developed to determine the cell cycle stages of individual cells. However, in most of these methods, cells have to be segmented, and their features need to be extracted. During feature extraction, some important information may be lost, resulting in lower classification accuracy. Thus, we used a deep learning method to retain all cell features. In order to solve the problems surrounding insufficient numbers of original images and the imbalanced distribution of original images, we used the Wasserstein generative adversarial network-gradient penalty (WGAN-GP) for data augmentation. At the same time, a residual network (ResNet) was used for image classification. ResNet is one of the most used deep learning classification networks. The classification accuracy of cell cycle images was achieved more effectively with our method, reaching 83.88%. Compared with an accuracy of 79.40% in previous experiments, our accuracy increased by 4.48%. Another dataset was used to verify the effect of our model and, compared with the accuracy from previous results, our accuracy increased by 12.52%. The results showed that our new cell cycle image classification system based on WGAN-GP and ResNet is useful for the classification of imbalanced images. Moreover, our method could potentially solve the low classification accuracy in biomedical images caused by insufficient numbers of original images and the imbalanced distribution of original images.

Download Full-text

AN AI-BASED APPROACH TO ENHANCED FRACTURE RESOLUTION IN IMAGE LOGS

10.30632/spwla-2021-0081 ◽

2021 ◽

Author(s):

James Howard ◽

◽

Joe Tracey ◽

Mike Shen ◽

Shawn Zhang ◽

...

Keyword(s):

Neural Network ◽

Deep Learning ◽

Nearest Neighbor ◽

Rock Fracture ◽

Short Interval ◽

Acoustic Properties ◽

Generative Adversarial Network ◽

Adversarial Network ◽

Deep Learning Neural Network ◽

Borehole Image

Borehole image logs are used to identify the presence and orientation of fractures, both natural and induced, found in reservoir intervals. The contrast in electrical or acoustic properties of the rock matrix and fluid-filled fractures is sufficiently large enough that sub-resolution features can be detected by these image logging tools. The resolution of these image logs is based on the design and operation of the tools, and generally is in the millimeter per pixel range. Hence the quantitative measurement of actual width remains problematic. An artificial intelligence (AI) -based workflow combines the statistical information obtained from a Machine-Learning (ML) segmentation process with a multiple-layer neural network that defines a Deep Learning process that enhances fractures in a borehole image. These new images allow for a more robust analysis of fracture widths, especially those that are sub-resolution. The images from a BHTV log were first segmented into rock and fluid-filled fractures using a ML-segmentation tool that applied multiple image processing filters that captured information to describe patterns in fracture-rock distribution based on nearest-neighbor behavior. The robust ML analysis was trained by users to identify these two components over a short interval in the well, and then the regression model-based coefficients applied to the remaining log. Based on the training, each pixel was assigned a probability value between 1.0 (being a fracture) and 0.0 (pure rock), with most of the pixels assigned one of these two values. Intermediate probabilities represented pixels on the edge of rock-fracture interface or the presence of one or more sub-resolution fractures within the rock. The probability matrix produced a map or image of the distribution of probabilities that determined whether a given pixel in the image was a fracture or partially filled with a fracture. The Deep Learning neural network was based on a Conditional Generative Adversarial Network (cGAN) approach where the probability map was first encoded and combined with a noise vector that acted as a seed for diverse feature generation. This combination was used to generate new images that represented the BHTV response. The second layer of the neural network, the adversarial or discriminator portion, determined whether the generated images were representative of the actual BHTV by comparing the generated images with actual images from the log and producing an output probability of whether it was real or fake. This probability was then used to train the generator and discriminator models that were then applied to the entire log. Several scenarios were run with different probability maps. The enhanced BHTV images brought out fractures observed in the core photos that were less obvious in the original BTHV log through enhanced continuity and improved resolution on fracture widths.

Download Full-text

Generative Adversarial Networks-Based Semi-Supervised Automatic Modulation Recognition for Cognitive Radio Networks

Sensors ◽

10.3390/s18113913 ◽

2018 ◽

Vol 18 (11) ◽

pp. 3913 ◽

Cited By ~ 6

Author(s):

Mingxuan Li ◽

Ou Li ◽

Guangyi Liu ◽

Ce Zhang

Keyword(s):

Deep Learning ◽

Cognitive Radio ◽

Supervised Learning ◽

Rapid Development ◽

Generative Adversarial Networks ◽

Modulation Recognition ◽

Learning Methods ◽

Generative Adversarial Network ◽

Adversarial Network ◽

Automatic Modulation Recognition

With the recently explosive growth of deep learning, automatic modulation recognition has undergone rapid development. Most of the newly proposed methods are dependent on large numbers of labeled samples. We are committed to using fewer labeled samples to perform automatic modulation recognition in the cognitive radio domain. Here, a semi-supervised learning method based on adversarial training is proposed which is called signal classifier generative adversarial network. Most of the prior methods based on this technology involve computer vision applications. However, we improve the existing network structure of a generative adversarial network by adding the encoder network and a signal spatial transform module, allowing our framework to address radio signal processing tasks more efficiently. These two technical improvements effectively avoid nonconvergence and mode collapse problems caused by the complexity of the radio signals. The results of simulations show that compared with well-known deep learning methods, our method improves the classification accuracy on a synthetic radio frequency dataset by 0.1% to 12%. In addition, we verify the advantages of our method in a semi-supervised scenario and obtain a significant increase in accuracy compared with traditional semi-supervised learning methods.

Download Full-text

INFRASTRUCTURE DEGRADATION AND POST-DISASTER DAMAGE DETECTION USING ANOMALY DETECTING GENERATIVE ADVERSARIAL NETWORKS

ISPRS Annals of Photogrammetry Remote Sensing and Spatial Information Sciences ◽

10.5194/isprs-annals-v-2-2020-573-2020 ◽

2020 ◽

Vol V-2-2020 ◽

pp. 573-582 ◽

Cited By ~ 1

Author(s):

S. M. Tilon ◽

F. Nex ◽

D. Duarte ◽

N. Kerle ◽

G. Vosselman

Keyword(s):

Deep Learning ◽

Damage Detection ◽

Training Data ◽

Generative Adversarial Networks ◽

Generative Adversarial Network ◽

Essential Information ◽

Urban Scenes ◽

Adversarial Network ◽

Collapsed Buildings ◽

Post Disaster

Abstract. Degradation and damage detection provides essential information to maintenance workers in routine monitoring and to first responders in post-disaster scenarios. Despite advance in Earth Observation (EO), image analysis and deep learning techniques, the quality and quantity of training data for deep learning is still limited. As a result, no robust method has been found yet that can transfer and generalize well over a variety of geographic locations and typologies of damages. Since damages can be seen as anomalies, occurring sparingly over time and space, we propose to use an anomaly detecting Generative Adversarial Network (GAN) to detect damages. The main advantages of using GANs are that only healthy unannotated images are needed, and that a variety of damages, including the never before seen damage, can be detected. In this study we aimed to investigate 1) the ability of anomaly detecting GANs to detect degradation (potholes and cracks) in asphalt road infrastructures using Mobile Mapper imagery and building damage (collapsed buildings, rubble piles) using post-disaster aerial imagery, and 2) the sensitivity of this method against various types of pre-processing. Our results show that we can detect damages in urban scenes at satisfying levels but not on asphalt roads. Future work will investigate how to further classify the found damages and how to improve damage detection for asphalt roads.

Download Full-text

Research on clothing patterns generation based on multi-scales self-attention improved generative adversarial network

International Journal of Intelligent Computing and Cybernetics ◽

10.1108/ijicc-04-2021-0065 ◽

2021 ◽

Vol ahead-of-print (ahead-of-print) ◽

Author(s):

Zi-yan Yu ◽

Tian-jian Luo

Keyword(s):

Dominant Role ◽

Costume Design ◽

Generative Adversarial Network ◽

Content Type ◽

Clothing Design ◽

Local Texture ◽

Adversarial Network ◽

Conventional Design ◽

Output Ratio ◽

Multi Scales

PurposeClothing patterns play a dominant role in costume design and have become an important link in the perception of costume art. Conventional clothing patterns design relies on experienced designers. Although the quality of clothing patterns is very high on conventional design, the input time and output amount ratio is relative low for conventional design. In order to break through the bottleneck of conventional clothing patterns design, this paper proposes a novel way based on generative adversarial network (GAN) model for automatic clothing patterns generation, which not only reduces the dependence of experienced designer, but also improve the input-output ratio.Design/methodology/approachIn view of the fact that clothing patterns have high requirements for global artistic perception and local texture details, this paper improves the conventional GAN model from two aspects: a multi-scales discriminators strategy is introduced to deal with the local texture details; and the self-attention mechanism is introduced to improve the global artistic perception. Therefore, the improved GAN called multi-scales self-attention improved generative adversarial network (MS-SA-GAN) model, which is used for high resolution clothing patterns generation.FindingsTo verify the feasibility and effectiveness of the proposed MS-SA-GAN model, a crawler is designed to acquire standard clothing patterns dataset from Baidu pictures, and a comparative experiment is conducted on our designed clothing patterns dataset. In experiments, we have adjusted different parameters of the proposed MS-SA-GAN model, and compared the global artistic perception and local texture details of the generated clothing patterns.Originality/valueExperimental results have shown that the clothing patterns generated by the proposed MS-SA-GAN model are superior to the conventional algorithms in some local texture detail indexes. In addition, a group of clothing design professionals is invited to evaluate the global artistic perception through a valence-arousal scale. The scale results have shown that the proposed MS-SA-GAN model achieves a better global art perception.

Download Full-text

Improving CBCT Quality to CT Level using Deep‐Learning with Generative Adversarial Network

Medical Physics ◽

10.1002/mp.14624 ◽

2020 ◽

Author(s):

Yang Zhang ◽

Ning Yue ◽

Min‐Ying Su ◽

Bo Liu ◽

Yi Ding ◽

...

Keyword(s):

Deep Learning ◽

Generative Adversarial Network ◽

Adversarial Network

Download Full-text