scholarly journals Open Set Self and Across Domain Adaptation for Tomato Disease Recognition With Deep Learning Techniques

2021 ◽  
Vol 12 ◽  
Author(s):  
Alvaro Fuentes ◽  
Sook Yoon ◽  
Taehyun Kim ◽  
Dong Sun Park

Recent advances in automatic recognition systems based on deep learning technology have shown the potential to provide environmental-friendly plant disease monitoring. These systems are able to reliably distinguish plant anomalies under varying environmental conditions as the basis for plant intervention using methods such as classification or detection. However, they often show a performance decay when applied under new field conditions and unseen data. Therefore, in this article, we propose an approach based on the concept of open-set domain adaptation to the task of plant disease recognition to allow existing systems to operate in new environments with unseen conditions and farms. Our system specifically copes diagnosis as an open set learning problem, and mainly operates in the target domain by exploiting a precise estimation of unknown data while maintaining the performance of the known classes. The main framework consists of two modules based on deep learning that perform bounding box detection and open set self and across domain adaptation. The detector is built based on our previous filter bank architecture for plant diseases recognition and enforces domain adaptation from the source to the target domain, by constraining data to be classified as one of the target classes or labeled as unknown otherwise. We perform an extensive evaluation on our tomato plant diseases dataset with three different domain farms, which indicates that our approach can efficiently cope with changes of new field environments during field-testing and observe consistent gains from explicit modeling of unseen data.

Agriculture is the backbone and plays a vital role in many Asian countries. Farmers mainly depend on their agricultural produce for their living. A report says one-third of the farmers income account’s for the agricultural loss which is primarily due to plant diseases. To combat this farmers are in need of a early plant disease identification mechanism. Observation of individual plants in the farm for detecting the disease is labor-intensive and time consuming work, if the farm is vast and multiple plants are cultivated then it’s even worse. To solve such issues, current technologies like the Internet of Things (IoT) and artificial intelligence (AI) and Machine Learning (ML) are used to predict the diseases more effectively. Farmers usually detect plant diseases with the help of images captured manually and analyzed separately by experts. The proposed system renders an efficient solution for detecting multiple diseases in several plant varieties. The system is designed to detect and recognize several plant varieties, specifically pepper, grapes, and strawberry. The proposed system discovers various plant’s various diseases based on the inputs obtained by capturing images from a built-in camera present in the Autonomous rover. The rover also record’s it’s GPS location and makes a map of the entire farm traced and checked by the robot. The images are processed and are classified into their respective categories using deep learning algorithms. Convolutional neural networks the powerful methodology for image classification is the underlying principle applied. The deep learning model’s architecture namely, VGG16 and InceptionResNetV2, are used to train the model. These models are primarily made of convolutional layers. On testing, we recorded am accuracy of 93.21% was obtained from VGG16, and 95.24% from InceptionResNetV2.


Author(s):  
Renjun Xu ◽  
Pelen Liu ◽  
Yin Zhang ◽  
Fang Cai ◽  
Jindong Wang ◽  
...  

Domain adaptation (DA) has achieved a resounding success to learn a good classifier by leveraging labeled data from a source domain to adapt to an unlabeled target domain. However, in a general setting when the target domain contains classes that are never observed in the source domain, namely in Open Set Domain Adaptation (OSDA), existing DA methods failed to work because of the interference of the extra unknown classes. This is a much more challenging problem, since it can easily result in negative transfer due to the mismatch between the unknown and known classes. Existing researches are susceptible to misclassification when target domain unknown samples in the feature space distributed near the decision boundary learned from the labeled source domain. To overcome this, we propose Joint Partial Optimal Transport (JPOT), fully utilizing information of not only the labeled source domain but also the discriminative representation of unknown class in the target domain. The proposed joint discriminative prototypical compactness loss can not only achieve intra-class compactness and inter-class separability, but also estimate the mean and variance of the unknown class through backpropagation, which remains intractable for previous methods due to the blindness about the structure of the unknown classes. To our best knowledge, this is the first optimal transport model for OSDA. Extensive experiments demonstrate that our proposed model can significantly boost the performance of open set domain adaptation on standard DA datasets.


2021 ◽  
Vol 11 (4) ◽  
pp. 251-264
Author(s):  
Radhika Bhagwat ◽  
Yogesh Dandawate

Plant diseases cause major yield and economic losses. To detect plant disease at early stages, selecting appropriate techniques is imperative as it affects the cost, diagnosis time, and accuracy. This research gives a comprehensive review of various plant disease detection methods based on the images used and processing algorithms applied. It systematically analyzes various traditional machine learning and deep learning algorithms used for processing visible and spectral range images, and comparatively evaluates the work done in literature in terms of datasets used, various image processing techniques employed, models utilized, and efficiency achieved. The study discusses the benefits and restrictions of each method along with the challenges to be addressed for rapid and accurate plant disease detection. Results show that for plant disease detection, deep learning outperforms traditional machine learning algorithms while visible range images are more widely used compared to spectral images.


2021 ◽  
Vol 11 (1) ◽  
pp. 491-508
Author(s):  
Monika Lamba ◽  
Yogita Gigras ◽  
Anuradha Dhull

Abstract Detection of plant disease has a crucial role in better understanding the economy of India in terms of agricultural productivity. Early recognition and categorization of diseases in plants are very crucial as it can adversely affect the growth and development of species. Numerous machine learning methods like SVM (support vector machine), random forest, KNN (k-nearest neighbor), Naïve Bayes, decision tree, etc., have been exploited for recognition, discovery, and categorization of plant diseases; however, the advancement of machine learning by DL (deep learning) is supposed to possess tremendous potential in enhancing the accuracy. This paper proposed a model comprising of Auto-Color Correlogram as image filter and DL as classifiers with different activation functions for plant disease. This proposed model is implemented on four different datasets to solve binary and multiclass subcategories of plant diseases. Using the proposed model, results achieved are better, obtaining 99.4% accuracy and 99.9% sensitivity for binary class and 99.2% accuracy for multiclass. It is proven that the proposed model outperforms other approaches, namely LibSVM, SMO (sequential minimal optimization), and DL with activation function softmax and softsign in terms of F-measure, recall, MCC (Matthews correlation coefficient), specificity and sensitivity.


Author(s):  
Shradha Verma ◽  
Anuradha Chug ◽  
Amit Prakash Singh ◽  
Shubham Sharma ◽  
Puranjay Rajvanshi

With the increasing computational power, areas such as machine learning, image processing, deep learning, etc. have been extensively applied in agriculture. This chapter investigates the applications of the said areas and various prediction models in plant pathology for accurate classification, identification, and quantification of plant diseases. The authors aim to automate the plant disease identification process. To accomplish this objective, CNN has been utilized for image classification. Research shows that deep learning architectures outperform other machine learning tools significantly. To this effect, the authors have implemented and trained five CNN models, namely Inception ResNet v2, VGG16, VGG19, ResNet50, and Xception, on PlantVillage dataset for tomato leaf images. The authors analyzed 18,160 tomato leaf images spread across 10 class labels. After comparing their performance measures, ResNet50 proved to be the most accurate prediction tool. It was employed to create a mobile application to classify and identify tomato plant diseases successfully.


2020 ◽  
Vol 12 (11) ◽  
pp. 1716
Author(s):  
Reham Adayel ◽  
Yakoub Bazi ◽  
Haikel Alhichri ◽  
Naif Alajlan

Most of the existing domain adaptation (DA) methods proposed in the context of remote sensing imagery assume the presence of the same land-cover classes in the source and target domains. Yet, this assumption is not always realistic in practice as the target domain may contain additional classes unknown to the source leading to the so-called open set DA. Under this challenging setting, the problem turns to reducing the distribution discrepancy between the shared classes in both domains besides the detection of the unknown class samples in the target domain. To deal with the openset problem, we propose an approach based on adversarial learning and pareto-based ranking. In particular, the method leverages the distribution discrepancy between the source and target domains using min-max entropy optimization. During the alignment process, it identifies candidate samples of the unknown class from the target domain through a pareto-based ranking scheme that uses ambiguity criteria based on entropy and the distance to source class prototype. Promising results using two cross-domain datasets that consist of very high resolution and extremely high resolution images, show the effectiveness of the proposed method.


Symmetry ◽  
2019 ◽  
Vol 11 (7) ◽  
pp. 939 ◽  
Author(s):  
Marko Arsenovic ◽  
Mirjana Karanovic ◽  
Srdjan Sladojevic ◽  
Andras Anderla ◽  
Darko Stefanovic

Plant diseases cause great damage in agriculture, resulting in significant yield losses. The recent expansion of deep learning methods has found its application in plant disease detection, offering a robust tool with highly accurate results. The current limitations and shortcomings of existing plant disease detection models are presented and discussed in this paper. Furthermore, a new dataset containing 79,265 images was introduced with the aim to become the largest dataset containing leaf images. Images were taken in various weather conditions, at different angles, and daylight hours with an inconsistent background mimicking practical situations. Two approaches were used to augment the number of images in the dataset: traditional augmentation methods and state-of-the-art style generative adversarial networks. Several experiments were conducted to test the impact of training in a controlled environment and usage in real-life situations to accurately identify plant diseases in a complex background and in various conditions including the detection of multiple diseases in a single leaf. Finally, a novel two-stage architecture of a neural network was proposed for plant disease classification focused on a real environment. The trained model achieved an accuracy of 93.67%.


2020 ◽  
Vol 8 (6) ◽  
pp. 3069-3075

Plant diseases are diseases that change or disrupt its important functions. The reduction in the age at which a plant dies is the main danger of plant diseases. And farmers around the world have to face the challenge of identifying and classifying these diseases and changing their treatments for each disease. This task becomes more difficult when they have to rely on naked eyes to identify diseases due to the lack of proper financial resources. But with the widespread use of smartphones by farmers and advances made in the field of deep learning, researchers around the world are trying to find a solution to this problem. Similarly, the purpose of this paper is to classify these diseases using deep learning and localize them on their respective leaves. We have considered two main models for classification called resnet and efficientnet and for localizing these diseases we have used GRADCAM and CAM. GRADCAM was able to localize diseases better than CAM


2021 ◽  
Vol 12 ◽  
Author(s):  
Alvaro Fuentes ◽  
Sook Yoon ◽  
Mun Haeng Lee ◽  
Dong Sun Park

Recognizing plant diseases is a major challenge in agriculture, and recent works based on deep learning have shown high efficiency in addressing problems directly related to this area. Nonetheless, weak performance has been observed when a model trained on a particular dataset is evaluated in new greenhouse environments. Therefore, in this work, we take a step towards these issues and present a strategy to improve model accuracy by applying techniques that can help refine the model’s generalization capability to deal with complex changes in new greenhouse environments. We propose a paradigm called “control to target classes.” The core of our approach is to train and validate a deep learning-based detector using target and control classes on images collected in various greenhouses. Then, we apply the generated features for testing the inference of the system on data from new greenhouse conditions where the goal is to detect target classes exclusively. Therefore, by having explicit control over inter- and intra-class variations, our model can distinguish data variations that make the system more robust when applied to new scenarios. Experiments demonstrate the effectiveness and efficiency of the proposed approach on our extended tomato plant diseases dataset with 14 classes, from which 5 are target classes and the rest are control classes. Our detector achieves a recognition rate of target classes of 93.37% mean average precision on the inference dataset. Finally, we believe that our study offers valuable guidelines for researchers working in plant disease recognition with complex input data.


2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Wenli Zhang ◽  
Kaizhen Chen ◽  
Jiaqi Wang ◽  
Yun Shi ◽  
Wei Guo

AbstractFruit detection and counting are essential tasks for horticulture research. With computer vision technology development, fruit detection techniques based on deep learning have been widely used in modern orchards. However, most deep learning-based fruit detection models are generated based on fully supervised approaches, which means a model trained with one domain species may not be transferred to another. There is always a need to recreate and label the relevant training dataset, but such a procedure is time-consuming and labor-intensive. This paper proposed a domain adaptation method that can transfer an existing model trained from one domain to a new domain without extra manual labeling. The method includes three main steps: transform the source fruit image (with labeled information) into the target fruit image (without labeled information) through the CycleGAN network; Automatically label the target fruit image by a pseudo-label process; Improve the labeling accuracy by a pseudo-label self-learning approach. Use a labeled orange image dataset as the source domain, unlabeled apple and tomato image dataset as the target domain, the performance of the proposed method from the perspective of fruit detection has been evaluated. Without manual labeling for target domain image, the mean average precision reached 87.5% for apple detection and 76.9% for tomato detection, which shows that the proposed method can potentially fill the species gap in deep learning-based fruit detection.


Sign in / Sign up

Export Citation Format

Share Document