scholarly journals Deep-Learning-Based Pupil Center Detection and Tracking Technology for Visible-Light Wearable Gaze Tracking Devices

2021 ◽  
Vol 11 (2) ◽  
pp. 851
Author(s):  
Wei-Liang Ou ◽  
Tzu-Ling Kuo ◽  
Chin-Chieh Chang ◽  
Chih-Peng Fan
Keyword(s):  
Deep Learning ◽  
Visible Light ◽  
Tracking System ◽  
Recall Rate ◽  
Detection Accuracy ◽  
Learning Technology ◽  
Tracking Errors ◽  
Gaze Tracking ◽  
Detection Technology ◽  
Pupil Tracking

In this study, for the application of visible-light wearable eye trackers, a pupil tracking methodology based on deep-learning technology is developed. By applying deep-learning object detection technology based on the You Only Look Once (YOLO) model, the proposed pupil tracking method can effectively estimate and predict the center of the pupil in the visible-light mode. By using the developed YOLOv3-tiny-based model to test the pupil tracking performance, the detection accuracy is as high as 80%, and the recall rate is close to 83%. In addition, the average visible-light pupil tracking errors of the proposed YOLO-based deep-learning design are smaller than 2 pixels for the training mode and 5 pixels for the cross-person test, which are much smaller than those of the previous ellipse fitting design without using deep-learning technology under the same visible-light conditions. After the combination of calibration process, the average gaze tracking errors by the proposed YOLOv3-tiny-based pupil tracking models are smaller than 2.9 and 3.5 degrees at the training and testing modes, respectively, and the proposed visible-light wearable gaze tracking system performs up to 20 frames per second (FPS) on the GPU-based software embedded platform.

scholarly journals Application of Color Featuring and Deep Learning in Maize Plant Detection

2020 ◽  
Vol 12 (14) ◽  
pp. 2229
Author(s):  
Haojie Liu ◽  
Hong Sun ◽  
Minzan Li ◽  
Michihisa Iida
Keyword(s):  
Deep Learning ◽  
False Negative ◽  
Color Space ◽  
Performance Comparison ◽  
Maize Plant ◽  
Detection Accuracy ◽  
Learning Technology ◽  
Practical Applications ◽  
Feature Based ◽  
Detection Speed

Maize plant detection was conducted in this study with the goals of target fertilization and reduction of fertilization waste in weed spots and gaps between maize plants. The methods used included two types of color featuring and deep learning (DL). The four color indices used were excess green (ExG), excess red (ExR), ExG minus ExR, and the hue value from the HSV (hue, saturation, and value) color space, while the DL methods used were YOLOv3 and YOLOv3_tiny. For practical application, this study focused on performance comparison in detection accuracy, robustness to complex field conditions, and detection speed. Detection accuracy was evaluated by the resulting images, which were divided into three categories: true positive, false positive, and false negative. The robustness evaluation was performed by comparing the average intersection over union of each detection method across different sub–datasets—namely original subset, blur processing subset, increased brightness subset, and reduced brightness subset. The detection speed was evaluated by the indicator of frames per second. Results demonstrated that the DL methods outperformed the color index–based methods in detection accuracy and robustness to complex conditions, while they were inferior to color feature–based methods in detection speed. This research shows the application potential of deep learning technology in maize plant detection. Future efforts are needed to improve the detection speed for practical applications.

scholarly journals CropDeep: The Crop Vision Dataset for Deep-Learning-Based Classification and Detection in Precision Agriculture

Sensors ◽  
2019 ◽  
Vol 19 (5) ◽  
pp. 1058 ◽  
Author(s):  
Yang-Yang Zheng ◽  
Jian-Lei Kong ◽  
Xue-Bo Jin ◽  
Xiao-Yi Wang ◽  
Min Zuo
Keyword(s):  
Deep Learning ◽  
Precision Agriculture ◽  
Production Efficiency ◽  
State Of The Art ◽  
Detection Accuracy ◽  
Similar Species ◽  
Learning Technology ◽  
Well Performance ◽  
Species Classification ◽  
Domain Specific

Intelligence has been considered as the major challenge in promoting economic potential and production efficiency of precision agriculture. In order to apply advanced deep-learning technology to complete various agricultural tasks in online and offline ways, a large number of crop vision datasets with domain-specific annotation are urgently needed. To encourage further progress in challenging realistic agricultural conditions, we present the CropDeep species classification and detection dataset, consisting of 31,147 images with over 49,000 annotated instances from 31 different classes. In contrast to existing vision datasets, images were collected with different cameras and equipment in greenhouses, captured in a wide variety of situations. It features visually similar species and periodic changes with more representative annotations, which have supported a stronger benchmark for deep-learning-based classification and detection. To further verify the application prospect, we provide extensive baseline experiments using state-of-the-art deep-learning classification and detection models. Results show that current deep-learning-based methods achieve well performance in classification accuracy over 99%. While current deep-learning methods achieve only 92% detection accuracy, illustrating the difficulty of the dataset and improvement room of state-of-the-art deep-learning models when applied to crops production and management. Specifically, we suggest that the YOLOv3 network has good potential application in agricultural detection tasks.

scholarly journals A survey on Deep Learning Based Eye Gaze Estimation Methods

2021 ◽  
Vol 3 (3) ◽  
pp. 190-207
Author(s):  
S. K. B. Sangeetha
Keyword(s):  
Computer Vision ◽  
Deep Learning ◽  
Near Infrared ◽  
Eye Gaze ◽  
Infrared Image ◽  
Estimation Methods ◽  
Learning Technology ◽  
Learning Approaches ◽  
Gaze Tracking ◽  
Inference Models

In recent years, deep-learning systems have made great progress, particularly in the disciplines of computer vision and pattern recognition. Deep-learning technology can be used to enable inference models to do real-time object detection and recognition. Using deep-learning-based designs, eye tracking systems could determine the position of eyes or pupils, regardless of whether visible-light or near-infrared image sensors were utilized. For growing electronic vehicle systems, such as driver monitoring systems and new touch screens, accurate and successful eye gaze estimates are critical. In demanding, unregulated, low-power situations, such systems must operate efficiently and at a reasonable cost. A thorough examination of the different deep learning approaches is required to take into consideration all of the limitations and opportunities of eye gaze tracking. The goal of this research is to learn more about the history of eye gaze tracking, as well as how deep learning contributed to computer vision-based tracking. Finally, this research presents a generalized system model for deep learning-driven eye gaze direction diagnostics, as well as a comparison of several approaches.

scholarly journals A Review of Intelligent Driving Pedestrian Detection Based on Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-16
Author(s):  
Di Tian ◽  
Yi Han ◽  
Biyao Wang ◽  
Tian Guan ◽  
Wei Wei
Keyword(s):  
Deep Learning ◽  
Object Detection ◽  
Rapid Development ◽  
Pedestrian Detection ◽  
Evaluation Criteria ◽  
Human Perception ◽  
Detection Accuracy ◽  
Learning Stage ◽  
Detection Technology ◽  
General Object

Pedestrian detection is a specific application of object detection. Compared with general object detection, it shows similarities and unique characteristics. In addition, it has important application value in the fields of intelligent driving and security monitoring. In recent years, with the rapid development of deep learning, pedestrian detection technology has also made great progress. However, there still exists a huge gap between it and human perception. Meanwhile, there are still a lot of problems, and there remains a lot of room for research. Regarding the application of pedestrian detection in intelligent driving technology, it is of necessity to ensure its real-time performance. Additionally, it is necessary to lighten the model while ensuring detection accuracy. This paper first briefly describes the development process of pedestrian detection and then concentrates on summarizing the research results of pedestrian detection technology in the deep learning stage. Subsequently, by summarizing the pedestrian detection dataset and evaluation criteria, the core issues of the current development of pedestrian detection are analyzed. Finally, the next possible development direction of pedestrian detection technology is explained at the end of the paper.

scholarly journals Research on Network Security Application Based on Deep Learning

CONVERTER ◽  
2021 ◽  
pp. 598-605
Author(s):  
Zhao Jianchao
Keyword(s):  
Deep Learning ◽  
Learning Algorithm ◽  
Rapid Development ◽  
Internet Security ◽  
Detection Accuracy ◽  
Data Sets ◽  
Learning Technology ◽  
Data Set ◽  
Deep Learning Algorithm ◽  
Internet Industry

Behind the rapid development of the Internet industry, Internet security has become a hidden danger. In recent years, the outstanding performance of deep learning in classification and behavior prediction based on massive data makes people begin to study how to use deep learning technology. Therefore, this paper attempts to apply deep learning to intrusion detection to learn and classify network attacks. Aiming at the nsl-kdd data set, this paper first uses the traditional classification methods and several different deep learning algorithms for learning classification. This paper deeply analyzes the correlation among data sets, algorithm characteristics and experimental classification results, and finds out the deep learning algorithm which is relatively good at. Then, a normalized coding algorithm is proposed. The experimental results show that the algorithm can improve the detection accuracy and reduce the false alarm rate.

scholarly journals Nonwearable Gaze Tracking System for Controlling Home Appliance

2014 ◽  
Vol 2014 ◽  
pp. 1-20 ◽  
Author(s):  
Hwan Heo ◽  
Jong Man Lee ◽  
Dongwook Jung ◽  
Ji Woo Lee ◽  
Kang Ryoung Park
Keyword(s):  
Tracking System ◽  
Control Panel ◽  
Detection Accuracy ◽  
Specific Time ◽  
Laptop Computer ◽  
Gaze Tracking ◽  
Specific Time Period ◽  
Time Period ◽  
Home Appliance ◽  
Navigation Mode

A novel gaze tracking system for controlling home appliances in 3D space is proposed in this study. Our research is novel in the following four ways. First, we propose a nonwearable gaze tracking system containing frontal viewing and eye tracking cameras. Second, our system includes three modes: navigation (for moving the wheelchair depending on the direction of gaze movement), selection (for selecting a specific appliance by gaze estimation), and manipulation (for controlling the selected appliance by gazing at the control panel). The modes can be changed by closing eyes during a specific time period or gazing. Third, in the navigation mode, the signal for moving the wheelchair can be triggered according to the direction of gaze movement. Fourth, after a specific home appliance is selected by gazing at it for more than predetermined time period, a control panel with3×2menu is displayed on laptop computer below the gaze tracking system for manipulation. The user gazes at one of the menu options for a specific time period, which can be manually adjusted according to the user, and the signal for controlling the home appliance can be triggered. The proposed method is shown to have high detection accuracy through a series of experiments.

scholarly journals Convolutional Neural Networks(CNN) based Eye-Gaze Tracking System using Machine Learning Algorithm

2021 ◽  
Vol 5 (2) ◽  
pp. 36-40
Author(s):  
Prakash Kanade ◽  
Fortune David ◽  
Sunay Kanade
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
User Interfaces ◽  
Data Science ◽  
Learning Algorithm ◽  
Tracking System ◽  
Eye Gaze ◽  
Classification Systems ◽  
Gaze Tracking

To avoid the rising number of car crash deaths, which are mostly caused by drivers' inattentiveness, a paradigm shift is expected. The knowledge of a driver's look area may provide useful details about his or her point of attention. Cars with accurate and low-cost gaze classification systems can increase driver safety. When drivers shift their eyes without turning their heads to look at objects, the margin of error in gaze detection increases. For new consumer electronic applications such as driver tracking systems and novel user interfaces, accurate and effective eye gaze prediction is critical. Such systems must be able to run efficiently in difficult, unconstrained conditions while using reduced power and expense. A deep learning-based gaze estimation technique has been considered to solve this issue, with an emphasis on WSN based Convolutional Neural Networks (CNN) based system. The proposed study proposes the following architecture, which is focused on data science: The first is a novel neural network model that is programmed to manipulate any possible visual feature, such as the states of both eyes and head location, as well as many augmentations; the second is a data fusion approach that incorporates several gaze datasets. However, due to different factors such as environment light shifts, reflections on glasses surface, and motion and optical blurring of the captured eye signal, the accuracy of detecting and classifying the pupil centre and corneal reflection centre depends on a car environment. This work also includes pre-trained models, network structures, and datasets for designing and developing CNN-based deep learning models for Eye-Gaze Tracking and Classification.

scholarly journals Lightweight Fruit-Detection Algorithm for Edge Computing Applications

2021 ◽  
Vol 12 ◽  
Author(s):  
Wenli Zhang ◽  
Yuxin Liu ◽  
Kaizhen Chen ◽  
Huibin Li ◽  
Yulin Duan ◽  
...  
Keyword(s):  
Deep Learning ◽  
Real Time ◽  
Sampling Method ◽  
Feature Fusion ◽  
Detection Algorithm ◽  
Detection Accuracy ◽  
Model Structure ◽  
Excellent Performance ◽  
Backbone Network ◽  
Detection Technology

In recent years, deep-learning-based fruit-detection technology has exhibited excellent performance in modern horticulture research. However, deploying deep learning algorithms in real-time field applications is still challenging, owing to the relatively low image processing capability of edge devices. Such limitations are becoming a new bottleneck and hindering the utilization of AI algorithms in modern horticulture. In this paper, we propose a lightweight fruit-detection algorithm, specifically designed for edge devices. The algorithm is based on Light-CSPNet as the backbone network, an improved feature-extraction module, a down-sampling method, and a feature-fusion module, and it ensures real-time detection on edge devices while maintaining the fruit-detection accuracy. The proposed algorithm was tested on three edge devices: NVIDIA Jetson Xavier NX, NVIDIA Jetson TX2, and NVIDIA Jetson NANO. The experimental results show that the average detection precision of the proposed algorithm for orange, tomato, and apple datasets are 0.93, 0.847, and 0.850, respectively. Deploying the algorithm, the detection speed of NVIDIA Jetson Xavier NX reaches 21.3, 24.8, and 22.2 FPS, while that of NVIDIA Jetson TX2 reaches 13.9, 14.1, and 14.5 FPS and that of NVIDIA Jetson NANO reaches 6.3, 5.0, and 8.5 FPS for the three datasets. Additionally, the proposed algorithm provides a component add/remove function to flexibly adjust the model structure, considering the trade-off between the detection accuracy and speed in practical usage.

scholarly journals Fast Anther Dehiscence Status Recognition System Establishing by Deep Learning to Screen Heat Tolerant Cotton

2021 ◽  
Author(s):  
Zhihao Tan ◽  
Jiawei Shi ◽  
Rongjie Lv ◽  
Qingyuan Li ◽  
Jing Yang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Recognition System ◽  
Reproductive Organs ◽  
Detection Accuracy ◽  
Learning Technology ◽  
Anther Dehiscence ◽  
Accurate Identification ◽  
Manual Method ◽  
Improved Model ◽  
Status Recognition

Abstract BackgroundCotton is one of the most economically important crops in the world. The fertility of male reproductive organs is a key determinant of cotton yield. The anther dehiscence or indehiscence directly determine the probability of fertilization in cotton. Thus, the rapid and accurate identification of cotton anther dehiscence status is important for judging anther growth status and promoting genetic breeding research. The development of computer vision technology and the advent of big data have prompted the application of deep learning techniques to agricultural phenotype research. Therefore, two deep learning models (Faster R-CNN and YOLOv5) were proposed to detect the number and dehiscence status of anthers. ResultThe single-stage model based on YOLOv5 has higher recognition efficiency and the ability to deploy to the mobile end. Breeding researchers can apply this model to terminals to achieve a more intuitive understanding of cotton anther dehiscence status. Moreover, three improvement strategies of Faster R-CNN model were proposed, the improved model has higher detection accuracy than YOLOv5 model. We have made four improvements to the Faster R-CNN model and after the ensemble of the four models, R2 of “open” reaches 0.8765, R2 of “close” reaches 0.8539, R2 of “all” reaches 0.8481, higher than the prediction result of either model alone, and can completely replace the manual counting method. We can use this model to quickly extract the dehiscence rate of cotton anther under high temperature (HT) condition. In addition, the percentage of dehiscent anther of randomly selected 30 cotton varieties were observed from cotton population under normal conditions and HT conditions through the ensemble of Faster R-CNN model and manual observation. The result showed HT varying decreased the percentage of dehiscent anther in different cotton lines, consistent with the manual method. ConclusionsThe deep learning technology first time been applied to cotton anther dehiscence status recognition instead of manual method to quickly screen the HT tolerant cotton varieties and can help to explore the key genetic improvement genes in the future, promote cotton breeding and improvement.

Sign in / Sign up

Export Citation Format

Share Document