scholarly journals Shelf Auditing Based on Image Classification Using Semi-Supervised Deep Learning to Increase On-Shelf Availability in Grocery Stores

Sensors ◽  
2021 ◽  
Vol 21 (2) ◽  
pp. 327
Author(s):  
Ramiz Yilmazer ◽  
Derya Birant
Keyword(s):  
Artificial Intelligence ◽  
Computer Vision ◽  
Deep Learning ◽  
Image Classification ◽  
Experimental Studies ◽  
Grocery Stores ◽  
Software Application ◽  
Explainable Artificial Intelligence ◽  
Key Factor ◽  
First Time

Providing high on-shelf availability (OSA) is a key factor to increase profits in grocery stores. Recently, there has been growing interest in computer vision approaches to monitor OSA. However, the largest and well-known computer vision datasets do not provide annotation for store products, and therefore, a huge effort is needed to manually label products on images. To tackle the annotation problem, this paper proposes a new method that combines two concepts “semi-supervised learning” and “on-shelf availability” (SOSA) for the first time. Moreover, it is the first time that “You Only Look Once” (YOLOv4) deep learning architecture is used to monitor OSA. Furthermore, this paper provides the first demonstration of explainable artificial intelligence (XAI) on OSA. It presents a new software application, called SOSA XAI, with its capabilities and advantages. In the experimental studies, the effectiveness of the proposed SOSA method was verified on image datasets, with different ratios of labeled samples varying from 20% to 80%. The experimental results show that the proposed approach outperforms the existing approaches (RetinaNet and YOLOv3) in terms of accuracy.

Image Classification Based On CNN: A Survey

2021 ◽  
pp. PP. 18-50
Author(s):  
Ahmed A. Elngar ◽  
◽  
◽  
◽  
◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Neural Networks ◽  
Computer Vision ◽  
Deep Learning ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Vision System ◽  
Machine Learning Algorithms ◽  
Traffic Lights

Computer vision is one of the fields of computer science that is one of the most powerful and persuasive types of artificial intelligence. It is similar to the human vision system, as it enables computers to recognize and process objects in pictures and videos in the same way as humans do. Computer vision technology has rapidly evolved in many fields and contributed to solving many problems, as computer vision contributed to self-driving cars, and cars were able to understand their surroundings. The cameras record video from different angles around the car, then a computer vision system gets images from the video, and then processes the images in real-time to find roadside ends, detect other cars, and read traffic lights, pedestrians, and objects. Computer vision also contributed to facial recognition; this technology enables computers to match images of people’s faces to their identities. which these algorithms detect facial features in images and then compare them with databases. Computer vision also play important role in Healthcare, in which algorithms can help automate tasks such as detecting Breast cancer, finding symptoms in x-ray, cancerous moles in skin images, and MRI scans. Computer vision also contributed to many fields such as image classification, object discovery, motion recognition, subject tracking, and medicine. The rapid development of artificial intelligence is making machine learning more important in his field of research. Use algorithms to find out every bit of data and predict the outcome. This has become an important key to unlocking the door to AI. If we had looked to deep learning concept, we find deep learning is a subset of machine learning, algorithms inspired by structure and function of the human brain called artificial neural networks, learn from large amounts of data. Deep learning algorithm perform a task repeatedly, each time tweak it a little to improve the outcome. So, the development of computer vision was due to deep learning. Now we'll take a tour around the convolution neural networks, let us say that convolutional neural networks are one of the most powerful supervised deep learning models (abbreviated as CNN or ConvNet). This name ;convolutional ; is a token from a mathematical linear operation between matrixes called convolution. CNN structure can be used in a variety of real-world problems including, computer vision, image recognition, natural language processing (NLP), anomaly detection, video analysis, drug discovery, recommender systems, health risk assessment, and time-series forecasting. If we look at convolutional neural networks, we see that CNN are similar to normal neural networks, the only difference between CNN and ANN is that CNNs are used in the field of pattern recognition within images mainly. This allows us to encode the features of an image into the structure, making the network more suitable for image-focused tasks, with reducing the parameters required to set-up the model. One of the advantages of CNN that it has an excellent performance in machine learning problems. So, we will use CNN as a classifier for image classification. So, the objective of this paper is that we will talk in detail about image classification in the following sections.

scholarly journals Deep learning-enabled medical computer vision

2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Andre Esteva ◽  
Katherine Chou ◽  
Serena Yeung ◽  
Nikhil Naik ◽  
Ali Madani ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Computer Vision ◽  
Deep Learning ◽  
Medical Imaging ◽  
Real World ◽  
Recent Progress ◽  
Medical Applications ◽  
Modern Computer ◽  
Medical Computer

AbstractA decade of unprecedented progress in artificial intelligence (AI) has demonstrated the potential for many fields—including medicine—to benefit from the insights that AI techniques can extract from data. Here we survey recent progress in the development of modern computer vision techniques—powered by deep learning—for medical applications, focusing on medical imaging, medical video, and clinical deployment. We start by briefly summarizing a decade of progress in convolutional neural networks, including the vision tasks they enable, in the context of healthcare. Next, we discuss several example medical imaging applications that stand to benefit—including cardiology, pathology, dermatology, ophthalmology–and propose new avenues for continued work. We then expand into general medical video, highlighting ways in which clinical workflows can integrate computer vision to enhance care. Finally, we discuss the challenges and hurdles required for real-world clinical deployment of these technologies.

scholarly journals Image classification using Deep learning

2018 ◽  
Vol 7 (2.7) ◽  
pp. 614 ◽  
Author(s):  
M Manoj krishna ◽  
M Neelima ◽  
M Harshali ◽  
M Venu Gopala Rao
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Image Processing ◽  
Computer Vision ◽  
Deep Learning ◽  
Image Classification ◽  
Convolutional Neural Networks ◽  
Classical Problem

The image classification is a classical problem of image processing, computer vision and machine learning fields. In this paper we study the image classification using deep learning. We use AlexNet architecture with convolutional neural networks for this purpose. Four test images are selected from the ImageNet database for the classification purpose. We cropped the images for various portion areas and conducted experiments. The results show the effectiveness of deep learning based image classification using AlexNet.  

scholarly journals A deep learning platooning-based video information-sharing Internet of Things framework for autonomous driving systems

2019 ◽  
Vol 15 (11) ◽  
pp. 155014771988313 ◽  
Author(s):  
Zishuo Zhou ◽  
Zahid Akhtar ◽  
Ka Lok Man ◽  
Kamran Siddique
Keyword(s):  
Artificial Intelligence ◽  
Computer Vision ◽  
Deep Learning ◽  
Internet Of Things ◽  
Information Sharing ◽  
Communication Technology ◽  
Empirical Evaluation ◽  
Traffic Lights ◽  
Video Information ◽  
Safety And Stability

To enhance the safety and stability of autonomous vehicles, we present a deep learning platooning-based video information-sharing Internet of Things framework in this study. The proposed Internet of Things framework incorporates concepts and mechanisms from several domains of computer science, such as computer vision, artificial intelligence, sensor technology, and communication technology. The information captured by camera, such as road edges, traffic lights, and zebra lines, is highlighted using computer vision. The semantics of highlighted information is recognized by artificial intelligence. Sensors provide information on the direction and distance of obstacles, as well as their speed and moving direction. The communication technology is applied to share the information among the vehicles. Since vehicles have high probability to encounter accidents in congested locations, the proposed system enables vehicles to perform self-positioning with other vehicles in a certain range to reinforce their safety and stability. The empirical evaluation shows the viability and efficacy of the proposed system in such situations. Moreover, the collision time is decreased considerably compared with that when using traditional systems.

scholarly journals Explainable Artificial Intelligence for Developing Smart Cities Solutions

Smart Cities ◽  
2020 ◽  
Vol 3 (4) ◽  
pp. 1353-1382
Author(s):  
Dhavalkumar Thakker ◽  
Bhupesh Kumar Mishra ◽  
Amr Abdullatif ◽  
Suvodeep Mazumdar ◽  
Sydney Simpson
Keyword(s):  
Artificial Intelligence ◽  
Deep Learning ◽  
Semantic Web ◽  
Image Classification ◽  
Smart Cities ◽  
Semantic Web Technologies ◽  
Hybrid Classifier ◽  
Web Technologies ◽  
Explainable Ai ◽  
Flood Monitoring

Traditional Artificial Intelligence (AI) technologies used in developing smart cities solutions, Machine Learning (ML) and recently Deep Learning (DL), rely more on utilising best representative training datasets and features engineering and less on the available domain expertise. We argue that such an approach to solution development makes the outcome of solutions less explainable, i.e., it is often not possible to explain the results of the model. There is a growing concern among policymakers in cities with this lack of explainability of AI solutions, and this is considered a major hindrance in the wider acceptability and trust in such AI-based solutions. In this work, we survey the concept of ‘explainable deep learning’ as a subset of the ‘explainable AI’ problem and propose a new solution using Semantic Web technologies, demonstrated with a smart cities flood monitoring application in the context of a European Commission-funded project. Monitoring of gullies and drainage in crucial geographical areas susceptible to flooding issues is an important aspect of any flood monitoring solution. Typical solutions for this problem involve the use of cameras to capture images showing the affected areas in real-time with different objects such as leaves, plastic bottles etc., and building a DL-based classifier to detect such objects and classify blockages based on the presence and coverage of these objects in the images. In this work, we uniquely propose an Explainable AI solution using DL and Semantic Web technologies to build a hybrid classifier. In this hybrid classifier, the DL component detects object presence and coverage level and semantic rules designed with close consultation with experts carry out the classification. By using the expert knowledge in the flooding context, our hybrid classifier provides the flexibility on categorising the image using objects and their coverage relationships. The experimental results demonstrated with a real-world use case showed that this hybrid approach of image classification has on average 11% improvement (F-Measure) in image classification performance compared to DL-only classifier. It also has the distinct advantage of integrating experts’ knowledge on defining the decision-making rules to represent the complex circumstances and using such knowledge to explain the results.

scholarly journals Technical note: AI-Track-tive: automated fission track recognition using computer vision (Artificial Intelligence)

2020 ◽  
Author(s):  
Simon Nachtergaele ◽  
Johan De Grave
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
Computer Vision ◽  
Deep Neural Networks ◽  
Fission Track ◽  
Detection Algorithm ◽  
Technical Note ◽  
Success Rates ◽  
Automatic Counting ◽  
First Time

Abstract. Artificial intelligence techniques such as deep neural networks and computer vision are developed for fission track recognition and included in a computer program for the first time. These deep neural networks use the Yolov3 object detection algorithm, which is currently one of the most powerful and fastest object recognition algorithms. These deep neural networks can be used in new software called AI-Track-tive. The developed program successfully finds most of the fission tracks in the microscope images, however, the user still needs to supervise the automatic counting. The success rates of the automatic recognition range from 70 % to 100 % depending on the areal track densities in apatite and (muscovite) external detector. The success rate generally decreases for images with high areal track densities, because overlapping tracks are less easily recognizable for computer vision techniques.

scholarly journals Project Management’s Triple Constraints Mapping on Augmented Reality based Learning System for Improved Quality

2019 ◽  
Author(s):  
Mehreen Sirshar ◽  
Syeda Hafsa Ali ◽  
Haleema Sadia Baig
Keyword(s):  
Artificial Intelligence ◽  
Computer Vision ◽  
Deep Learning ◽  
Project Management ◽  
Augmented Reality ◽  
Learning System ◽  
It Professionals ◽  
Successful Completion ◽  
Project Objectives ◽  
Work Done

Over the last few decades there has been an exponential growth in IT, motivating IT professionals and scientists to explore new dimensions resulting in the advancement of artificial intelligence and its subcategories like computer vision, deep learning and augmented reality. AR is comparatively a new area which was initially explored for gaming but recently a lot of work has been done in education using AR. Most of this focuses on improving students understanding and motivation. Like any other project, the performance of an AR based project is determined by the customer satisfaction which is usually affected by the theory of triple constraints; cost, time and scope. many studies have shown that most of the projects are under development because they are unable to overcome these constraints and meet project objectives. We were unable to find any notable work done regarding project management for augmented reality systems and application. Therefore, in this paper, we propose a system for management of AR applications which mainly focuses on catering triple constraints to meet desired objectives. Each variable is further divided into subprocesses and by following these processes successful completion of the project can be achieved.

scholarly journals Image Classification Using Reinforcement Learning

2020 ◽  
Vol 23 (6) ◽  
pp. 1172-1191
Author(s):  
Artem Aleksandrovich Elizarov ◽  
Evgenii Viktorovich Razinkov
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Machine Learning ◽  
Computer Vision ◽  
Reinforcement Learning ◽  
Image Classification ◽  
Deep Neural Network ◽  
Learning Algorithms ◽  
Further Development

Recently, such a direction of machine learning as reinforcement learning has been actively developing. As a consequence, attempts are being made to use reinforcement learning for solving computer vision problems, in particular for solving the problem of image classification. The tasks of computer vision are currently one of the most urgent tasks of artificial intelligence. The article proposes a method for image classification in the form of a deep neural network using reinforcement learning. The idea of ​​the developed method comes down to solving the problem of a contextual multi-armed bandit using various strategies for achieving a compromise between exploitation and research and reinforcement learning algorithms. Strategies such as -greedy, -softmax, -decay-softmax, and the UCB1 method, and reinforcement learning algorithms such as DQN, REINFORCE, and A2C are considered. The analysis of the influence of various parameters on the efficiency of the method is carried out, and options for further development of the method are proposed.

scholarly journals Frontiers of Computer Vision Technologies on Real Estate Property Photographs and Floorplans

2021 ◽  
pp. 325-337
Author(s):  
Yoji Kiyota
Keyword(s):  
Artificial Intelligence ◽  
Computer Vision ◽  
Deep Learning ◽  
Real Estate ◽  
Image Data ◽  
Learning Technologies ◽  
Data Sets ◽  
Academic Communities ◽  
Estate Property ◽  
Extract Information

AbstractThis article describes frontier efforts to apply deep learning technologies, which is the greatest innovation of research on artificial intelligence and computer vision, to image data such as real estate property photographs and floorplans. Specifically, attempts to detect property photographs that violate regulations or were misclassified, or to extract information that can be used as new recommendation features from property photographs, were mentioned. Besides, this article introduces an innovation created by providing data sets for academic communities.

Sign in / Sign up

Export Citation Format

Share Document