scholarly journals A Computer Vision Sensor for AI Accelerated Detection and Tracking of Occluded Objects

2022 ◽  
Author(s):  
Can Cuhadar ◽  
Hoi Nok Tsao
Keyword(s):  
Computer Vision ◽  
Cloud Computing ◽  
Edge Computing ◽  
Vision Sensor ◽  
Occlusion Handling ◽  
Dye Sensitized ◽  
Detection And Tracking ◽  
Occluded Objects ◽  
The Moment ◽  
Self Learning

A prominent problem in computer vision is occlusion, which occurs when an object’s key features temporarily disappear behind another crossing body, causing the computer to struggle with image detection. While the human brain is capable of compensating for the invisible parts of the blocked object, computers lack such scene interpretation skills. Cloud computing using convolutional neural networks is typically the method of choice for handling such a scenario. However, for mobile applications where energy consumption and computational costs are critical, cloud computing should be minimized. In this regard, we propose a computer vision sensor capable of efficiently detecting and tracking covered objects without heavy reliance on occlusion handling software. Our edge-computing sensor accomplishes this task by self-learning the object prior to the moment of occlusion and uses this information to “reconstruct” the blocked invisible features. Furthermore, the sensor is capable of tracking a moving object by predicting the path it will most likely take while travelling out of sight behind an obstructing body. Finally, sensor operation is demonstrated by exposing the device to various simulated occlusion events. Keywords:  Computer vision, occlusion handling, edge computing, object tracking, dye sensitized solar cell. Corresponding author Email: [email protected] 

OBJECT CLASSIFICATION AND OCCLUSION HANDLING USING QUADRATIC FEATURE CORRELATION MODEL AND NEURAL NETWORKS

2011 ◽  
Vol 25 (02) ◽  
pp. 287-298 ◽  
Author(s):  
NA FAN
Keyword(s):  
Neural Networks ◽  
Computer Vision ◽  
Pattern Recognition ◽  
Object Recognition ◽  
State Of The Art ◽  
Feature Points ◽  
Correlation Model ◽  
Occlusion Handling ◽  
Occluded Objects ◽  
Feature Correlation

Occlusion handling is an old but important problem for the computer vision and pattern recognition community. Features from different objects may twist with each other, and any matched feature points may belong to different objects for many traditional object recognition algorithms. To recognize occlusions, we should not only match objects from different view points but also match features extracted from the same object. In this paper, we propose a method to consider these two perspectives simultaneously by encoding various types of features, such as geometry, color and texture relationships among feature points into a matrix and find the best quadratic feature correlation model to fit them. Experiments on our own built dataset and the publicly available PASCAL VOC dataset shows that, our method can robustly classify objects and handle occluded objects under large occlusions, and the performance is among the state-of-the-art.

scholarly journals Optimization and Prediction Techniques for Self-Healing and Self-Learning Applications in a Trustworthy Cloud Continuum

Information ◽  
2021 ◽  
Vol 12 (8) ◽  
pp. 308
Author(s):  
Juncal Alonso ◽  
Leire Orue-Echevarria ◽  
Eneko Osaba ◽  
Jesús López Lobo ◽  
Iñigo Martinez ◽  
...  
Keyword(s):  
Cloud Computing ◽  
Heterogeneous Computing ◽  
Economies Of Scale ◽  
Fog Computing ◽  
Edge Computing ◽  
Continuous Control ◽  
Data Path ◽  
Self Healing ◽  
Application Deployment ◽  
Self Learning

The current IT market is more and more dominated by the “cloud continuum”. In the “traditional” cloud, computing resources are typically homogeneous in order to facilitate economies of scale. In contrast, in edge computing, computational resources are widely diverse, commonly with scarce capacities and must be managed very efficiently due to battery constraints or other limitations. A combination of resources and services at the edge (edge computing), in the core (cloud computing), and along the data path (fog computing) is needed through a trusted cloud continuum. This requires novel solutions for the creation, optimization, management, and automatic operation of such infrastructure through new approaches such as infrastructure as code (IaC). In this paper, we analyze how artificial intelligence (AI)-based techniques and tools can enhance the operation of complex applications to support the broad and multi-stage heterogeneity of the infrastructural layer in the “computing continuum” through the enhancement of IaC optimization, IaC self-learning, and IaC self-healing. To this extent, the presented work proposes a set of tools, methods, and techniques for applications’ operators to seamlessly select, combine, configure, and adapt computation resources all along the data path and support the complete service lifecycle covering: (1) optimized distributed application deployment over heterogeneous computing resources; (2) monitoring of execution platforms in real time including continuous control and trust of the infrastructural services; (3) application deployment and adaptation while optimizing the execution; and (4) application self-recovery to avoid compromising situations that may lead to an unexpected failure.

Reinforcement Learning for Cloud Computing Digital Library

2014 ◽  
Vol 571-572 ◽  
pp. 105-108
Author(s):  
Lin Xu
Keyword(s):  
Artificial Intelligence ◽  
Cloud Computing ◽  
Reinforcement Learning ◽  
Digital Library ◽  
Learning Algorithms ◽  
Experimental Results ◽  
Current Status ◽  
Self Learning ◽  
New Framework

This paper proposes a new framework of combining reinforcement learning with cloud computing digital library. Unified self-learning algorithms, which includes reinforcement learning, artificial intelligence and etc, have led to many essential advances. Given the current status of highly-available models, analysts urgently desire the deployment of write-ahead logging. In this paper we examine how DNS can be applied to the investigation of superblocks, and introduce the reinforcement learning to improve the quality of current cloud computing digital library. The experimental results show that the method works more efficiency.

Multi Object Detection and Tracking from Video File

2014 ◽  
Vol 533 ◽  
pp. 218-225 ◽  
Author(s):  
Rapee Krerngkamjornkit ◽  
Milan Simic
Keyword(s):  
Computer Vision ◽  
Background Subtraction ◽  
Moving Objects ◽  
Gaussian Mixture Models ◽  
Gaussian Mixture ◽  
Video Tracking ◽  
Partial Occlusion ◽  
Video File ◽  
Detection And Tracking ◽  
Over Time

This paper describes computer vision algorithms for detection, identification, and tracking of moving objects in a video file. The problem of multiple object tracking can be divided into two parts; detecting moving objects in each frame and associating the detections corresponding to the same object over time. The detection of moving objects uses a background subtraction algorithm based on Gaussian mixture models. The motion of each track is estimated by a Kalman filter. The video tracking algorithm was successfully tested using the BIWI walking pedestrians datasets [. The experimental results show that system can operate in real time and successfully detect, track and identify multiple targets in the presence of partial occlusion.

CenterTrack3D: Improved CenterTrack more Suitable for 3D Objects

2021 ◽  
pp. 1-32
Author(s):  
Lipeng Gu ◽  
Shaoyuan Sun ◽  
Xunhua Liu ◽  
Xiang Li
Keyword(s):  
Object Tracking ◽  
Research Field ◽  
Unmanned Vehicles ◽  
Current Frame ◽  
3D Objects ◽  
Detection And Tracking ◽  
Tracking Algorithms ◽  
Occluded Objects ◽  
Previous Frame ◽  
3D Information

Abstract Compared with 2D multi-object tracking algorithms, 3D multi-object tracking algorithms have more research significance and broad application prospects in the unmanned vehicles research field. Aiming at the problem of 3D multi-object detection and tracking, in this paper, the multi-object tracker CenterTrack, which focuses on 2D multi-object tracking task while ignoring object 3D information, is improved mainly from two aspects of detection and tracking, and the improved network is called CenterTrack3D. In terms of detection, CenterTrack3D uses the idea of attention mechanism to optimize the way that the previous-frame image and the heatmap of previous-frame tracklets are added to the current-frame image as input, and second convolutional layer of the output head is replaced by dynamic convolution layer, which further improves the ability to detect occluded objects. In terms of tracking, a cascaded data association algorithm based on 3D Kalman filter is proposed to make full use of the 3D information of objects in the image and increase the robustness of the 3D multi-object tracker. The experimental results show that, compared with the original CenterTrack and the existing 3D multi-object tracking methods, CenterTrack3D achieves 88.75% MOTA for cars and 59.40% MOTA for pedestrians and is very competitive on the KITTI tracking benchmark test set.

scholarly journals A Survey on Mobile Edge Computing: Focusing on Service Adoption and Provision

2018 ◽  
Vol 2018 ◽  
pp. 1-16 ◽  
Author(s):  
Kai Peng ◽  
Victor C. M. Leung ◽  
Xiaolong Xu ◽  
Lixin Zheng ◽  
Jiabin Wang ◽  
...  
Keyword(s):  
Cloud Computing ◽  
Mobile Networks ◽  
Edge Computing ◽  
Computation Offloading ◽  
Battery Life ◽  
Mobile Edge Computing ◽  
Service Adoption ◽  
Comprehensive Survey ◽  
And Storage ◽  
Execution Delay

Mobile cloud computing (MCC) integrates cloud computing (CC) into mobile networks, prolonging the battery life of the mobile users (MUs). However, this mode may cause significant execution delay. To address the delay issue, a new mode known as mobile edge computing (MEC) has been proposed. MEC provides computing and storage service for the edge of network, which enables MUs to execute applications efficiently and meet the delay requirements. In this paper, we present a comprehensive survey of the MEC research from the perspective of service adoption and provision. We first describe the overview of MEC, including the definition, architecture, and service of MEC. After that we review the existing MUs-oriented service adoption of MEC, i.e., offloading. More specifically, the study on offloading is divided into two key taxonomies: computation offloading and data offloading. In addition, each of them is further divided into single MU offloading scheme and multi-MU offloading scheme. Then we survey edge server- (ES-) oriented service provision, including technical indicators, ES placement, and resource allocation. In addition, other issues like applications on MEC and open issues are investigated. Finally, we conclude the paper.

Visual Attention Guided Object Detection and Tracking

2016 ◽  
pp. 99-114
Author(s):  
Debi Prosad Dogra
Keyword(s):  
Computer Vision ◽  
Object Recognition ◽  
Visual Attention ◽  
Visual Saliency ◽  
Video Object ◽  
Salient Region Detection ◽  
Region Detection ◽  
Video Object Tracking ◽  
Detection And Tracking ◽  
Pros And Cons

Scene understanding and object recognition heavily depend on the success of visual attention guided salient region detection in images and videos. Therefore, summarizing computer vision techniques that take the help of visual attention models to accomplish video object recognition and tracking, can be helpful to the researchers of computer vision community. In this chapter, it is aimed to present a philosophical overview of the possible applications of visual attention models in the context of object recognition and tracking. At the beginning of this chapter, a brief introduction to various visual saliency models suitable for object recognition is presented, that is followed by discussions on possible applications of attention models on video object tracking. The chapter also provides a commentary on the existing techniques available on this domain and discusses some of their possible extensions. It is believed that, prospective readers will benefit since the chapter comprehensively guides a reader to understand the pros and cons of this particular topic.

Sign in / Sign up

Export Citation Format

Share Document