scholarly journals A Hard Example Mining Approach for Concealed Multi-Object Detection of Active Terahertz Image

2021 ◽  
Vol 11 (23) ◽  
pp. 11241
Author(s):  
Ling Li ◽  
Fei Xue ◽  
Dong Liang ◽  
Xiaofei Chen
Keyword(s):  
Computer Vision ◽  
Object Detection ◽  
State Of The Art ◽  
Terahertz Imaging ◽  
Public Security ◽  
Counter Terrorism ◽  
Detection Algorithms ◽  
Public Dataset ◽  
The One ◽  
Objects Detection

Concealed objects detection in terahertz imaging is an urgent need for public security and counter-terrorism. So far, there is no public terahertz imaging dataset for the evaluation of objects detection algorithms. This paper provides a public dataset for evaluating multi-object detection algorithms in active terahertz imaging. Due to high sample similarity and poor imaging quality, object detection on this dataset is much more difficult than on those commonly used public object detection datasets in the computer vision field. Since the traditional hard example mining approach is designed based on the two-stage detector and cannot be directly applied to the one-stage detector, this paper designs an image-based Hard Example Mining (HEM) scheme based on RetinaNet. Several state-of-the-art detectors, including YOLOv3, YOLOv4, FRCN-OHEM, and RetinaNet, are evaluated on this dataset. Experimental results show that the RetinaNet achieves the best mAP and HEM further enhances the performance of the model. The parameters affecting the detection metrics of individual images are summarized and analyzed in the experiments.

scholarly journals A Fast Orientation Invariant Detector Based on the One-stage Method

2018 ◽  
Vol 232 ◽  
pp. 04036
Author(s):  
Jun Yin ◽  
Huadong Pan ◽  
Hui Su ◽  
Zhonggeng Liu ◽  
Zhirong Peng
Keyword(s):  
Object Detection ◽  
Loss Function ◽  
High Efficiency ◽  
Detection Method ◽  
State Of The Art ◽  
Orientation Angle ◽  
Detection Methods ◽  
Detection Algorithms ◽  
Bounding Boxes ◽  
The One

We propose an object detection method that predicts the orientation bounding boxes (OBB) to estimate objects locations, scales and orientations based on YOLO (You Only Look Once), which is one of the top detection algorithms performing well both in accuracy and speed. Horizontal bounding boxes(HBB), which are not robust to orientation variances, are used in the existing object detection methods to detect targets. The proposed orientation invariant YOLO (OIYOLO) detector can effectively deal with the bird’s eye viewpoint images where the orientation angles of the objects are arbitrary. In order to estimate the rotated angle of objects, we design a new angle loss function. Therefore, the training of OIYOLO forces the network to learn the annotated orientation angle of objects, making OIYOLO orientation invariances. The proposed approach that predicts OBB can be applied in other detection frameworks. In additional, to evaluate the proposed OIYOLO detector, we create an UAV-DAHUA datasets that annotated with objects locations, scales and orientation angles accurately. Extensive experiments conducted on UAV-DAHUA and DOTA datasets demonstrate that OIYOLO achieves state-of-the-art detection performance with high efficiency comparing with the baseline YOLO algorithms.

scholarly journals Object Detectors’ Convolutional Neural Networks backbones : a review and a comparative study

2021 ◽  
Vol 9 (11) ◽  
pp. 1379-1386
Keyword(s):  
Neural Networks ◽  
Computer Vision ◽  
Object Detection ◽  
Convolutional Neural Networks ◽  
Crucial Role ◽  
Extended Version ◽  
Backbone Networks ◽  
Detection Algorithms ◽  
Wide Range

Computer vision is a scientific field that deals with how computers can acquire significant level comprehension from computerized images or videos. One of the keystones of computer vision is object detection that aims to identify relevant features from video or image to detect objects. Backbone is the first stage in object detection algorithms that play a crucial role in object detection. Object detectors are usually provided with backbone networks designed for image classification. Object detection performance is highly based on features extracted by backbones, for instance, by simply replacing a backbone with its extended version, a large accuracy metric grows up. Additionally, the backbone's importance is demonstrated by its efficiency in real-time object detection. In this paper, we aim to accumulate the crucial role of the deep learning era and convolutional neural networks in particular in object detection tasks. We have analyzed and have been concentrating on a wide range of reviews on convolutional neural networks used as the backbone of object detection models. Building, therefore, a review of backbones that help researchers and scientists to use it as a guideline for their works.

scholarly journals PI-RCNN: An Efficient Multi-Sensor 3D Object Detector with Point-Based Attentive Cont-Conv Fusion Module

2020 ◽  
Vol 34 (07) ◽  
pp. 12460-12467
Author(s):  
Liang Xie ◽  
Chao Xiang ◽  
Zhengxu Yu ◽  
Guodong Xu ◽  
Zheng Yang ◽  
...  
Keyword(s):  
Object Detection ◽  
State Of The Art ◽  
Point Clouds ◽  
Semantic Features ◽  
Feature Maps ◽  
3D Object ◽  
Detection Algorithms ◽  
Full Resolution ◽  
Fusion Methods ◽  
3D Object Detection

LIDAR point clouds and RGB-images are both extremely essential for 3D object detection. So many state-of-the-art 3D detection algorithms dedicate in fusing these two types of data effectively. However, their fusion methods based on Bird's Eye View (BEV) or voxel format are not accurate. In this paper, we propose a novel fusion approach named Point-based Attentive Cont-conv Fusion(PACF) module, which fuses multi-sensor features directly on 3D points. Except for continuous convolution, we additionally add a Point-Pooling and an Attentive Aggregation to make the fused features more expressive. Moreover, based on the PACF module, we propose a 3D multi-sensor multi-task network called Pointcloud-Image RCNN(PI-RCNN as brief), which handles the image segmentation and 3D object detection tasks. PI-RCNN employs a segmentation sub-network to extract full-resolution semantic feature maps from images and then fuses the multi-sensor features via powerful PACF module. Beneficial from the effectiveness of the PACF module and the expressive semantic features from the segmentation module, PI-RCNN can improve much in 3D object detection. We demonstrate the effectiveness of the PACF module and PI-RCNN on the KITTI 3D Detection benchmark, and our method can achieve state-of-the-art on the metric of 3D AP.

Machine learning using synthetic images for detecting dust emissions on construction sites

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Ruoxin Xiong ◽  
Pingbo Tang
Keyword(s):  
Object Detection ◽  
Real World ◽  
State Of The Art ◽  
Synthetic Image ◽  
Single Shot ◽  
Construction Sites ◽  
Content Type ◽  
Detection Algorithms ◽  
Dust Detection ◽  
Synthetic Images

PurposeAutomated dust monitoring in workplaces helps provide timely alerts to over-exposed workers and effective mitigation measures for proactive dust control. However, the cluttered nature of construction sites poses a practical challenge to obtain enough high-quality images in the real world. The study aims to establish a framework that overcomes the challenges of lacking sufficient imagery data (“data-hungry problem”) for training computer vision algorithms to monitor construction dust.Design/methodology/approachThis study develops a synthetic image generation method that incorporates virtual environments of construction dust for producing training samples. Three state-of-the-art object detection algorithms, including Faster-RCNN, you only look once (YOLO) and single shot detection (SSD), are trained using solely synthetic images. Finally, this research provides a comparative analysis of object detection algorithms for real-world dust monitoring regarding the accuracy and computational efficiency.FindingsThis study creates a construction dust emission (CDE) dataset consisting of 3,860 synthetic dust images as the training dataset and 1,015 real-world images as the testing dataset. The YOLO-v3 model achieves the best performance with a 0.93 F1 score and 31.44 fps among all three object detection models. The experimental results indicate that training dust detection algorithms with only synthetic images can achieve acceptable performance on real-world images.Originality/valueThis study provides insights into two questions: (1) how synthetic images could help train dust detection models to overcome data-hungry problems and (2) how well state-of-the-art deep learning algorithms can detect nonrigid construction dust.

scholarly journals Survey and Performance Analysis of Object Detection in Challenging Environments

2021 ◽  
Author(s):  
Muhammad Ahmed ◽  
Khurram Azeem Hashmi ◽  
Alain Pagani ◽  
Marcus Liwicki ◽  
Didier Stricker ◽  
...  
Keyword(s):  
Performance Analysis ◽  
Object Detection ◽  
State Of The Art ◽  
Detection System ◽  
Rapid Development ◽  
Background Information ◽  
Comprehensive Overview ◽  
Detection Algorithms ◽  
And Performance ◽  
Qualitative Performance

Recent progress in deep learning has led to accurate and efficient generic object detection networks. Training of highly reliable models depends on large datasets with highly textured and rich images. However, in real-world scenarios, the performance of the generic object detection system decreases when (i) occlusions hide the objects, (ii) objects are present in low-light images, or (iii) they are merged with background information. In this paper, we refer to all these situations as challenging environments. With the recent rapid development in generic object detection algorithms, notable progress has been observed in the field of object detection in challenging environments. However, there is no consolidated reference to cover state-of-the-art in this domain. To the best of our knowledge, this paper presents the first comprehensive overview, covering recent approaches that have tackled the problem of object detection in challenging environments. Furthermore, we present the quantitative and qualitative performance analysis of these approaches and discuss the currently available challenging datasets. Moreover, this paper investigates the performance of current state-of-the-art generic object detection algorithms by benchmarking results on the three well-known challenging datasets. Finally, we highlight several current shortcomings and outline future directions.

scholarly journals Towards Robust Object Detection in Floor Plan Images: A Data Augmentation Approach

2021 ◽  
Vol 11 (23) ◽  
pp. 11174
Author(s):  
Shashank Mishra ◽  
Khurram Azeem Hashmi ◽  
Alain Pagani ◽  
Marcus Liwicki ◽  
Didier Stricker ◽  
...  
Keyword(s):  
Computer Vision ◽  
Object Detection ◽  
Data Augmentation ◽  
State Of The Art ◽  
Floor Plan ◽  
Previous State ◽  
Floor Plans ◽  
Better Than

Object detection is one of the most critical tasks in the field of Computer vision. This task comprises identifying and localizing an object in the image. Architectural floor plans represent the layout of buildings and apartments. The floor plans consist of walls, windows, stairs, and other furniture objects. While recognizing floor plan objects is straightforward for humans, automatically processing floor plans and recognizing objects is challenging. In this work, we investigate the performance of the recently introduced Cascade Mask R-CNN network to solve object detection in floor plan images. Furthermore, we experimentally establish that deformable convolution works better than conventional convolutions in the proposed framework. Prior datasets for object detection in floor plan images are either publicly unavailable or contain few samples. We introduce SFPI, a novel synthetic floor plan dataset consisting of 10,000 images to address this issue. Our proposed method conveniently exceeds the previous state-of-the-art results on the SESYD dataset with an mAP of 98.1%. Moreover, it sets impressive baseline results on our novel SFPI dataset with an mAP of 99.8%. We believe that introducing the modern dataset enables the researcher to enhance the research in this domain.

OBJECTS DETECTION FROM AN IMAGE USING MATLAB

2020 ◽  
Vol 70 (4) ◽  
Author(s):  
Sherif Sherif ◽  
Jordan Kralev ◽  
Tsonyo Slavov
Keyword(s):  
Machine Learning ◽  
Computer Vision ◽  
Embedded Systems ◽  
Object Detection ◽  
Color Space ◽  
Detection Algorithm ◽  
Color Space Conversion ◽  
Intensity Images ◽  
Objects Detection

Objects detection from a cluttered scene is one of the main tasks in computer vision. A lot of research has focused on the optimization of this process by using machine learning, where creating algorithms with specific instructions for solving a problem is not applicable. Most of embedded systems for detection object are based on algorithms using monochrome (intensity) images. Therefore, in the article are created models for color space conversion from images and the main stages of the object detection algorithm are discussed, as well as the functions through which this is done in MATLAB.

scholarly journals Improving Deep Object Detection Algorithms for Game Scenes

Electronics ◽  
2021 ◽  
Vol 10 (20) ◽  
pp. 2527
Author(s):  
Minji Jung ◽  
Heekyung Yang ◽  
Kyungha Min
Keyword(s):  
Computer Vision ◽  
Object Detection ◽  
Real World ◽  
Computer Games ◽  
Recognition Performance ◽  
Role Playing ◽  
Scene Analysis ◽  
Research Topics ◽  
The Real ◽  
Detection Algorithms

The advancement and popularity of computer games make game scene analysis one of the most interesting research topics in the computer vision society. Among the various computer vision techniques, we employ object detection algorithms for the analysis, since they can both recognize and localize objects in a scene. However, applying the existing object detection algorithms for analyzing game scenes does not guarantee a desired performance, since the algorithms are trained using datasets collected from the real world. In order to achieve a desired performance for analyzing game scenes, we built a dataset by collecting game scenes and retrained the object detection algorithms pre-trained with the datasets from the real world. We selected five object detection algorithms, namely YOLOv3, Faster R-CNN, SSD, FPN and EfficientDet, and eight games from various game genres including first-person shooting, role-playing, sports, and driving. PascalVOC and MS COCO were employed for the pre-training of the object detection algorithms. We proved the improvement in the performance that comes from our strategy in two aspects: recognition and localization. The improvement in recognition performance was measured using mean average precision (mAP) and the improvement in localization using intersection over union (IoU).

Sign in / Sign up

Export Citation Format

Share Document