scholarly journals A Novel Neural Network Model for Traffic Sign Detection and Recognition under Extreme Conditions

2021 ◽  
Vol 2021 ◽  
pp. 1-16
Author(s):  
Haifeng Wan ◽  
Lei Gao ◽  
Manman Su ◽  
Qinglong You ◽  
Hui Qu ◽  
...  

Traffic sign detection is extremely important in autonomous driving and transportation safety systems. However, the accurate detection of traffic signs remains challenging, especially under extreme conditions. This paper proposes a novel model called Traffic Sign Yolo (TS-Yolo) based on the convolutional neural network to improve the detection and recognition accuracy of traffic signs, especially under low visibility and extremely restricted vision conditions. A copy-and-paste data augmentation method was used to build a large number of new samples based on existing traffic-sign datasets. Based on You Only Look Once (YoloV5), the mixed depth-wise convolution (MixConv) was employed to mix different kernel sizes in a single convolution operation, so that different patterns with various resolutions can be captured. Furthermore, the attentional feature fusion (AFF) module was integrated to fuse the features based on attention from same-layer to cross-layer scenarios, including short and long skip connections, and even performing the initial fusion with itself. The experimental results demonstrated that, using the YoloV5 dataset with augmentation, the precision was 71.92, which was increased by 34.56 compared with the data without augmentation, and the mean average precision mAP_0.5 was 80.05, which was increased by 33.11 compared with the data without augmentation. When MixConv and AFF were applied to the TS-Yolo model, the precision was 74.53 and 2.61 higher than that with data augmentation only, and the value of mAP_0.5 was 83.73 and 3.68 higher than that based on the YoloV5 dataset with augmentation only. Overall, the performance of the proposed method was competitive with the latest traffic sign detection approaches.

Author(s):  
Kurniawan Nur Ramadhani ◽  
M.Syahrul Mubarok ◽  
Agnes Dirgahayu Palit

[Id]Kota-kota besar pasti tidak lepas dengan penggunaan rambu lalu lintas untuk meningkatkan keselamatan pengguna jalan. Rambu lalu lintas dirancang untuk pembantu pengemudi untuk mencapai tujuan mereka dengan aman, dengan menyediakan informasi rambu yang berguna. Meskipun demikian, hal yang tidak diinginkan dapat terjadi ketika informasi yang tersimpan pada rambu lalu lintas tidak diterima dengan baik pada pengguna jalan. Hal ini dapat menjadi masalah baru dalam keamanan berkendara. Dalam meminimalisasi masalah tersebut, dapat dibuat suatu teknologi yang mengembangkan sistem yang mengidentifikasi objek rambu lalu lintas secara otomatis yang dapat menjadi salah satu alternatif meningkatkan keselamatan berkendara, yaitu Traffic Sign Detection and Recognition (Sistem Deteksi dan Rekognisi Rambu Lalu Lintas). Sistem ini menggunakan menggunakan deteksi ciri warna dan bentuk. metode Histogram of Oriented Gradient (HOG) untuk ektraksi ciri citra bentuk, colour moment untuk ekstraksi warna dan Support Vector Machines (SVM) untuk mengklasifikasikan citra rambu lalu lintas. Sehingga dapat dianalisa bagaimana Sistem dapat mendeteksi dan mengenali citra yang merupakan objek rambu lalu lintas Diharapkan dengan adanya paduan metode-metode tersebut dapat membangun sistem deteksi dan rekognisi rambu lalu lintas, dan meningkat performansi sistem dalam mendeteksi dan mengenali rambu lalu lintas. Performansi yang dihasilkan dari sistem adalah 94.5946% menggunakan micro average f1-score.Kata kunci : ekstraksi ciri fitur, ekstraksi ciri warna, klasifikasi, HOG, colour moment, SVM, micro average f1-score.[En]The big cities must not be separated by the use of traffic signs to improve road safety. Traffic signs are designed to aide drivers to reach their destination safely, by providing useful information signs. Nonetheless, undesirable things can happen when information stored in the traffic signs are not received well on the road. It can be a new problem in road safety. In minimizing the problem, can be made of a technology that is developing a system that identifies an object traffic signs automatically which can be one alternative to improve driving safety, the Traffic Sign Detection and Recognition (Detection System and Traffic Sign Recognition). The system uses using the detection characteristics of colors and shapes. methods Histogram of Oriented Gradient (HOG) to extract image characteristic shape, color moment for the extraction of color and Support Vector Machines (SVM) to classify traffic signs image. So it can be analyzed how the system can detect and recognize the image which is the object of traffic signs Expected by the blend of these methods can build a system of detection and recognition of traffic signs, and increased system performance to detect and recognize traffic signs. Performasi generated in the system is 94.5946% using micro average f1-score.


IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 189855-189868
Author(s):  
Aleksej Avramovic ◽  
Davor Sluga ◽  
Domen Tabernik ◽  
Danijel Skocaj ◽  
Vladan Stojnic ◽  
...  

Author(s):  
Anju C P ◽  
Andria Joy ◽  
Haritha Ashok ◽  
Joseph Ronald Pious ◽  
Livya George

As placement of traffic sign board do not follow any international standard, it may be difficultfor non-local residents to recognize and infer the signs easily. So, this project mainly focuses ondemonstrating a system that can help facilitate this inconvenience. This can be achieved byinterpreting the traffic sign as a voice note in the user’s preferred language. Therefore, the wholeprocess involves detecting the traffic sign, detecting textual data if any with the help of availabledatasets and then processing it into an audio as the output to the user in his/her preferred language.The proposed system not only tackles the above-mentioned problem, but also to an extent ensuressafer driving by reducing accidents through conveying the traffic signs properly. The techniques usedto implement the system include digital image processing, natural language processing and machinelearning concepts. The implementation of the system includesthree major steps which are detection of traffic sign from a captured traffic scene, classification of traffic signs and finally conversion of classified traffic signs to audio message.


Author(s):  
Mr. Mohammad Shabbir Sheikh

Abstract: Now a days, automobiles became most convenient mode of transportation for everyone. As we know one of the most important functions, TSDR has become a popular research . It primarily involves the use of vehicle cameras to collect real- time road pictures and then recognize and identify traffic signs seen on the road, therefore delivering correct data to the driving system. With the advancement of science and technology, an increasing number of scholars are turning to deep learning technology to save time in traditional processes. From the training samples, this model can learn the deep features inside the autonomously. The accuracy and great efficiency of detection and identification are the subject of this essay. A deep convolution neural network algorithm is proposed to train traffic sign training sets using Caffe[3], an open-source framework, in order to obtain a model that can classify traffic signs and learn and identify the most critical of these traffic sign features, in order to achieve the goal of identifying traffic signs in the real world. Keywords: Traffic sign, Segmentation, Gabor filter, Traffic Sign Detection and Recognition (TSDR)


Sensors ◽  
2018 ◽  
Vol 18 (10) ◽  
pp. 3192 ◽  
Author(s):  
Faming Shao ◽  
Xinqing Wang ◽  
Fanjie Meng ◽  
Ting Rui ◽  
Dong Wang ◽  
...  

Traffic sign detection and recognition plays an important role in expert systems, such as traffic assistance driving systems and automatic driving systems. It instantly assists drivers or automatic driving systems in detecting and recognizing traffic signs effectively. In this paper, a novel approach for real-time traffic sign detection and recognition in a real traffic situation was proposed. First, the images of the road scene were converted to grayscale images, and then we filtered the grayscale images with simplified Gabor wavelets (SGW), where the parameters were optimized. The edges of the traffic signs were strengthened, which was helpful for the next stage of the process. Second, we extracted the region of interest using the maximally stable extremal regions algorithm and classified the superclass of traffic signs using the support vector machine (SVM). Finally, we used convolution neural networks with input by simplified Gabor feature maps, where the parameters were the same as the detection stage, to classify the traffic signs into their subclasses. The experimental results based on Chinese and German traffic sign databases showed that the proposed method obtained a comparable performance with the state-of-the-art method, and furthermore, the processing efficiency of the whole process of detection and classification was improved and met the real-time processing demands.


Author(s):  
Bhaumik Vaidya ◽  
Chirag Paunwala

Traffic sign recognition is a vital part for any driver assistance system which can help in making complex driving decision based on the detected traffic signs. Traffic sign detection (TSD) is essential in adverse weather conditions or when the vehicle is being driven on the hilly roads. Traffic sign recognition is a complex computer vision problem as generally the signs occupy a very small portion of the entire image. A lot of research is going on to solve this issue accurately but still it has not been solved till the satisfactory performance. The goal of this paper is to propose a deep learning architecture which can be deployed on embedded platforms for driver assistant system with limited memory and computing resources without sacrificing on detection accuracy. The architecture uses various architectural modification to the well-known Convolutional Neural Network (CNN) architecture for object detection. It uses a trainable Color Transformer Network (CTN) with the existing CNN architecture for making the system invariant to illumination and light changes. The architecture uses feature fusion module for detecting small traffic signs accurately. In the proposed work, receptive field calculation is used for choosing the number of convolutional layer for prediction and the right scales for default bounding boxes. The architecture is deployed on Jetson Nano GPU Embedded development board for performance evaluation at the edge and it has been tested on well-known German Traffic Sign Detection Benchmark (GTSDB) and Tsinghua-Tencent 100k dataset. The architecture only requires 11 MB for storage which is almost ten times better than the previous architectures. The architecture has one sixth parameters than the best performing architecture and 50 times less floating point operations per second (FLOPs). The architecture achieves running time of 220[Formula: see text]ms on desktop GPU and 578 ms on Jetson Nano which is also better compared to other similar implementation. It also achieves comparable accuracy in terms of mean average precision (mAP) for both the datasets.


Sign in / Sign up

Export Citation Format

Share Document