scholarly journals LIDAR-INCORPORATED TRAFFIC SIGN DETECTION FROM VIDEO LOG IMAGES OF MOBILE MAPPING SYSTEM

2016 ◽  
Vol XLI-B1 ◽  
pp. 661-668 ◽  
Author(s):  
Y. Li ◽  
J. Fan ◽  
Y. Huang ◽  
Z. Chen
Keyword(s):  
Geometric Constraints ◽  
Transportation Infrastructure ◽  
Traffic Sign ◽  
Mobile Mapping ◽  
Traffic Signs ◽  
Mapping System ◽  
Sign Detection ◽  
Mobile Mapping System ◽  
Transportation Agencies ◽  
Traffic Sign Detection

Mobile Mapping System (MMS) simultaneously collects the Lidar points and video log images in a scenario with the laser profiler and digital camera. Besides the textural details of video log images, it also captures the 3D geometric shape of point cloud. It is widely used to survey the street view and roadside transportation infrastructure, such as traffic sign, guardrail, etc., in many transportation agencies. Although many literature on traffic sign detection are available, they only focus on either Lidar or imagery data of traffic sign. Based on the well-calibrated extrinsic parameters of MMS, 3D Lidar points are, the first time, incorporated into 2D video log images to enhance the detection of traffic sign both physically and visually. Based on the local elevation, the 3D pavement area is first located. Within a certain distance and height of the pavement, points of the overhead and roadside traffic signs can be obtained according to the setup specification of traffic signs in different transportation agencies. The 3D candidate planes of traffic signs are then fitted using the RANSAC plane-fitting of those points. By projecting the candidate planes onto the image, Regions of Interest (ROIs) of traffic signs are found physically with the geometric constraints between laser profiling and camera imaging. The Random forest learning of the visual color and shape features of traffic signs is adopted to validate the sign ROIs from the video log images. The sequential occurrence of a traffic sign among consecutive video log images are defined by the geometric constraint of the imaging geometry and GPS movement. Candidate ROIs are predicted in this temporal context to double-check the salient traffic sign among video log images. The proposed algorithm is tested on a diverse set of scenarios on the interstate highway G-4 near Beijing, China under varying lighting conditions and occlusions. Experimental results show the proposed algorithm enhances the rate of detecting traffic signs with the incorporation of the 3D planar constraint of their Lidar points. It is promising for the robust and large-scale survey of most transportation infrastructure with the application of MMS.

scholarly journals LIDAR-INCORPORATED TRAFFIC SIGN DETECTION FROM VIDEO LOG IMAGES OF MOBILE MAPPING SYSTEM

2016 ◽  
Vol XLI-B1 ◽  
pp. 661-668
Author(s):  
Y. Li ◽  
J. Fan ◽  
Y. Huang ◽  
Z. Chen
Keyword(s):  
Geometric Constraints ◽  
Transportation Infrastructure ◽  
Traffic Sign ◽  
Mobile Mapping ◽  
Traffic Signs ◽  
Mapping System ◽  
Sign Detection ◽  
Mobile Mapping System ◽  
Transportation Agencies ◽  
Traffic Sign Detection

Mobile Mapping System (MMS) simultaneously collects the Lidar points and video log images in a scenario with the laser profiler and digital camera. Besides the textural details of video log images, it also captures the 3D geometric shape of point cloud. It is widely used to survey the street view and roadside transportation infrastructure, such as traffic sign, guardrail, etc., in many transportation agencies. Although many literature on traffic sign detection are available, they only focus on either Lidar or imagery data of traffic sign. Based on the well-calibrated extrinsic parameters of MMS, 3D Lidar points are, the first time, incorporated into 2D video log images to enhance the detection of traffic sign both physically and visually. Based on the local elevation, the 3D pavement area is first located. Within a certain distance and height of the pavement, points of the overhead and roadside traffic signs can be obtained according to the setup specification of traffic signs in different transportation agencies. The 3D candidate planes of traffic signs are then fitted using the RANSAC plane-fitting of those points. By projecting the candidate planes onto the image, Regions of Interest (ROIs) of traffic signs are found physically with the geometric constraints between laser profiling and camera imaging. The Random forest learning of the visual color and shape features of traffic signs is adopted to validate the sign ROIs from the video log images. The sequential occurrence of a traffic sign among consecutive video log images are defined by the geometric constraint of the imaging geometry and GPS movement. Candidate ROIs are predicted in this temporal context to double-check the salient traffic sign among video log images. The proposed algorithm is tested on a diverse set of scenarios on the interstate highway G-4 near Beijing, China under varying lighting conditions and occlusions. Experimental results show the proposed algorithm enhances the rate of detecting traffic signs with the incorporation of the 3D planar constraint of their Lidar points. It is promising for the robust and large-scale survey of most transportation infrastructure with the application of MMS.

scholarly journals Novel Approach to Automatic Traffic Sign Inventory Based on Mobile Mapping System Data and Deep Learning

2020 ◽  
Vol 12 (3) ◽  
pp. 442 ◽  
Author(s):  
Jesús Balado ◽  
Elena González ◽  
Pedro Arias ◽  
David Castro
Keyword(s):  
False Positive Rate ◽  
Good Condition ◽  
Point Clouds ◽  
Traffic Sign ◽  
Mobile Mapping ◽  
Traffic Signs ◽  
Novel Approach ◽  
Mapping System ◽  
Positive Rate ◽  
Mobile Mapping System

Traffic signs are a key element in driver safety. Governments invest a great amount of resources in maintaining the traffic signs in good condition, for which a correct inventory is necessary. This work presents a novel method for mapping traffic signs based on data acquired with MMS (Mobile Mapping System): images and point clouds. On the one hand, images are faster to process and artificial intelligence techniques, specifically Convolutional Neural Networks, are more optimized than in point clouds. On the other hand, point clouds allow a more exact positioning than the exclusive use of images. The false positive rate per image is only 0.004. First, traffic signs are detected in the images obtained by the 360° camera of the MMS through RetinaNet and they are classified by their corresponding InceptionV3 network. The signs are then positioned in the georeferenced point cloud by means of a projection according to the pinhole model from the images. Finally, duplicate geolocalized signs detected in multiple images are filtered. The method has been tested in two real case studies with 214 images, where 89.7% of the signals have been correctly detected, of which 92.5% have been correctly classified and 97.5% have been located with an error of less than 0.5 m. This sequence, which combines images to detection–classification, and point clouds to geo-referencing, in this order, optimizes processing time and allows this method to be included in a company’s production process. The method is conducted automatically and takes advantage of the strengths of each data type.

scholarly journals FAST DRAWING OF TRAFFIC SIGN USING MOBILE MAPPING SYSTEM

2016 ◽  
Vol XLI-B3 ◽  
pp. 937-944
Author(s):  
Q. Yao ◽  
B. Tan ◽  
Y. Huang
Keyword(s):  
Asset Management ◽  
Large Scale ◽  
Rare Event ◽  
Drawing Process ◽  
Traffic Sign ◽  
Mobile Mapping ◽  
Traffic Signs ◽  
Mapping System ◽  
Mobile Mapping System ◽  
Anchor Points

Traffic sign provides road users with the specified instruction and information to enhance traffic safety. Automatic detection of traffic sign is important for navigation, autonomous driving, transportation asset management, etc. With the advance of laser and imaging sensors, Mobile Mapping System (MMS) becomes widely used in transportation agencies to map the transportation infrastructure. Although many algorithms of traffic sign detection are developed in the literature, they are still a tradeoff between the detection speed and accuracy, especially for the large-scale mobile mapping of both the rural and urban roads. This paper is motivated to efficiently survey traffic signs while mapping the road network and the roadside landscape. Inspired by the manual delineation of traffic sign, a drawing strategy is proposed to quickly approximate the boundary of traffic sign. Both the shape and color prior of the traffic sign are simultaneously involved during the drawing process. The most common speed-limit sign circle and the statistic color model of traffic sign are studied in this paper. Anchor points of traffic sign edge are located with the local maxima of color and gradient difference. Starting with the anchor points, contour of traffic sign is drawn smartly along the most significant direction of color and intensity consistency. The drawing process is also constrained by the curvature feature of the traffic sign circle. The drawing of linear growth is discarded immediately if it fails to form an arc over some steps. The Kalman filter principle is adopted to predict the temporal context of traffic sign. Based on the estimated point,we can predict and double check the traffic sign in consecutive frames.The event probability of having a traffic sign over the consecutive observations is compared with the null hypothesis of no perceptible traffic sign. The temporally salient traffic sign is then detected statistically and automatically as the rare event of having a traffic sign.The proposed algorithm is tested with a diverse set of images that are taken inWuhan, China with theMMS ofWuhan University. Experimental results demonstrate that the proposed algorithm can detect traffic signs at the rate of over 80% in around 10 milliseconds. It is promising for the large-scale traffic sign survey and change detection using the mobile mapping system.

scholarly journals FAST DRAWING OF TRAFFIC SIGN USING MOBILE MAPPING SYSTEM

2016 ◽  
Vol XLI-B3 ◽  
pp. 937-944
Author(s):  
Q. Yao ◽  
B. Tan ◽  
Y. Huang
Keyword(s):  
Asset Management ◽  
Large Scale ◽  
Rare Event ◽  
Drawing Process ◽  
Traffic Sign ◽  
Mobile Mapping ◽  
Traffic Signs ◽  
Mapping System ◽  
Mobile Mapping System ◽  
Anchor Points

Traffic sign provides road users with the specified instruction and information to enhance traffic safety. Automatic detection of traffic sign is important for navigation, autonomous driving, transportation asset management, etc. With the advance of laser and imaging sensors, Mobile Mapping System (MMS) becomes widely used in transportation agencies to map the transportation infrastructure. Although many algorithms of traffic sign detection are developed in the literature, they are still a tradeoff between the detection speed and accuracy, especially for the large-scale mobile mapping of both the rural and urban roads. This paper is motivated to efficiently survey traffic signs while mapping the road network and the roadside landscape. Inspired by the manual delineation of traffic sign, a drawing strategy is proposed to quickly approximate the boundary of traffic sign. Both the shape and color prior of the traffic sign are simultaneously involved during the drawing process. The most common speed-limit sign circle and the statistic color model of traffic sign are studied in this paper. Anchor points of traffic sign edge are located with the local maxima of color and gradient difference. Starting with the anchor points, contour of traffic sign is drawn smartly along the most significant direction of color and intensity consistency. The drawing process is also constrained by the curvature feature of the traffic sign circle. The drawing of linear growth is discarded immediately if it fails to form an arc over some steps. The Kalman filter principle is adopted to predict the temporal context of traffic sign. Based on the estimated point,we can predict and double check the traffic sign in consecutive frames.The event probability of having a traffic sign over the consecutive observations is compared with the null hypothesis of no perceptible traffic sign. The temporally salient traffic sign is then detected statistically and automatically as the rare event of having a traffic sign.The proposed algorithm is tested with a diverse set of images that are taken inWuhan, China with theMMS ofWuhan University. Experimental results demonstrate that the proposed algorithm can detect traffic signs at the rate of over 80% in around 10 milliseconds. It is promising for the large-scale traffic sign survey and change detection using the mobile mapping system.

The Traffic Sign Detection Algorithm Based on Region of Interest Extraction and Double Filter

2019 ◽  
Vol 13 ◽  
Author(s):  
Dongxian Yu ◽  
Jiatao Kang ◽  
Zaihui Cao ◽  
Neha Jain
Keyword(s):  
Region Of Interest ◽  
Detection Algorithm ◽  
Light Filter ◽  
Support Vector ◽  
Detection Accuracy ◽  
Traffic Light ◽  
Traffic Sign ◽  
Traffic Signs ◽  
Sign Detection ◽  
Traffic Sign Detection

In order to solve the current traffic sign detection technology due to the interference of various complex factors, it is difficult to effectively carry out the correct detection of traffic signs, and the robustness is weak, a traffic sign detection algorithm based on the region of interest extraction and double filter is designed.First, in order to reduce environmental interference, the input image is preprocessed to enhance the main color of each logo.Secondly, in order to improve the extraction ability Of Regions Of Interest, a Region Of Interest (ROI) detector based on Maximally Stable Extremal Regions (MSER) and Wave Equation (WE) was defined, and candidate Regions were selected through the ROI detector.Then, an effective HOG (Histogram of Oriented Gradient) descriptor is introduced as the detection feature of traffic signs, and SVM (Support Vector Machine) is used to classify them into traffic signs or background.Finally, the context-aware filter and the traffic light filter are used to further identify the false traffic signs and improve the detection accuracy.In the GTSDB database, three kinds of traffic signs, which are indicative, prohibited and dangerous, are tested, and the results show that the proposed algorithm has higher detection accuracy and robustness compared with the current traffic sign recognition technology.

DETEKSI DAN REKOGNISI RAMBU-RAMBU LALU LINTAS DENGAN MENGGUNAKAN METODE SUPPORT VECTOR MACHINE

2017 ◽  
Vol 3 (2) ◽  
Author(s):  
Kurniawan Nur Ramadhani ◽  
M.Syahrul Mubarok ◽  
Agnes Dirgahayu Palit
Keyword(s):  
Support Vector Machines ◽  
Road Safety ◽  
Support Vector ◽  
Traffic Sign ◽  
Traffic Signs ◽  
Histogram Of Oriented Gradient ◽  
Vector Machines ◽  
Sign Detection ◽  
Traffic Sign Detection ◽  
Detection And Recognition

[Id]Kota-kota besar pasti tidak lepas dengan penggunaan rambu lalu lintas untuk meningkatkan keselamatan pengguna jalan. Rambu lalu lintas dirancang untuk pembantu pengemudi untuk mencapai tujuan mereka dengan aman, dengan menyediakan informasi rambu yang berguna. Meskipun demikian, hal yang tidak diinginkan dapat terjadi ketika informasi yang tersimpan pada rambu lalu lintas tidak diterima dengan baik pada pengguna jalan. Hal ini dapat menjadi masalah baru dalam keamanan berkendara. Dalam meminimalisasi masalah tersebut, dapat dibuat suatu teknologi yang mengembangkan sistem yang mengidentifikasi objek rambu lalu lintas secara otomatis yang dapat menjadi salah satu alternatif meningkatkan keselamatan berkendara, yaitu Traffic Sign Detection and Recognition (Sistem Deteksi dan Rekognisi Rambu Lalu Lintas). Sistem ini menggunakan menggunakan deteksi ciri warna dan bentuk. metode Histogram of Oriented Gradient (HOG) untuk ektraksi ciri citra bentuk, colour moment untuk ekstraksi warna dan Support Vector Machines (SVM) untuk mengklasifikasikan citra rambu lalu lintas. Sehingga dapat dianalisa bagaimana Sistem dapat mendeteksi dan mengenali citra yang merupakan objek rambu lalu lintas Diharapkan dengan adanya paduan metode-metode tersebut dapat membangun sistem deteksi dan rekognisi rambu lalu lintas, dan meningkat performansi sistem dalam mendeteksi dan mengenali rambu lalu lintas. Performansi yang dihasilkan dari sistem adalah 94.5946% menggunakan micro average f1-score.Kata kunci : ekstraksi ciri fitur, ekstraksi ciri warna, klasifikasi, HOG, colour moment, SVM, micro average f1-score.[En]The big cities must not be separated by the use of traffic signs to improve road safety. Traffic signs are designed to aide drivers to reach their destination safely, by providing useful information signs. Nonetheless, undesirable things can happen when information stored in the traffic signs are not received well on the road. It can be a new problem in road safety. In minimizing the problem, can be made of a technology that is developing a system that identifies an object traffic signs automatically which can be one alternative to improve driving safety, the Traffic Sign Detection and Recognition (Detection System and Traffic Sign Recognition). The system uses using the detection characteristics of colors and shapes. methods Histogram of Oriented Gradient (HOG) to extract image characteristic shape, color moment for the extraction of color and Support Vector Machines (SVM) to classify traffic signs image. So it can be analyzed how the system can detect and recognize the image which is the object of traffic signs Expected by the blend of these methods can build a system of detection and recognition of traffic signs, and increased system performance to detect and recognize traffic signs. Performasi generated in the system is 94.5946% using micro average f1-score.

Synthetic Traffic Signs Dataset for Traffic Sign Detection & Recognition In Distributed Smart Systems

2021 ◽  
Author(s):  
Ilias Siniosoglou ◽  
Panagiotis Sarigiannidis ◽  
Yannis Spyridis ◽  
Anish Khadka ◽  
Georgios Efstathopoulos ◽  
...  
Keyword(s):  
Traffic Sign ◽  
Traffic Signs ◽  
Smart Systems ◽  
Sign Detection ◽  
Traffic Sign Detection

scholarly journals REAL OBJECT DETECTION SYSTEM FOR IRAQ TRAFFIC SIGNS BASED ON MASK R-CNN

2021 ◽  
Vol 4 (3) ◽  
pp. 12-22
Author(s):  
Ammar A. Aggar ◽  
Mohammed J. Zaiter ◽  
Abdalrazak T. Raheem
Keyword(s):  
Object Detection ◽  
Detection System ◽  
Traffic Sign ◽  
Traffic Signs ◽  
Timely Response ◽  
Sign Detection ◽  
Weak Light ◽  
Real Video ◽  
Important Object ◽  
Traffic Sign Detection

Traffic signs object detection has gained great interest in recent years, as one of the most important object detector applications. Traffic signs detection is based on deep learning, which gives it the benefit of high detection precision and timely response to condition changes of the traffic. Therefore, this paper shows an efficient method for detecting traffic signs in real-time. Hence, it implements a new Iraqi Traffic Sign Detection Benchmark (IQTSDB) dataset based on Mask Region-based Convolutional Neural Network (Mask R-CNN). The results show that the implementation of IQTSDB dataset with Mask R-CNN has a great efficiency in different conditions such as sunny, cloudy, weak light, and rainy conditions. In addition, the real video captured for traffic signs in Baghdad has been taken and compared to the German Traffic Signs Detection Benchmark (GTSDB) dataset. The IQTSDB dataset has a better performance than GTSDB dataset based on the performance parameters training loss and mean Average Precision (mAP).

Sign in / Sign up

Export Citation Format

Share Document