Road speed limit and height limit information extraction from traffic sign in street view images

doi:10.13474/j.cnki.11-2246.2025.0407

Abstract

Abstract: Aiming at the problem that the end-to-end detection model has poor effect on few-shot sample traffic signs,this paper constructs a method to firstly detect traffic signs in street view images and then extract the semantic information,as to update the speed limit and height limit attributes of the road where the sign is located. Firstly,the public sample dataset is integrated to train the detection model based on four typical networks. After comparison,the best Faster R-CNN is selected as the sign detection model.Then,the panoramic street view image is segmented to detect the speed limit and height limit signs in the sub-image.Finally,the PP-OCRv3 text detection model is combined to extract the speed limit and height limit values,and the results are cleaned by semantic constraints. The method in this paper is verified by using the public data of the transportation department,and the application experiment is carried out in Tainan city,Taiwan,China. The results show that this method is suitable for few-shotsample traffic signs,which can accurately extract speed limit and height limit information from street view images,and has application value in traffic sign management and speed limit and height limit road attribute verification and update.

Key words: road speed limit, road height limit, traffic sign, object detection, information extraction, street view image

CLC Number:

P237

JI Chen, LIU Lei, CAI Dong, CHENG Liang. Road speed limit and height limit information extraction from traffic sign in street view images[J]. Bulletin of Surveying and Mapping, 2025, 0(4): 39-44.

References

[1] 李德仁,洪勇,王密,等.测绘遥感能为智能驾驶做什么？[J].测绘学报,2021,50(11):1421-1431.
[2] 梁祺策.高精地图构建中交通标志牌检测与识别算法研究[D].北京:北京建筑大学,2022.
[3] 张帆,刘瑜.街景影像: 基于人工智能的方法与应用[J].遥感学报,2021,25(5):1043-1054.
[4] BILJECKI F,ITO K.Street view imagery in urban analytics and GIS:a review[J].Landscape and Urban Planning,2021,215:104217.
[5] CAMPBELL A,BOTH A,SUN Q.Detecting and mapping traffic signs from Google Street View images using deep learning and GIS[J].Computers,Environment and Urban Systems,2019,77:101350.
[6] 潘兴楠.基于街景影像的交通指路牌变化检测[D].北京:北京建筑大学,2020.
[7] HOUBEN S,STALLKAMP J,SALMEN J,et al.Detection of traffic signs in real-world images:The German traffic sign detection benchmark[C]//Proceedings of 2013 International Joint Conference on Neural Networks.Dallas:IEEE,2013.
[8] ZHU Zhe,LIANG Dun,ZHANG Songhai,et al.Traffic-sign detection and classification in the wild[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE,2016.
[9] MALETZKY A,HOFER N,THUMFART S,et al.Traffic sign detection and classification on the Austrian highway traffic sign data set[J].Data,2023,8(1):16.
[10] TABERNIK D,SKOCAJ D.Deep learning for large-scale traffic-sign detection and recognition[J].IEEE Transactions on Intelligent Transportation Systems,2020,21(4):1427-1440.
[11] ZHANG Yanting,WANG Ziheng,QI Yonggang,et al.CTSD:a dataset for traffic sign recognition in complex real-world images[C]//Proceedings of 2018 IEEE Visual Communications and Image Processing.Taichung:IEEE,2018.
[12] ERTLER C,MISLEJ J,OLLMANN T,et al.The mapillary traffic sign dataset for detection and classification on a global scale[M]//VEDALDI A,BISCHOF H,BROX T,et al.Lecture Notes in Computer Science.Cham:Springer International Publishing,2020:68-84.
[13] ATIF M,ZOPPI T,GHARIB M,et al.Towards enhancing traffic sign recognition through sliding windows[J].Sensors,2022,22(7):2683.
[14] MANZARI O N,BOUDESH A,SHOKOUHI S B.Pyramid transformer for traffic sign detection[C]//Proceedings of the 12th International Conference on Computer and Knowledge Engineering (ICCKE).Mashhad:IEEE,2022.
[15] BALALI V,RAD A A,GOLPARVAR-FARD M.Detection,classification,and mapping of U.S.traffic signs using google street view images for roadway inventory management[J].Visualization in Engineering,2015,3(1):1-18.
[16] LI Chenxia,LIU Weiwei,GUO Ruoyu,et al.PP-OCRv3:more attempts for the improvement of ultra lightweight OCR system[EB/OL].[2024-08-01].https://arxiv.org/abs/2206.03001v2.
[17] PADILLA R,PASSOS W L,DIAS T L B,et al.A comparative analysis of object detection metrics with a companion open-source toolkit[J].Electronics,2021,10(3):279.