街景影像交通标志牌限速限高信息提取

doi:10.13474/j.cnki.11-2246.2025.0407

测绘通报 ›› 2025, Vol. 0 ›› Issue (4): 39-44.doi: 10.13474/j.cnki.11-2246.2025.0407

• 学术研究 • 上一篇

街景影像交通标志牌限速限高信息提取

季辰^1,2, 刘磊¹, 蔡栋^3,4, 程亮^1,2

1. 南京大学地理与海洋科学学院, 江苏南京 210023;
2. 江苏省地理信息技术重点实验室, 江苏南京 210023;
3. 江苏警官学院, 江苏南京 210031;
4. 警用地理信息技术公安部重点实验室, 江苏南京 210031

收稿日期:2024-08-12 发布日期:2025-04-28
通讯作者: 蔡栋。E-mail:caidong@jspi.cn
作者简介:季辰(1990—),男,博士,助理研究员,主要从事地理信息分析方面研究工作。E-mail:gisjc@nju.edu.cn
基金资助:
天基综合信息系统重点实验室基金(HLJGXQ20220916032);国家自然科学基金(42401548)

Road speed limit and height limit information extraction from traffic sign in street view images

JI Chen^1,2, LIU Lei¹, CAI Dong^3,4, CHENG Liang^1,2

1. School of Geography and Ocean Science, Nanjing University, Nanjing 210023, China;
2. Jiangsu Provincial Key Laboratory of Geographic Information Science and Technology, Nanjing 210023, China;
3. Jiangsu Police Institute, Nanjing 210031, China;
4. Key Laboratory of Police Geographic Information Technology, Ministry of Public Security, Nanjing 210031, China

Received:2024-08-12 Published:2025-04-28

摘要/Abstract

摘要： 针对端到端识别模型对样本稀疏交通标志牌识别效果差的问题,本文构建了一种在街景影像中先检测交通标志牌,再提取限速限高语义信息的方法,以实现对标志牌所在道路限速限高属性的更新。首先,融合公开样本数据集,训练基于4种典型网络的检测模型,对比选用效果最佳的Faster R-CNN作为标志牌检测模型;然后,分割全景街景影像,在子图像中检测限速限高标志牌;最后,引入PP-OCRv3文字识别模型提取限速限高值,并通过语义约束清洗结果。结合交通运输部门公开数据,对本文方法进行测试,并在中国台湾省台南市开展应用试验。结果表明,该方法适用于样本稀疏的限速限高标志牌,能从街景影像中准确提取限速限高信息,对交通标志牌管理和限速限高道路属性校验更新具有应用价值。

关键词: 道路限速, 道路限高, 交通标志牌, 目标检测, 信息提取, 街景影像

Abstract: Aiming at the problem that the end-to-end detection model has poor effect on few-shot sample traffic signs,this paper constructs a method to firstly detect traffic signs in street view images and then extract the semantic information,as to update the speed limit and height limit attributes of the road where the sign is located. Firstly,the public sample dataset is integrated to train the detection model based on four typical networks. After comparison,the best Faster R-CNN is selected as the sign detection model.Then,the panoramic street view image is segmented to detect the speed limit and height limit signs in the sub-image.Finally,the PP-OCRv3 text detection model is combined to extract the speed limit and height limit values,and the results are cleaned by semantic constraints. The method in this paper is verified by using the public data of the transportation department,and the application experiment is carried out in Tainan city,Taiwan,China. The results show that this method is suitable for few-shotsample traffic signs,which can accurately extract speed limit and height limit information from street view images,and has application value in traffic sign management and speed limit and height limit road attribute verification and update.

Key words: road speed limit, road height limit, traffic sign, object detection, information extraction, street view image

中图分类号:

P237

季辰, 刘磊, 蔡栋, 程亮. 街景影像交通标志牌限速限高信息提取[J]. 测绘通报, 2025, 0(4): 39-44.

JI Chen, LIU Lei, CAI Dong, CHENG Liang. Road speed limit and height limit information extraction from traffic sign in street view images[J]. Bulletin of Surveying and Mapping, 2025, 0(4): 39-44.

参考文献

[1] 李德仁,洪勇,王密,等.测绘遥感能为智能驾驶做什么？[J].测绘学报,2021,50(11):1421-1431.
[2] 梁祺策.高精地图构建中交通标志牌检测与识别算法研究[D].北京:北京建筑大学,2022.
[3] 张帆,刘瑜.街景影像: 基于人工智能的方法与应用[J].遥感学报,2021,25(5):1043-1054.
[4] BILJECKI F,ITO K.Street view imagery in urban analytics and GIS:a review[J].Landscape and Urban Planning,2021,215:104217.
[5] CAMPBELL A,BOTH A,SUN Q.Detecting and mapping traffic signs from Google Street View images using deep learning and GIS[J].Computers,Environment and Urban Systems,2019,77:101350.
[6] 潘兴楠.基于街景影像的交通指路牌变化检测[D].北京:北京建筑大学,2020.
[7] HOUBEN S,STALLKAMP J,SALMEN J,et al.Detection of traffic signs in real-world images:The German traffic sign detection benchmark[C]//Proceedings of 2013 International Joint Conference on Neural Networks.Dallas:IEEE,2013.
[8] ZHU Zhe,LIANG Dun,ZHANG Songhai,et al.Traffic-sign detection and classification in the wild[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE,2016.
[9] MALETZKY A,HOFER N,THUMFART S,et al.Traffic sign detection and classification on the Austrian highway traffic sign data set[J].Data,2023,8(1):16.
[10] TABERNIK D,SKOCAJ D.Deep learning for large-scale traffic-sign detection and recognition[J].IEEE Transactions on Intelligent Transportation Systems,2020,21(4):1427-1440.
[11] ZHANG Yanting,WANG Ziheng,QI Yonggang,et al.CTSD:a dataset for traffic sign recognition in complex real-world images[C]//Proceedings of 2018 IEEE Visual Communications and Image Processing.Taichung:IEEE,2018.
[12] ERTLER C,MISLEJ J,OLLMANN T,et al.The mapillary traffic sign dataset for detection and classification on a global scale[M]//VEDALDI A,BISCHOF H,BROX T,et al.Lecture Notes in Computer Science.Cham:Springer International Publishing,2020:68-84.
[13] ATIF M,ZOPPI T,GHARIB M,et al.Towards enhancing traffic sign recognition through sliding windows[J].Sensors,2022,22(7):2683.
[14] MANZARI O N,BOUDESH A,SHOKOUHI S B.Pyramid transformer for traffic sign detection[C]//Proceedings of the 12th International Conference on Computer and Knowledge Engineering (ICCKE).Mashhad:IEEE,2022.
[15] BALALI V,RAD A A,GOLPARVAR-FARD M.Detection,classification,and mapping of U.S.traffic signs using google street view images for roadway inventory management[J].Visualization in Engineering,2015,3(1):1-18.
[16] LI Chenxia,LIU Weiwei,GUO Ruoyu,et al.PP-OCRv3:more attempts for the improvement of ultra lightweight OCR system[EB/OL].[2024-08-01].https://arxiv.org/abs/2206.03001v2.
[17] PADILLA R,PASSOS W L,DIAS T L B,et al.A comparative analysis of object detection metrics with a companion open-source toolkit[J].Electronics,2021,10(3):279.

街景影像交通标志牌限速限高信息提取

Road speed limit and height limit information extraction from traffic sign in street view images

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	郝佳, 姚国英, 周剑, 王斯远, 肖进胜. 基于图像和点云融合的三维小目标检测方法[J]. 测绘通报, 2025, 0(3): 33-38.
[2]	杨家芳, 尹林江, 张洪亮, 赵卫权, 李威. 基于无人机遥感影像多维特征的茶树种植信息提取方法[J]. 测绘通报, 2025, 0(3): 138-143.
[3]	乌萌, 熊超. 利用激光点云测距影像的城市环境动态目标检测优化方法[J]. 测绘通报, 2025, 0(2): 35-40.
[4]	蓝贵文, 徐梓睿, 任新月, 钟展, 郭瑞东, 范冬林. 基于YOLOv8n改进的航拍输电线路图像多类电力部件检测算法[J]. 测绘通报, 2024, 0(9): 38-43,49.
[5]	石一剑, 谭海, 钟旭辉. 改进YOLOv5的国产光学影像辐射异常检测方法[J]. 测绘通报, 2024, 0(8): 60-65,72.
[6]	黄子恒, 芮杰, 林雨准, 王淑香, 刘相云. 基于改进的YOLOv5遥感影像飞机目标检测[J]. 测绘通报, 2024, 0(8): 73-78,89.
[7]	付利钊, 杨青岗, 陈永立, 韩金廷, 杨歆佳. 基于SFNet-F地物识别技术的农业大棚信息提取[J]. 测绘通报, 2024, 0(7): 65-70.
[8]	刘兵, 刘宇, 金凤学, 邹一波, 葛艳, 赵林林. 针对浒苔目标检测的全局背景强化的位置蒸馏方法[J]. 测绘通报, 2024, 0(6): 19-23.
[9]	姚楚羡, 蔡皓楠, 张远波, 唐可懿, 詹璐, 周宝定. 基于轻量化车载设备的道路病害检测方法[J]. 测绘通报, 2024, 0(5): 147-150.
[10]	杨明秋, 陈国坤, 左小清, 董燕. 改进YOLOv8的SAR影像船舰目标检测模型[J]. 测绘通报, 2024, 0(12): 18-23.
[11]	王志涛, 张瑞菊, 王坚, 赵佳星, 刘严涛. 基于YOLOv5改进的交通场景目标检测算法HCAM-YOLO[J]. 测绘通报, 2024, 0(11): 61-67.
[12]	宋宗莹, 王兴中, 曾杉, 张正军, 尹太军, 柳红利. 基于改进YOLOv7的无人机图像铁路接触网部件目标检测方法[J]. 测绘通报, 2024, 0(11): 108-114.
[13]	牟翠伟, 王召泽. 多源点云融合技术在城市更新数据采集中的应用[J]. 测绘通报, 2024, 0(11): 151-155.
[14]	陈婕, 刘纪平, 徐胜华. 增强边缘信息的全卷积神经网络遥感影像建筑物变化检测[J]. 测绘通报, 2023, 0(6): 61-67.
[15]	杜宇峰, 黄亮, 赵子龙, 李国柱. 基于DETR的高分辨率遥感影像滑坡体识别与检测[J]. 测绘通报, 2023, 0(5): 16-20.