Review on the development of surveillance video and geographic information fusion technology

doi:10.13474/j.cnki.11-2246.2022.0132

Abstract

Abstract: Surveillance video plays an important role in the security and management of smart and safe cities. Although, the video data has the characteristics of real-time, intuitive, and rich, the coupling analysis ability with geographic information is insufficient. The spatial information of the video itself cannot be effectively utilized. At the same time, due to the shortcomings of poor real-time and slow update of geographic information, it cannot reflect the dynamic scenes. In order to achieve better results, many scholars and industry personnel at home and abroad comprehensively consider their advantages and research the fusion of surveillance video and geographic information. This paper introduces the key technologies of the fusion of surveillance video and geographic information, analyzes the research status and application fields of the fusion, and finally points out the possible development trend in the future based on the bottlenecks and difficulties encountered.

Key words: surveillance video, geographic information, fusion, mapping

CLC Number:

P208

HAN Shijing, MIAO Shufeng, HAO Xiangyang, CHEN Runze. Review on the development of surveillance video and geographic information fusion technology[J]. Bulletin of Surveying and Mapping, 2022, 0(5): 1-6.

References

[1] 李德仁,邵振峰.论物理城市、数字城市和智慧城市[J].地理空间信息,2018,16(9):1-4.
[2] LUO W H, XING J L, MILAN A, et al. Multiple object tracking:a literature review[J]. Artificial Intelligence, 2020, 293:103448.
[3] GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus:IEEE, 2014:580-587.
[4] REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once:unified, real-time object detection[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas:IEEE, 2016:779-788.
[5] 郝腾龙,李熙莹.提升预测框定位稳定性的视频目标检测[J].中国图象图形学报,2021,26(1):113-122.
[6] 尉婉青,禹晶,柏鳗晏,等.SSD与时空特征融合的视频目标检测[J].中国图象图形学报,2021,26(3):542-555.
[7] HOU L, WAN W G, HWANG J N, et al. Human tracking over camera networks:a review[J/OL]. EURASIP Journal on Advances in Signal Processing, 2017[2021-10-08]. https://link.springer.com/article/10.1186/s13634-017-0482-z#citeas.
[8] LI X L,DONG W H,CHANG F L,et al.Topology learning of non-overlapping multi-camera network[J].International Journal of Signal Processing, Image Processing and Pattern Recognition, 2015, 8(11):243-254.
[9] YE M, SHEN J B, LIN G J, et al. Deep learning for person re-identification:a survey and outlook[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021, 1(1):99.
[10] 王高杰,郝向阳,欧阳文,等.定位点分布对相机位姿解算精度影响分析[J].导航定位学报,2020, 8(6):21-28.
[11] 张旭,郝向阳,李建胜,等.监控视频中动态目标与地理空间信息的融合与可视化方法[J].测绘学报,2019,48(11):1415-1423.
[12] COLLINS R T, TSIN Y, MILLER J R, et al. Using a DEM to determine geospatial object trajectories[C]//Proceedings of 1998 DARPA Image Understanding Workshop. San Francisco:Morgan Kaufmann,1998:115-122.
[13] 张兴国.地理场景协同的多摄像机目标跟踪研究[D].南京:南京师范大学,2014.
[14] 唐丽玉,王熠中,陈崇成,等.视频图像中监控目标的空间定位方法[J].福州大学学报(自然科学版),2014,42(1):55-61.
[15] LIPPMAN A. Movie-maps:an application of the optical videodisc to computer graphics[J]. Acm Siggraph Computer Graphics, 1980, 14(3):32-42.
[16] 刘学军,间国年,吴勇,等.侧面看世界——视频GIS框架综述[C/OL]//第二届地理元胞自动机和应用研讨会论文集.广州:中国地理信息系统协会, 2007:205-211[2021-10-08]. http://www.doc88.com/p-679409641645.html.
[17] GIRGENSOHN A, KIMBER D, VAUGHAN J, et al. Dots:support for effective video surveillance[C]//Proceedings of the 15th ACM International Conference on Multimedia. New York:Association for Computing Machinery, 2007:423-432.
[18] TAKEHARA T, NAKASHIMA Y, NITTA N, et al. Digital diorama:sensing-based real-world visualization[C]//Proceedings of 2010 International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems. Berlin:Springer, 2010:663-672.
[19] BRADFORD B,DIXON E M,SISSKIND J,et al. Target tracking with GIS data using a fusion-based approach[C/OL]//Proceedings of 2011 SPIE-the International Society for Optical Engineering.[S.l.]:SPIE, 2011[2021-10-08]. https://doi.org/10.1117/12.883424.
[20] 刘洋.监控视频与二维地图的集成研究[D].南京:南京师范大学,2016.
[21] MILOSAVLJEVI AC' A, RAN AČ I AC' D, DIMITRIJEVI AC' A, et al. Integration of GIS and video surveillance[J]. International Journal of Geographical Information Science, 2016, 30(10):2089-2107.
[22] XIE Y J, WANG M Z, LIU X J, et al. Integration of GIS and moving objects in surveillance video[J]. ISPRS International Journal of Geo-Information, 2017, 6(4):94.
[23] XIE Y J, WANG M Z, LIU X J, et al. Integration of multi-camera video moving objects and GIS[J]. ISPRS International Journal of Geo-Information, 2019, 8(12):561.
[24] 邓仕虎,张兴国,王小勇,等.视频和GIS协同的人群状态感知模型[J].信阳师范学院学报(自然科学版),2018,31(1):59-63.
[25] 宋亦然.基于物体识别地理配准的跨视频行人检测定位技术研究[D].深圳:中国科学院大学(中国科学院深圳先进技术研究院),2020.
[26] 韩丰宇.视频运动目标轨迹智能提取算法与WebGIS集成研究[D].泰安:山东农业大学,2019.
[27] 刘垒.基于地理约束场景的动态目标检测及行为识别方法研究[D].桂林:桂林理工大学,2020.
[28] HAN S J,DONG X R,HAO X Y,et al. Extracting objects'spatia-temporal information based on surveillance videos and the digital surface model[J]. ISPRS International Journal of Geo-Information,2022,11(2):103.
[29] WANG H,LIU C,ZHANG X,et al.Multi-camera tracking based on information fusion in video surveillance[C]//Proceedings of the 2nd International Congress on Image and Signal Processing. Tianjin:IEEE, 2009:1-5.
[30] CHEN K W, HUNG Y P. Multi-cue integration for multi-camera tracking[C]//Proceedings of the 20th International Conference on Pattern Recognition. Istanbul:IEEE, 2010:145-148.
[31] 邓颖娜,朱虹,李刚,等.基于场景模型的多摄像机目标跟踪算法[J].计算机工程与应用,2008,44(5):55-57.
[32] DAI X C,PAYANDEH S.Geometry-based object association and consistent labeling in multi-camera surveillance[J]. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2013, 3(2):175-184.
[33] 林青,范晶晶,胡波.多摄像头目标跟踪动态单应投影方法研究[J].复旦学报(自然科学版), 2011,50(4):501-510.
[34] 徐汝东,刘进.可量测视频目标动态轨迹生成及GIS应用[J].武汉大学学报(信息科学版),2016,41(6):818-824.
[35] 解愉嘉,刘学军.顾及轨迹地理方向的监控视频浓缩方法[J].武汉大学学报(信息科学版),2017,42(1):70-76.
[36] 解愉嘉,刘学军.虚实融合监控视频压缩方法的分析与评价[J].南京师大学报(自然科学版),2016,39(3):130-134.
[37] 沈昌力,龚少麟.视频监控中的纹理映射技术[J].指挥信息系统与技术,2015,6(6):96-100.
[38] 李伟,景海涛,原世伟,等.视频数据的地理信息提取研究[J].测绘科学,2017,42(11):92-96.
[39] HAN L T, HUANG B H, CHEN L. Integration and application of video surveillance system and 3DGIS[C]//Proceedings of the 18th International Conference on Geoinformatics. Beijing:IEEE, 2010:1-5.
[40] YANG Y M, CHANG M C, TU P, et al. Seeing as it happens:real time 3D video event visualization[C]//Proceedings of 2015 IEEE International Conference on Image Processing (ICIP). Quebec:IEEE, 2015:2875-2879.
[41] ZHENG J,ZHANG D N,ZHANG Z,et al. An integrated system of video surveillance and GIS[C/OL]//Proceedings of 2018 IOP Conference Series:Earth and Environmental Science.[S.l.]:IOP, 2018[2021-10-08]. https://iopscience.iop.org/article/10.1088/1755-1315/170/2/022088/pdf.