利用点云配准的空地影像融合技术

doi:10.13474/j.cnki.11-2246.2022.0176.

测绘通报 ›› 2022, Vol. 0 ›› Issue (6): 82-87.doi: 10.13474/j.cnki.11-2246.2022.0176.

利用点云配准的空地影像融合技术

谢洪¹, 陈立波², 聂倩², 吴玮², 张沛¹

1. 武汉大学测绘学院, 湖北武汉 430079;
2. 宁波市测绘和遥感技术研究院, 浙江宁波 315042

收稿日期:2021-07-23 发布日期:2022-06-30
作者简介:谢洪(1987-),男,博士,讲师,研究方向为移动激光测量与三维计算机视觉。E-mail:hxie@sgg.whu.edu.cn
基金资助:
国家重点研发计划( 2020YFD1100200)

Air-ground image fusion technology with point cloud registration

XIE Hong¹, CHEN Libo², NIE Qian², WU Wei², ZHANG Pei¹

1. School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China;
2. Ningbo Institute of Surveying, Mapping and Remote Sensing, Ningbo 315042, China

Received:2021-07-23 Published:2022-06-30

摘要/Abstract

摘要： 为实现空地影像的高精度融合,本文提出了一种基于密集匹配点云配准的融合方法,并与利用空三加密点云配准的融合效果进行了对比。首先,通过对空地影像进行空三加密和密集匹配,得到相应的三维点云;然后,利用基于3DSC特征的SAC-IA算法,完成空中点云和地面点云的粗配准;最后,通过改进的Point-to-Plane ICP算法进行精配准,进而完成空地影像的融合。试验表明,相比空三加密点云,密集匹配点云能够提供更为稳健的配准结果,且能够达到厘米级的精度。

关键词: 空地影像融合, 密集匹配, 空三加密, 点云配准

Abstract: In order to achieve the high-precision fusion of air-ground images, a fusion method based on dense matching is proposed in this paper, and the result is compared with the fusion scheme using point cloud from aerial triangulation. Firstly, the three-dimensional point cloud is obtained by aerial triangulation and dense matching to the air-ground images. Then, the coarse registration of air point cloud and ground point cloud is performed by the SAC-IA algorithm based on 3DSC features. Finally, the refined registration is performed by the improved Point-to-Plane ICP algorithm, leading to the fusion of air-ground images.Compared with the sparse point cloud from aerial triangulation, the experimental results show that the dense matching point cloud can provide more robust registration result, and its accuracy is at centimeter-level.

Key words: air-ground image fusion, dense matching, aerial triangulation, point cloud registration

中图分类号:

P208

谢洪, 陈立波, 聂倩, 吴玮, 张沛. 利用点云配准的空地影像融合技术[J]. 测绘通报, 2022, 0(6): 82-87.

XIE Hong, CHEN Libo, NIE Qian, WU Wei, ZHANG Pei. Air-ground image fusion technology with point cloud registration[J]. Bulletin of Surveying and Mapping, 2022, 0(6): 82-87.

参考文献

[1] WU B,XIE L,HU H,et al.Integration of aerial oblique imagery and terrestrial imagery for optimized 3D modeling in urban areas[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2018(139):119-132.
[2] NEX F,GERKE M,REMONDINO F,et al.ISPRS benchmark for multi-platform photogrammetry[C]//Proceedings of 2015 ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences. Munich:ISPRS,2015:135-142.
[3] GAO X,SHEN S,ZHOU Y,et al.Ancient Chinese architecture 3D preservation by merging ground and aerial point clouds[J].ISPRS Journal of Photogrammetry and Remote Sensing,2018(143):72-84.
[4] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision,2004,60(2):91-110.
[5] BAY H,ESS A,TUYTELAARS T,et al. Speeded-up robust features (SURF)[J]. Computer Vision and Image Understanding,2008,110(3):346-359.
[6] SHAH R,DESHPANDE A,NARAYANAN P J. Multistage SFM:revisiting incremental structure from motion[C]//Proceedings of 2014 International Conference on 3D Vision. Tokyo:IEEE,2014:417-424.
[7] NODA M,TOMOKAZU T. Vehicle ego-localization by matching in-vehicle camera images to an aerial image[C]//Proceedings of 2010 Asian Conference on Computer Vision 2010 Workshops. Queenstown:Springer,2010:163-173.
[8] JENDE P,NEX F,GERKE M,et al. A fully automatic approach to register mobile mapping and airborne imagery to support the correction of platform trajectories in GNSS-denied urban areas[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2018,141:86-99.
[9] WOLFF M,COLLINS R T,LIU Y X. Regularity-driven building facade matching between aerial and street views[C]//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Seattle:IEEE,2016:1591-1600.
[10] TIAN Y C,CHEN C,SHAH M. Cross-view image matching for geo-localization in urban environments[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu:IEEE,2017:1998-2006.
[11] LIN T Y,CUI Y,BELONGIE S,et al. Learning deep representations for ground-to-aerial geolocalization[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston:IEEE,2015:5007-5015.
[12] 杨璐宏,吴玮,王芮.基于空地影像联合的精细化三维重建研究[J].测绘通报,2021(S1):144-148.
[13] 赵文更,张旭,邵晴晴.融合反射强度图像的地铁隧道点云自动配准[J].测绘通报,2020(9):38-41.
[14] 马伟丽,王健,孙文潇.曲率约束的激光点云全局优化配准算法[J].遥感信息,2019,34(4):62-67.
[15] BESL P J,MCKAY N D. Method for registration of 3D shapes[C]//Proceedings of 1992 Sensor Fusion IV:Control Paradigms and Data Structures.[S.l.]:International Society for Optics and Photonics,1992.
[16] CHETVERIKOV D,SVIRKO D,STEPANOV D,et al. The trimmed iterative closest point algorithm[C]//Proceedings of 2002 IEEE International Conference on Pattern Recognition. Quebec:IEEE,2002.
[17] YU Z. Intrinsic shape signatures:a shape descriptor for 3D object recognition[C]//Proceedings of 2009 IEEE International Conference on Computer Vision Workshops. Kyoto:IEEE,2009:689-696.
[18] FROME A,HUBER D,KOLLURI R,et al. Recognizing objects in range data using regional point descriptors[C]//Proceedings of the 8th European Conference on Computer Vision. Prague:Springer,2004:224-237.
[19] RUSU R B,BLODOW N,BEETZ M. Fast point feature histograms (FPFH) for 3D registration[C]//Proceedings of 2009 IEEE International Conference on Robotics&Automation. Kobe:IEEE,2009.
[20] 李仁忠,杨曼,田瑜,等.基于ISS特征点结合改进ICP的点云配准算法[J].激光与光电子学进展,2017,54(11):312-319.

利用点云配准的空地影像融合技术

Air-ground image fusion technology with point cloud registration

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	谢元, 董梦, 马新建. 多源数据在复杂场景建筑物三维重建的应用[J]. 测绘通报, 2022, 0(6): 143-147.
[2]	阮明浩, 卢永华, 刘玉贤, 汤圣君, 王伟玺, 张宇琦, 李游. 激光与倾斜点云精确配准与无缝融合[J]. 测绘通报, 2022, 0(4): 6-10.
[3]	羌鑫林, 蒋圣, 王继, 钱程扬, 方炫. 面向Z-5无人直升机航测的测绘质量检查体系及实证[J]. 测绘通报, 2022, 0(2): 136-139.
[4]	赵彦刚, 付守健, 陈宏强, 吴波. Heron移动背包三维激光扫描系统在1∶500大比例尺测图中的精度评价及效率分析[J]. 测绘通报, 2021, 0(10): 114-116.
[5]	吴波, 李俊, 蒋大鹏, 冯志. 针对地质灾害隐患点的无人机航摄像控点布点方案[J]. 测绘通报, 2020, 0(6): 125-127,140.
[6]	李宇翔, 郭际明, 潘尚毅, 吕丽丽, 卢主兴, 章迪. 一种基于ISS-SHOT特征的点云配准算法[J]. 测绘通报, 2020, 0(4): 21-26.
[7]	杨海舰, 徐二帅, 陈文佳, 许志华. 四元组标靶辅助下的RGB-D室内点云配准[J]. 测绘通报, 2020, 0(12): 32-36.
[8]	袁志聪, 鲁铁定, 刘瑞. 一种基于BFGS修正的正态分布变换点云配准方法[J]. 测绘通报, 2020, 0(10): 38-42.
[9]	王果, 王强, 刘绍堂, 杨福芹, 赵光兴, 杨彬. 布料模拟法无人机倾斜摄影建筑点云提取[J]. 测绘通报, 2020, 0(10): 97-100.
[10]	李明峰, 陆海芳, 赵湘玉. 对偶四元数法在稳健点云配准中的应用[J]. 测绘通报, 2019, 0(9): 22-26.
[11]	郭雨, 夏永华, 杨明龙. 融合多源测量数据的钟乳石三维建模方法[J]. 测绘通报, 2019, 0(2): 49-53.
[12]	杨铭. 背包式移动三维激光扫描系统的应用[J]. 测绘通报, 2018, 0(9): 91-95.
[13]	邹进贵, 杨义辉, 李琴, 翟若明. 局部相位相关法在密集匹配中的应用及精度分析[J]. 测绘通报, 2018, 0(5): 25-28.
[14]	杨敏, 甘淑, 袁希平, 高莎, 朱赞, 于辉. 复杂带状地形条件下的地面三维激光扫描点云数据采集与配准处理试验[J]. 测绘通报, 2018, 0(5): 35-40.
[15]	王刊生, 郑亮. 一种无人机影像空三加密点抽稀算法[J]. 测绘通报, 2018, 0(3): 108-112.