Panoramic image matching based on spherical congruence projection

doi:10.13474/j.cnki.11-2246.2025.1010

Abstract

Abstract: With the widespread application of wide-angle vision sensors in various fields, traditional perspective cameras have gradually revealed their limitations, especially in complex visual perception tasks.Although wide-angle lenses provide a broader field of view, the introduced image distortion severely affects the accuracy and reliability of feature matching.To address this issue, this study proposes an innovative panoramic image matching technique based on spherical isometric mapping.The technique firstly projects the panoramic image into a spherical isometric mapping image using the scaramuzza camera model, eliminating the inconsistency distortion inherent in panoramic images in a planar structure.On this basis, a corresponding spherical data structure is constructed, and the FAST corner detection method is adopted.Furthermore, an improved rBRIEF algorithm tailored for spherical pixel structures is proposed, along with the construction of corresponding feature descriptors, to achieve high-precision and highly robust panoramic image matching.

Key words: panoramic image, spherical structure, improved ORB, pixel segmentation, spherical descriptor

CLC Number:

P237

XIAO Yao, YANG Yusheng, SHI Hang, XIE Yangmin. Panoramic image matching based on spherical congruence projection[J]. Bulletin of Surveying and Mapping, 2025, 0(10): 57-62.

References

[1] 陈坚炜,何元烈,何铭臻,等. 多目鱼眼视觉SLAM特征点误匹配的剔除优化[J]. 大连工业大学学报,2024,43(1):61-72. [2] 张煌,何佳洲,王景石,等. 基于全景图像的无人艇激光雷达杂波滤除方法[J]. 光学学报,2022,42(18):74-84. [3] 杨娜,张翀,李天昊. 基于无人机与计算机视觉的中国古建筑木结构裂缝监测系统设计[J]. 工程力学,2021,38(3): 27-39. [4] 丁颖,刘延伟,刘金霞,等. 虚拟现实全景图像显著性检测研究进展综述[J]. 电子学报,2019,47(7): 1575-1583. [5] 陈令羽,贾奋励,宋国民. 基于全景图的地理现实增强技术研究[J]. 测绘通报,2015(4): 14-17. [6] 王步云,李宏伟,赵姗. 融合点云与全景影像的路侧多目标识别[J]. 测绘通报,2023(10): 40-46. [7] JI Shunping,QIN Zijie,SHAN Jie,et al. Panoramic SLAM from a multiple fisheye camera rig[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2020,159: 169-183. [8] RUBLEE E,RABAUD V,KONOLIGE K,et al. ORB: an efficient alternative to SIFT or SURF[C]//Proceedings of 2011 International Conference on Computer Vision. Barcelona: IEEE,2011: 2564-2571. [9] LEUTENEGGER S,CHLI M,SIEGWART R Y. BRISK: Binary Robust invariant scalable keypoints[C]//Proceedings of 2011 International Conference on Computer Vision. Barcelona: IEEE,2011: 2548-2555. [10] SEOK H,LIM J. ROVO: robust omnidirectional visual odometry for wide-baseline wide-FOV camera systems[C]//Proceedings of 2019 International Conference on Robotics and Automation (ICRA). Montreal:IEEE,019: 6344-6350. [11] LIU Shuai,ZHAO Lingli,LI Junsheng,et al. Th SIFT features matching for spherical panoramic images[C]//Proceedings of the 11th IEEE International Conference on Control ＆ Automation (ICCA). Taichung:IEEE,2014: 914-917. [12] LOWE D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision,2004,60(2): 91-110. [13] 王奕丹,闫利. POS辅助车载组合全景影像路面角点特征匹配算法[J]. 测绘通报,2016(4): 24-27. [14] YANG Yusheng,GAO Zhiyuan,ZHANG Jinghan,et al. UVS-CNNs: Constructing general convolutional neural networks on quasi-uniform spherical images[J]. Computers ＆ Graphics,2024,122: 103973. [15] SCARAMUZZA D,MARTINELLI A,SIEGWART R. A toolbox for easily calibrating omnidirectional cameras[C]//Proceedings of 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems. Beijing: IEEE,2006: 5695-5701.