Registration of fisheyes panoramic image and terrestrial LiDAR date based on line feature

doi:10.13474/j.cnki.11-2246.2021.0212

Abstract

Abstract: Combining terrestrial laser point cloud and fisheye image are high efficiency on panoramic information analysis. Registration of fisheyes panoramic image and terrestrial LiDAR data is a prerequistite for its information complement each other. But it is necessary to overcome the difficulties of data dimensional difference transformation and feature matching. In this paper, a new semi-automatic method is brought up to registered these two data based on Hough algorithm, both fisheyes image and LiDAR points are reprojected to a same cylindrical surface. Line features are extracted from these two images based on Hough algorithm. And then, the modified Iterated Hough transform is employed to registered LiDAR range image and fisheye cylindrical surface image. Experimentation shows that the model has capability to register these two data in 3D screen with less manual intervention, and obtain high register precision within the area near fisheyes image viewing point.

Key words: fisheyes image, LiDAR, line feature, MIHT, registration

CLC Number:

P237

XIONG Youyi, QIAO Jigang, ZHANG Wenjin. Registration of fisheyes panoramic image and terrestrial LiDAR date based on line feature[J]. Bulletin of Surveying and Mapping, 2021, 0(7): 74-80.

References 19

[1]	AGOSTO E, BOR WAZ L. 3D models in cultural heritage:approaches for their creation and use[J]. International Journal of Computational Methods in Heritage Science, 2017,1(1):1-9.
[2]	鲁春芳. 面向全景立体球视觉系统的三维重建关键算法研究[D].天津:天津理工大学,2016.
[3]	司传波, 高子翔, 崔程宝. 机载LiDAR数据和航空影像基于角特征的配准[J].测绘与空间地理信息, 2017, 40(10):151-153.
[4]	盛庆红,张斌,肖晖,等.直线簇约束下的地面LiDAR点云配准方法[J].武汉大学学报(信息科学版),2018,43(3):406-412.
[5]	HAO W, WANG YH, LIANG W. Slice-based building facade reconstruction from 3D point clouds[J]. International Journal of Remote Sensing, 2018,39(20):6587-6606.
[6]	BARBARELLA M, D'AMICO F, BLASIIS M R D, et al. Use of terrestrial laser scanner for rigid airport pavement management.[J]. Sensors (Basel), 2017,18(1):44.
[7]	闫利,索一凡,曹亮.车载激光雷达点云与全景影像的自动配准[J].测绘科学,2016,41(4):113-117.
[8]	FUJIWARA E, SILVA L E D, MARQUES T H R,et al. Polymer optical fiber specklegram strain sensor with extended dynamic range[J].Optical Engineering,2018,57(11):116107.
[9]	陈驰,杨必胜,田茂,等.车载MMS激光点云与序列全景影像自动配准方法[J].测绘学报,2018,47(2):215-224.
[10]	皮英冬,李欣,陈智勇,等.基于三维控制场的鱼眼影像检校和纠正方法[J].光学学报,2017,37(1):224-232.
[11]	王向军,白皓月,吴凡璐,等.基于改进球面透视投影的鱼眼图像畸变校正方法[J].图学学报,2018,39(1):43-49.
[12]	张晓康,李小平.浅析模糊图像复原方法[J].现代计算机(专业版),2018(14):38-42.
[13]	THAHER R H, HUSSEIN Z K. Stereo vision distance estimation employing canny edge detector with interpolation algorithm[J]. American Journal of Science and Technology,2015,2(6):346-353.
[14]	BURGOS P B, MANSO L J, BUSTOS P. A variant of the Hough transform for the combined detection of corners, segments, and polylines[J]. EURASIP Journal on Image and Video Processing,2017,32:10.1186.
[15]	刁燕,吴晨柯,罗华,等.基于改进的概率Hough变换的直线检测优化算法[J].光学学报,2018,38(8):170-178.
[16]	MANZANERA A, NGUYEN P T, XU X L. Line and circle detection using dense one-to-one Hough transforms on greyscale images[J]. EURASIP Journal on Image and Video Processing,2016(1):10.1186.
[17]	VIANELLO A, MANFREDI G, DIEBOLD M, et al. 3D reconstruction by a combined structure tensor and Hough transform light field approach[J]. tm-Technisches Messen,2017,84,7:10.1515.
[18]	MENG Y C, ZHANG ZP, YIN HQ, et al. Automatic detection of particle size distribution by image analysis based on local adaptive canny edge detection and modified circular Hough transform.[J]. Micron,2018,106:34-41.
[19]	李喆,李建增,胡永江,等.基于频谱预处理与改进霍夫变换的离焦模糊盲复原算法[J].图学学报,2018,39(5):909-916.