面向密度明显差异点云的室内场景三维Mesh模型POCO重建方法

doi:10.13474/j.cnki.11-2246.2025.0202

测绘通报 ›› 2025, Vol. 0 ›› Issue (2): 7-12,47.doi: 10.13474/j.cnki.11-2246.2025.0202

面向密度明显差异点云的室内场景三维Mesh模型POCO重建方法

宋培焱^1,2, 叶勤^1,3, 曾亮³, 罗俊奇³, 张硕³, 尹长江³

1. 自然资源部城市国土资源监测与仿真重点实验室, 广东深圳 518034;
2. 深圳市规划和自然资源调查测绘中心, 广东深圳 518000;
3. 同济大学测绘与地理信息学院, 上海 200092

收稿日期:2024-06-04 发布日期:2025-03-03
通讯作者: 曾亮。E-mail:zz16ang@163.com
作者简介:宋培焱(1985—),男,硕士,高级工程师,主要从事实景三维重建技术工作。E-mail:403091732@qq.com
基金资助:
自然资源部城市国土资源监测与仿真重点实验室开放基金(KF-2023-08-014);国家自然科学基金(41771480)

Indoor scene 3D Mesh model reconstruction from point cloud with density variation using POCO

SONG Peiyan^1,2, YE Qin^1,3, ZENG Liang³, LUO Junqi³, ZHANG Shuo³, YIN Changjiang³

1. Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources, Shenzhen 518034, China;
2. Shenzhen Planning and Natural Resources Surveying and Mapping Center, Shenzhen 518000, China;
3. College of Surveying and Geo-Informatics, Tongji University, Shanghai 200092, China

Received:2024-06-04 Published:2025-03-03

摘要/Abstract

摘要： 针对现有室内场景三维重建方法在处理大规模且密度显著差异的点云时重建效果不佳的问题,本文提出了一种基于POCO深度神经网络、改进训练、重建策略的室内场景三维Mesh模型重建方法。首先,改进训练策略,充分利用现有少量仿真场景与极少量真实场景数据对原模型进行微调训练;然后,改进重建策略,引入最远点采样和包围盒尺度一致的策略;最后,对重建的三维Mesh模型进行尺度复原。试验结果表明,本文方法在重建精度和模型完整度上均优于改进前的POCO原模型,可为实景三维中国建设提供有力支持。

关键词: POCO, 三维重建, 室内场景, 密度差异点云, 深度学习

Abstract: To address the suboptimal performance of existing point cloud-based indoor 3D reconstruction methods when handling large-scale point cloud with significant density variations, we propose an improved indoor scene 3D Mesh model reconstruction method based on the POCO deep neural network, featuring enhanced training and reconstruction strategies. Firstly, we improve the training strategy by fine-tuning the original model using a small amount of simulated scene data and a very limited amount of real scene data. Secondly, we enhance the reconstruction strategy by introducing farthest point sampling and a strategy to ensure consistent bounding box scales. Finally, we restore the scale of the reconstructed 3D Mesh model. Experimental results demonstrate that our method outperforms the original POCO model in terms of reconstruction accuracy and model completeness, providing support for China's national 3D mapping program (3dRGLM).

Key words: POCO, 3D reconstruction, indoor scenes, point cloud with density variation, deep learning

中图分类号:

P237

宋培焱, 叶勤, 曾亮, 罗俊奇, 张硕, 尹长江. 面向密度明显差异点云的室内场景三维Mesh模型POCO重建方法[J]. 测绘通报, 2025, 0(2): 7-12,47.

SONG Peiyan, YE Qin, ZENG Liang, LUO Junqi, ZHANG Shuo, YIN Changjiang. Indoor scene 3D Mesh model reconstruction from point cloud with density variation using POCO[J]. Bulletin of Surveying and Mapping, 2025, 0(2): 7-12,47.

参考文献

[1] 陈军,田海波,高崟,等. 实景三维中国的总体架构与主体技术[J/OL]. 测绘学报,2024(2024-04-18).https://kns.cnki.net/kcms/detail/11.2089.P.20240417.0946.002.html.
[2] 鲁一慧,魏国忠,宋禄楷,等. 多源点云优化的城市三维模型构建[J]. 测绘通报,2024(S1): 23-28.
[3] 杨泽鑫,程效军,丁琼,等. 面向室内场景点云的对象重建[J]. 测绘通报,2017(6): 45-48.
[4] XU Yusheng,STILLA U. Toward building and civil infrastructure reconstruction from point clouds: a review on data and key techniques[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2021,14: 2857-2885.
[5] 康志忠,杨俊涛. 室内实景三维重建技术综述[J]. 时空信息学报,2024,31(1): 1-10.
[6] 刘翔宇,王健,常清法,等. 改进贪婪投影三角化算法的激光点云快速三维重建[J]. 激光与红外,2022,52(5): 763-770.
[7] HOU Fei,WANG Chiyu,WANG Wencheng,et al. Iterative Poisson surface reconstruction (iPSR) for unoriented points[J]. ACM Transactions on Graphics,2022,41(4): 1-13.
[8] MESCHEDER L,OECHSLE M,NIEMEYER M,et al. Occupancy networks: learning 3D reconstruction in function space[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach: IEEE,2019: 4455-4465.
[9] PARK J J,FLORENCE P,STRAUB J,et al. DeepSDF: learning continuous signed distance functions for shape representation[C]//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Long Beach: IEEE,2019: 165-174.
[10] BOULCH A,MARLET R. POCO: point convolution for surface reconstruction[C]//Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans: IEEE,2022: 6292-6304.
[11] WU Zhirong,SONG Shuran,KHOSLA A,et al. 3D ShapeNets: a deep representation for volumetric shapes[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston: IEEE,2015: 1912-1920.
[12] SHANMUGAM D,BLALOCK D,BALAKRISHNAN G,et al. Better aggregation in test-time augmentation[C]//Proceedings of 2021 IEEE/CVF International Conference on Computer Vision (ICCV). Montreal: IEEE,2021: 1194-1203.
[13] BOULCH A,PUY G,MARLET R. FKAConv: feature-kernel alignment for point cloud convolution[M]//Lecture Notes in Computer Science. Cham: Springer International Publishing,2021: 381-399.
[14] HANDA A,WHELAN T,MCDONALD J,et al. A benchmark for RGB-D visual odometry,3D reconstruction and SLAM[C]//Proceedings of 2014 IEEE International Conference on Robotics and Automation (ICRA). Hong Kong: IEEE,2014: 1524-1531.
[15] 白静,司庆龙,秦飞巍. 基于卷积神经网络和投票机制的三维模型分类与检索[J]. 计算机辅助设计与图形学学报,2019,31(2): 303-314.

面向密度明显差异点云的室内场景三维Mesh模型POCO重建方法

Indoor scene 3D Mesh model reconstruction from point cloud with density variation using POCO

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	石佳俊, 臧玉府, 肖雄武, 张莹滢. 非刚性匹配的激光点云与多光谱影像深度融合[J]. 测绘通报, 2025, 0(2): 41-47.
[2]	刘俊伟, 张周平, 郭大海, 杨文雪, 曲冠晨, 马欣蕊, 王思宇, 朱倩. 城市建筑三维实体自动化建模技术集成与实践[J]. 测绘通报, 2024, 0(9): 1-7.
[3]	马浩然, 王金华. 多维特征学习与模型融合的地理命名实体识别[J]. 测绘通报, 2024, 0(9): 129-134.
[4]	石一剑, 谭海, 钟旭辉. 改进YOLOv5的国产光学影像辐射异常检测方法[J]. 测绘通报, 2024, 0(8): 60-65,72.
[5]	尤相骏, 赵霞, 龙四春, 王嘉伟, 郑颖, 邝利军. 地铁隧道病害检测深度学习模型优化及应用[J]. 测绘通报, 2024, 0(8): 96-101.
[6]	马下平, 王风凯, 赵庆志, 高余婷. 深度学习的大高差高海拔地区高程拟合方法[J]. 测绘通报, 2024, 0(8): 102-108.
[7]	侯佳鑫, 车向红, 刘纪平, 王鸿雁, 王勇, 徐胜华, 罗安. 三种图像匹配模型在地图匹配中的适用性[J]. 测绘通报, 2024, 0(8): 109-114,121.
[8]	杨晓峰, 魏浩翰, 张强, 向云飞. 融合孤立森林和深度学习的GNSS-IR土壤湿度反演[J]. 测绘通报, 2024, 0(7): 88-94.
[9]	田亚林, 连增增, 王鹏辉, 王孟奇, 陆力. 基于KF-LSTM的UWB室内定位算法[J]. 测绘通报, 2024, 0(7): 95-99,151.
[10]	刘兵, 刘宇, 金凤学, 邹一波, 葛艳, 赵林林. 针对浒苔目标检测的全局背景强化的位置蒸馏方法[J]. 测绘通报, 2024, 0(6): 19-23.
[11]	郭宝云, 姚玉凯, 李彩林, 王悦, 孙娜, 鲁一慧. 改进的3D-BoNet算法应用于点云实例分割与三维重建[J]. 测绘通报, 2024, 0(6): 30-35.
[12]	高墨通, 杨维芳, 刘祖昱, 曹小双, 张瑞琪, 侯宇豪. 结合卷积神经网络和注意力机制的LSTM采空区地表沉降预测方法[J]. 测绘通报, 2024, 0(6): 53-58,170.
[13]	钟青岑, 吴晨昊, 向隆刚, 姚鹏. 顾及路网约束的深度地图匹配方法[J]. 测绘通报, 2024, 0(6): 96-102,133.
[14]	尹泽中, 李功权. 三维场叠加视频流的电子围栏越界检测方法[J]. 测绘通报, 2024, 0(6): 103-108.
[15]	王丽霞, 喜文飞, 史正涛, 赵子龙, 钱堂慧, 赵磊, 马奕捷. 深度学习滑坡识别算法中样本不平衡问题的研究[J]. 测绘通报, 2024, 0(5): 12-18.