Large format remote sensing image segmentation method based on Spark with optimised chunking

doi:10.13474/j.cnki.11-2246.2024.1014.

Abstract

Abstract: Aiming at the large format remote sensing image in the chunk boundary feature discontinuity and segmentation efficiency is not high. In this paper, we propose a simple linear iterative clustering superpixel segmentation algorithm (SLIC) that combines the Spark platform and optimal compactness evaluation. Firstly, the SLIC superpixel segmentation method with optimal tightness is used to complete the image chunking, which solves the problem of low accuracy of the chunk boundary; then, the SLIC segmentation algorithm is used in parallel to the chunked data by using Spark to improve the computational efficiency; finally, the SLIC algorithm is improved by using the ratio of vegetation index combined with the method of maximum interclass variation to improve the accuracy of the superpixel segmentation.WorldView-2 Satellite Imagery and GF-2 images are used as experimental data. The experimental results show that the improved SLIC method improves about 9 times of the original method in terms of computing efficiency, 1.5% of the edge fitting precision, 8.2% of the under-segmentation error, and 0.2% of the edge recall.

Key words: large format remote sensing image, Spark platform, improved SLIC algorithm, parallel computing, optimal parameter evaluation

CLC Number:

P237

XIE Zhiwei, SONG Guangming, ZHANG Fengyuan, CHEN Min, PENG Bo. Large format remote sensing image segmentation method based on Spark with optimised chunking[J]. Bulletin of Surveying and Mapping, 2024, 0(10): 84-90.

References

[1] 张谦,贾永红,吴晓良,等.一种带几何约束的大幅面遥感影像自动快速配准方法[J].武汉大学学报(信息科学版),2014,39(1): 17-21.
[2] 苏岳瀚.互联网场景下遥感影像的大规模并行处理技术研究[D].开封: 河南大学,2021.
[3] 常方正,赵银娣,刘善磊.遥感影像CVA变化检测的CUDA并行算法设计[J].遥感学报,2016,20(1): 114-128.
[4] 胥博文.基于异构平台的TWDTW遥感影像分类算法并行化研究[D].郑州: 郑州大学,2022.
[5] 霍迎秋,秦仁波,邢彩燕,等.基于CUDA的并行K-means聚类图像分割算法优化[J].农业机械学报,2014,45(11): 47-53.
[6] 李宏益,吴素萍.Mean Shift图像分割算法的并行化[J].中国图象图形学报,2013,18(12): 1610-1619.
[7] 张金.目标识别数据集原始图像恢复算法多线程并行研究[D].大连: 大连理工大学,2021.
[8] 袁媛,刘顺喜,陈静波,等.土地利用现状图斑约束下的并行图像分割[J].国土资源遥感,2013,25(4): 160-165.
[9] TOP A E,TORUN F Ş,KAYA H.Parallel k-means clustering with naïve sharding for unsupervised image segmentation via mpi “,” denetimsiz görüntü bölütleme için naïve sharding ile mpi kullanarak paralel k-means kümelemesi[J].Mühendislik Bilimleri Ve Tasarım Dergisi,2020,8(3): 791-798.
[10] HUANG Fang,CHEN Yinjie,LI Li,et al.Implementation of the parallel mean shift-based image segmentation algorithm on a GPU cluster[J].International Journal of Digital Earth,2019,12(3): 328-353.
[11] 邢郅超.基于分布式系统遥感图像与无人机低空遥感图像数据挖掘技术研究[D].济南: 山东大学,2020.
[12] KAUR CHAHAL P,PANDEY S.An efficient Hadoop-based brain tumor detection framework using big data analytic[J].Software: Practice and Experience,2022,52(3): 805-818.
[13] ZHANG Yidi.Hadoop small image processing technology based on big data processing and its application effect in face feature extraction and face recognition system design[J].Mobile Information Systems,2022,2022: 7493441.
[14] 王康.Spark的并行处理技术在岩石薄片图像的研究与应用[J].智能计算机与应用,2019,9(2):196-199.
[15] 李玉,崔书琳,赵泉华.基于优化RDD分区的Spark并行K-Means大尺度遥感图像分割 [J].控制与决策,2024,39(5):1612-1619.
[16] CHEBBI I,MELLOULI N,FARAH I R,et al.Big remote sensing image classification based on deep learning extraction features and distributed spark frameworks[J].Big Data and Cognitive Computing,2021,5(2): 21.
[17] WANG Ning,CHEN Fang,YU Bo,et al.Segmentation of large-scale remotely sensed images on a Spark platform: a strategy for handling massive image tiles with the MapReduce model[J].ISPRS Journal of Photogrammetry and Remote Sensing,2020,162: 137-147.
[18] 杨蕴.基于多智能体的大尺度高分辨率遥感影像分割研究[D].阜新: 辽宁工程技术大学,2022.
[19] 任伟建,刘泽宇,霍凤财,等.一种改进的多光谱遥感图像超像素分割算法[J].吉林大学学报(理学版),2022,60(2): 351-360.
[20] 朱士才,翟晓彤,王宗伟.基于Mean Shift的大批量遥感影像分割方法[J].国土资源遥感,2020,32(1): 13-18.
[21] NEUBERT P,PROTZEL P.Superpixel benchmark and comparison[J].Computer Science,2012,6: 1-12.
[22] 曾有灵,陈耿铎,熊威,等.基于Spark的CT图像FBP重建算法程序并行设计[J].计算机工程与应用,2019,55(10): 218-224.
[23] 汤梦瑶,程斐斐.基于Spark的地震数据分析与可视化系统设计与实现[J].现代信息科技,2023,7(18): 20-24.
[24] 胡敏,李梅,汪荣贵.改进的Otsu算法在图像分割中的应用[J].电子测量与仪器学报,2010,24(5): 443-449.
[25] 张继贤,顾海燕,杨懿,等.高分辨率遥感影像智能解译研究进展与趋势[J].遥感学报,2021,25(11): 2198-2210.
[26] 黄亮,姚丙秀,陈朋弟,等.高分辨率遥感影像超像素的模糊聚类分割法[J].测绘学报,2020,49(5):589-597.
[27] YANG Kunping,TONG Xinyi,XIA Guisong,et al.Hidden path selection network for semantic segmentation of remote sensing images[J].IEEE Transactions on Geoscience and Remote Sensing,2022,60: 1-15.
[28] 刘仲民,王阳,胡文瑾.超像素图像分割算法研究综述[C]//第18届中国系统仿真技术及其应用学术年会论文集(18th CCSSTA 2017),兰州:[s.n.],2017: 217-224.