The efficiency improvement of spatial data analysis by using the distributed automatic parallel processing framework

doi:10.13474/j.cnki.11-2246.2020.0338

Abstract

Abstract: Focusing on the efficiency improvement of GIS application system in spatial data analysis, in view of the problem of data analysis and processing efficiency, this paper puts forward a set of efficiency improvement method based on distributed automatic parallel processing framework. It expounds how to realize the distributed automatic parallel processing based on the key technologies such as ArcPy, WebAPI, distributed scheduling and scheduling control factors. It is helpful to solve the efficiency problem of large amount of spatial data analysis and processing conveniently and efficiently.

Key words: ArcPy, WebAPI, distributed, parallel processing, spatial data analysis

CLC Number:

P208

LIANG Zheheng, WU Baoyou, XIE Gangsheng. The efficiency improvement of spatial data analysis by using the distributed automatic parallel processing framework[J]. Bulletin of Surveying and Mapping, 2020, 0(10): 143-147.

References

[1] 杨霄翼.基于Python的"地理处理"并行方案[J].地理信息世界,2017,24(6):117-121.
[2] 仇阿根,刘纪平,张志然,等.地理要素的分布式空间近似查询处理方法[J].测绘科学,2017,42(7):57-64.
[3] 李德仁.展望大数据时代的地球空间信息学[J].测绘学报,2016,45(4):379-384.
[4] 孙立新,张栩之,吕海洋.基于云计算SME-FFD算法的概率优度虚拟机资源配置[J].计算机工程,2016,42(5):23-29.
[5] 杨政,张朋.标准分幅影像图接边的自动检查[J].科学技术创新,2017(36):79-80.
[6] 朱道强,关海涛.Python在ArcGIS中的应用[J].测绘与空间地理信息,2013,36(7):152-154.
[7] 王尔琪,黄骞,滕寿威.地理空间信息并行处理架构与系统研究[J].测绘与空间地理信息,2013,36(S1):1-6,18.
[8] 彭海波,向洪普.基于Python的空间数据批量处理方法[J].测绘与空间地理信息,2011,34(4):81-82,85,87.
[9] 刘纪平,张福浩,王亮,等.面向大数据的空间信息决策支持服务研究与展望[J].测绘科学,2014,39(5):8-12,17.
[10] 朱剑.基于虚拟云计算架构的GIS服务资源弹性调度应用研究[J].测绘通报,2013(5):92-95,107.
[11] 陈晓斌,葛文,李歆,等.一种空间数据分布式处理方法[J].测绘工程,2013,22(1):4-6.
[12] 曾浩.FDTD及其并行算法在粗糙面和目标复合电磁散射中的应用[D].西安:西安电子科技大学,2010.
[13] 耿风华,陆鑫达.网络并行计算的一种新架构[J].计算机工程,2002(3):4-6.
[14] WANG S, ANSELIN L, BHADURI B, et al. CyberGIS software:a synthetic review and integration roadmap[J]. International Journal of Geographical Information Science, 2013, 27(11):2122-2145.
[15] DOBESOVA Z. Programming language python for data processing[C]//Proceedings of 2011 International Conference on Electrical and Control Engineering(ICECE).Yichang:IEEE,2011.