Big Data Organization Method of GIS Spatio-temporal Expanded the Streaming Data Cube

doi:10.13474/j.cnki.11-2246.2018.0257

Abstract

Abstract: Aiming at the problem of multi-source heterogeneous dynamic and data storage optimization for large-scale data faced by big data GIS,this paper studies geographical spatio-temporal data organization and model under the background of big data,proposes an extensible cube handing framework based on stream data,on the typical two-dimensional data sequence of stream data,constructs a data cube that increases the vertical direction to manage the unstructured data.Combining the definition and characteristics of the data cube model,this paper discusses the organization method of GIS spatio-temporal big data by extending relational database and cooperating non-relational database.Simultaneously,by extending the data sources,data types and data manipulation,this paper highlights the characteristics of spatio-temporal relationship and evolution process in the multi-source heterogeneous big data,and then,the data of spatio-temporal big data is organized,stored and analyzed together.In the end,this paper addresses the technical bottleneck question of large volume,heterogeneity and dynamic for spatio-temporal big data in GIS data management and analysis.Also,it provides scientific methods and solutions to effectively manage GIS spatio-temporal big data.

Key words: stream data, cube, big data of spatio-temporal, GIS

CLC Number:

P208

LU Yanling, LI Jingwen, YE Suxian, JIANG Jianwu, YIN Min, ZHOU Yanliu. Big Data Organization Method of GIS Spatio-temporal Expanded the Streaming Data Cube[J]. 测绘通报, 2018, 0(8): 115-118.

References

[1] KINSEY M.Global Institute,Big Data:The Next Frontier for Innovation Ompetition and Productivity[R].[S.l.]:McKinsey &Company,2011.
[2] AHALT S C.Why Data Science[J].Communications of the CCF,2013,9(12):11-15.
[3] 李清泉,李德仁.大数据GIS[J].武汉大学学报(信息科学版),2014,39(6):641-645.
[4] 李德仁,马军,邵振峰.论时空大数据及其应用[J].卫星应用,2015,1(9):7-12.
[5] LI Q,ZHANG T,YU Y.Using Cloud Computing to Process Intensive Floating Car Data for Urban Traffic Surveillance[J].International Journal of Geographical Information Science,2011,25(8):1301-1322.
[6] VIVONI E R,CAMILLI R.Real-time Streaming of Environmental Field Data[J].Computera & Geosciences,2003,29(4):457-468.
[7] 龚健雅,李小龙,吴华意.实时GIS时空数据模型[J].测绘学报,2014,43(3):226-233.
[8] HEATHMAN G C,LAROSE M,ASCOUGH J C.Soil and Water Assessment Tool Evaluation of Soil and Use Geographic Information System Data Sets on Simulated Stream Flow[J].Journal of Soil and Water Conservation,2009,64(1):17-32.
[9] 李庆华,陈球霞,蒋盛益.基于流数据的实时处理框架模型[J].计算机工程,2005,31(16):59-61.
[10] 黄祥志.基于智方体的地理时空栅格数据模型化研究[D].杭州:浙江大学,2015.
[11] GARBRECHT J,OGDEN F L,DEBARRY P A,et al.GIS and Distributed Watershed Models.1:Data Coverages and Sources[J].Joural of Hydrologic Engineering,2011,6(6):506-514.
[12] PIJANOWSKI B C,TAYYEBI A,DOUCETTE J,et al.A Big Data Urban Growth Simulation at a National Scale:Configuring the GIS and Neural Network Based Land Transformation Model to Run in a High Performance Computing (HPC) Environment[J].Environment Modelling & Software,2014,51:250-268.
[13] 刘经南,方媛,郭迟,等.位置大数据的分析处理研究进展[J].武汉大学学报(信息科学版),2014,39(4):379-386.
[14] 肖建华,王厚之,彭清山,等.地理时空大数据管理与应用云平台建设[J].测绘通报,2016(4):38-42.

[1]	QIANG Dexia, MA Haizheng, ZHU Ziping, GOU Yanmei. Spatial distribution and analysis of debris flow in Jishishan county of Gansu province [J]. Bulletin of Surveying and Mapping, 2022, 0(7): 107-111,117.
[2]	JING Haoran, XU Jinghai. Registration of unmanned aerial vehicle point clouds and terrestrial 3D laser scanner point clouds for irregular buildings [J]. Bulletin of Surveying and Mapping, 2022, 0(6): 32-39.
[3]	XIE Hong, CHEN Libo, NIE Qian, WU Wei, ZHANG Pei. Air-ground image fusion technology with point cloud registration [J]. Bulletin of Surveying and Mapping, 2022, 0(6): 82-87.
[4]	XIE Yuan, DONG Meng, MA Xinjian. Application of multi-source data in 3D reconstruction of buildings in complex scenes [J]. Bulletin of Surveying and Mapping, 2022, 0(6): 143-147.
[5]	GAO Jiaji, LI Hongkui, BAI Zhizhen, YANG Jun. Analysis of climate suitability pattern and influencing factors of human settlements in the three provinces of Northeast China based on GIS [J]. Bulletin of Surveying and Mapping, 2022, 0(6): 148-153.
[6]	ZHAO Chuanwu, WU Ziruo, ZHANG Yuhuan, GUO Wei. Analysis of impervious surface change in Ordos city based on multi-temporal remote sensing [J]. Bulletin of Surveying and Mapping, 2022, 0(5): 56-61.
[7]	RUAN Minghao, LU Yonghua, LIU Yuxian, TANG Shengjun, WANG Weixi, ZHANG Yuqi, LI You. Registration and seamless fusion of point cloud from LiDAR and oblique photography [J]. Bulletin of Surveying and Mapping, 2022, 0(4): 6-10.
[8]	PEI Lianlian, KONG Lingyan, REN Haiying, DONG Chengwei. Application of data sharing mode based on blockchain technology:taking Beijing real estate registration as an example [J]. Bulletin of Surveying and Mapping, 2022, 0(4): 154-157.
[9]	YANG Yiyuan, YANG Cunjian. Sensitivity analysis of ecological environment in Dongchuan district based on GIS [J]. Bulletin of Surveying and Mapping, 2022, 0(3): 7-12.
[10]	ZHANG Longqi, GUO Yunkai, ZHANG Yunfei. Discussion on GIS experimental hybrid teaching method for surveying and mapping engineering [J]. Bulletin of Surveying and Mapping, 2022, 0(2): 164-167,173.
[11]	GUO Ling, DU Weiwei, LIU Ling, LI Rui, WAN Ping. Application of 5G and high-precision positioning in military logistics warehousing application [J]. Bulletin of Surveying and Mapping, 2021, 0(9): 64-67,97.
[12]	YAN Kun, ZHANG Zhihua, YAN Luchun. Ground penetrating radar data reconstruction combined with regularized K-SVD and Hampel filter [J]. Bulletin of Surveying and Mapping, 2021, 0(8): 22-27.
[13]	WANG Yanli, GAO Kaichao, LIU Baoqiang, ZHOU Congwei. Construction and application of distribution cable mobile GIS system supported by GNSS [J]. Bulletin of Surveying and Mapping, 2021, 0(8): 150-153.
[14]	XU Gang, HU Kunlin, WEN Jianfeng, XU Dengcai, DAI Xinyi, CHEN Jie, ZHU Anfeng, ZHANG Hao, SU Zongkui. Assessment of disaster-prone areas considering the influence of terrain and neighborhood [J]. Bulletin of Surveying and Mapping, 2021, 0(7): 59-64.
[15]	XIONG Youyi, QIAO Jigang, ZHANG Wenjin. Registration of fisheyes panoramic image and terrestrial LiDAR date based on line feature [J]. Bulletin of Surveying and Mapping, 2021, 0(7): 74-80.