测绘通报 ›› 2020, Vol. 0 ›› Issue (1): 45-49,81.doi: 10.13474/j.cnki.11-2246.2020.0010

• 学术研究 • 上一篇    下一篇

一种基于ELK框架的地理信息动态时空数据获取与挖掘方法

吴嘉琪   

  1. 上海市测绘院, 上海 200063
  • 收稿日期:2019-10-11 发布日期:2020-02-10
  • 作者简介:吴嘉琪(1992-),男,硕士,助理工程师,研究方向为地理信息系统。E-mail:jiaqismi@163.com

A dynamic spatial-temporal data acquisition and mining method based on ELK stack

WU Jiaqi   

  1. Shanghai Institute of Surveying and Mapping, Shanghai 200063, China
  • Received:2019-10-11 Published:2020-02-10

摘要: 尝试将ELK框架在大规模日志实时处理方面的能力抽离出来,将其优势能力与地理信息技术相结合,提供一种基于ELK框架的地理信息动态时空数据获取与挖掘方法。该方法通过建立机制动态采集海量级非结构化数据,并实时筛取与地理要素相关的时空信息,从而实现海量级分析样本下的地理信息时空数据的实时动态分析与挖掘。最后以上海市快速路交通流量作为研究对象验证该方法模型,试验结果能够反映一定的社会潜在规律并提供相关指导价值,证明方法可行,并对方法的优缺点进行了记录与分析。

关键词: ELK, 动态时空数据, 实时数据获取与挖掘, 非结构化, 交通流量

Abstract: This paper attempts to extract the ability of ELK inprocessing large-scale and real-time log files, combines its superiority with geographic information technology, and provides a dynamic spatial-temporal data acquisition and mining method based on ELK stack. The method dynamically collects massive unstructured data and screens spatial-temporal information related to geographic elements in real time, so as to realize real-time dynamic analysis and mining of spatial-temporal geo-information data under massive analysis samples, and takes the traffic flow of Shanghai expressway which is used to verify the method model as a research object. The experimental results can reflect certain social potential laws and provide relevant guidance value, prove the method is feasible, and the advantages and disadvantages of the method are recorded and analyzed.

Key words: ELK, dynamic spatial-temporal data, real-time data acquisition and mining, unstructured, traffic flow

中图分类号: