| Peer-Reviewed

Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology

Received: 7 August 2017     Published: 7 August 2017
Views:       Downloads:
Abstract

It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.

Published in Science Discovery (Volume 5, Issue 5)
DOI 10.11648/j.sd.20170505.16
Page(s) 331-339
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.

Copyright

Copyright © The Author(s), 2017. Published by Science Publishing Group

Keywords

Framework, Business Data, Multi-source, Universality

References
[1] Gantz J, Reinsel D (2011) Extracting value from chaos. IDC iView, pp 1–12.
[2] Min Chen, Shiwen Mao, Yunhao Liu. Big Data: A Survey[J]. Mobile Netw Appl, 2014, 19: 171–209.
[3] Ahmed R, DeSmedt P, Kent W, et al. Pegasus: A system for seamless integration of heterogeneous information sources [C]. Compcon Spring'91. Digest of Papers. IEEE, 1991: 128-136.
[4] Attaluri G K, Bradshaw D P, Coburn N, et al. The CORDS multidatabase project [J]. IBM Systems Journal, 1995, 34(1): 39-62.
[5] Li L, kumar Nalluri A, Ai L. Space-Aware Data Integration for Ocean Observing Systems[J]. Procedia Environmental Sciences, 2011, 11: 285-290.
[6] Belussi A, Migliorini S. A framework for integrating multi-accuracy spatial data in geographical applications[J]. GeoInformatica, 2012, 16(3): 523-561.
[7] 程海军,胡圣武,张子平.GIS数据格式集成方法的探讨[J]. 河南理工大学学报:自然科学版, 2006, 25(1): 37-41.
[8] 张文江.地质灾害数据集成关键技术研究[D].成都:成都理工大学,2013。
[9] Bansal S K. Towards a Semantic Extract-Transform-Load (ETL) Framework for Big Data Integration[C]. Big Data (BigData Congress), 2014 IEEE International Congress on. IEEE, 2014: 522-529.
[10] 卢一枝,陈军华.Deep Web 数据库集成技术的研究[J].上海师范大学学报(自然科学版),2016, 45(4): 422-427。
[11] 陈惠敏,胡飞虎,耿泽飞等.基于GIS的灾害应急管理系统业务数据和空间数据的集成[J].自然灾害学报,2011, 20(1): 163-167。
[12] 董浩然,谢欢,陈鹏等.基于GIS主题爬虫的在线房产估价系统与优化[J].地理信息世界.2016, 23(2), 107-112。
[13] 于一男,关佶红,周水庚等.GSPress:一个GML流压缩器[J].小型微型计算机系统.2011, 32(3): 397-401。
[14] 崔玉洁,廖坤.借助八爪鱼采集器实现过刊网刊元数据的自动提取[J].编辑学报.2016, 28(5), 485-487。
[15] 冯文娟.基于FME实现CAD到GIS数据格式转换研究及实例[J].煤矿现代化.2015(3), 98-100。
[16] 郑江,闫世浩,陈宝枝等.基于DWGdirect.NET与Arcgis Engine的CAD地形图转换[J].测绘与空间地理信息.2015, 38(2), 176-178。
[17] 李伙友,吴善和.DWG与SHP数据格式互转换方法研究[J].集美大学学报 (自然科学版). 2015, 20(1), 76-80。
[18] 于艳超,许捍卫,杜婵娟.基于DWGDirect的CAD到GIS数据转换研究[J].地理空间信息.2015, 13(1), 84-86。
[19] myfme的博客.用MyFME扩展你的ArcGIS应用[EB/OL]. http://blog.sina.com.cn/s/blog_7cfdb4de0100uyw1.html. 2011-10-13。
Cite This Article
  • APA Style

    Xu Qiang, Fan Hong, Dang XiaoHu. (2017). Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Science Discovery, 5(5), 331-339. https://doi.org/10.11648/j.sd.20170505.16

    Copy | Download

    ACS Style

    Xu Qiang; Fan Hong; Dang XiaoHu. Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Sci. Discov. 2017, 5(5), 331-339. doi: 10.11648/j.sd.20170505.16

    Copy | Download

    AMA Style

    Xu Qiang, Fan Hong, Dang XiaoHu. Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Sci Discov. 2017;5(5):331-339. doi: 10.11648/j.sd.20170505.16

    Copy | Download

  • @article{10.11648/j.sd.20170505.16,
      author = {Xu Qiang and Fan Hong and Dang XiaoHu},
      title = {Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology},
      journal = {Science Discovery},
      volume = {5},
      number = {5},
      pages = {331-339},
      doi = {10.11648/j.sd.20170505.16},
      url = {https://doi.org/10.11648/j.sd.20170505.16},
      eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.sd.20170505.16},
      abstract = {It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.},
     year = {2017}
    }
    

    Copy | Download

  • TY  - JOUR
    T1  - Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology
    AU  - Xu Qiang
    AU  - Fan Hong
    AU  - Dang XiaoHu
    Y1  - 2017/08/07
    PY  - 2017
    N1  - https://doi.org/10.11648/j.sd.20170505.16
    DO  - 10.11648/j.sd.20170505.16
    T2  - Science Discovery
    JF  - Science Discovery
    JO  - Science Discovery
    SP  - 331
    EP  - 339
    PB  - Science Publishing Group
    SN  - 2331-0650
    UR  - https://doi.org/10.11648/j.sd.20170505.16
    AB  - It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.
    VL  - 5
    IS  - 5
    ER  - 

    Copy | Download

Author Information
  • College of Computer Science, Shaanxi Normal University, Xi’an, China

  • College of Computer Science, Shaanxi Normal University, Xi’an, China

  • College of Computer Science, Shaanxi Normal University, Xi’an, China

  • Sections