Journal of Computer Applications ›› 2015, Vol. 35 ›› Issue (5): 1276-1279.DOI: 10.11772/j.issn.1001-9081.2015.05.1276

Previous Articles     Next Articles

Metadata management mechanism of massive spatial data storage

YANG Wenhui1, LI Guoqiang1, MIAO Fang1,2,3   

  1. 1. Key Laboratory of Earth Exploration and Information Techniques of Ministry of Education (Chengdu University of Technology), Chengdu Sichuan 610059, China;
    2. State Key Laboratory of Geohazard Prevention and Geoenvironment Protection (Chengdu University of Technology), Chengdu Sichuan 610059, China;
    3. Key Laboratory of Pattern Recognition and Intelligent Information Processing of University of Sichuan Province (Chengdu University), Chengdu Sichuan 610106, China
  • Received:2014-12-11 Revised:2015-01-17 Online:2015-05-10 Published:2015-05-14

面向海量空间数据存储的元数据管理机制

杨文晖1, 李国强1, 苗放1,2,3   

  1. 1. 地球探测与信息技术教育部重点实验室(成都理工大学), 成都 610059;
    2. 地质灾害防治与地质环境保护国家重点实验室(成都理工大学), 成都 610059;
    3. 模式识别与智能信息处理四川省高校重点实验室(成都大学), 成都 610106
  • 通讯作者: 李国强
  • 作者简介:杨文晖(1969-),女,上海人,副教授,主要研究方向:虚拟现实与仿真、分布式并行计算; 李国强(1990-),男,四川泸州人,硕士研究生,主要研究方向:分布式存储与计算、空间信息技术; 苗放(1958-),男,北京人,教授,博士,主要研究方向:计算机网络、空间信息技术.
  • 基金资助:

    国家自然科学基金资助项目(61071121);成都市经信委科技专项(201102153).

Abstract:

In order to manage the metadata of massive spatial data storage effectively, a distributed metadata server management structure based on consistent hashing was introduced, and on this basis, a metadata wheeled backup strategy was proposed in this paper, which stored Hash metadata node after excuting a consistent Hash algorithm according to the method of data backup, and it effectively alleviated the single point of metadata management and access bottleneck problems. Finally testing wheel backup strategy, it obtained the optimum number of metadata node backup solution. Compared with the single point of metadata servers, the proposed strategy improves the metadata safety, reduces the access delay, and improves the load balance of distributed metadata server combined with virtual nodes.

Key words: consistent hashing, metadata, distributed file system, wheeled backup strategy

摘要:

为了有效管理海量空间数据存储的元数据,引入了一种基于一致性哈希的分布式元数据服务器管理架构,并在此基础上提出了一种元数据轮式备份策略,将经过一致性哈希算法散列后存储元数据的节点按轮转方式进行数据备份,有效缓解了元数据管理的单点问题与访问瓶颈.最后对轮式备份策略进行测试,得出最佳元数据节点个数备份方案,与单点元数据服务器相比提高了元数据的安全性,降低了访问延迟,并结合虚拟节点改善了分布式元数据服务器的负载均衡.

关键词: 一致性哈希, 元数据, 分布式文件系统, 轮式备份策略

CLC Number: