面向云存储的非结构化数据存取

doi:10.3724/SP.J.1087.2012.01924

计算机应用 ›› 2012, Vol. 32 ›› Issue (07): 1924-1928.DOI: 10.3724/SP.J.1087.2012.01924

面向云存储的非结构化数据存取

谢华成,陈向东

信阳师范学院网络信息与计算中心,河南信阳464000

收稿日期:2012-01-03 修回日期:2012-02-15 发布日期:2012-07-05 出版日期:2012-07-01
通讯作者: 谢华成
作者简介:谢华成(1977-),男,河南信阳人,讲师,硕士,CCF会员,主要研究方向:云存储、数据库系统；陈向东(1981-)，男,河南信阳人,助教,硕士,主要研究方向:分布式计算、信息系统。
基金资助:
河南省自然科学研究计划项目(102102210175;112300410234);河南省教育厅自然科学研究计划项目(2011A520038)

Cloud storage-oriented unstructured data storage

XIE Hua-cheng,CHEN Xiang-dong

Network Information and Computer Center, Xinyang Normal University, Xinyang Henan 464000, China

Received:2012-01-03 Revised:2012-02-15 Online:2012-07-05 Published:2012-07-01
Contact: XIE Hua-cheng

摘要/Abstract

摘要： 非结构化数据呈爆炸态势增长，现有存储技术在I/O吞吐能力、可扩展性及易管理性等方面亟待改进。存储系统以云存储和可靠性理论为基础，建立了非结构化数据的分布式存储模型，并设计了可靠度函数。采用分布式关系数据库管理系统(RDBMS)作为存储底层，将非结构化数据直接存储于数据表中，实现了非结构化数据和元数据的分离式存储和统一管理，进而提升了存储系统性能。相对于集中式存储，新系统具有较高的可用性。仿真结果显示，存储系统可靠度高且易于扩展。该分布式存储系统可应用于动态开放计算环境，提供效能较高的云存储服务。

关键词: 云存储, 非结构化数据存储, 可靠度函数, 数据分离存储, 存储仿真

Abstract: With the explosive growth of unstructured data, the existing storage technology in the aspects of I/O throughput, scalability and manageability needs improving urgently. Based on cloud storage and reliability theory, a model of distributed storage for unstructured data was created, and reliability function was also proposed. The distributed Relational Database Management System (RDBMS) was adopted as the bottom storage facilities, so unstructured data could be stored directly in the data table. Separated storage and unified management for unstructured data and metadata was realized, and thus storage system performance was promoted. Relative to the centralized storage, new system has superior availability. The simulation results show that the storage system has higher reliability and it is easy to expand. The distributed storage system can be applied to dynamic open computing environment, and it provides cloud storage service with better performance.

Key words: cloud storage, unstructured data storage, reliability function, data separate storage, storage simulation

中图分类号:

TP311
TP274

谢华成陈向东. 面向云存储的非结构化数据存取[J]. 计算机应用, 2012, 32(07): 1924-1928.

XIE Hua-cheng CHEN Xiang-dong. Cloud storage-oriented unstructured data storage[J]. Journal of Computer Applications, 2012, 32(07): 1924-1928.

参考文献

［1］ ZHU BIN, WANG ANBAO. The storage technology for GIS data realization ［J］. Journal of Computers, 2011, 10(6): 2229-2236.

［2］ DOAN A, NAUGHTON J F, BAID A, et al. The case for a structured approach to managing unstructured data ［EB/OL］. ［2011-10-11］. https://database.cs.wisc.edu/cidr/cidr2009/Paper_110.pdf.

［3］ ZHANG XIAO, DU XIAO-YONG, CHEN JIN-CHUAN, et al. Managing a large shared bank of unstructured data by using free-table ［C］// APWEB'10: Proceedings of the 2010 12th International Asia-Pacific Web Conference. Washington, DC: IEEE Computer Society, 2010: 441-446.

［4］ VILACA R, OLIVEIRA R. Clouder: a flexible large scale decentralized object store: architecture overview ［C］// WDDDM 2009: Proceedings of the Third Workshop on Dependable Distributed Data Management. New York: ACM, 2009: 25-28.

［5］ VAHDAT A, AL-FARES M, FARRINGTON N, et al. Scale-out networking in the data center ［J］. IEEE Micro, 2010, 30(4): 29-41.

［6］ LIN YUNFENG, LIANG BEN, LI BAOCHUN. Priority random linear codes in distributed storage systems ［J］. IEEE Transactions on Parallel and Distributed Systems, 2009, 20(11): 1653-1667.

［7］谢华成,张昆朋,范黎林,等.基于文件分割的二进制大对象存取算法［J］.计算机应用,2011,31(10):2612-2616.

［8］ DORNBACH J, ROEDEL M, KEHR J, et al. Enterprise service oriented architecture for large file handling with document management system: US, 7899922［P］. 2011-03-01.

［9］ ANGSKUN T, FAGG G, BOSILCA G, et al. Self-healing network for scalable fault-tolerant runtime environments ［J］. Future Generation Computer Systems, 2010, 26(3): 479-485.

［10］ GOTTUMUKKALA N R, NASSAR R, PAUN M, et al. Reliability of a system of k nodes for high performance computing applications ［J］. IEEE Transactions on Reliability, 2010, 59(1):162-169.

［11］陶永才,石磊.可靠的网格作业调度机制［J］.计算机应用,2010,30(8):2066-2069.

［12］林予松,陈安领,王宗敏.大规模流媒体直播系统扰动性研究［J］.计算机应用研究,2010,27(1):181-183.

［13］张民悦,陈艳丽.不同类型三部件串并联系统的可靠性分析［J］.兰州理工大学学报,2011,37(2):127-130.

［14］ CALDERN A, GARCA-CARBALLEIRA F, SNCHEZ L M, et al. Fault tolerant file models for parallel file systems: Introducing distribution patterns for every file ［J］. The Journal of Supercomputing, 2009, 47(3): 312-334.

[1]	李秀艳, 刘明曦, 史闻博, 董国芳. 面向资源受限用户的高效动态数据审计方案[J]. 计算机应用, 2021, 41(2): 422-432.
[2]	唐鑫, 周琳娜. 基于响应模糊化的抗附加块攻击云数据安全去重方法[J]. 计算机应用, 2020, 40(4): 1085-1090.
[3]	付伟, 顾晨阳, 高强. 基于属性加密的多用户共享ORAM方案[J]. 计算机应用, 2020, 40(2): 497-502.
[4]	王海勇, 彭垚, 郭凯璇. 云存储中基于代理重加密的CP-ABE访问控制方案[J]. 计算机应用, 2019, 39(9): 2611-2616.
[5]	柳玉东, 王绪安, 涂广升, 王涵. 全生命周期的云外包数据安全审计协议[J]. 计算机应用, 2019, 39(7): 1954-1958.
[6]	明洋, 何宝康. 支持属性撤销的可验证外包的多授权属性加密方案[J]. 计算机应用, 2019, 39(12): 3556-3562.
[7]	周坚, 金瑜, 何亨, 李鹏. 基于嵌套Merkle Hash tree区块链的云数据动态审计模型[J]. 计算机应用, 2019, 39(12): 3575-3583.
[8]	李静, 刘冬实. 主动容错云存储系统的可靠性评价模型[J]. 计算机应用, 2018, 38(9): 2631-2636.
[9]	陈博, 何连跃, 严巍巍, 徐照淼, 徐俊. 海量小文件系统的可移植操作系统接口兼容技术[J]. 计算机应用, 2018, 38(5): 1389-1392.
[10]	杨宏宇, 王玥. 云存储环境下的多关键字密文搜索方法[J]. 计算机应用, 2018, 38(2): 343-347.
[11]	王敏燊, 熊金波, 林倩, 王丽丽. 基于密钥分发和密文抽样的云数据确定性删除方案[J]. 计算机应用, 2018, 38(1): 194-200.
[12]	李强, 刘晓峰. 基于Hopfield神经网络的云存储负载均衡策略[J]. 计算机应用, 2017, 37(8): 2214-2217.
[13]	李昊宇, 张龙军, 李庆鹏. 基于B⁺树的动态数据持有性证明方案[J]. 计算机应用, 2017, 37(7): 1931-1935.
[14]	曹景源, 李立新, 李全良, 丁永善. 云存储环境下生命周期可控的数据销毁模型[J]. 计算机应用, 2017, 37(5): 1335-1340.
[15]	李阿妮, 张晓, 张伯阳, 柳春懿, 赵晓南. 公有云存储系统性能评测方法研究[J]. 计算机应用, 2017, 37(5): 1229-1235.

面向云存储的非结构化数据存取

Cloud storage-oriented unstructured data storage

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics