结合云存储的新一代博客系统架构

doi:10.11772/j.issn.1001-9081.2015.08.2158

计算机应用 ›› 2015, Vol. 35 ›› Issue (8): 2158-2163.DOI: 10.11772/j.issn.1001-9081.2015.08.2158

结合云存储的新一代博客系统架构

张宝军^1,2, 潘瑞芳^1,2

1. 浙江传媒学院新媒体学院, 杭州 310018;
2. 浙江省媒体传播优化协同创新中心, 杭州 310018

收稿日期:2015-03-05 修回日期:2015-04-10 出版日期:2015-08-10 发布日期:2015-08-14
通讯作者: 张宝军(1977-),男,湖北荆门人,讲师,博士,CCF会员,主要研究方向:计算机网络、体系结构,zbjhover@zju.edu.cn
作者简介:潘瑞芳(1959-),女,江西赣州人,教授,主要研究方向:数字媒体、数据库、计算机网络。
基金资助:
浙江省重点科技创新团队项目(2011R50019);国家新闻出版广电总局科研项目(2014-42)。

Architecture of new generation blog system with cloud storage

ZHANG Baojun^1,2, PAN Ruifang^1,2

1. School of New Media, Zhejiang University of Media and Communications, Hangzhou Zhejiang 310018, China;
2. Zhejiang Province Media Optimization of Collaborative Innovation Center, Hangzhou Zhejiang 310018, China

Received:2015-03-05 Revised:2015-04-10 Online:2015-08-10 Published:2015-08-14

摘要/Abstract

摘要：

为解决新一代博客系统海量信息的存储问题,结合云存储技术,提出了一种新的博客系统架构BlogCloud。该架构以分布式存储技术为核心,避免了集中式存储的性能瓶颈问题,可扩展性高;采用半分布式P2P网络拓扑结构,能快速定位网络中的存储资源;只将稳定节点作为存储节点,避免了不稳定节点带来的网络波动问题;遵循就近存储原则,同时在客户端缓存文件,减少了网络传输;允许用户自定义文件分块的大小,对大的文件可分块并行传输,提高了文件传输的速度,对小的文件则不用分块,节省了文件分块、合并的开销;具备数据冗余备份功能,在网络中多个存储节点保留文件副本,并实行异地备份,增强了数据的安全性和可靠性。在虚拟机上对BlogCloud和ZSWIN博客系统进行比较测试,结果显示:BlogCloud的吞吐量明显高于ZSWIN;将不稳定节点作为存储节点会降低BlogCloud的性能;在存储节点和索引节点减少的情况下BlogCloud仍然能够稳定运行,可靠性较高。结果表明,BlogCloud架构能够满足新一代博客系统的存储要求。

关键词: 云存储, 博客, 海量信息, 对等网络, 半分布式

Abstract:

To solve the storage problem of massive information for new generation blog system, combined with the cloud storage, a new blog system architecture named BlogCloud was proposed. By using the distributed storage technology, BlogCloud avoided the bottleneck problem in centralized storage, and had high scalability. With semi-distributed Peer-to-Peer (P2P) architecture, it located storage resources quickly. To avoid the network flipping caused by the instable nodes, only the stable nodes were regarded as storage nodes. The rule of nearest storage was adopted and the data was kept in the client cache to reduce the network transmission. Users were allowed to customize the block size of file, it meant that the large files could be devided into blocks and transmitted parallel to enhance the transmission speed, while the small files did not need to be devided, which saved the cost for segmentation and combination. It also had functions of redundancy to enhance the security and reliability of the data, including storing copies of files in multi-storage nodes and remote backup. The comparison test between BlogCloud and ZSWIN was given on the virtual machine. The results show that the throughput of BlogCloud is higher than ZSWIN obviously; the performance of BlogCloud is degraded when using instable nodes as the storage nodes; BlogCloud has high reliability, it still can run stably when reducing the storage nodes and index nodes. The results verify that BlogCloud can satisfy the storage requirements for the new generation blog system.

Key words: cloud storage, blog, massive information, Peer-to-Peer (P2P), semi-distributed

中图分类号:

TP393.09

张宝军, 潘瑞芳. 结合云存储的新一代博客系统架构[J]. 计算机应用, 2015, 35(8): 2158-2163.

ZHANG Baojun, PAN Ruifang. Architecture of new generation blog system with cloud storage[J]. Journal of Computer Applications, 2015, 35(8): 2158-2163.

参考文献

[1] HE F. Design and implementation of blog system based on SSH mode [D]. Changsha: Hunan University, 2012: 9-18. (何发胜. 基于SSH模式架构的博客系统的设计与实现[D]. 长沙:湖南大学, 2012: 9-18.)
[2] LIU Q. Design and implementation of enterprise blog system based on SSH framework [D]. Jinan: Shandong University, 2013:5-7. (柳青. 基于SSH框架的企业内博客系统的设计与实现[D]. 济南:山东大学, 2013: 5-7.)
[3] WIKIPEDIA. Cloud storage[EB/OL]. (2014-12-06) [2015-03-18]. http://en.wikipedia.org/wiki/Cloud_storage.
[4] GHEMAWAT S, GOBIOFF H, LEUNG S-T. The Google file system [C]//SIGOPS 2003: Proceedings of the 2003 Operating Systems Review. New York: ACM Special Interest Group on Operating Systems, 2003: 29-43.
[5] WU Z. The analysis of the core technology of cloud computing [M]. Beijing: People's Posts and Telecommunications Press, 2011: 7-8. (吴朱华.云计算核心技术剖析[M].北京: 人民邮电出版社,2011:7-8.)
[6] BORTHAKUR D. The Hadoop distributed file system: architecture and design [R/OL]. [S.l.]: The Apache Software Foundation, 2007 [2015-03-22]. http://svn.apache.org/repos/asf/hadoop/common/tags/release-0.13.1/docs/hdfs_design.pdf.
[7] Hbase Development Team. Hbase: bigtable-like structured storage for Hadoop HDFS [EB/OL]. (2011-12-20) [2014-11-15]. http://wiki.apache.org/hadoop/Hbase.
[8] GUAN L. P2P technology secret: the principle and typical system development of P2P network technology [M]. Beijing: Tsinghua University Press, 2011: 41-59. (管磊. P2P技术揭秘——P2P网络技术原理与典型系统开发[M]. 北京: 清华大学出版社, 2011:41-59.)
[9] XU F, YANG G, JU D. Design of distributed storage system on peer-to-peer structure [J]. Journal of Software, 2004, 15(2):268-277. (徐非,杨广文,鞠大鹏.基于Peer-to-Peer的分布式存储系统的设计 [J].软件学报, 2004, 15(2): 268-277.)
[10] TIAN R, LU X, HOU M, et al. P2P-based distributed storage system [J]. Computer Science, 2007, 34(6): 47-48. (田荣华,卢显良,侯孟书,等. P2P分布式存储系统 [J]. 计算机科学, 2007, 34(6): 47-48.)
[11] YANG D, XU L, ZHANG J. Blue whale distributed file system metadata service [J]. Computer Engineering, 2008, 34(7): 4-6. (杨德志,许鲁,张建刚.蓝鲸分布式文件系统元数据服务 [J].计算机工程,2008, 34(7): 4-6.)
[12] ZHANG J, ZHANG J, ZHANG J, et al. Isolation technology of metadata from data in blue whale file system [J]. Computer Engineering, 2010, 36(2): 28-30. (张敬亮,张军伟,张建刚,等.蓝鲸文件系统中元数据与数据隔离技术 [J].计算机工程,2010, 36(2): 28-30.)
[13] GROSSMAN R, GU Y. Data mining using high performance data clouds: experimental studies using sector and sphere [C]//KDD '08: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM, 2008: 920-927.
[14] GU Y, GROSSMAN R. Sector and sphere: the design and implementation of a high-performance data cloud [J]. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2009, 367(1897): 2429-2445.
[15] BOWERS K D, JUELS A, OPREA A. HAIL: a high-availability and integrity layer for cloud storage [C]//CCS '09: Proceedings of the 16th ACM Conference on Computer and Communications Security. New York: ACM, 2009: 187-198.
[16] MA W, WU H, LIU P. MassCloud cloud storage system architecture and reliability mechanism [J]. Journal of Hohai University: Natural Sciences, 2011, 39(3): 348-352. (马玮骏,吴海佳,刘鹏. MassCloud云存储系统构架及可靠性机制 [J]. 河海大学学报:自然科学版, 2011, 39(3): 348-352.)
[17] SUN J, YU H, ZHENG W. Index of meta-data set of the similar files for inline de-duplication in distributed storage systems [J]. Journal of Computer Research and Development, 2013, 50(1): 197-205. (孙竞,余宏亮,郑纬民. 支持分布式存储删冗的相似文件元数据集合索引 [J]. 计算机研究与发展, 2013, 50(1): 197-205.)
[18] YANG W. Sina micro-blog technical architecture analysis [EB/OL]. (2010-11-16) [2015-01-10]. http://tech.sina.com.cn/i/2010-11-16/14434871585.shtml. (杨卫华. 新浪微博技术架构分析[EB/OL]. (2010-11-16) [2015-01-10]. http://tech.sina.com.cn/i/2010-11-16/14434871585.shtml.)
[19] AIMEI. Analysis of the 2011 China cloud storage market development [EB/OL]. (2012-03-05) [2014-12-13]. http://www.iimedia.cn/26270.html. (艾媒网. 2011中国云存储市场发展状况研究分析[EB/OL]. (2012-03-05) [2014-12-13]. http://www.iimedia.cn/26270.html.)

结合云存储的新一代博客系统架构

Architecture of new generation blog system with cloud storage

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	李秀艳, 刘明曦, 史闻博, 董国芳. 面向资源受限用户的高效动态数据审计方案[J]. 计算机应用, 2021, 41(2): 422-432.
[2]	唐鑫, 周琳娜. 基于响应模糊化的抗附加块攻击云数据安全去重方法[J]. 计算机应用, 2020, 40(4): 1085-1090.
[3]	付伟, 顾晨阳, 高强. 基于属性加密的多用户共享ORAM方案[J]. 计算机应用, 2020, 40(2): 497-502.
[4]	王海勇, 彭垚, 郭凯璇. 云存储中基于代理重加密的CP-ABE访问控制方案[J]. 计算机应用, 2019, 39(9): 2611-2616.
[5]	柳玉东, 王绪安, 涂广升, 王涵. 全生命周期的云外包数据安全审计协议[J]. 计算机应用, 2019, 39(7): 1954-1958.
[6]	明洋, 何宝康. 支持属性撤销的可验证外包的多授权属性加密方案[J]. 计算机应用, 2019, 39(12): 3556-3562.
[7]	周坚, 金瑜, 何亨, 李鹏. 基于嵌套Merkle Hash tree区块链的云数据动态审计模型[J]. 计算机应用, 2019, 39(12): 3575-3583.
[8]	李静, 刘冬实. 主动容错云存储系统的可靠性评价模型[J]. 计算机应用, 2018, 38(9): 2631-2636.
[9]	陈博, 何连跃, 严巍巍, 徐照淼, 徐俊. 海量小文件系统的可移植操作系统接口兼容技术[J]. 计算机应用, 2018, 38(5): 1389-1392.
[10]	杨宏宇, 王玥. 云存储环境下的多关键字密文搜索方法[J]. 计算机应用, 2018, 38(2): 343-347.
[11]	王敏燊, 熊金波, 林倩, 王丽丽. 基于密钥分发和密文抽样的云数据确定性删除方案[J]. 计算机应用, 2018, 38(1): 194-200.
[12]	李强, 刘晓峰. 基于Hopfield神经网络的云存储负载均衡策略[J]. 计算机应用, 2017, 37(8): 2214-2217.
[13]	李昊宇, 张龙军, 李庆鹏. 基于B⁺树的动态数据持有性证明方案[J]. 计算机应用, 2017, 37(7): 1931-1935.
[14]	李阿妮, 张晓, 张伯阳, 柳春懿, 赵晓南. 公有云存储系统性能评测方法研究[J]. 计算机应用, 2017, 37(5): 1229-1235.
[15]	曹景源, 李立新, 李全良, 丁永善. 云存储环境下生命周期可控的数据销毁模型[J]. 计算机应用, 2017, 37(5): 1335-1340.