1. Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu Sichuan 610041, China 2. Graduate University of Chinese Academy of Sciences, Beijing 100049, China
LI Xiao-kai DAI Xiang LI Wen-jie CUI Zhe. Improved HDFS scheme based on erasure code and dynamical-replication system[J]. Journal of Computer Applications, 2012, 32(08): 2150-2158.
[1]GHEMAWAT S, GOBIOFF H, LEUNG S-T. The Google file system[C]// SOSP 2003: Proceedings of 19th ACM Symposium on Operating Systems Principles. New York: ACM, 2003:58-66.
[2]Hadoop[EB/OL].[2011-12-01]. http://hadoop.apache.org/common.
[3]Map-Reduce[EB/OL].[2011-12-01]. http://wiki.apache.org/mapreduce/.
[4]BORTHAKUR D.Hadoop and its usage at Facebook [R/OL]. [2011-11-13]. http://borthakur.com/ftp/newflixalone.pdf.
[5]MACKEY G, SEHRISH S, WANG JUN. Improving metadata management for small files in HDFS [C]// CLUSTER '09: IEEE International Conference on Cluster Computing and Workshops. Piscataway: IEEE, 2009: 1-4.
[6]THUSOO A, SARMA J S, JAIN N, et al. Hive: A petabyte scale data warehouse using Hadoop[C]// ICDE 2010:Proceedings of 26th IEEE International Conference on Data Engineering. Piscataway: IEEE, 2010: 996-1005.
[7]JIANG D, OOI B C, SHI L, et al. The performance of MapReduce: an in-depth study[J].Proceedings of the VLDB Endowment, 2010, 3(1/2): 472-483.
[8]DONG BO, QIU JIE, ZHENG QINGHUA, et al. A novel approach to improving the efficiency of storing and accessing small files on Hadoop: a case study by PowerPoint files[C]// SCC '10: Proceedings of the 2010 IEEE International Conference on Services Computing. Washington, DC: IEEE Computer Society, 2010:65-72.
[9]LIU XUHUI, HAN JIZHONG, ZHONG YUNQIN, et al. Implementing WebGIS on Hadoop: a case study of improving small file I/O performance on HDFS[C]// CLUSTER '09: IEEE International Conference on Cluster Computing and Workshops. Piscataway: IEEE, 2009:45-48.
[10]HDFS [EB/OL]. [2011-12-05]. http://hadoop.apache.org/common/.
[11]NameNode[EB/OL].[2011-12-11]. http://wiki.apache.org/namenode /.
[12]DataNode[EB/OL].[2011-12-21].http://wiki.apache.org/ datanode /.
[13]陈铮.一类新的阵列纠删码理论及应用[D].北京:中国科学院研究生院,2009.
[14]BlocksMap[EB/OL].[2011-02-08]. http://www.tbdata.org/archives/1120/.
[15]WHITE T. Hadoop: The definitive guide[M]. Sebastopol, California: O'Reilly Media,2011:295.