[1] CHOWDHURY M, ZAHARIA M, MA J, et al. Managing data transfers in computer clusters with orchestra[J]. ACM SIGCOMM Computer Communication Review, 2011, 41(4):98-109. [2] YU W, WANG Y, QUE X, et al. Design evaluation of network-levitated merge for Hadoop acceleration[J]. IEEE Transactions on Parallel and Distributed Systems, 2014, 25(3):602-611. [3] RAHMAN M W, ISLAM N S, LU X, et al. A comprehensive study of MapReduce over lustre for intermediate data placement and shuffle strategies on HPC clusters[J]. IEEE Transactions on Parallel and Distributed Systems, 2017, 28(3):633-646. [4] SHI W, WANG Y, CORRIVEAU J, et al. Smart shuffling in MapReduce:a solution to balance network traffic and workloads[C]//Proceedings of the 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing. Piscataway, NJ:IEEE, 2015:35-44. [5] ARSLAN E, SHEKHAR M, KOSAR T. Locality and network-aware reduce task scheduling for data-intensive applications[C]//DataCloud 2014:Proceedings of the 5th International Workshop on Data-Intensive Computing in the Clouds. Piscataway, NJ:IEEE, 2014:14-24. [6] ZHENG H, WAN Z, WU J. Optimizing MapReduce framework through joint scheduling of overlapping phases[C]//Proceedings of the 201625th International Conference on Computer Communication and Networks. Piscataway, NJ:IEEE, 2016:1-9. [7] KE H, LI P, GUO S, et al. On traffic-aware partition and aggregation in MapReduce for big data applications[J]. IEEE Transactions on Parallel and Distributed Systems, 2016, 27(3):818-828. [8] KE H, LI P, GUO S, et al. Aggregation on the fly:reducing traffic for big data in the cloud[J]. IEEE Network, 2015, 29(5):17-23. [9] WANG J H, QIU M K, GUO B, et al. Phase-reconfigurable shuffle optimization for Hadoop MapReduce[J]. IEEE Transaction on Cloud Computing, 2017,PP(99):1. [10] YU W, WANG Y, QUE X, et al. Virtual shuffling for efficient data movement in MapReduce[J]. IEEE Transactions on Computers, 2015, 64(2):556-568. [11] 荀亚玲, 张继福, 秦啸.MapReduce集群环境下的数据放置策略[J]. 软件学报, 2015, 26(8):2056-2073.(XUN Y L, ZHANG J F, QIN X. Data placement strategy for MapReduce cluster environment[J]. Journal of Software, 2015, 26(8):2056-2073.) [12] LEE S, JO J-Y, KIM Y. Performance improvement of MapReduce process by promoting deep data locality[C]//Proceedings of the 2016 IEEE International Conference on Data Science and Advanced Analytics. Piscataway, NJ:IEEE, 2016:293-301. |