计算机应用 ›› 2014, Vol. 34 ›› Issue (6): 1541-1545.DOI: 10.11772/j.issn.1001-9081.2014.06.1541

• 网络与通信 • 上一篇    下一篇

基于分组特性的冗余流量消除算法

郑鸿1,2,邢玲1,2,马强1,2   

  1. 1. 特殊环境机器人技术四川省重点实验室, 四川 绵阳 621010
    2. 西南科技大学 信息工程学院,四川 绵阳 621010
  • 收稿日期:2013-12-13 修回日期:2014-03-01 出版日期:2014-06-01 发布日期:2014-07-02
  • 通讯作者: 郑鸿
  • 作者简介:郑鸿(1987-),男,四川成都人,硕士研究生,主要研究方向:冗余流量抑制;邢玲(1978-),女,四川成都人,副教授,博士,主要研究方向:大尺度冗余流量测量及其特性分析;马强(1982-),男,四川成都人,讲师,博士,主要研究方向:冗余抑制的体系结构。
  • 基金资助:

    国家自然科学基金资助项目

Redundancy traffic elimination algorithm based on packet feature

ZHENG Hong1,2,XING Ling1,2,MA Qiang1,2   

  1. 1. Robot Technology Used for Special Environment Key Laboratory of Sichuan Province, Mianyang Sichuan 621010, China
    2. School of Information Engineering, Southwest University of Science and Technology, Mianyang Sichuan 621010, China;
  • Received:2013-12-13 Revised:2014-03-01 Online:2014-06-01 Published:2014-07-02
  • Contact: ZHENG Hong

摘要:

针对大量数据片段冗余传输造成网络传输效率降低的问题,在协议无关冗余消除技术的基础上,提出了一种基于分组特性的冗余流量消除(PFRTE)算法。该算法以对数据包大小分组为基础,动态统计和分析网络流量的双峰特性和分组特性,以对冗余消除贡献大的数据包为阈值,利用滑动窗口计算数据块的边界点,对两个边界点间的数据块计算其指纹并进行指纹匹配。对重复传输的数据块进行简单编码,用编码数据替换重复传输的数据片段,再对消除冗余流量的数据包进行传输。与基于最大值选择和基于静态查找表选择等冗余流量消除算法相比,PFRTE算法动态统计网络流量分组特性,能够大大减少服务器端和客户端的CPU运行时间,同时冗余消除字节节省了8%~40%,证明了该算法的有效性。

Abstract:

Concerning the low efficiency of network transmission caused by redundant traffic, an algorithm named Packet Feature based Redundancy Traffic Elimination (PFRTE) was proposed based on the protocol-independent traffic redundancy elimination technique. Based on the grouping of packet size, PFRTE dynamically analyzed statistical bimodal characteristics and packet features of network traffic and regarded the size of the packet with the greatest capability of redundancy elimination as the threshold. It decided the boundary points by using sliding window method and calculated the fingerprint of block data within two boundary points. PFRTE encoded the redundant blocks in a simple way and transfered the encoded data instead of redundant data. The experimental results show that, compared with redundant traffic elimination algorithm based on maximum selection and static lookup table selection, PFRTE has the advantage of analyzing the redundancy statistics of network traffic dynamically, and the CPU consumption reduces both at server and client. Meanwhile, the algorithm is also effective with rate of redundancy elimination bytes saving of 8%-40%.

中图分类号: