计算机应用 ›› 2016, Vol. 36 ›› Issue (3): 596-600.DOI: 10.11772/j.issn.1001-9081.2016.03.596

• 网络与通信 • 上一篇    下一篇

基于数据流转发的实时数据交换系统设计

曹健1, 刘琼2, 王远1   

  1. 1. 国网电力科学研究院 江苏瑞中数据股份有限公司, 南京 210000;
    2. 国网电力科学研究院 国电南瑞南京控制系统有限公司, 南京 210000
  • 收稿日期:2015-08-25 修回日期:2015-10-13 出版日期:2016-03-10 发布日期:2016-03-17
  • 通讯作者: 曹健
  • 作者简介:曹健(1987-),男,江苏连云港人,工程师,主要研究方向:分布式系统、数据交换;刘琼(1986-),女,江苏连云港人,工程师,硕士,主要研究方向:系统控制、数据挖掘;王远(1980-),男,山东青岛人,高级工程师,博士,主要研究方向:数据分析、数据库、分布式系统、并行计算。
  • 基金资助:
    国家863计划项目(2011AA05A116);国家电网科技项目(62KJ130501B1003620120)。

Firm real-time data-transmitting system based on data stream-transmitting mechanism

CAO Jian1, LIU Qiong2, WANG Yuan1   

  1. 1. China Real-time Database Company Limited, State Grid Electric Power Research Institute, Nanjing Jiangsu 210000, China;
    2. NARI Nanjing Control System Company Limited, State Grid Electric Power Research Institute, Nanjing Jiangsu 210000, China
  • Received:2015-08-25 Revised:2015-10-13 Online:2016-03-10 Published:2016-03-17
  • Supported by:
    This work is partially supported by the National High Technology Research and Development Program (863 Program) of China (2011AA05A116) and the Technology Research Program of National Grid (62KJ130501B1003620120).

摘要: 针对传统的基于全量转发机制的消息中间件应用于电力信息系统大规模数据交换时效率低的问题,设计并实现了基于数据流转发的实时数据交换中间件。基于队列缓冲技术,实现了消息型数据的异步发送与批量确认;设计了流式数据转发机制,消除数据在传输节点上的缓存延迟与缓存资源代价,提高了数据传输的及时性与并发性;结合分布式与数据路由思想,实现了对第三方系统透明的节点组网与数据路由功能。通过模拟某省电力信息系统数据交换场景,验证了系统性能,数据交换能力达3000并发,千兆带宽环境下系统传输速度达980 MB/s,交换延迟在毫秒级。

关键词: 消息中间件, 队列缓冲, 数据交换, 数据流, 数据路由, 异步传输

Abstract: Aiming at the low data-transmitting efficiency of the traditional message-oriented middleware in power information system, a firm real-time data-transmitting system based on data stream-transmitting mechanism was proposed. Queue caching mechanism was adopted to realize the asynchronous sending and batch confirmation of message. Data stream-transmitting mechanism was designed to eliminate the cache latency and the cost of cache resources of the data on transit node to improve the timeliness and concurrency of data transmission. Distributed and data routing thought was used-data to make the node network to the third-party system transparently and achieve a data routing distribution function. The simulation results of a provincial electric power information system data exchange scene, verified the system performance. Concurrent data exchange capacity is 3000 concurrent. Transmission speed in the gigabit bandwidth system environment is 980 MB/s. Switching delay is kept in milliseconds.

Key words: message-oriented middleware, queue caching, data-transmitting, data stream, data routing, asynchronous transmission

中图分类号: