Parallel computing method of data stream quantiles with GPU

Journal of Computer Applications ›› 2010, Vol. 30 ›› Issue (2): 543-546.

• Typical applications • Previous Articles Next Articles

Parallel computing method of data stream quantiles with GPU

Received:2009-08-02 Revised:2009-09-13 Online:2010-02-10 Published:2010-02-01
Contact: Hao Wang

使用GPU技术的数据流分位数并行计算方法

周勇¹,王皓²,程春田³

1. 大连理工大学
2. 大连理工大学软件学院
3.

通讯作者: 王皓
基金资助:
电力市场环境下省级电网水火电协调竞争优化及风险分析方法

Abstract

Abstract: The real-time, continuous and rapid arrival properties of data streams decide the real-time processing capability of data stream. Quantiles are commonly used for describing data stream with low dimension distribution. The research focused on mining powerful computing capacity and high memory bandwidth of Graphics Processing Unit (GPU) to compute data stream quantiles, and presented a GPU cooperated parallel processing model of data stream based on Computing Unified Device Architecture (CUDA) as well as parallel computing method of data stream quantiles which increased data stream processing bandwidth remarkably with precision no less than pure CPU algorithm.

Key words: Computing Unified Device Architecture (CUDA), general-purpose computing on graphics processing unit, data stream, quantile, parallel computing

摘要： 数据流实时、连续、快速到达的特点决定了数据流的实时处理能力。在处理低维数据流时经常使用分位数信息来描述数据流的统计信息，利用图形处理器（GPU）的强大计算能力和高内存带宽的特性计算数据流分位数信息，提出了基于统一计算设备架构（CUDA）的数据流处理模型和基于该模型的数据流分位数并行计算方法。实验证明，该方法在提供不低于纯CPU分位数算法相同精度的条件下，使数据流分位数的实时计算带宽得到了显著的提高。

关键词: 统一计算设备架构, 通用图形处理器, 数据流, 分位数, 并行计算

周勇王皓程春田. 使用GPU技术的数据流分位数并行计算方法[J]. 计算机应用, 2010, 30(2): 543-546.

[1]	Runlian ZHANG, Mi ZHANG, Xiaonian WU, Rui SHU. Differential property evaluation method based on GPU for large-state cryptographic S-boxes [J]. Journal of Computer Applications, 2024, 44(9): 2785-2790.
[2]	Dongliang MU, Meng HAN, Ang LI, Shujuan LIU, Zhihui GAO. Overview of classification methods for complex data streams with concept drift [J]. Journal of Computer Applications, 2023, 43(6): 1664-1675.
[3]	Zhiqiang CHEN, Meng HAN, Hongxin WU, Muhang LI, Xilong ZHANG. Multi-stage weighted concept drift detection method [J]. Journal of Computer Applications, 2023, 43(3): 776-784.
[4]	Qian LIU, Yangming ZHANG, Dingsheng WAN. Parallel computing algorithm of grid-based distributed Xin’anjiang hydrological model [J]. Journal of Computer Applications, 2023, 43(11): 3327-3333.
[5]	JIANG Songyan, LIAO Xiaojuan, CHEN Guangzhu. Optimal task scheduling method based on satisfiability modulo theory for multiple processors with communication delay [J]. Journal of Computer Applications, 2023, 43(1): 185-191.
[6]	Jingwen CAI, Yongzhuang WEI, Zhenghong LIU. GPU-based method for evaluating algebraic properties of cryptographic S-boxes [J]. Journal of Computer Applications, 2022, 42(9): 2750-2756.
[7]	Le WANG, Meng HAN, Xiaojuan LI, Ni ZHANG, Haodong CHENG. Ensemble classification algorithm based on dynamic weighting function [J]. Journal of Computer Applications, 2022, 42(4): 1137-1147.
[8]	Xinyuan QIU, Zecong YE, Xiaolong CUI, Zhiqiang GAO. Survey of communication overhead of federated learning [J]. Journal of Computer Applications, 2022, 42(2): 333-342.
[9]	Qidi XU, Zhenghong LIU, Lin ZHENG. Low density parity check code decoding acceleration technology based on GPU [J]. Journal of Computer Applications, 2022, 42(12): 3841-3846.
[10]	Xiaojuan LI, Meng HAN, Le WANG, Ni ZHENG, Haodong CHENG. Dynamic weighted ensemble classification algorithm based on accuracy climbing [J]. Journal of Computer Applications, 2022, 42(1): 123-131.
[11]	Zhihui SHAN, Meng HAN, Qiang HAN. Survey of high utility pattern mining on dynamic data [J]. Journal of Computer Applications, 2022, 42(1): 94-108.
[12]	YIN Chunyong, ZHANG Guojie. Ensemble classification model for distributed drifted data streams [J]. Journal of Computer Applications, 2021, 41(7): 1947-1955.
[13]	GUO Shuai, SU Yang. Encrypted traffic classification method based on data stream [J]. Journal of Computer Applications, 2021, 41(5): 1386-1391.
[14]	XIE Wenbo, WEI Yongzhuang, LIU Zhenghong. Parallel implementation and analysis of SKINNY encryption algorithm using CUDA [J]. Journal of Computer Applications, 2021, 41(4): 1136-1141.
[15]	YANG Xianfeng, GUI Hongjun, FU Chunchang. F-X domain predictive filtering parallel algorithm based on compute unified device architecture [J]. Journal of Computer Applications, 2021, 41(2): 486-491.

Parallel computing method of data stream quantiles with GPU

使用GPU技术的数据流分位数并行计算方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics