关键词: 关键词: Spark Streaming框架, 分布式流处理, 网络数据分析, DDoS攻击

Abstract: Abstract: In the vast amounts of concurrent network access, it has important significance to identify the network attack and make timely feedback from the huge amounts of data stream. In order to realize the rapid analysis of massive real-time data, a distributed real-time data analysis system（for short DRDAS）was designed, which resolve the collection, storage and real-time analysis for mass concurrent data；And according to the operation principle of spark streaming，a dynamic sampling K-means parallel algorithm was proposed, which Can quickly and efficiently detect all kinds of DDoS attacks. In the concerned experiments, the DRDAS has good scalability, fault tolerance and real-time processing ability; And along with new K-means parallel algorithm, the DRDAS can real-time detect various DDoS attacks, and shorten the detecting time of attacks.

Key words: Keywords: Spark Streaming Frame, Distributed Streaming Processing, Network Data Analysis, DDoS Attack