基于短文本的突发事件发展过程表示方法

doi:10.11772/j.issn.1001-9081.2016.06.1605

计算机应用 ›› 2016, Vol. 36 ›› Issue (6): 1605-1612.DOI: 10.11772/j.issn.1001-9081.2016.06.1605

基于短文本的突发事件发展过程表示方法

陈雪, 胡晓峰, 徐浩

上海大学计算机工程与科学学院, 上海 200444

收稿日期:2015-09-21 修回日期:2015-11-30 出版日期:2016-06-10 发布日期:2016-06-08
通讯作者: 陈雪
作者简介:陈雪(1981-),女,河南信阳人,副教授,博士,CCF会员,主要研究方向:语义Web、对等网络、并行体系结构;胡晓峰(1991-),男,湖南湘潭人,硕士研究生,主要研究方向:海量Web信息挖掘;徐浩(1990-),男,江苏南通人,硕士研究生,主要研究方向:海量Web信息挖掘。
基金资助:
上海市教育委员会科研创新项目(B.10-0108-14-202)。

Burst-event evolution process expression based on short-text

CHEN Xue, HU Xiaofeng, XU Hao

School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China

Received:2015-09-21 Revised:2015-11-30 Online:2016-06-10 Published:2016-06-08
Supported by:
This work is partially supported by Innovation Program of Shanghai Municipal Education Commission (B.10-0108-14-202).

摘要/Abstract

摘要： 针对当前短文本的突发事件分析不能较为简易且准确地描述事件发展过程的问题,提出一种新的基于短文本的突发事件发展过程表示方法。首先,提出一种事件状态值,它被用于描述事件在各个时间点的状态,以便于用户分析事件的发展过程;其次,根据短文本的结构化信息,将事件状态值从文本信息和用户信息两个方面考虑;然后,考虑文本信息的影响因子,构造相关公式计算文本信息权重;再次,考虑用户信息的影响因子,提出一种改造的PageRank算法和用户分层思想,构造相关公式计算用户信息权重;最后,根据文本信息权重和用户信息权重计算事件状态值。实验结果表明依次考虑用户信息、采用改造的PageRank算法以及采用分层思想均能修正1~2个描述点,提高事件发展过程表示的准确度。

关键词: 事件分析, PageRank, 分层, 短文本, 状态值

Abstract: Current analytical method based on short-text can not describe the evolution process of burst-event in a simple and accurate manner. In order to solve the problem, a new method was proposed to express the evolution process of burst-event based on short-text data sets. Firstly, a method of measuring event status was proposed to describe the state of event at each time for analyzing the development process of the event. Secondly, according to the structured information of short-text, the value of event status was set from two aspects: text information and user information. Thirdly, with the consideration of the impact factor of text information, the weight of text information was calculated by constructing related formulas. Fourthly, with the consideration of the impact factor of user information, a modified PageRank algorithm was proposed, and users were divided into different layers to calculate the weight of user information by constructing related formulas. Finally, the weight of text information and the weight of user information were combined to calculate the value of event status. The experimental results show that considering user information in turn, the modified PageRank algorithm, and the idea of dividing the users into different layers all can correct 1~2 points of description and improve the accuracy of expressing the evolution process of event.

Key words: event analysis, PageRank, layering, short-text, status value

中图分类号:

TP391

陈雪, 胡晓峰, 徐浩. 基于短文本的突发事件发展过程表示方法[J]. 计算机应用, 2016, 36(6): 1605-1612.

CHEN Xue, HU Xiaofeng, XU Hao. Burst-event evolution process expression based on short-text[J]. Journal of Computer Applications, 2016, 36(6): 1605-1612.

参考文献

[1] LI C, SUN A, DATTA A. Twevent: segment-based event detection from tweets[C]//Proceedings of the 21st ACM International Conference on Information and Knowledge Management. New York: ACM, 2012: 155-164.
[2] VACA C K, MANTRACH A, JAIMES A, et al. A time-based collective factorization for topic discovery and monitoring in news[C]//WWW 2014: Proceedings of the 23rd International Conference on World Wide Web. New York: ACM, 2014: 527-538.
[3] ZHAO Z B, JIA Y F, LAN Y, et al. 5WTAG: detecting the topics of Chinese microblogs based on 5W model[C]//Proceedings of the 201310th Web Information System and Application Conference. Piscataway, NJ: IEEE, 2013: 237-242.
[4] SONG B, LOU H, WANG Y. A composite events detecting approach based on similar sub-events[C]//Proceedings of the 20129th Web Information Systems and Applications Conference. Piscataway, NJ: IEEE, 2012: 49-53.
[5] YOU B, LIU M, LIU B Q, et al. Detecting hot topics in technology news streams[C]//Proceedings of the 2012 International Conference on Machine Learning and Cybernetics. Piscataway, NJ: IEEE, 2012, 5: 1968-1974.
[6] LI W, HUANG Y. New event detect based on LDA and correlation of subject terms[C]//Proceedings of the 2011 International Conference on Internet Technology and Applications. Piscataway, NJ: IEEE, 2011: 1-4.
[7] 王昊,杨亮,林鸿飞.日本地震的微博热点事件分析[J].中文信息学报,2012,26(5):7-13.(WANG H, YANG L, LIN H F. Hot event analysis of Japan earthquake on microblog[J]. Journal of Chinese Information Processing, 2012, 26(5): 7-13.)
[8] 吴昊,耿焕同,吴祥.一种基于聚类分析的BBS主题发现算法研究[J].安徽师范大学学报(自然科学版),2009, 32(1):9-13.(WU H, GENG H T, WU X. Research on discovery of BBS topic based on clustering[J]. Journal of Anhui Normal University (Natural Science), 2009, 32(1): 9-13.)
[9] 唐果,陈宏刚.基于BBS热点主题发现的文本聚类方法[J].计算机工程,2010,36(7):79-81.(TANG G, CHEN H G. Text clustering method based on BBS hot topics discovery[J]. Computer Engineering, 2010, 36(7): 79-81.)
[10] 刘骅,朱庆华.基于标题的BBS热点话题挖掘——以南京大学小百合BBS为例[J].现代情报,2013,33(1):162-165.(LIU H, ZHU Q H. Hot topic mining based on titles in BBS-taking Lily BBS in Nanjing University as an example[J]. Journal of Modern Information, 2013, 33(1): 162-166.)
[11] 唐晓波,房小可.基于文本聚类与LDA相融合的微博主题检索模型研究[J].情报理论与实践,2013,36(8):85-90.(TANG X B, FANG X K. Microblogging topic retrieval model research based on integration of text clustering and LDA[J]. Information Studies: Theory & Application, 2013, 36(8): 85-90.)
[12] ROGERS I. the google pagerank algorithm and how it works[J]. IEEE Communications Letters, 1998, 2(2): 36-38.

[1]	李翀, 王宇宸, 杜伟静, 何晓涛, 刘学敏, 张士波, 李树仁. 基于Web of Science的PageRank人才挖掘算法[J]. 计算机应用, 2021, 41(5): 1356-1360.
[2]	王鹏, 李艳雯, 杨迪, 杨华民. 基于层级控制的宏观基本图交通信号控制模型[J]. 计算机应用, 2021, 41(2): 571-576.
[3]	邓钰, 李晓瑜, 崔建, 刘齐. 用于短文本情感分类的多头注意力记忆网络[J]. 《计算机应用》唯一官方网站, 2021, 41(11): 3132-3138.
[4]	尹春勇, 章荪. 面向短文本情感分类的端到端对抗变分贝叶斯方法[J]. 计算机应用, 2020, 40(9): 2536-2542.
[5]	陈晓楠, 胡建敏, 陈茜, 张威. 基于LightGBM算法的网络战仿真与效能评估[J]. 计算机应用, 2020, 40(7): 2003-2008.
[6]	薛露, 宋威. 基于动态标签的关系抽取方法[J]. 计算机应用, 2020, 40(6): 1601-1606.
[7]	王舒漫, 李爱萍, 段利国, 付佳, 陈永乐. 基于BTM的物联网服务发现方法[J]. 计算机应用, 2020, 40(2): 459-464.
[8]	张小川, 戴旭尧, 刘璐, 冯天硕. 融合多头自注意力机制的中文短文本分类模型[J]. 计算机应用, 2020, 40(12): 3485-3489.
[9]	张宪立, 唐建新, 曹来成. 基于反向PageRank的影响力最大化算法[J]. 计算机应用, 2020, 40(1): 96-102.
[10]	陈洁, 邵志清, 张欢欢, 费佳慧. 基于并行混合神经网络模型的短文本情感分析[J]. 计算机应用, 2019, 39(8): 2192-2197.
[11]	孟曌, 田生伟, 禹龙, 王瑞锦. 联合分层注意力网络和独立循环神经网络的地域欺凌识别[J]. 计算机应用, 2019, 39(8): 2450-2455.
[12]	涂广升, 杨晓元, 周潭平. 高效的身份基多用户全同态加密方案[J]. 计算机应用, 2019, 39(3): 750-755.
[13]	冯光升, 张晓雪, 王慧强, 李冰洋, 袁泉, 陈诗军, 陈大伟. 分层式三维室内地图分类方法及更新机制[J]. 计算机应用, 2019, 39(1): 78-81.
[14]	余慧, 冯旭鹏, 刘利军, 黄青松. 聊天机器人中用户就医意图识别方法[J]. 计算机应用, 2018, 38(8): 2170-2174.
[15]	曹大为, 贺超波, 陈启买, 刘海. 基于加权核非负矩阵分解的短文本聚类算法[J]. 计算机应用, 2018, 38(8): 2180-2184.

基于短文本的突发事件发展过程表示方法

Burst-event evolution process expression based on short-text

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics