逼真生成表格式数据的非时间属性关联模型

doi:10.11772/j.issn.1001-9081.2017.09.2684

计算机应用 ›› 2017, Vol. 37 ›› Issue (9): 2684-2688.DOI: 10.11772/j.issn.1001-9081.2017.09.2684

逼真生成表格式数据的非时间属性关联模型

张锐^1,2, 肖如良^1,2, 倪友聪^1,2, 杜欣^1,2

1. 福建师范大学软件学院, 福州 350117;
2. 福建省公共服务大数据挖掘与应用工程研究中心, 福州 350117

收稿日期:2017-03-29 修回日期:2017-05-16 出版日期:2017-09-10 发布日期:2017-09-13
通讯作者: 肖如良,xiaoruliang@163.com
作者简介:张锐(1992-),男,湖北孝感人,硕士研究生,主要研究方向:大数据软件;肖如良(1966-),男,湖南娄底人,教授,博士,CCF高级会员,主要研究方向:大数据软件、Web智能推荐系统、软件工程、系统虚拟化;倪友聪(1976-),男,安徽合肥人,副教授,博士,主要研究方向:软件体系结构、移动云计算;杜欣(1979-),女,新疆石河子人,副教授,博士,主要研究方向:智能计算、计算复杂性、基于搜索的软件工程。
基金资助:
福建省科技计划重大项目（2016H6007）；福州市市校合作项目（2016-G-40）。

Not-temporal attribute correlation model to generate table data realistically

ZHANG Rui^1,2, XIAO Ruliang^1,2, NI Youcong^1,2, DU Xin^1,2

1. Faculty of Software, Fujian Normal University, Fuzhou Fujian 350117, China;
2. Fujian Provincial Engineering Research Center of Public Service Big Data Mining and Application, Fuzhou Fujian 350117, China

Received:2017-03-29 Revised:2017-05-16 Online:2017-09-10 Published:2017-09-13
Supported by:
This work is partially supported by the Major Project of Fuijian Provincial Science and Technology Plan (2016H6007), Fuzhou City School Cooperation Project (2016-G-40).

摘要/Abstract

摘要： 针对数据仿真过程中表格数据属性间关联难的问题，提出一种刻画表格数据中非时间属性间关联特征的H模型。首先，从数据集中提取评价主体和被评价主体关键属性，进行两重频数统计，得到关于关键属性的4个关系对；然后，计算各关系对的最大信息系数（MIC）来评估各关系对的相关性，并采用拉伸指数分布（SE）对各关系对进行关系拟合；最后，设置评价主体和被评价主体的数据规模，根据拟合出的关系计算出评价主体的活跃度和被评价主体的流行度，通过活跃度总和等于流行度总和建立关联，得到非时间属性关联的H模型。实验结果表明，利用H模型能有效地刻画真实数据集中非时间属性间的关联特征。

关键词: 数据仿真, 关联, 最大信息系数, 拉伸指数分布, 属性关联

Abstract: To solve the difficulty of attribute correlation in the process of simulating table data, an H model was proposed for describing not-temporal attribute correlation in table data. Firstly, the key attributes of the evaluation subject and the evaluated subject were extracted from the data set, by the twofold frequency statistics, four relationships of the key attributes were obtained. Then, the Maximum Information Coefficient (MIC) of each relationship was calculated to evaluate the correlation of each relationship, and each relationship was fitted by the Stretched Exponential (SE) distribution. Finally, the data scales of the evaluation subject and the evaluated subject were set. According to the result of fitting, the activity of the evaluation subject was calculated, and the popularity of the evaluated subject was calculated. H model was obtained through the association that was established by equal sum of activity and popularity. The experimental results show that H model can effectively describe the correlation characteristics of the non-temporal attributes in real data sets.

Key words: data simulation, correlation, Maximum Information Coefficient (MIC), Stretched Exponential (SE) distribution, attribute correlation

中图分类号:

TP311.1

张锐, 肖如良, 倪友聪, 杜欣. 逼真生成表格式数据的非时间属性关联模型[J]. 计算机应用, 2017, 37(9): 2684-2688.

ZHANG Rui, XIAO Ruliang, NI Youcong, DU Xin. Not-temporal attribute correlation model to generate table data realistically[J]. Journal of Computer Applications, 2017, 37(9): 2684-2688.

参考文献

[1] MING Z, LUO C, GAO W, et al. BDGS:a scalable big data generator suite in big data benchmarking[C]//Advancing Big Data Benchmarks, LNCS 8585. Berlin:Springer, 2014:138-154.
[2] 詹剑锋,高婉铃,王磊,等.BigDataBench:开源的大数据系统评测基准[J].计算机学报,2016,39(1):196-211.(ZHAN J F, GAO W L, WANG L, et al. Bigdatabench:an open-source big data benchmark suite[J]. Chinese Journal of Computers, 2016, 39(1):196-211.)
[3] GRAY J, SUNDARESAN P, ENGLERT S, et al. Quickly generating billion-record synthetic databases[J]. ACM SIGMOD Record, 1994, 23(2):243-252.
[4] RABL T, FRANK M, SERGIEH H M, et al. A data generator for cloud-scale benchmarking[C]//Proceedings of the 2nd TPC Technology Conference on Performance Evaluation, Measurement and Characterization of Complex Systems. Berlin:Springer, 2010:41-56.
[5] COOPER B F, SILBERSTEIN A, TAM E, et al. Benchmarking cloud serving systems with YCSB[C]//Proceedings of the 1st ACM Symposium on Cloud Computing. New York:ACM, 2010:143-154.
[6] BRUNO N, CHAUDHURI S. Flexible database generators[C]//Proceedings of the 31st International Conference on Very Large Data Bases. Trondheim, Norway:VLDB Endowment, 2005:1097-1107.
[7] RABL T, LANG A, HACKL T, et al. Generating shifting workloads to benchmark adaptability in relational database systems[M]//Technology Conference on Performance Evaluation and Benchmarking, LNCS 5895. Berlin:Springer, 2009:116-131.
[8] YIN J, LU X, ZHAO X, et al. BURSE:a bursty and self-similar workload generator for cloud computing[J]. IEEE Transactions on Parallel & Distributed Systems, 2015, 26(3):668-680.
[9] AKROUR N, MALLET C, BARTHES L, et al. A rainfall simulator based on multifractal generator[EB/OL].[2016-12-04]. http://meetingorganizer.copernicus.org/EGU2015/EGU2015-9488.pdf.
[10] ANSARI N, LIU H, SHI Y Q, et al. On modeling MPEG video traffics[J]. IEEE Transactions on Broadcasting, 2002, 48(4):337-347.
[11] JIANG M, NIKOLIC M, HARDY S, et al. Impact of self-similarity on wireless data network performance[C]//Proceedings of the 2001 IEEE International Conference on Communications. Piscataway, NJ:IEEE, 2001:477-481.
[12] BUSARI M, WILLIAMSON C. ProWGen:a synthetic workload generation tool for simulation evaluation of Web proxy caches[J]. Computer Networks, 2002, 38(6):779-794.
[13] 丘志鹏,肖如良,张锐.优先关联的Web日志数据逼真生成算法[J].计算机系统应用,2017,26(3):126-133.(QIU Z P, XIAO R L, ZHANG R. Simulate generating Web log algorithm using Fields' priority relevance[J]. Computer Systems and Applications, 2017, 26(3):126-133.)
[14] RESHEF D N, RESHEF Y A, FINUCANE H K, et al. Detecting novel association in large data sets[J]. Science, 2011, 334(6062):1518-1524.
[15] 韩筱璞,汪秉宏,周涛.人类行为动力学研究[J].复杂系统与复杂性科学,2010,7(2):132-144.(HAN X P, WANG B H, ZHOU T. Researches of human dynamics[J]. Complex Systems and Complexity Science, 2010, 7(2):132-144.)
[16] 樊超,郭进利,韩筱璞,等.人类行为动力学研究综述[J].复杂系统与复杂性科学,2011,8(2):1-17.(FAN C, GUO J L, HAN X P, et al. A review of research on human dynamics[J]. Complex Systems and Complexity Science, 2011, 8(2):1-17.)
[17] GUO L, TAN E, CHEN S, et al. The stretched exponential distribution of Internet media access patterns[C]//Proceedings of the 27th ACM Symposium on Principles of Distributed Computing. New York:ACM, 2008:283-294.
[18] GUO L, TAN E, CHEN S, et al. Analyzing patterns of user content generation in online social networks[C]//Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM, 2009:369-378.

逼真生成表格式数据的非时间属性关联模型

Not-temporal attribute correlation model to generate table data realistically

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	余敦辉, 万鹏, 王社. 基于企业知识图谱构建的实体关联查询系统[J]. 计算机应用, 2021, 41(9): 2510-2516.
[2]	严海升, 马新强. 基于径向基函数的多目标回归特征构建算法[J]. 计算机应用, 2021, 41(8): 2219-2224.
[3]	肖跃雷, 邓小凡. 基于证书的有线局域网安全关联方案改进与分析[J]. 计算机应用, 2021, 41(7): 1970-1976.
[4]	徐国保, 陈媛晓, 王骥. 基于图卷积网络的药物靶标关联预测算法[J]. 计算机应用, 2021, 41(5): 1522-1526.
[5]	刘黎, 胡海波, 杨涛. 探索会展环境时空数据的可视分析系统[J]. 计算机应用, 2020, 40(9): 2719-2727.
[6]	戎炜, 蒋哲远, 谢昭, 吴克伟. 基于聚类关联网络的群组行为识别[J]. 计算机应用, 2020, 40(9): 2507-2513.
[7]	王磊. 改进粗糙集属性约简结合K-means聚类的网络入侵检测方法[J]. 计算机应用, 2020, 40(7): 1996-2002.
[8]	王剑, 唐珊, 黄于欣, 余正涛. 基于句子关联图的汉越双语多文档新闻观点句识别[J]. 计算机应用, 2020, 40(10): 2845-2849.
[9]	杨博, 蔺素珍, 禄晓飞, 李大威, 秦品乐, 左健宏. 基于多特征融合与分层数据关联的空中红外多目标跟踪方法[J]. 计算机应用, 2020, 40(10): 3075-3080.
[10]	王淳颖, 张驯, 赵金雄, 袁晖, 李方军, 赵博, 朱小琴, 杨凡, 吕世超. 基于多源告警的攻击事件分析[J]. 计算机应用, 2020, 40(1): 123-128.
[11]	严经纬, 李强, 王春茂, 谢迪, 王保青, 戴骏. 面部运动单元检测研究综述[J]. 计算机应用, 2020, 40(1): 8-15.
[12]	黄光球, 谢蓉. 考虑节点过载的碳排放空间关联系统级联失效模型[J]. 计算机应用, 2019, 39(6): 1829-1835.
[13]	于永斌, 戚敏惠, 尼玛扎西, 王琳. 基于阈值自适应忆阻器Hopfield神经网络的关联规则挖掘算法[J]. 计算机应用, 2019, 39(3): 728-733.
[14]	陈柳, 冯山. 正负关联规则两级置信度阈值设置方法[J]. 计算机应用, 2018, 38(5): 1315-1319.
[15]	尹远, 张昌, 文凯, 郑云俊. 基于DiffNodeset结构的最大频繁项集挖掘算法[J]. 计算机应用, 2018, 38(12): 3438-3443.