计算机应用 ›› 2005, Vol. 25 ›› Issue (03): 637-638.DOI: 10.3724/SP.J.1087.2005.0637

• 数据库与数据挖掘 • 上一篇    下一篇

一种基于熵的连续属性离散化算法

贺跃1,郑建军2,朱蕾1   

  1. 1. 北京理工大学信息科学技术学院; 2.北京理工大学管理与经济学院
  • 出版日期:2005-03-01 发布日期:2005-03-01

An entropy-based algorithm for discretization of continuous variables

HE Yue1,ZHENG Jian-jun2,ZHU Lei1   

  1. 1. School of Information Science and Technology, Beijing Institute of Technology, Beijing 100081, China; 2. School of Management and Economics, Beijing Institute of Technology, Beijing 100081, China
  • Online:2005-03-01 Published:2005-03-01

摘要:

连续属性离散化的关键在于合理确定离散化划分点的个数和位置。为了提高无监督离散化的效率,给出一种基于熵的连续属性离散化方法。该方法利用连续属性的信息量 (熵 )的特性,通过对连续属性变量的自身划分,最小化信息熵的减少和区间数,并寻求熵的损失与适度的区间数之间的最佳平衡,以便得到优化的离散值。实验表明该算法是行之有效的。

关键词: 熵, 连续属性, 离散化, 分类

Abstract:

It is very important to ascertain rationally the number and positions of split points for discretization of continuous variables. To improve the efficiency of unsupervised discretization, an entropy-based algorithm was proposed for discretization of continuous variables. It made use of the characteristics of the information content(entropy) of a continuous variable, and partitioned the continuous variable by itself for minimizing both the loss of entropy and the number of partitions, in order to find the best balance between the information loss and a low number of partitions, so then obtained an optimal discretization result. The experiments show this approach effective.

Key words: entropy, continuous variable, discretization, classification

中图分类号: