基于遗传算法和互信息公式结合的特征选择

Feature selection based on the combination of genetic algorithm and mutual information formula

  • 摘要: 提出了一种由遗传算法和改进互信息公式相结合的特征选择方法.将遗传算法中的特征评价函数换为改进互信息公式来对特征进行选择,结合了过滤式和封装式这2种特征选择方法的优点.实验部分采用另外2种特征选择算法与本文所提方法分别进行特征选择,将这3种方法所得到的特征子集用于概率神经网络、BP神经网络分类器上,通过比较对应的分类精度,检验各种特征选择方法的效果. 实验结果显示,所提出的特征选择方法能更为有效的实现特征选择,所取得的特征子集具有更好的泛化特性.

     

    Abstract: In order to effectively reduce the feature dimension and obtain the optimal subset of features, a method for feature selection combining the genetic algorithm with the improved mutual information formula is proposed. The improved mutual information formula is used as the fitness function of genetic algorithm for feature selection. The algorithm presented in this paper combines the advantages of filter and wrapper method. The other two feature selection algorithms are used to compare with this method; and probabilistic neural network and BP neural network are used as classifiers to test these three types of feature selection algorithms. The effects of different approaches are compared by classification accuracies. Experimental results show that the proposed feature selection method can select features effectively with better generalized property.

     

/

返回文章
返回