首页    期刊浏览 2024年09月18日 星期三
登录注册

文章基本信息

  • 标题:sCwc/sLcc: Highly Scalable Feature Selection Algorithms
  • 本地全文:下载
  • 作者:Kilho Shin ; Tetsuji Kuboyama
  • 期刊名称:Information
  • 电子版ISSN:2078-2489
  • 出版年度:2017
  • 卷号:8
  • 期号:4
  • 页码:159
  • DOI:10.3390/info8040159
  • 语种:English
  • 出版社:MDPI Publishing
  • 摘要:Feature selection is a useful tool for identifying which features, or attributes, of a dataset cause or explain the phenomena that the dataset describes, and improving the efficiency and accuracy of learning algorithms for discovering such phenomena. Consequently, feature selection has been studied intensively in machine learning research. However, while feature selection algorithms that exhibit excellent accuracy have been developed, they are seldom used for analysis of high-dimensional data because high-dimensional data usually include too many instances and features, which make traditional feature selection algorithms inefficient. To eliminate this limitation, we tried to improve the run-time performance of two of the most accurate feature selection algorithms known in the literature. The result is two accurate and fast algorithms, namely sCwc and sLcc. Multiple experiments with real social media datasets have demonstrated that our algorithms improve the performance of their original algorithms remarkably. For example, we have two datasets, one with 15,568 instances and 15,741 features, and another with 200,569 instances and 99,672 features. sCwc performed feature selection on these datasets in 1.4 seconds and in 405 seconds, respectively. In addition, sLcc has turned out to be as fast as sCwc on average. This is a remarkable improvement because it is estimated that the original algorithms would need several hours to dozens of days to process the same datasets. In addition, we introduce a fast implementation of our algorithms: sCwc does not require any adjusting parameter, while sLcc requires a threshold parameter, which we can use to control the number of features that the algorithm selects.
  • 关键词:feature selection; consistency; high-dimensional data; scalability feature selection ; consistency ; high-dimensional data ; scalability
国家哲学社会科学文献中心版权所有