首页    期刊浏览 2024年11月28日 星期四
登录注册

文章基本信息

  • 标题:Spectrum of Variable-Random Trees
  • 本地全文:下载
  • 作者:F. T. Liu ; K. M. Ting ; Y. Yu
  • 期刊名称:Journal of Automation, Mobile Robotics & Intelligent Systems (JAMRIS)
  • 印刷版ISSN:1897-8649
  • 电子版ISSN:2080-2145
  • 出版年度:2008
  • 卷号:32
  • 页码:355-384
  • 出版社:Industrial Research Inst. for Automation and Measurements, Warsaw
  • 摘要:

    In this paper, we show that a continuous spectrum of randomisation exists, in which most existing tree randomisations are only operating around the two ends of the spectrum. That leaves a huge part of the spectrum largely unexplored. We propose a base learner VR-Tree which generates trees with variable-randomness. VR-Trees are able to span from the conventional deterministic trees to the complete-random trees using a probabilistic parameter. Using VR-Trees as the base models, we explore the entire spectrum of randomised ensembles, together with Bagging and Random Subspace. We discover that the two halves of the spectrum have their distinct characteristics; and the understanding of which allows us to propose a new approach in building better decision tree ensembles. We name this approach Coalescence, which coalesces a number of points in the random-half of the spectrum. Coalescence acts as a committee of ``experts'' to cater for unforeseeable conditions presented in training data. Coalescence is found to perform better than any single operating point in the spectrum, without the need to tune to a specific level of randomness. In our empirical study, Coalescence ranks top among the benchmarking ensemble methods including Random Forests, Random Subspace and C5 Boosting; and only Coalescence is significantly better than Bagging and Max-Diverse Ensemble among all the methods in the comparison. Although Coalescence is not significantly better than Random Forests, we have identified conditions under which one will perform better than the other.

国家哲学社会科学文献中心版权所有