首页    期刊浏览 2024年11月26日 星期二
登录注册

文章基本信息

  • 标题:The Forward Search for Very Large Datasets
  • 本地全文:下载
  • 作者:Marco Riani ; Domenico Perrotta ; Andrea Cerioli
  • 期刊名称:Journal of Statistical Software
  • 印刷版ISSN:1548-7660
  • 电子版ISSN:1548-7660
  • 出版年度:2015
  • 卷号:67
  • 期号:1
  • 页码:1-20
  • 语种:English
  • 出版社:University of California, Los Angeles
  • 摘要:The identification of atypical observations and the immunization of data analysis against both outliers and failures of modeling are important aspects of modern statistics. The forward search is a graphics rich approach that leads to the formal detection of outliers and to the detection of model inadequacy combined with suggestions for model enhancement. The key idea is to monitor quantities of interest, such as parameter estimates and test statistics, as the model is fitted to data subsets of increasing size. In this paper we propose some computational improvements of the forward search algorithm and we provide a recursive implementation of the procedure which exploits the information of the previous step. The output is a set of efficient routines for fast updating of the model parameter estimates, which do not require any data sorting, and fast computation of likelihood contributions, which do not require matrix inversion or qr decomposition. It is shown that the new algorithms enable a reduction of the computation time by more than 80%. Furthemore, the running time now increases almost linearly with the sample size. All the routines described in this paper are included in the FSDA toolbox for MATLAB which is freely downloadable from the internet.
  • 关键词:fast updating, FSDA, linear and logical indexing, order statistics, MATLAB
国家哲学社会科学文献中心版权所有