期刊名称：Pakistan Journal of Statistics and Operation Research
印刷版ISSN：2220-5810
出版年度：2011
卷号：7
期号：2-Sp
DOI：10.1234/pjsor.v7i2-Sp.292
语种：English
出版社：College of Statistical and Actuarial Sciences
摘要：Although model selection is routinely used in practice nowadays, little is known about its precise effects on any subsequent inference that is carried out. The same goes for the effects induced by the closely related technique of model averaging. This paper is concerned with the use of the same data first to select a model and then to carry out inference, in particular point estimation and point prediction. The properties of the resulting estimator, called a post-model-selection estimator (PMSE), are hard to derive. Using selection criteria such as hypothesis testing, AIC, BIC, HQ and Cp, we illustrate that, in terms of risk function, no single PMSE dominates the others. The same conclusion holds more generally for any penalised likelihood information criterion. We also compare various model averaging schemes and show that no single one dominates the others in terms of risk function. Since PMSEs can be regarded as a special case of model averaging, with 0-1 random-weights, we propose a connection between the two theories, in the frequentist approach, by taking account of the selection procedure when performing model averaging. We illustrate the point by simulating a simple linear regression model.
关键词：Model averaging, model selection, inference after model selection, post-selection, weights
