首页    期刊浏览 2024年10月06日 星期日
登录注册

文章基本信息

  • 标题:PAC-Bayesian bounds for sparse regression estimation with exponential weights
  • 本地全文:下载
  • 作者:Pierre Alquier ; Karim Lounici
  • 期刊名称:Electronic Journal of Statistics
  • 印刷版ISSN:1935-7524
  • 出版年度:2011
  • 卷号:5
  • 页码:127-145
  • DOI:10.1214/11-EJS601
  • 语种:English
  • 出版社:Institute of Mathematical Statistics
  • 摘要:We consider the sparse regression model where the number of parameters p is larger than the sample size n. The difficulty when considering high-dimensional problems is to propose estimators achieving a good compromise between statistical and computational performances. The Lasso is solution of a convex minimization problem, hence computable for large value of p. However stringent conditions on the design are required to establish fast rates of convergence for this estimator. Dalalyan and Tsybakov [17–19] proposed an exponential weights procedure achieving a good compromise between the statistical and computational aspects. This estimator can be computed for reasonably large p and satisfies a sparsity oracle inequality in expectation for the empirical excess risk only under mild assumptions on the design. In this paper, we propose an exponential weights estimator similar to that of [17] but with improved statistical performances. Our main result is a sparsity oracle inequality in probability for the true excess risk.
国家哲学社会科学文献中心版权所有