首页    期刊浏览 2024年09月16日 星期一
登录注册

文章基本信息

  • 标题:Confidence intervals for policy evaluation in adaptive experiments
  • 本地全文:下载
  • 作者:Vitor Hadad ; David A. Hirshberg ; Ruohan Zhan
  • 期刊名称:Proceedings of the National Academy of Sciences
  • 印刷版ISSN:0027-8424
  • 电子版ISSN:1091-6490
  • 出版年度:2021
  • 卷号:118
  • 期号:15
  • 页码:1
  • DOI:10.1073/pnas.2014602118
  • 出版社:The National Academy of Sciences of the United States of America
  • 摘要:Adaptive experimental designs can dramatically improve efficiency in randomized trials. But with adaptively collected data, common estimators based on sample means and inverse propensity-weighted means can be biased or heavy-tailed. This poses statistical challenges, in particular when the experimenter would like to test hypotheses about parameters that were not targeted by the data-collection mechanism. In this paper, we present a class of test statistics that can handle these challenges. Our approach is to adaptively reweight the terms of an augmented inverse propensity-weighting estimator to control the contribution of each term to the estimator’s variance. This scheme reduces overall variance and yields an asymptotically normal test statistic. We validate the accuracy of the resulting estimates and their CIs in numerical experiments and show that our methods compare favorably to existing alternatives in terms of mean squared error, coverage, and CI size.
  • 关键词:adaptive experimentation ; multiarmed bandits ; policy evaluation ; central limit theorem ; frequentist inference
国家哲学社会科学文献中心版权所有