首页    期刊浏览 2024年11月24日 星期日
登录注册

文章基本信息

  • 标题:A divided and prioritized experience replay approach for streaming regression
  • 本地全文:下载
  • 作者:Mikkel Leite Arnø ; John-Morten Godhavn ; Ole Morten Aamo
  • 期刊名称:MethodsX
  • 印刷版ISSN:2215-0161
  • 电子版ISSN:2215-0161
  • 出版年度:2021
  • 卷号:8
  • 页码:1-14
  • DOI:10.1016/j.mex.2021.101571
  • 语种:English
  • 出版社:Elsevier
  • 摘要:Graphical abstractDisplay OmittedAbstractIn the streaming learning setting, an agent is presented with a data stream on which to learn from in an online fashion. A common problem is catastrophic forgetting of old knowledge due to updates to the model. Mitigating catastrophic forgetting has received a lot of attention, and a variety of methods exist to solve this problem. In this paper, we present a divided and prioritized experience replay approach for streaming regression, in which relevant observations are retained in the replay, and extra focus is added to poorly estimated observations through prioritization. Using a real-world dataset, the method is compared to the standard sliding window approach. A statistical power analysis is performed, showing how our approach improves performance on rare, important events at a trade-off in performance for more common observations. Close inspections of the dataset are provided, with emphasis on areas where the standard approach fails. A rephrasing of the problem to a binary classification problem is performed to separate common and rare, important events. These results provide an added perspective regarding the improvement made on rare events.•We divide the prediction space in a streaming regression setting•Observations in the experience replay are prioritized for further training by the model’s current error
  • 关键词:Streaming regression;Catastrophic forgetting;Nonstationarity
国家哲学社会科学文献中心版权所有