摘要：Humans are known to discount future rewards hyperbolically in time. Nevertheless, a formal recursive model of hyperbolic discounting has been elusive until recently, with the introduction of the hyperbolically discounted temporal difference (HDTD) model. Prior to that, models of learning (especially reinforcement learning) have relied on exponential discounting, which generally provides poorer fits to behavioral data. Recently, it has been shown that hyperbolic discounting can also be approximated by a summed distribution of exponentially discounted values, instantiated in the µAgents model. The HDTD model and the µAgents model differ in one key respect, namely how they treat sequences of rewards. The µAgents model is a particular implementation of a parallel discounting model, which values sequences based on the summed value of the individual rewards whereas the HDTD model contains a nonlinear interaction. To discriminate among these models, we ascertained how subjects discounted a sequence of three rewards, and then we tested how well each candidate model fit the subject data. The results show that the parallel model generally provides a better fit to the human data.
关键词：discounting; hyperbolic discounting; Exponential discounting; model fitting; Parallel model; temporal difference learning; recursive model; Behavioral Research
