Hyperbolic discounting


In economics, hyperbolic discounting is a time-inconsistent model of delay discounting. It is one of the cornerstones of behavioral economics and its brain-basis is actively being studied by neuroeconomics researchers.
According to the discounted utility approach, intertemporal choices are no different from other choices, except that some consequences are delayed and hence must be anticipated and discounted.
Given two similar rewards, humans show a preference for one that arrives in a more prompt timeframe. Humans are said to discount the value of the later reward, by a factor that increases with the length of the delay. In the financial world, this process is normally modeled in the form of exponential discounting, a time-consistent model of discounting. Many psychological studies have since demonstrated deviations in instinctive preference from the constant discount rate assumed in exponential discounting. Hyperbolic discounting is an alternative mathematical model that agrees more closely with these findings.
According to hyperbolic discounting, valuations fall relatively rapidly for earlier delay periods, but then fall more slowly for longer delay periods. For example, in an early study subjects said they would be indifferent between receiving $15 immediately or $30 after 3 months, $60 after 1 year, or $100 after 3 years. These indifferences reflect annual discount rates that declined from 277% to 139% to 63% as delays got longer. This contrasts with exponential discounting, in which valuation falls by a constant factor per unit delay and the discount rate stays the same.
The standard experiment used to reveal a test subject's hyperbolic discounting curve is to compare short-term preferences with long-term preferences. For instance: "Would you prefer a dollar today or three dollars tomorrow?" or "Would you prefer a dollar in one year or three dollars in one year and one day?" It has been claimed that a significant fraction of subjects will take the lesser amount today, but will gladly wait one extra day in a year in order to receive the higher amount instead. Individuals with such preferences are described as "present-biased".
The most important consequence of hyperbolic discounting is that it creates temporary preferences for small rewards that occur sooner over larger, later ones. Individuals using hyperbolic discounting reveal a strong tendency to make choices that are inconsistent over time – they make choices today that their future self would prefer not to have made, despite knowing the same information. This dynamic inconsistency happens because hyperbolas distort the relative value of options with a fixed difference in delays in proportion to how far the choice-maker is from those options.

Observations

The phenomenon of hyperbolic discounting is implicit in Richard Herrnstein's "matching law", which states that when dividing their time or effort between two non-exclusive, ongoing sources of reward, most subjects allocate in direct proportion to the rate and size of rewards from the two sources, and in inverse proportion to their delays. That is, subjects' choices "match" these parameters.
After the report of this effect in the case of delay, George Ainslie pointed out that in a single choice between a larger, later and a smaller, sooner reward, inverse proportionality to delay would be described by a plot of value by delay that had a hyperbolic shape, and that when the smaller, sooner reward is preferred, this preference can be reversed by increasing both rewards' delays by the same absolute amount. Ainslie's research showed that a substantial number of subjects reported that they would prefer $50 immediately rather than $100 in six months, but would NOT prefer $50 in 3 months rather than $100 in nine months, even though this was the same choice seen at 3 months' greater distance. More significantly, those subjects who said they preferred $50 in 3 months to $100 in 9 months said they would NOT prefer $50 in 12 months to $100 in 18 months—again, the same pair of options at a different distance—showing that the preference-reversal effect did not depend on the excitement of getting an immediate reward. Nor does it depend on human culture; the first preference reversal findings were in rats and pigeons.
Many subsequent experiments have confirmed that spontaneous preferences by both human and nonhuman subjects follow a hyperbolic curve rather than the conventional, exponential curve that would produce consistent choice over time. For instance, when offered the choice between $50 now and $100 a year from now, many people will choose the immediate $50. However, given the choice between $50 in five years or $100 in six years almost everyone will choose $100 in six years, even though that is the same choice seen at five years' greater distance.
Hyperbolic discounting has also been found to relate to real-world examples of self-control. Indeed, a variety of studies have used measures of hyperbolic discounting to find that drug-dependent individuals discount delayed consequences more than matched nondependent controls, suggesting that extreme delay discounting is a fundamental behavioral process in drug dependence. Some evidence suggests pathological gamblers also discount delayed outcomes at higher rates than matched controls. Whether high rates of hyperbolic discounting precede addictions or vice versa is currently unknown, although some studies have reported that high-rate discounters are more likely to consume alcohol and cocaine than lower-rate discounters. Likewise, some have suggested that high-rate hyperbolic discounting makes unpredictable outcomes more satisfying.
The degree of discounting is vitally important in describing hyperbolic discounting, especially in the discounting of specific rewards such as money. The discounting of monetary rewards varies across age groups due to the varying discount rate. The rate depends on a variety of factors, including the species being observed, age, experience, and the amount of time needed to consume the reward.

Mathematical model

Step-by-step explanation

Suppose that in a study, participants are offered the choice between taking dollars immediately or taking dollars days later. Suppose further that one participant in that study employs exponential discounting and another employs hyperbolic discounting. Both participants know that they can invest the money they receive today in a savings plan that gives them an interest of. Both of them realize that they should take dollars immediately if the future value of the savings plan will yield more than dollars days later. Each participant correctly understands the fundamental question being asked: "For any given value of dollars and days, what is the minimum amount of dollars, that I should be willing to accept? In other words, how many dollars would I need to invest today to get dollars days from now?" Each will take dollars if is greater than the answer that they calculate, and each will take dollars days from now if is smaller than that answer. However, the methods that they use to calculate that amount and the answers that they get will be different, and only the exponential discounter will use the correct method and get a reliably correct result:
  • The exponential discounter thinks "The savings plan adds to its value, in each day, percent of the value that it had the previous day. So every day it multiplies its value once by. So if I hold the investment for days, its value will have multiplied itself by this amount times, making that value of what it was at the start – that is, times what it was at the start. So to figure out how much I would need to start with today to get dollars days from now, I need to divide dollars by."
  • The hyperbolic discounter, however, thinks "The savings plan adds to its value, in each day, percent. Therefore, after days, it adds to its value percent . So to figure out how much I would need to start with today to get dollars days from now, I need to divide dollars by."
As becomes very large, the value of becomes much larger than the value of, with the effect that the value of becomes much smaller than the value of Therefore, the minimum value of that suffices to be greater than that amount will be much smaller than the hyperbolic discounter thinks, with the result that they will perceive -values in the range from to inclusive as being too small and, as a result, irrationally turn those alternatives down when they are in fact the better investment.

Formal model

Hyperbolic discounting is mathematically described as
where is the discount factor that multiplies the value of the reward, is the delay in the reward, and is a parameter governing the degree of discounting. This is compared with the formula for exponential discounting:

Comparison

Consider an exponential discounting function with and a hyperbolic function with, and suppose both use units of weeks to measure, the delay. Then the exponential discounting a week from "now" is
and the exponential discounting from weeks of delay to weeks is
so the incremental discount associated with an additional week of delay is the same. For the hyperbolic model using, the discount for a week from now is
which is the same as for in the exponential model, while the incremental discount for an additional week after a delay of weeks is not the same:
From this one can see that the two models of discounting are the same "now"; this is the reason for the choice of interest rate parameters. However, when is much greater than 1,
so that the hyperbolic discounting of an additional week after a long delay is almost no discount at all, while the exponential discount factor is still 1/2, so there is still substantial discounting in the far future. Hyperbolic discounting places very little discount on an additional week of delay beyond an already large delay, while exponential discounting places a constant discount on every week of delay, whether it is far in the future or the next week.