Dynamic Environments and Time Preferences

Time

Let $\mathbb T$ denoted the the time index set in our dynamic model. We consider the following cases:

Finite Horizon
Infinite Horizon
Continuous
$\mathbb T=[0,T]$
$\mathbb T=[0,+\infty)$
Discrete
$\mathbb T=\{0,1,2,\ldots,T\}$
$\mathbb T=\{0,1,2,\ldots,+\infty\}$

Time Preferences

Discounting

Let's consider an utility flow $u(t)$ for $t$ in $\mathbb{T}$ of an agent.

  1. The value of one unit of utility in period $t$ in terms of present utility ($t=0$) is $d(t)\lt 1$.
  2. The value of $u(t)$ units of utility in period $t$ in terms of present utility is $d(t)\cdot u(t)$.
  3. We refer to $d(t)$ as the discount factor of the individual.

Time Preferences

Discounting — An Example: Present Value

When $u(t)$ for $t$ in $\mathbb{T}$ is the flow of profits for a firm:

  1. The value of one dollar period $t$ in terms of present value ($t=0$) is $d(t)=\frac{1}{(1+r)^{t}}$, where $r$ is the interest rate.
  2. The value of $u(t)$ dollars in period $t$ in terms of present value (PV) is $d(t)\cdot u(t)=\frac{u(t)}{(1+r)^{t}}$.
  3. $\mathrm{PV}(u_{0},u_{1},u_{2},u_{3},\ldots,u_{t},\ldots)=\sum_{t=0}^{+\infty}\frac{u_t}{(1+r)^{t}}$.

Time Preferences

Discounting

Consider discrete time and an utility flow $u(t)$ for $t$ in $\mathbb{T}$ of an agent. With discounting preferences, an agent evaluates utility flows, $(u(0),u(1),u(2),\ldots)$, accordingly to the discounted value of the flow: $$U(u(0),u(1),u(2),\ldots)=\sum_{t=0}^{+\infty}d(t)\cdot u(t).$$

Here, $d(t)$ is the discount factor of period $t$, and $d(t)\cdot u(t)$ is the present utility (the utility in terms of period $t=0$ utility) of receiving $u(t)$ utils in period $t$. Since we assume agents display impatient, they prefer to receive utility sooner than later, it follows that $0<d(t)<1$.

Time Preferences

Exponential Discounting

Exponential Discounting is the standard discounting model. Under exponential discounting $d(t)=\delta^{t}$ where $0<\delta<1$. $$U(u(0),u(1),u(2),\ldots)=\sum_{t=0}^{+\infty}\delta^{t}\cdot u(t).$$ The continuous time version is: $$U(u(t)_{t\in \mathbb T})=\int_{0}^{+\infty}\exp(-\rho\cdot t)\cdot u(t),$$ where $\rho=-\log(\delta)>0$.

Time Preferences

Exponential Discounting as a Particular Case of Recursive Utility

Consider the standard exponential discounting model with discrete time and finite horizon. We shall re-normalize the discounted utility by multiplying the utility by a factor of $1-\delta$, so the the discounted utility at period zero can be expressed as: $$U_{0}=(1-\delta)\sum_{t=0}^{T}\delta^{t}u_t.$$ Remember that $u_{t}$ is the instantaneous utility-- the utility that is actually received at period $t$. By the same token the discounted utility at period $\mathbf k$ can be written as: $$U_{k}=(1-\delta)\sum_{t=k}^{T}\delta^{t-k}u_t.$$

Time Preferences

Recursive Utility

Notice that we can write the discounted utility at period $\mathbf t$ in a recursive manner:

$$U_{t}=(1-\delta)u_t+\delta U_{t+1} \tag{R}$$

Using the fact that with a finite horizon, $U_{T+1}=0$ by definition, we can use the recursive equation (R) as a way of defining the discounted utility at a given period.

Time Preferences

Recursive Utility, The General Case

We saw that exponential discounting preferences can be stated in terms of recursive utility: $$U_{t}=(1-\delta)u_t+\delta U_{t+1},$$ The above formulation is a particular case of the following recursive preferences: $$U_{t}=\left((1-\delta)u_t^{\theta}+\delta U_{t+1}^{\theta}\right)^{\frac1\theta}$$ where $0<\theta\leq 1$ and $0<\delta < 1$.

Time Preferences

Recursive Utility, The General Case

Consider $\theta=\frac12$ and $\delta=\frac12$. Suppose $u_0=4$, $u_1=16$, and from $t=2$ onwards utility is constant: $u_2=u_3=\cdots=4$. Then: $$U_2=4, \quad U_1=\left(\tfrac12\sqrt{16}+\tfrac12\sqrt{4}\right)^2=9, \quad U_0=\left(\tfrac12\sqrt{4}+\tfrac12\sqrt{9}\right)^2=6.25.$$

Note: We assume that if the utility flow is constant from some period onwards, $u_t=\overline{u}$, then $U_t$ is also constant from that period onwards, $U_t=\overline{u}$. This assumption is needed because we cannot compute $U_\infty$ directly for infinite sequences.

Time Preferences

The Intertemporal Rate of Substitution

Assuming exponential discounting, at period $t$, what is the maximum amount the agent would be willing to sacrifice of future utility $U_{t+1}$ in order to increase the instantaneous utility $u_{t}$ by one util?

The answer is the marginal rate of intertemporal substitution of utility, MRIS. $$ (1-\delta)\Delta u_t+\delta \Delta U_{t+1}=0 \Rightarrow \mathrm{MRIS}=\left|\dfrac{ \Delta U_{t+1}}{ \Delta u_{t}}\right|=\dfrac{\delta}{1-\delta}. $$

So, in the case of exponential discounting the MRIS is a constant.

Recursive Utility and Intertemporal Rate of Substitution

In order to allow for preferences with non-constant MRIS, the following family of recursive utility functions is often used: $$U_{t}=\left((1-\delta)u_t^{\theta}+\delta U_{t+1}^{\theta}\right)^{\frac1\theta}$$ where $0<\theta\leq 1$.

$$\mathrm{MRIS}=\left|\dfrac{ \Delta U_{t+1}}{ \Delta u_{t}}\right|=\dfrac{\delta}{1-\delta}\left(\dfrac{U_{t+1}}{u_{t}}\right)^{1-\theta}. $$

Click here to practice computing recursive utilities.

← Dynamic Games Choice Under Uncertainty →