Residual time

In the theory of renewal processes, a part of the mathematical theory of probability, the residual time or the forward recurrence time is the time between any given time ${\displaystyle t}$ and the next epoch of the renewal process under consideration. In the context of random walks, it is also known as overshoot. Another way to phrase residual time is "how much more time is there to wait?".

The residual time is very important in most of the practical applications of renewal processes:

• In queueing theory, it determines the remaining time, that a newly arriving customer to a non-empty queue has to wait until being served. ^[1]
• In wireless networking, it determines, for example, the remaining lifetime of a wireless link on arrival of a new packet.
• In dependability studies, it models the remaining lifetime of a component.
• etc.

Formal definition

Sample evolution of a renewal process with holding timesS_i and jump times J_n.

Consider a renewal process ${\displaystyle \{N(t),t\geq 0\}}$, with holding times${\displaystyle S_{i}}$ and jump times (or renewal epochs) ${\displaystyle J_{i}}$, and ${\displaystyle i\in \mathbb {N} }$. The holding times ${\displaystyle S_{i}}$ are non-negative, independent, identically distributed random variables and the renewal process is defined as ${\displaystyle N(t)=\sup\{n:J_{n}\leq t\}}$. Then, to a given time ${\displaystyle t}$, there corresponds uniquely an ${\displaystyle N(t)}$, such that:

${\displaystyle J_{N(t)}\leq t<J_{N(t)+1}.\,}$

The residual time (or excess time) is given by the time ${\displaystyle Y(t)}$ from ${\displaystyle t}$ to the next renewal epoch.

${\displaystyle Y(t)=J_{N(t)+1}-t.\,}$

Probability distribution of the residual time

Let the cumulative distribution function of the holding times ${\displaystyle S_{i}}$ be ${\displaystyle F(t)=Pr[S_{i}\leq t]}$ and recall that the renewal function of a process is ${\displaystyle m(t)=\mathbb {E} [N(t)]}$. Then, for a given time ${\displaystyle t}$, the cumulative distribution function of ${\displaystyle Y(t)}$ is calculated as: ^[2]

${\displaystyle \Phi (x,t)=\Pr[Y(t)\leq x]=F(t+x)-\int _{0}^{t}\left[1-F(t+x-y)\right]dm(y)}$

Differentiating with respect to ${\displaystyle x}$, the probability density function can be written as

${\displaystyle \phi (x,t)=f(t+x)+\int _{0}^{t}f(u+x)m'(t-u)du,}$

where we have substituted ${\displaystyle u=t-y.}$ From elementary renewal theory, ${\displaystyle m'(t)\rightarrow 1/\mu }$ as ${\displaystyle t\rightarrow \infty }$, where ${\displaystyle \mu }$ is the mean of the distribution ${\displaystyle F}$. If we consider the limiting distribution as ${\displaystyle t\rightarrow \infty }$, assuming that ${\displaystyle f(t)\rightarrow 0}$ as ${\displaystyle t\rightarrow \infty }$, we have the limiting pdf as

${\displaystyle \phi (x)={\frac {1}{\mu }}\int _{0}^{\infty }f(u+x)du={\frac {1}{\mu }}\int _{x}^{\infty }f(v)dv={\frac {1-F(x)}{\mu }}.}$

Likewise, the cumulative distribution of the residual time is

${\displaystyle \Phi (x)={\frac {1}{\mu }}\int _{0}^{x}[1-F(u)]du.}$

For large ${\displaystyle t}$, the distribution is independent of ${\displaystyle t}$, making it a stationary distribution. An interesting fact is that the limiting distribution of forward recurrence time (or residual time) has the same form as the limiting distribution of the backward recurrence time (or age). This distribution is always J-shaped, with mode at zero.

The first two moments of this limiting distribution ${\displaystyle \Phi }$ are:

${\displaystyle E[Y]={\frac {\mu _{2}}{2\mu }}={\frac {\mu ^{2}+\sigma ^{2}}{2\mu }},}$

${\displaystyle E[Y^{2}]={\frac {\mu _{3}}{3\mu }},}$

where ${\displaystyle \sigma ^{2}}$ is the variance of ${\displaystyle F}$ and ${\displaystyle \mu _{2}}$ and ${\displaystyle \mu _{3}}$ are its second and third moments.

Waiting time paradox

The fact that ${\displaystyle E[Y]={\frac {\mu ^{2}+\sigma ^{2}}{2\mu }}>{\frac {\mu }{2}}}$ (for ${\displaystyle \sigma >0}$) is also known variously as the waiting time paradox, inspection paradox, or the paradox of renewal theory. The paradox arises from the fact that the average waiting time until the next renewal, assuming that the reference time point ${\displaystyle t}$ is uniform randomly selected within the inter-renewal interval, is larger than the average inter-renewal interval ${\displaystyle {\frac {\mu }{2}}}$. The average waiting is ${\displaystyle E[Y]={\frac {\mu }{2}}}$ only when ${\displaystyle \sigma ^{2}=0}$, that is when the renewals are always punctual or deterministic.

Special case: Markovian holding times

When the holding times ${\displaystyle S_{i}}$ are exponentially distributed with ${\displaystyle F(t)=1-e^{-\lambda t}}$, the residual times are also exponentially distributed. That is because ${\displaystyle m(t)=\lambda t}$ and:

${\displaystyle \Pr[Y(t)\leq x]=\left[1-e^{-\lambda (t+x)}\right]-\int _{0}^{t}\left[1-1+e^{-\lambda (t+x-y)}\right]d(\lambda y)=1-e^{-\lambda x}.}$

This is a known characteristic of the exponential distribution, i.e., its memoryless property. Intuitively, this means that it does not matter how long it has been since the last renewal epoch, the remaining time is still probabilistically the same as in the beginning of the holding time interval.

Related notions

Renewal theory texts usually also define the spent time or the backward recurrence time (or the current lifetime) as ${\displaystyle Z(t)=t-J_{N(t)}}$. Its distribution can be calculated in a similar way to that of the residual time. Likewise, the total life time is the sum of backward recurrence time and forward recurrence time.

References

1. William J. Stewart, "Probability, Markov Chains, Queues, and Simulation: The Mathematical Basis of Performance Modeling", Princeton University Press, 2011, ISBN   1-4008-3281-0, 9781400832811
2. Jyotiprasad Medhi, "Stochastic processes", New Age International, 1994, ISBN   81-224-0549-5, 9788122405491