BRS-inequality

BRS-inequality is the short name for Bruss-Robertson-Steele inequality. This inequality gives a convenient upper bound for the expected maximum number of non-negative random variables one can sum up without exceeding a given upper bound ${\displaystyle s>0}$.

For example, suppose 100 random variables ${\displaystyle X_{1},X_{2},...,X_{100}}$ are all uniformly distributed on ${\displaystyle [0,1]}$, not necessarily independent, and let ${\displaystyle s=10}$, say. Let ${\displaystyle N[n,s]:=N[100,10]}$ be the maximum number of ${\displaystyle X_{j}}$ one can select in ${\displaystyle \{X_{1},X_{2},...,X_{100}\}}$ such that their sum does not exceed ${\displaystyle s=10}$. ${\displaystyle N[100,10]}$ is a random variable, so what can one say about bounds for its expectation? How would an upper bound for ${\displaystyle E(N[n,s])}$ behave, if one changes the size ${\displaystyle n}$ of the sample and keeps ${\displaystyle s}$ fixed, or alternatively, if one keeps ${\displaystyle n}$ fixed but varies ${\displaystyle s}$? What can one say about ${\displaystyle E(N[n,s])}$, if the uniform distribution is replaced by another continuous distribution? In all generality, what can one say if each ${\displaystyle X_{k}}$ may have its own continuous distribution function ${\displaystyle F_{k}}$?

General problem

Let ${\displaystyle X_{1},X_{2},...}$ be a sequence of non-negative random variables (possibly dependent) that are jointly continuously distributed. For ${\displaystyle n\in \{1,2,...\}}$ and ${\displaystyle s\in \mathbb {R} ^{+}}$ let ${\displaystyle N[n,s]}$ be the maximum number of observations among ${\displaystyle X_{1},X_{2},...,X_{n}}$ that one can sum up without exceeding ${\displaystyle s}$.

Now, to obtain ${\displaystyle N[n,s]}$ one may think of looking at the list of all observations, first select the smallest one, then add the second smallest, then the third and so on, as long as the accumulated sum does not exceed ${\displaystyle s}$. Hence ${\displaystyle N[s,n]}$ can be defined in terms of the increasing order statistics of ${\displaystyle X_{1},X_{2},\cdots ,X_{n}}$, denoted by ${\displaystyle X_{1,n}\leq X_{2,n}\leq \cdots \leq X_{n,n},}$, namely by

${\displaystyle {\begin{aligned}N[n,s]={\begin{cases}0&,{\rm {~if~}}~X_{1,n}>s,\\\max\{~k\in \mathbb {N}$ :~X_{1,n}+X_{2,n}+\cdots +X_{k,n}\leq s\}&,{\rm {~otherwise}}.\end{cases}}\end{aligned}}(1)}

What is the best possible general upper bound for ${\displaystyle E(N[n,s])}$ if one requires only the continuity of the joint distribution of all variables? And then, how to compute this bound?

Identically distributed random variables.

Theorem 1 Let ${\displaystyle X_{1},X_{2},\cdots ,X_{n}}$ be identically distributed non-negative random variables with absolutely continuous distribution function ${\displaystyle F}$. Then

${\displaystyle E(N[n,s])\leq nF(t),}$ (2)

where ${\displaystyle t:=t(n,s)}$ solves the so-called BRS-equation

${\displaystyle n\int _{0}^{t}x\,dF(x)\,=\,s}$. (3)

As an example, here are the answers for the questions posed at the beginning. Thus let all ${\displaystyle X_{1},X_{2},\cdots ,X_{n}}$ be uniformly distributed on ${\displaystyle [0,1]}$. Then ${\displaystyle F(t)=t}$ on ${\displaystyle [0,1]}$, and hence ${\displaystyle dF(x)/dx=1}$ on ${\displaystyle [0,1]}$. The BRS-equation becomes

${\displaystyle n\int _{0}^{t}xdx=nt^{2}/2=s.}$

The solution is ${\displaystyle t={\sqrt {2s/n}}}$, and thus from the inequality (2)

${\displaystyle E(N[n,s])\leq n\,F(t)=n{\sqrt {2s/n}}={\sqrt {2sn}}}$. (4)

Since one always has ${\displaystyle N[n,s]\leq n}$, this bound becomes trivial for ${\displaystyle s\geq nE(X)=n/2}$.

For the example questions with ${\displaystyle n=100,s=10}$ this yields ${\displaystyle E(N[100,10])\leq {\sqrt {2000}}\approx 44.7}$. As one sees from (4), doubling the sample size ${\displaystyle n}$ and keeping ${\displaystyle s}$ fixed, or vice versa, yield for the uniform distribution in the non-trivial case the same upper bound.

Generalised BRS-inequality

Theorem 2. Let ${\displaystyle X_{1},X_{2},\cdots ,X_{n}}$ be positive random variables that are jointly distributed such that ${\displaystyle X_{k}}$ has an absolutely continuous distribution function ${\displaystyle F_{k},~k=1,2,\cdots ,n.}$. If ${\displaystyle N[n,s]}$ is defined as before, then

${\displaystyle E(N[n,s])\leq \sum _{k=1}^{n}F_{k}(t)}$, (5)

where ${\displaystyle t:=t(n,s)}$ is the unique solution of the BRS-equation

${\displaystyle \sum _{k=1}^{n}\int _{0}^{t}\,x\,dF_{k}(x)=s.}$ (6)

Clearly, if all random variables ${\displaystyle X_{i},i=1,2,\cdots ,n}$ have the same marginal distribution ${\displaystyle F}$, then (6) recaptures (3), and (5) recaptures (2). Again it should be pointed out that no independence hypothesis whatsoever is needed.

Refinements of the BRS-inequality

Depending on the type of the distributions ${\displaystyle F_{k}}$, refinements of Theorem 2 can be of true interest. We just mention one of them.

Let ${\displaystyle A[n,s]}$ be the random set of those variables one can sum up to yield the maximum random number ${\displaystyle N[n,s]}$, that is,

${\displaystyle \#A[n,s]=N[n,s]}$,

and let ${\displaystyle S_{A[n,s]}}$ denote the sum of these variables. The so-called residual ${\displaystyle s-S_{A[n,s]}}$ is by definition always non-negative, and one has:

Theorem 3. Let ${\displaystyle X_{1},X_{2},\cdots ,X_{n}}$ be jointly continuously distributed with marginal distribution functions ${\displaystyle F_{k},k=1,2,\cdots ,n}$, and let ${\displaystyle t:=t(n,s)}$ be the solution of (6). Then

${\displaystyle E(N[n,s])\leq \left(\sum _{k=1}^{n}F_{k}(t(n,s))\right)-{\frac {s-E(S_{A[n,s]})}{t(n,s)}}}$. (7)

The improvement in (7) compared with (5) therefore consists of

${\displaystyle {\frac {s-E(S_{A[n,s]})}{t(n,s)}}}$.

The expected residual in the numerator is typically difficult to compute or estimate, but there exist nice exceptions. For example, if all ${\displaystyle X_{k}}$ are independent exponential random variables, then the memoryless property implies (if s is exceeded) the distributional symmetry of the residual and the overshoot over ${\displaystyle s}$. For fixed ${\displaystyle s}$ one can then show that :${\displaystyle {\frac {s-E(S_{A[n,s]})}{t(n,s)}}\to 1/2{\rm {~as~}}n\to \infty }$. This improvement fluctuates around ${\displaystyle 1/2}$, and the convergence to ${\displaystyle 1/2}$, (simulations) seems quick.

Source

The first version of the BRS-inequality (Theorem 1) was proved in Lemma 4.1 of F. Thomas Bruss and James B. Robertson (1991). This paper proves moreover that the upper bound is asymptotically tight if the random variables are independent of each other. The generalisation to arbitrary continuous distributions (Theorem 2) is due to J. Michael Steele (2016). Theorem 3 and other refinements of the BRS-inequality are more recent and proved in Bruss (2021).

Applications

The BRS-inequality is a versatile tool since it applies to many types of problems, and since the computation of the BRS-equation is often not very involved. Also, and in particular, one notes that the maximum number ${\displaystyle N[n,s]}$ always dominates the maximum number of selections under any additional constraint, such as e.g. for online selections without recall. Examples studied in Steele (2016) and Bruss (2021) touch many applications, including comparisons between i.i.d. sequences and non-i.i.d. sequences, problems of condensing point processes, “awkward” processes, selection algorithms, knapsack problems, Borel-Cantelli-type problems, the Bruss-Duerinckx theorem, and online Tiling strategies.

References

Bruss F. T. and Robertson J. B. (1991) ’Wald’s Lemma’ for Sums of Order Statistics of i.i.d. Random Variables, Adv. Appl. Probab., Vol. 23, 612-623.

Bruss F. T. and Duerinckx M. (2015), Resource dependent branching processes and the envelope of societie, Ann. of Appl. Probab., Vol. 25 (1), 324-372.

Steele J.M. (2016), The Bruss-Robertson Inequality: Elaborations, Extensions, and Applications, Math. Applicanda, Vol. 44, No 1, 3-16.

Bruss F. T. (2021),The BRS-inequality and its applications, Probab. Surveys, Vol.18, 44-76.