Interleave lower bound

In the theory of optimal binary search trees, the interleave lower bound is a lower bound on the number of operations required by a Binary Search Tree (BST) to execute a given sequence of accesses.

Several variants of this lower bound have been proven. ^{[1] [2] [3]} This article is based on a variation of the first Wilber's bound. ^[4] This lower bound is used in the design and analysis of Tango tree. ^[4] Furthermore, this lower bound can be rephrased and proven geometrically, Geometry of binary search trees. ^[5]

Definition

The bound is based on a fixed perfect BST${\displaystyle P}$, called the lower bound tree, over the keys ${\displaystyle \{1,2,...,n\}}$. For example, for ${\displaystyle n=7}$, ${\displaystyle P}$ can be represented by the following parenthesis structure:

[([1] 2 [3]) 4 ([5] 6 [7])]

For each node ${\displaystyle y}$ in ${\displaystyle P}$, define:

• ${\displaystyle Left(y)}$ to be the set of nodes in the left sub-tree of ${\displaystyle y}$, including ${\displaystyle y}$.
• ${\displaystyle Right(y)}$ to be the set of nodes in the right sub-tree of ${\displaystyle y}$.

Consider the following access sequence: ${\displaystyle X=x_{1},x_{2},...,x_{m}}$. For a fixed node ${\displaystyle y}$, and for each access ${\displaystyle x_{i}}$, define the label of ${\displaystyle x_{i}}$ with respect to ${\displaystyle y}$ as:

• "L" - if ${\displaystyle x_{i}}$ is in ${\displaystyle Left(y)}$.
• "R" - if ${\displaystyle x_{i}}$ is in ${\displaystyle Right(y)}$;
• Null - otherwise.

The label of ${\displaystyle y}$ is the concatenation of the labels from all the accesses. For example, if the sequence of accesses is: ${\displaystyle 7,6,3}$ then the label of the root ${\displaystyle (4)}$ is: "RRL", the label of 6 is: "RL", and the label of 2 is: "R".

For every node ${\displaystyle y}$, define the amount of interleaving through y as the number of alternations between L and R in the label of ${\displaystyle y}$. In the above example, the interleaving through ${\displaystyle 4}$ and ${\displaystyle 6}$ is ${\displaystyle 1}$ and the interleaving through all other nodes is ${\displaystyle 0}$.

The interleave bound, ${\displaystyle {\mathit {IB}}(X)}$, is the sum of the interleaving through all the nodes of the tree. The interleave bound of the above sequence is ${\displaystyle 2}$.

The Lower Bound Statement and its Proof

The interleave bound is summarized by the following theorem.

Theorem —  Let ${\displaystyle X}$ be an access sequence. Denote by ${\displaystyle IB(X)}$ the interleave bound of ${\displaystyle X}$, then ${\displaystyle {\mathit {IB}}(X)/2-n}$ is a lower bound of ${\displaystyle OPT(X)}$, the cost of optimal offline BST that serves ${\displaystyle X}$.

The following proof is based on. ^[4]

Proof

Let ${\displaystyle X=x_{1},x_{2},...,x_{m}}$ be an access sequence. Denote by ${\displaystyle T_{i}}$ the state of an arbitrary BST at time ${\displaystyle i}$ i.e. after executing the sequence ${\displaystyle x_{1},x_{2},...,x_{i}}$. We also fix a lower bound BST ${\displaystyle P}$.

For a node ${\displaystyle y}$ in ${\displaystyle P}$, define the transition point for ${\displaystyle y}$ at time ${\displaystyle i}$ to be the minimum-depth node ${\displaystyle z}$ in the BST ${\displaystyle T_{i}}$ such that the path from the root of ${\displaystyle T_{i}}$ to ${\displaystyle z}$ includes both a node from Left(y) and a node from Right(y). Intuitively, any BST algorithm on ${\displaystyle T_{i}}$ that accesses an element from Right(y) and then an element from Left(y) (or vice versa) must touch the transition point of ${\displaystyle y}$ at least once. In the following Lemma, we will show that transition point is well-defined.

Lemma 1 — The transition point of a node ${\displaystyle y}$ in ${\displaystyle P}$ at a time ${\displaystyle i}$ exists and it is unique. ^[4]

Proof

Define ${\displaystyle \ell }$ to be the lowest common ancestor of all nodes in ${\displaystyle T_{i}}$ that are in Left(y). Given any two nodes ${\displaystyle a<b}$ in ${\displaystyle T_{i}}$, the lowest common ancestor of ${\displaystyle a}$ and ${\displaystyle b}$, denoted by ${\displaystyle lca(a,b)}$, satisfies the following inequalities. ${\displaystyle a\leq lca(a,b)\leq b}$. Consequently, ${\displaystyle \ell }$ is in Left(y), and ${\displaystyle \ell }$ is the unique node of minimum depth in ${\displaystyle T_{i}}$. Same reasoning can be applied for ${\displaystyle r}$, the lowest common ancestor of all nodes in ${\displaystyle T_{i}}$ that are in Right(y). In addition, the lowest common ancestor for all the points in Left(y) and right(y) is also in one of these sets. Therefore, the unique minimum depth node must be among the nodes of Left(y) and right(y). More precisely, it is either ${\displaystyle \ell }$ or ${\displaystyle r}$. Suppose, it is ${\displaystyle \ell }$. Then, ${\displaystyle \ell }$ is an ancestor of ${\displaystyle r}$. Consequently, ${\displaystyle r}$ is a transition points since the path from the root to ${\displaystyle r}$ contains ${\displaystyle \ell }$. Moreover, any path in ${\displaystyle T_{i}}$ from the root to a node in the sub-tree of ${\displaystyle y}$ must visit ${\displaystyle \ell }$ because it is the ancestor of all such nodes, and for any path to a node in the right region must visit ${\displaystyle r}$ because it is lowest common ancestor of all the nodes in right(y). To conclude, ${\displaystyle r}$ is the unique transition point for ${\displaystyle y}$ in ${\displaystyle T_{i}}$.

The second lemma that we need to prove states that the transition point is stable. It will not change until it is touched.

Lemma 2 — Given a node ${\displaystyle y}$. Suppose ${\displaystyle z}$ is the transition point of ${\displaystyle y}$ at a time ${\displaystyle j}$. If an access algorithm for a BST does not touch ${\displaystyle z}$ in ${\displaystyle T_{i}}$ for ${\displaystyle i\in [j,k]}$, then the transition point of ${\displaystyle y}$ will remain ${\displaystyle z}$ in ${\displaystyle T_{i}}$ for ${\displaystyle i\in [j,k]}$. ^[4]

Proof

Consider the same definition for ${\displaystyle \ell }$ and ${\displaystyle r}$ as in Lemma 1. Without loss of generality, suppose also that ${\displaystyle \ell }$ is an ancestor of ${\displaystyle r}$ in the BST at time ${\displaystyle j}$, denoted by ${\displaystyle T_{j}}$. As a result, ${\displaystyle r}$ will be the transition point of ${\displaystyle y}$. By hypothesis, the BST algorithm does not touch the transition point, in our case ${\displaystyle r}$, for the entirety of ${\displaystyle [j,k]}$. Therefore, it does not touch any node in Right(y). Consequently, ${\displaystyle r}$ remains the lowest common ancestor for any two nodes in Right(y). However, the access algorithm might touch a node in Left(y). More precisely, it might touch the lowest common ancestor of all nodes in Left(y) at a time ${\displaystyle i}$, which we will denoted by ${\displaystyle \ell _{i}}$. Even so, ${\displaystyle \ell _{i}}$ will remain the ancestor of ${\displaystyle r}$ for the following reasons: Firstly, observe that any node of Left(y) that was outside the tree rooted at ${\displaystyle r}$ at time ${\displaystyle j}$ cannot enter this tree at a time ${\displaystyle i\in [j,k]}$, since ${\displaystyle r}$ isn't touched in this time frame. Secondly, there exists at least one node ${\displaystyle \ell _{i}'}$ in Left(y) outside the tree rooted at ${\displaystyle r}$, for any time ${\displaystyle i\in [j,k]}$. This is since ${\displaystyle \ell }$ was initially outside ${\displaystyle r}$'s sub-tree, and no nodes from outside the tree can enter it in this timeframe. Now, consider ${\displaystyle a_{i}=lca(\ell _{i}',r)}$. ${\displaystyle a_{i}}$ cannot be ${\displaystyle r}$ since ${\displaystyle \ell _{i}'}$ is not in the sub-tree of ${\displaystyle r}$. So, ${\displaystyle a_{i}}$ must be in Left(y), since ${\displaystyle \ell _{i}'\leq a_{i}\leq r}$. Consequently ${\displaystyle \ell _{i}}$ must be an ancestor of ${\displaystyle a_{i}}$ and by consequence an ancestor of ${\displaystyle r}$ at time ${\displaystyle i}$. Therefore, there always exists a node in Left(y) on the path from the root to ${\displaystyle r}$, and as such ${\displaystyle r}$ remains the transition point.

The last Lemma toward the proof states that every node ${\displaystyle y\in P}$ has its unique transition point.

Lemma 3 — Given a BST at time ${\displaystyle i}$, ${\displaystyle T_{i}}$, any node ${\displaystyle y}$ in ${\displaystyle T_{i}}$ can be only a transition for at most one node in ${\displaystyle P}$. ^[4]

Proof

Given two distinct nodes ${\displaystyle y_{1},y_{2}\in P}$. Let ${\displaystyle r_{1},\ell _{1},r_{2},\ell _{2}}$ be the lowest common ancestor of ${\displaystyle Right(y_{1}),Left(y_{1}),Right(y_{2}),Left(y_{2})}$ respectively. From Lemma 1, we know that the transition point of ${\displaystyle y_{i}}$ is either ${\displaystyle \ell _{i}}$ or ${\displaystyle r_{i}}$ for ${\displaystyle i\in \{1,2\}}$. Now we have two main cases to consider.

Case 1: There is no ancestrally relation between ${\displaystyle y_{1}}$ and ${\displaystyle y_{2}}$ in ${\displaystyle P}$. Consequently, the ${\displaystyle Left(y_{1}),Left(y_{2}),Right(y_{1}),}$ and ${\displaystyle Right(y_{2})}$ are all disjoint. Thus, ${\displaystyle r_{1}\neq r_{2}\neq \ell _{1}\neq \ell _{2}}$, and the transition points are different.

Case 2: Suppose without loss of generality that ${\displaystyle y_{1}}$ is an ancestor of ${\displaystyle y_{2}}$ in ${\displaystyle P}$.

Case 2.1: Suppose that the transition point of ${\displaystyle y_{1}}$ is not in the tree rooted at ${\displaystyle y_{2}}$ in ${\displaystyle P}$. Thus, it is different from ${\displaystyle \ell _{2}}$ and ${\displaystyle r_{2}}$, and consequently the transition point of ${\displaystyle y_{2}}$.

Case 2.2: The transition point of ${\displaystyle y_{1}}$ is in the tree rooted at ${\displaystyle y_{2}}$ in ${\displaystyle P}$. More precisely, it is one of the lowest common ancestor of ${\displaystyle Left(y_{2})}$ and ${\displaystyle right(y_{2})}$. In other words, it is either ${\displaystyle \ell _{2}}$ or ${\displaystyle r_{2}}$.

Suppose ${\displaystyle a_{1}}$ is the lowest common ancestor of the sub-tree rooted at ${\displaystyle y_{1}}$ and does not contain ${\displaystyle y_{2}}$. We have ${\displaystyle \ell _{2}}$ and ${\displaystyle r_{2}}$ deeper than ${\displaystyle a_{1}}$ because one of them is the transition point. Suppose that ${\displaystyle \ell _{2}}$ is the transition point. Then, ${\displaystyle \ell _{2}}$ is less deep that ${\displaystyle r_{2}}$. In this case, ${\displaystyle \ell _{2}}$ is the transition point of ${\displaystyle y_{1}}$ and ${\displaystyle r_{2}}$ is the transition point of ${\displaystyle y_{2}}$. Similar reasoning applies if ${\displaystyle r_{2}}$ is less deep that ${\displaystyle \ell _{2}}$. In sum, the transition point of ${\displaystyle y_{1}}$ is the less deep from ${\displaystyle \ell _{2}}$ and ${\displaystyle r_{2}}$, and ${\displaystyle y_{2}}$ has the deeper one as a transition point.

In conclusion, the transition points are different in all the cases.

Now, we are ready to prove the theorem. First of all, observe that the number of touched transition points by the offline BST algorithm is a lower bound on its cost, we are counting less nodes than the required for the total cost.

We know by Lemma 3 that at any time ${\displaystyle i}$, any node ${\displaystyle y}$ in ${\displaystyle T_{i}}$ can be only a transition for at most one node in ${\displaystyle P}$. Thus, It is enough to count the number of touches of a transition node of ${\displaystyle y}$, the sum over all ${\displaystyle y}$.

Therefore, for a fixed node ${\displaystyle y\in P}$, let ${\displaystyle \ell }$ and ${\displaystyle r}$ to be defined as in Lemma 1. The transition point of ${\displaystyle y}$ is among these two nodes. In fact, it is the deeper one. Let ${\displaystyle x_{i_{1}},x_{i_{2}},...,x_{i_{p}}}$ be a maximal ordered access sequence to nodes that alternate between ${\displaystyle Left(y)}$ and ${\displaystyle Right(y)}$. Then ${\displaystyle p}$ is the amount of interleaving through the node ${\displaystyle y}$. Suppose that the even indexed accesses are in the ${\displaystyle Left(y)}$, and the odd ones are in ${\displaystyle Right(y)}$ i.e. ${\displaystyle x_{i_{2j}}\in Left(y)}$ and ${\displaystyle x_{i_{2j-1}}\in Right(y)}$. We know by the properties of lowest common ancestor that an access to a node in ${\displaystyle Left(y)}$, it must touch ${\displaystyle \ell }$. Similarly, an access to a node in ${\displaystyle Right(y)}$ must touch ${\displaystyle r}$. Consider every ${\displaystyle j\in [1,\lfloor p/2\rfloor ]}$. For two consecutive accesses ${\displaystyle x_{i_{2j-1}}}$ and ${\displaystyle x_{i_{2j}}}$, if they avoid touching the access point of ${\displaystyle y}$, then ${\displaystyle \ell }$ and ${\displaystyle r}$ must change in between. However, by Lemma 2, such change requires touching the transition point. Consequently, the BST access algorithm touches the transition point of ${\displaystyle y}$ at least once in the interval of ${\displaystyle [i_{2j-1},i_{2j}]}$. Summing over all ${\displaystyle j\in [1,\lfloor p/2\rfloor ]}$, the best algorithm touches the transition point of ${\displaystyle y}$ at least ${\displaystyle \lfloor p/2\rfloor \geq p/2-1}$. Summing over all ${\displaystyle y}$,

${\displaystyle \sum _{y\in P}p_{y}/2-1\geq IB(X)/2-n}$

where ${\displaystyle p_{y}}$ is the amount of interleave through ${\displaystyle y}$. By definition, the ${\displaystyle p_{y}}$'s add up to ${\displaystyle IB(X)}$. That concludes the proof.

See also

• Tango tree
• Optimal binary search tree
• Geometry of binary search trees

References

1. Wilber, R. (1989). "Lower Bounds for Accessing Binary Search Trees with Rotations". SIAM Journal on Computing. 18: 56–67. doi:10.1137/0218004.
2. Hampapuram, H.; Fredman, M. L. (1998). "Optimal Biweighted Binary Trees and the Complexity of Maintaining Partial Sums". SIAM Journal on Computing. 28: 1–9. doi:10.1137/S0097539795291598.
3. Patrascu, M.; Demaine, E. D. (2006). "Logarithmic Lower Bounds in the Cell-Probe Model" (PDF). SIAM Journal on Computing. 35 (4): 932. arXiv: cs/0502041 . doi:10.1137/S0097539705447256.
4. Demaine, E. D.; Harmon, D.; Iacono, J.; Pătraşcu, M. (2007). "Dynamic Optimality—Almost" (PDF). SIAM Journal on Computing. 37: 240–251. doi:10.1137/S0097539705447347.
5. Demaine, Erik D.; Harmon, Dion; Iacono, John; Kane, Daniel; Pătraşcu, Mihai (2009), "The geometry of binary search trees", In Proceedings of the 20th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA 2009), New York: 496–505, doi: 10.1137/1.9781611973068.55 , ISBN   978-0-89871-680-1