K-sorted sequence

In computer science, a nearly-sorted sequence, also known as roughly-sorted sequence and as ${\displaystyle k}$-sorted sequence is a sequence which is almost ordered. By almost ordered, it is meant that no element of the sequence is very far away from where it would be if the sequence were perfectly ordered. It is still possible that no element of the sequence is at the place where it should be if the sequence were perfectly ordered.

The nearly-sorted sequences are particularly useful when the exact order of element has little importance. For example Twitter ^[1] nearly sort tweets, up to the second, as there is no need for more precision. Actually, given the impossibility to exactly synchronize all computers, an exact sorting of all tweets according to the time at which they are posted is impossible. This idea led to the creation of Snowflake IDs.

${\displaystyle k}$-sorting is the operation of reordering the elements of a sequence so that it becomes ${\displaystyle k}$-sorted. ${\displaystyle k}$-sorting is generally more efficient than sorting. Similarly, sorting a sequence is easier if it is known that the sequence is ${\displaystyle k}$-sorted. So if a program needs only to consider ${\displaystyle k}$-sorted sequences as input or output, considering ${\displaystyle k}$-sorted sequences may save time.

The radius of a sequence is a measure of presortedness, that is, its value indicate how much the elements in the list has to be moved to get a totally sorted value. In the above example of tweets which are sorted up to the second, the radius is bounded by the number of tweets in a second.

Definition

Given a positive number ${\displaystyle k}$, a sequence ${\displaystyle [a_{1},\dots ,a_{n}]}$ is said to be ${\displaystyle k}$-sorted if for each ${\displaystyle 1\leq i}$ and for each ${\displaystyle i+k\leq j\leq n}$, ${\displaystyle a_{i}\leq a_{j}}$. That is, the sequence has to be ordered only for pairs of elements whose distance is at least ${\displaystyle k}$.

The radius of the sequence ${\displaystyle \alpha }$, denoted ${\displaystyle {\text{ROUGH}}(\alpha )}$ ^[2] or ${\displaystyle {\text{Par}}(\alpha )}$ ^[3] is the smallest ${\displaystyle k}$ such that the sequence is ${\displaystyle k}$-sorted. The radius is a measure of presortedness.

A sequence is said to be nearly-sorted or roughly-sorted if its radius is small compared to its length.

Equivalent definition

A sequence ${\displaystyle [a_{1},\dots ,a_{n}]}$ is ${\displaystyle k}$-sorted if and only if each range of length ${\displaystyle 2k+2}$, ${\displaystyle [a_{i},a_{i+1},\dots ,a_{i+2k+2}]}$ is ${\displaystyle k}$-sorted.

Properties

All sequences of length ${\displaystyle n}$ are ${\displaystyle (n-1)}$-sorted, that is, ${\displaystyle 0\leq {\text{Par}}([a_{1},\dots ,a_{n}])<n}$. A sequence is ${\displaystyle 0}$-sorted if and only if it is sorted. A ${\displaystyle k}$-sorted sequence is automatically ${\displaystyle (k+1)}$-sorted but not necessarily ${\displaystyle (k-1)}$-sorted.

Relation with sorted sequences

Given a sequence a ${\displaystyle k}$-sorted sequence ${\displaystyle [a_{1},\dots ,a_{n}]}$ and its sorted permutation ${\displaystyle [a_{\sigma _{1}},\dots ,a_{\sigma _{n}}]}$, ${\displaystyle |i-\sigma _{i}|}$ is at most ${\displaystyle k}$.

Algorithms

Deciding whether a sequence is ${\displaystyle k}$-sorted

Deciding whether a sequence ${\displaystyle [a_{1},\dots ,a_{n}]}$ is ${\displaystyle k}$-sorted can be done in linear time and constant space by a streaming algorithm. It suffices, for each ${\displaystyle 1\leq i<n-k}$, to keep track of ${\displaystyle \max(a_{j}\mid j\leq i)}$ and to check that ${\displaystyle a_{i+k}\geq \max(a_{j}\mid j\leq i)}$.

Computing the radius of a sequence

Computing the radius of a sequence can be computed in linear time and space. This follows from the fact that it can be defined as ${\displaystyle \max(i-j\mid \min(a_{k}\mid k\geq i)<\max(a_{k}\mid k\leq j))}$.

Halving the radius of a sequence

Given a ${\displaystyle 2k}$-sorted sequence ${\displaystyle \alpha =[a_{1},\dots ,a_{n}]}$, it is possible to compute a ${\displaystyle (k-1)}$-sorted permutation ${\displaystyle \alpha '}$ of ${\displaystyle \alpha }$ in linear time and constant space.

First, given a sequence ${\displaystyle \beta =[b_{1},\dots ,b_{2k}]}$, lets say that this sequence is partitioned if the ${\displaystyle k}$-smaller elements are in ${\displaystyle [b_{1},\dots ,b_{k}]}$ and the ${\displaystyle k}$-greater elements are in ${\displaystyle [b_{k+1},\dots ,b_{2k}]}$. Lets call partitioning the action of reordering the sequence ${\displaystyle \beta }$ into a partitioned permutation. This can be done in linear time by first finding the median of ${\displaystyle b}$ and then moving elements to the first or second half depending on whether they are smaller or greater than the median.

The sequence ${\displaystyle \alpha '}$ can be obtained by partitioning the blocks of elements at position ${\displaystyle [2k(i-1)+1,\dots ,2ki]}$, then by partitioning the blocks of elements at position ${\displaystyle [2k(i-1)+k+1,\dots ,2ki+k]}$, and then again the elements at position ${\displaystyle [2k(i-1)+1,\dots ,2ki]}$ for each number ${\displaystyle i}$ such that those sequences are defined.

Using ${\displaystyle {\frac {n}{2k}}}$ processors, with no shared read nor write access to memory, the same algorithm can be applied in ${\displaystyle O(k)}$ time, since each partition of a sequence can occur in parallel.

Merging two ${\displaystyle k}$-sorted sequences

Not to be confused with k-way merge algorithm.

Merging two ${\displaystyle k}$-sorted sequences ${\displaystyle \alpha ^{1}=[a_{1}^{1},\dots ,a_{n}^{1}]}$ and ${\displaystyle \alpha =[a_{1}^{2},\dots ,a_{m}^{2}]}$ can be done in linear time and constant space.

First, using the preceding algorithm, both sequences should be transformed into ${\displaystyle k/2}$-sorted sequences.

Let's construct iteratively an output sequence ${\displaystyle \omega }$ by removing content from both ${\displaystyle \alpha ^{i}}$ and adding it in ${\displaystyle \omega }$.

If both ${\displaystyle \alpha ^{i}}$'s are empty, then it suffices to return ${\displaystyle \omega }$. Otherwise, let us assume that ${\displaystyle \alpha ^{1}}$ is empty and not ${\displaystyle \alpha ^{2}}$, it suffices to remove the content of ${\displaystyle \alpha ^{2}}$ and append it to ${\displaystyle \omega }$. The case where ${\displaystyle \alpha ^{2}}$ is empty and not ${\displaystyle \alpha ^{1}}$ is similar by symmetry.

Let us consider the case where neither ${\displaystyle \alpha ^{i}}$ is empty. Let us call ${\displaystyle A^{1}=\max(a_{i}^{1}\mid 1\leq i\leq k/2)}$ and ${\displaystyle A^{2}=\max(a_{i}^{2}\mid 1\leq i\leq k/2)}$, they are the greatest of the ${\displaystyle k/2}$-firsts elements of each list. Let us assume that ${\displaystyle A^{1}<A^{2}}$, the other case is similar by symmetry. Remove ${\displaystyle a_{1}^{1},\dots ,a_{k/2}^{1}}$ from ${\displaystyle \alpha ^{1}}$ and remove ${\displaystyle \{a_{j}^{2}\mid 1\leq j\leq k/2,a_{j}^{2}\leq A^{1}\}}$ from ${\displaystyle \alpha ^{2}}$ and add them to ${\displaystyle \omega }$.

Sorting a ${\displaystyle k}$-sorted sequence

A ${\displaystyle k}$-sorted sequence can be sorted by applying the halving algorithm given above ${\displaystyle \log _{2}(k)}$ times. This takes ${\displaystyle O(n\log k)}$ time on a sequential machine, or ${\displaystyle O(k\log k)}$ time using ${\displaystyle O(n)}$ processors.

${\displaystyle k}$-sorting a sequence

Since each sequence ${\displaystyle \alpha =[a_{1},\dots ,a_{n}]}$ is necessarily ${\displaystyle n}$-sorted, it suffices to apply the halving algorithm ${\displaystyle \log _{2}\left({\frac {n}{k}}\right)}$-times. Thus, ${\displaystyle k}$-sorting can be done in ${\displaystyle O(n\log(n/k))}$-time. This algorithm is Par-optimal, that is, there exists no sequential algorithm with a better worst-case complexity.

References

1. @rk. "Announcing Snowflake". Twitter blog. Retrieved 26 April 2021.
2. Altman, Tom; Igarashi, Yoshihide (1989-08-25). "Roughly Sorting: Sequential and Parallel Approach". Journal of Information Processing. 12 (2): 154–158.
3. Estivill-Castro, Vladimir; Wood, Derick (October 1989). "A new measure of presortdness". Information and Computation. 83 (1): 111–119. doi: 10.1016/0890-5401(89)90050-3 .