De Bruijn sequence

Not to be confused with the Moser–de Bruijn sequence, an integer sequence from number theory.

The de Bruijn sequence for alphabet size k = 2 and substring length n = 2. In general there are many sequences for a particular n and k but in this example it is unique, up to cycling.

In combinatorial mathematics, a de Bruijn sequence of order n on a size-k alphabet A is a cyclic sequence in which every possible length-n string on A occurs exactly once as a substring (i.e., as a contiguous subsequence). Such a sequence is denoted by B(k, n) and has length kⁿ, which is also the number of distinct strings of length n on A. Each of these distinct strings, when taken as a substring of B(k, n), must start at a different position, because substrings starting at the same position are not distinct. Therefore, B(k, n) must have at leastkⁿ symbols. And since B(k, n) has exactlykⁿ symbols, de Bruijn sequences are optimally short with respect to the property of containing every string of length n at least once.

The number of distinct de Bruijn sequences B(k, n) is

${\displaystyle {\dfrac {\left(k!\right)^{k^{n-1}}}{k^{n}}}.}$

The sequences are named after the Dutch mathematician Nicolaas Govert de Bruijn, who wrote about them in 1946. ^[1] As he later wrote, ^[2] the existence of de Bruijn sequences for each order together with the above properties were first proved, for the case of alphabets with two elements, by CamilleFlye Sainte-Marie ( 1894 ). The generalization to larger alphabets is due to Tatyanavan Aardenne-Ehrenfest andde Bruijn ( 1951 ). Automata for recognizing these sequences are denoted as de Bruijn automata.

In most applications, A = {0,1}.

History

The earliest known example of a de Bruijn sequence comes from Sanskrit prosody where, since the work of Pingala, each possible three-syllable pattern of long and short syllables is given a name, such as 'y' for short–long–long and 'm' for long–long–long. To remember these names, the mnemonic yamātārājabhānasalagām is used, in which each three-syllable pattern occurs starting at its name: 'yamātā' has a short–long–long pattern, 'mātārā' has a long–long–long pattern, and so on, until 'salagām' which has a short–short–long pattern. This mnemonic, equivalent to a de Bruijn sequence on binary 3-tuples, is of unknown antiquity, but is at least as old as Charles Philip Brown's 1869 book on Sanskrit prosody that mentions it and considers it "an ancient line, written by Pāṇini". ^[3]

In 1894, A. de Rivière raised the question in an issue of the French problem journal L'Intermédiaire des Mathématiciens , of the existence of a circular arrangement of zeroes and ones of size ${\displaystyle 2^{n}}$ that contains all ${\displaystyle 2^{n}}$ binary sequences of length ${\displaystyle n}$. The problem was solved (in the affirmative), along with the count of ${\displaystyle 2^{2^{n-1}-n}}$ distinct solutions, by Camille Flye Sainte-Marie in the same year. ^[2] This was largely forgotten, and Martin (1934) proved the existence of such cycles for general alphabet size in place of 2, with an algorithm for constructing them. Finally, when in 1944 Kees Posthumus conjectured the count ${\displaystyle 2^{2^{n-1}-n}}$ for binary sequences, de Bruijn proved the conjecture in 1946, through which the problem became well-known. ^[2]

Karl Popper independently describes these objects in his The Logic of Scientific Discovery (1934), calling them "shortest random-like sequences". ^[4]

Examples

• Taking A = {0, 1}, there are two distinct B(2, 3): 00010111 and 11101000, one being the reverse or negation of the other.
• Two of the 16 possible B(2, 4) in the same alphabet are 0000100110101111 and 0000111101100101.
• Two of the 2048 possible B(2, 5) in the same alphabet are 00000100011001010011101011011111 and 00000101001000111110111001101011.

Construction

A de Bruijn graph. Every four-digit sequence occurs exactly once if one traverses every edge exactly once and returns to one's starting point (a Eulerian cycle). Every three-digit sequence occurs exactly once if one visits every vertex exactly once (a Hamiltonian path).

The de Bruijn sequences can be constructed by taking a Hamiltonian path of an n-dimensional de Bruijn graph over k symbols (or equivalently, an Eulerian cycle of an (n − 1)-dimensional de Bruijn graph). ^[5]

An alternative construction involves concatenating together, in lexicographic order, all the Lyndon words whose length divides n. ^[6]

An inverse Burrows–Wheeler transform can be used to generate the required Lyndon words in lexicographic order. ^[7]

de Bruijn sequences can also be constructed using shift registers ^[8] or via finite fields. ^[9]

Example using de Bruijn graph

Directed graphs of two B(2,3) de Bruijn sequences and a B(2,4) sequence. In B(2,3), each vertex is visited once, whereas in B(2,4), each edge is traversed once.

Goal: to construct a B(2, 4) de Bruijn sequence of length 2⁴ = 16 using Eulerian (n − 1 = 4 − 1 = 3) 3-D de Bruijn graph cycle.

Each edge in this 3-dimensional de Bruijn graph corresponds to a sequence of four digits: the three digits that label the vertex that the edge is leaving followed by the one that labels the edge. If one traverses the edge labeled 1 from 000, one arrives at 001, thereby indicating the presence of the subsequence 0001 in the de Bruijn sequence. To traverse each edge exactly once is to use each of the 16 four-digit sequences exactly once.

For example, suppose we follow the following Eulerian path through these vertices:

000, 000, 001, 011, 111, 111, 110, 101, 011,

110, 100, 001, 010, 101, 010, 100, 000.

These are the output sequences of length k:

0 0 0 0

_ 0 0 0 1

_ _ 0 0 1 1

This corresponds to the following de Bruijn sequence:

0 0 0 0 1 1 1 1 0 1 1 0 0 1 0 1

The eight vertices appear in the sequence in the following way:

      {0  0  0  0} 1  1  1  1  0  1  1  0  0  1  0  1        0 {0  0  0  1} 1  1  1  0  1  1  0  0  1  0  1        0  0 {0  0  1  1} 1  1  0  1  1  0  0  1  0  1        0  0  0 {0  1  1  1} 1  0  1  1  0  0  1  0  1        0  0  0  0 {1  1  1  1} 0  1  1  0  0  1  0  1        0  0  0  0  1 {1  1  1  0} 1  1  0  0  1  0  1        0  0  0  0  1  1 {1  1  0  1} 1  0  0  1  0  1        0  0  0  0  1  1  1 {1  0  1  1} 0  0  1  0  1        0  0  0  0  1  1  1  1 {0  1  1  0} 0  1  0  1        0  0  0  0  1  1  1  1  0 {1  1  0  0} 1  0  1        0  0  0  0  1  1  1  1  0  1 {1  0  0  1} 0  1        0  0  0  0  1  1  1  1  0  1  1 {0  0  1  0} 1        0  0  0  0  1  1  1  1  0  1  1  0 {0  1  0  1}        0} 0  0  0  1  1  1  1  0  1  1  0  0 {1  0  1 ...    ... 0  0} 0  0  1  1  1  1  0  1  1  0  0  1 {0  1 ...    ... 0  0  0} 0  1  1  1  1  0  1  1  0  0  1  0 {1 ...

...and then we return to the starting point. Each of the eight 3-digit sequences (corresponding to the eight vertices) appears exactly twice, and each of the sixteen 4-digit sequences (corresponding to the 16 edges) appears exactly once.

Example using inverse Burrows—Wheeler transform

Mathematically, an inverse Burrows—Wheeler transform on a word w generates a multi-set of equivalence classes consisting of strings and their rotations. ^[7] These equivalence classes of strings each contain a Lyndon word as a unique minimum element, so the inverse Burrows—Wheeler transform can be considered to generate a set of Lyndon words. It can be shown that if we perform the inverse Burrows—Wheeler transform on a word w consisting of the size-k alphabet repeated kⁿ⁻¹ times (so that it will produce a word the same length as the desired de Bruijn sequence), then the result will be the set of all Lyndon words whose length divides n. It follows that arranging these Lyndon words in lexicographic order will yield a de Bruijn sequence B(k,n), and that this will be the first de Bruijn sequence in lexicographic order. The following method can be used to perform the inverse Burrows—Wheeler transform, using its standard permutation:

1. Sort the characters in the string w, yielding a new string w′
2. Position the string w′ above the string w, and map each letter's position in w′ to its position in w while preserving order. This process defines the Standard Permutation.
3. Write this permutation in cycle notation with the smallest position in each cycle first, and the cycles sorted in increasing order.
4. For each cycle, replace each number with the corresponding letter from string w′ in that position.
5. Each cycle has now become a Lyndon word, and they are arranged in lexicographic order, so dropping the parentheses yields the first de Bruijn sequence.

For example, to construct the smallest B(2,4) de Bruijn sequence of length 2⁴ = 16, repeat the alphabet (ab) 8 times yielding w=abababababababab. Sort the characters in w, yielding w′=aaaaaaaabbbbbbbb. Position w′ above w as shown, and map each element in w′ to the corresponding element in w by drawing a line. Number the columns as shown so we can read the cycles of the permutation:

Starting from the left, the Standard Permutation notation cycles are: (1) (2 3 5 9) (4 7 13 10) (6 11) (8 15 14 12) (16). (Standard Permutation)

Then, replacing each number by the corresponding letter in w′ from that column yields: (a)(aaab)(aabb)(ab)(abbb)(b).

These are all of the Lyndon words whose length divides 4, in lexicographic order, so dropping the parentheses gives B(2,4) = aaaabaabbababbbb.

Algorithm

The following Python code calculates a de Bruijn sequence, given k and n, based on an algorithm from Frank Ruskey's Combinatorial Generation. ^[10]

fromtypingimportIterable,Union,Anydefde_bruijn(k:Union[Iterable[Any],int],n:int)->str:"""de Bruijn sequence for alphabet k    and subsequences of length n.    """# Two kinds of alphabet input: an integer expands# to a list of integers as the alphabet..ifisinstance(k,int):alphabet=list(map(str,range(k)))else:# While any sort of list becomes used as it isalphabet=kk=len(k)a=[0]*k*nsequence=[]defdb(t,p):ift>n:ifn%p==0:sequence.extend(a[1:p+1])else:a[t]=a[t-p]db(t+1,p)forjinrange(a[t-p]+1,k):a[t]=jdb(t+1,t)db(1,1)return"".join(alphabet[i]foriinsequence)print(de_bruijn(2,3))print(de_bruijn("abcd",2))

which prints

00010111 aabacadbbcbdccdd

Note that these sequences are understood to "wrap around" in a cycle. For example, the first sequence contains 110 and 100 in this fashion.

Uses

de Bruijn cycles are of general use in neuroscience and psychology experiments that examine the effect of stimulus order upon neural systems, ^[11] and can be specially crafted for use with functional magnetic resonance imaging. ^[12]

Angle detection

The symbols of a de Bruijn sequence written around a circular object (such as a wheel of a robot) can be used to identify its angle by examining the n consecutive symbols facing a fixed point. This angle-encoding problem is known as the "rotating drum problem". ^[13] Gray codes can be used as similar rotary positional encoding mechanisms, a method commonly found in rotary encoders.

Finding least- or most-significant set bit in a word

A de Bruijn sequence can be used to quickly find the index of the least significant set bit ("right-most 1") or the most significant set bit ("left-most 1") in a word using bitwise operations and multiplication. ^[14] The following example uses a de Bruijn sequence to determine the index of the least significant set bit (equivalent to counting the number of trailing '0' bits) in a 32 bit unsigned integer:

uint8_tlowestBitIndex(uint32_tv){staticconstuint8_tBitPositionLookup[32]=// hash table{0,1,28,2,29,14,24,3,30,22,20,15,25,17,4,8,31,27,13,23,21,19,16,7,26,12,18,6,11,5,10,9};returnBitPositionLookup[((uint32_t)((v&-v)*0x077CB531U))>>27];}

The lowestBitIndex() function returns the index of the least-significant set bit in v, or zero if v has no set bits. The constant 0x077CB531U in the expression is the B (2, 5) sequence 0000 0111 0111 1100 1011 0101 0011 0001 (spaces added for clarity). The operation (v & -v) zeros all bits except the least-significant bit set, resulting in a new value which is a power of 2. This power of 2 is multiplied (arithmetic modulo 2³²) by the de Bruijn sequence, thus producing a 32-bit product in which the bit sequence of the 5 MSBs is unique for each power of 2. The 5 MSBs are shifted into the LSB positions to produce a hash code in the range [0, 31], which is then used as an index into hash table BitPositionLookup. The selected hash table value is the bit index of the least significant set bit in v.

The following example determines the index of the most significant bit set in a 32 bit unsigned integer:

uint32_tkeepHighestBit(uint32_tn){n|=(n>>1);n|=(n>>2);n|=(n>>4);n|=(n>>8);n|=(n>>16);returnn-(n>>1);}uint8_thighestBitIndex(uint32_tv){staticconstuint8_tBitPositionLookup[32]={// hash table0,1,16,2,29,17,3,22,30,20,18,11,13,4,7,23,31,15,28,21,19,10,12,6,14,27,9,5,26,8,25,24,};returnBitPositionLookup[(keepHighestBit(v)*0x06EB14F9U)>>27];}

In the above example an alternative de Bruijn sequence (0x06EB14F9U) is used, with corresponding reordering of array values. The choice of this particular de Bruijn sequence is arbitrary, but the hash table values must be ordered to match the chosen de Bruijn sequence. The keepHighestBit() function zeros all bits except the most-significant set bit, resulting in a value which is a power of 2, which is then processed as in the previous example.

Brute-force attacks on locks

One possible B (10, 4) sequence. The 2530 substrings are read from top to bottom then left to right, and their digits are concatenated. To get the string to brute-force a combination lock, the last three digits in brackets (000) are appended. The 10003-digit string is hence "0 0001 0002 0003 0004 0005 0006 0007 0008 0009 0011 … 79 7988 7989 7998 7999 8 8889 8899 89 8999 9 000" (spaces added for readability).

B{10,3} with digits read from top to bottom then left to right; [15] appending "00" yields a string to brute-force a 3-digit combination lock
0	1	2	3	4	5	6	7	8	9
001
002
003
004
005
006
007
008
009
011
012	112
013	113
014	114
015	115
016	116
017	117
018	118
019	119
021
022	122
023	123	223
024	124	224
025	125	225
026	126	226
027	127	227
028	128	228
029	129	229
031
032	132
033	133	233
034	134	234	334
035	135	235	335
036	136	236	336
037	137	237	337
038	138	238	338
039	139	239	339
041
042	142
043	143	243
044	144	244	344
045	145	245	345	445
046	146	246	346	446
047	147	247	347	447
048	148	248	348	448
049	149	249	349	449
051
052	152
053	153	253
054	154	254	354
055	155	255	355	455
056	156	256	356	456	556
057	157	257	357	457	557
058	158	258	358	458	558
059	159	259	359	459	559
061
062	162
063	163	263
064	164	264	364
065	165	265	365	465
066	166	266	366	466	566
067	167	267	367	467	567	667
068	168	268	368	468	568	668
069	169	269	369	469	569	669
071
072	172
073	173	273
074	174	274	374
075	175	275	375	475
076	176	276	376	476	576
077	177	277	377	477	577	677
078	178	278	378	478	578	678	778
079	179	279	379	479	579	679	779
081
082	182
083	183	283
084	184	284	384
085	185	285	385	485
086	186	286	386	486	586
087	187	287	387	487	587	687
088	188	288	388	488	588	688	788
089	189	289	389	489	589	689	789	889
091
092	192
093	193	293
094	194	294	394
095	195	295	395	495
096	196	296	396	496	596
097	197	297	397	497	597	697
098	198	298	398	498	598	698	798
099	199	299	399	499	599	699	799	899	(00)

A de Bruijn sequence can be used to shorten a brute-force attack on a PIN-like code lock that does not have an "enter" key and accepts the last n digits entered. For example, a digital door lock with a 4-digit code (each digit having 10 possibilities, from 0 to 9) would have B (10, 4) solutions, with length 10000. Therefore, only at most 10000 + 3 = 10003 (as the solutions are cyclic) presses are needed to open the lock, whereas trying all codes separately would require 4 × 10000 = 40000 presses.

Simplified principle of the Anoto digital pen.
The camera identifies a 6×6 matrix of dots, each displaced from the blue grid (not printed) in one of 4 directions.
The combinations of relative displacements of a 6-bit de Bruijn sequence between the columns, and between the rows gives its absolute position on the digital paper.

f-fold de Bruijn sequences

An f-fold n-ary de Bruijn sequence is an extension of the notion n-ary de Bruijn sequence, such that the sequence of the length ${\displaystyle fk^{n}}$ contains every possible subsequence of the length n exactly f times. For example, for ${\displaystyle n=2}$ the cyclic sequences 11100010 and 11101000 are two-fold binary de Bruijn sequences. The number of two-fold de Bruijn sequences, ${\displaystyle N_{n}}$ for ${\displaystyle n=1}$ is ${\displaystyle N_{1}=2}$, the other known numbers ^[16] are ${\displaystyle N_{2}=5}$, ${\displaystyle N_{3}=72}$, and ${\displaystyle N_{4}=43768}$.

de Bruijn torus

STL model of de Bruijn torus (16,32;3,3)₂ with 1s as panels and 0s as holes in the mesh – with consistent orientation, every 3×3 matrix appears exactly once

Main article: De Bruijn torus

A de Bruijn torus is a toroidal array with the property that every k-ary m-by-n matrix occurs exactly once.

Such a pattern can be used for two-dimensional positional encoding in a fashion analogous to that described above for rotary encoding. Position can be determined by examining the m-by-n matrix directly adjacent to the sensor, and calculating its position on the de Bruijn torus.

de Bruijn decoding

Computing the position of a particular unique tuple or matrix in a de Bruijn sequence or torus is known as the de Bruijn decoding problem. Efficient ${\displaystyle \color {Blue}O(n\log n)}$ decoding algorithms exist for special, recursively constructed sequences ^[17] and extend to the two-dimensional case. ^[18] de Bruijn decoding is of interest, e.g., in cases where large sequences or tori are used for positional encoding.

See also

• Normal number
• Linear-feedback shift register
• n-sequence
• BEST theorem
• Superpermutation

Notes

1. de Bruijn (1946).
2. de Bruijn (1975).
3. Brown (1869); Stein (1963); Kak (2000); Knuth (2006); Hall (2008).
4. Popper (2002).
5. Klein (2013).
6. According to Berstel & Perrin (2007), the sequence generated in this way was first described (with a different generation method) by Martin (1934), and the connection between it and Lyndon words was observed by Fredricksen & Maiorana (1978).
7. Higgins (2012).
8. Goresky & Klapper (2012).
9. Ralston (1982), pp. 136–139.
10. "De Bruijn sequences". Sage. Retrieved 2023-03-07.
11. Aguirre, Mattar & Magis-Weinberg (2011).
12. "de Bruijn cycle generator".
13. van Lint & Wilson (2001).
14. Anderson (1997–2009); Busch (2009)
15. "de Bruijn (DeBruijn) sequence (K=10, n=3)".
16. Osipov (2016).
17. Tuliani (2001).
18. Hurlbert & Isaak (1993).

References

• van Aardenne-Ehrenfest, Tanja; de Bruijn, Nicolaas Govert (1951). "Circuits and trees in oriented linear graphs" (PDF). Simon Stevin . 28: 203–217. MR   0047311.
• Aguirre, G. K.; Mattar, M. G.; Magis-Weinberg, L. (2011). "de Bruijn cycles for neural decoding". NeuroImage. 56 (3): 1293–1300. doi:10.1016/j.neuroimage.2011.02.005. PMC   3104402 . PMID   21315160.
• Anderson, Sean Eron (1997–2009). "Bit Twiddling Hacks". Stanford University . Retrieved 2009-02-12.
• Berstel, Jean; Perrin, Dominique (2007). "The origins of combinatorics on words" (PDF). European Journal of Combinatorics . 28 (3): 996–1022. doi:10.1016/j.ejc.2005.07.019. MR   2300777.
• Brown, C. P. (1869). Sanskrit Prosody and Numerical Symbols Explained. p. 28.
• de Bruijn, Nicolaas Govert (1946). "A combinatorial problem" (PDF). Proc. Koninklijke Nederlandse Akademie V. Wetenschappen. 49: 758–764. MR   0018142, Indagationes Mathematicae 8: 461–467
• de Bruijn, Nicolaas Govert (1975). Acknowledgement of Priority to C. Flye Sainte-Marie on the counting of circular arrangements of 2ⁿ zeros and ones that show each n-letter word exactly once (PDF). T.H.-Report 75-WSK-06. Technological University Eindhoven.
• Busch, Philip (2009). "Computing Trailing Zeros HOWTO" . Retrieved 2015-01-29.
• Flye Sainte-Marie, Camille (1894). "Solution to question nr. 48". L'Intermédiaire des Mathématiciens. 1: 107–110.
• Goresky, Mark; Klapper, Andrew (2012). "8.2.5 Shift register generation of de Bruijn sequences". Algebraic Shift Register Sequences. Cambridge University Press. pp. 174–175. ISBN   978-1-10701499-2.
• Hall, Rachel W. (2008). "Math for poets and drummers" (PDF). Math Horizons. 15 (3): 10–11. doi:10.1080/10724117.2008.11974752. S2CID   3637061. Archived from the original (PDF) on 2012-02-12. Retrieved 2008-10-22.
• Higgins, Peter (November 2012). "Burrows-Wheeler transforms and de Bruijn words" (PDF). Retrieved 2017-02-11.
• Hurlbert, Glenn; Isaak, Garth (1993). "On the de Bruijn torus problem". Journal of Combinatorial Theory . Series A. 64 (1): 50–62. doi: 10.1016/0097-3165(93)90087-O . MR   1239511.
• Kak, Subhash (2000). "Yamātārājabhānasalagāṃ an interesting combinatoric sūtra" (PDF). Indian Journal of History of Science. 35 (2): 123–127. Archived from the original (PDF) on 2014-10-29.
• Klein, Andreas (2013). Stream Ciphers. Springer. p. 59. ISBN   978-1-44715079-4.
• Knuth, Donald Ervin (2006). The Art of Computer Programming, Fascicle 4: Generating All Trees – History of Combinatorial Generation. Addison–Wesley. p. 50. ISBN   978-0-321-33570-8.
• Fredricksen, Harold; Maiorana, James (1978). "Necklaces of beads in k colors and k-ary de Bruijn sequences". Discrete Mathematics . 23 (3): 207–210. doi: 10.1016/0012-365X(78)90002-X . MR   0523071.
• Martin, Monroe H. (1934). "A problem in arrangements" (PDF). Bulletin of the American Mathematical Society . 40 (12): 859–864. doi: 10.1090/S0002-9904-1934-05988-3 . MR   1562989.
• Osipov, Vladimir (2016). "Wavelet Analysis on Symbolic Sequences and Two-Fold de Bruijn Sequences". Journal of Statistical Physics . 164 (1): 142–165. arXiv: 1601.02097 . Bibcode:2016JSP...164..142O. doi:10.1007/s10955-016-1537-5. ISSN   1572-9613. S2CID   16535836.
• Popper, Karl (2002) [1934]. The logic of scientific discovery. Routledge. p. 294. ISBN   978-0-415-27843-0.
• Ralston, Anthony (1982). "de Bruijn sequences—a model example of the interaction of discrete mathematics and computer science". Mathematics Magazine . 55 (3): 131–143. doi:10.2307/2690079. JSTOR   2690079. MR   0653429.
• Stein, Sherman K. (1963). "Yamátárájabhánasalagám". The Man-made Universe: An Introduction to the Spirit of Mathematics. pp. 110–118. Reprinted in Wardhaugh, Benjamin, ed. (2012), A Wealth of Numbers: An Anthology of 500 Years of Popular Mathematics Writing, Princeton University Press, pp. 139–144.
• Tuliani, Jonathan (2001). "de Bruijn sequences with efficient decoding algorithms". Discrete Mathematics . 226 (1–3): 313–336. doi:10.1016/S0012-365X(00)00117-5. MR   1802599.
• van Lint, J. H.; Wilson, Richard Michael (2001). A Course in Combinatorics. Cambridge University Press. p. 71. ISBN   978-0-52100601-9.

External links

• Weisstein, Eric W. "de Bruijn Sequence". MathWorld .
• OEIS sequenceA166315(Lexicographically smallest binary de Bruijn sequences)
• De Bruijn sequence
• CGI generator
• Applet generator
• Javascript generator and decoder. Implementation of J. Tuliani's algorithm.
• Door code lock
• Minimal arrays containing all sub-array combinations of symbols: de Bruijn sequences and tori
• http://debruijnsequence.org has many kinds of de Bruijn sequences.