Zyablov bound

In coding theory, the Zyablov bound is a lower bound on the rate ${\displaystyle r}$ and relative distance ${\displaystyle \delta }$ that are achievable by concatenated codes.

Statement of the bound

The bound states that there exists a family of ${\displaystyle q}$-ary (concatenated, linear) codes with rate ${\displaystyle r}$ and relative distance ${\displaystyle \delta }$ whenever

${\displaystyle r\leqslant \max \limits _{0\leqslant r'\leqslant 1-H_{q}(\delta )}r'\cdot \left(1-{\delta \over {H_{q}^{-1}(1-r')}}\right)}$,

where ${\displaystyle H_{q}}$ is the ${\displaystyle q}$-ary entropy function

${\displaystyle H_{q}(x)=x\log _{q}(q-1)-x\log _{q}(x)-(1-x)\log _{q}(1-x)}$.

Figure 1: The Zyablov bound. For comparison, the GV bound (which gives achievable parameters for general codes that may not be efficiently decodable) is also plotted.

Description

The bound is obtained by considering the range of parameters that are obtainable by concatenating a "good" outer code ${\displaystyle C_{out}}$ with a "good" inner code ${\displaystyle C_{in}}$. Specifically, we suppose that the outer code meets the Singleton bound, i.e. it has rate ${\displaystyle r_{out}}$ and relative distance ${\displaystyle \delta _{out}}$ satisfying ${\displaystyle r_{out}+\delta _{out}=1}$. Reed Solomon codes are a family of such codes that can be tuned to have any rate ${\displaystyle r_{out}\in (0,1)}$ and relative distance ${\displaystyle 1-r_{out}}$ (albeit over an alphabet as large as the codeword length). We suppose that the inner code meets the Gilbert–Varshamov bound, i.e. it has rate ${\displaystyle r_{in}}$ and relative distance ${\displaystyle \delta _{in}}$ satisfying ${\displaystyle r_{in}+H_{q}(\delta _{in})\geq 1}$. Random linear codes are known to satisfy this property with high probability, and an explicit linear code satisfying the property can be found by brute-force search (which requires time polynomial in the size of the message space).

The concatenation of ${\displaystyle C_{out}}$ and ${\displaystyle C_{in}}$, denoted ${\displaystyle C_{out}\circ C_{in}}$, has rate ${\displaystyle r=r_{in}\cdot r_{out}}$ and relative distance ${\displaystyle \delta =\delta _{out}\cdot \delta _{in}\geq (1-r_{out})\cdot H_{q}^{-1}(1-r_{in}).}$

Expressing ${\displaystyle r_{out}}$ as a function of ${\displaystyle \delta ,r_{in}}$,

${\displaystyle r_{out}\geq 1-{\frac {\delta }{H^{-1}(1-r_{in})}}}$

Then optimizing over the choice of ${\displaystyle r_{in}}$, we see it is possible for the concatenated code to satisfy,

${\displaystyle r\geq \max \limits _{0\leq r_{in}\leq {1-H_{q}(\delta )}}r_{in}\cdot \left(1-{\delta \over {H_{q}^{-1}(1-r_{in})}}\right)}$

See Figure 1 for a plot of this bound.

Note that the Zyablov bound implies that for every ${\displaystyle \delta >0}$, there exists a (concatenated) code with positive rate and positive relative distance.

Remarks

We can construct a code that achieves the Zyablov bound in polynomial time. In particular, we can construct explicit asymptotically good code (over some alphabets) in polynomial time.

Linear Codes will help us complete the proof of the above statement since linear codes have polynomial representation. Let Cout be an ${\displaystyle [N,K]_{Q}}$ Reed–Solomon error correction code where ${\displaystyle N=Q-1}$ (evaluation points being ${\displaystyle \mathbb {F} _{Q}^{*}}$ with ${\displaystyle Q=q^{k}}$, then ${\displaystyle k=\theta (\log N)}$.

We need to construct the Inner code that lies on Gilbert-Varshamov bound. This can be done in two ways

1. To perform an exhaustive search on all generator matrices until the required property is satisfied for ${\displaystyle C_{in}}$. This is because Varshamov's bound states that there exists a linear code that lies on Gilbert-Varshamon bound which will take ${\displaystyle q^{O(kn)}}$ time. Using ${\displaystyle k=rn}$ we get ${\displaystyle q^{O(kn)}=q^{O(k^{2})}=N^{O(\log N)}}$, which is upper bounded by ${\displaystyle nN^{O(\log nN)}}$, a quasi-polynomial time bound.
2. To construct ${\displaystyle C_{in}}$ in ${\displaystyle q^{O(n)}}$ time and use ${\displaystyle (nN)^{O(1)}}$ time overall. This can be achieved by using the method of conditional expectation on the proof that random linear code lies on the bound with high probability.

Thus we can construct a code that achieves the Zyablov bound in polynomial time.

See also

• Gilbert-Varshamov bound
• Singleton bound

References and external links

• MIT Lecture Notes on Essential Coding Theory – Dr. Madhu Sudan
• University at Buffalo Lecture Notes on Coding Theory – Dr. Atri Rudra
• University of Washington Lecture Notes on Coding Theory- Dr. Venkatesan Guruswami