Polar code (coding theory)

In information theory, a polar code is a linear block error-correcting code. The code construction is based on a multiple recursive concatenation of a short kernel code which transforms the physical channel into virtual outer channels. When the number of recursions becomes large, the virtual channels tend to either have high reliability or low reliability (in other words, they polarize or become sparse), and the data bits are allocated to the most reliable channels. It is the first code with an explicit construction to provably achieve the channel capacity for symmetric binary-input, discrete, memoryless channels (B-DMC) with polynomial dependence on the gap to capacity. ^[1] Polar codes were developed by Erdal Arikan, a professor of electrical engineering at Bilkent University.

Notably, polar codes have modest encoding and decoding complexity O(n log n), which renders them attractive for many applications. Moreover, the encoding and decoding energy complexity of generalized polar codes can reach the fundamental lower bounds for energy consumption of two dimensional circuitry to within an O(n^ε polylog n) factor for any ε > 0. ^[2]

Industrial applications

Polar codes have some limitations when used in industrial applications. Primarily, the original design of the polar codes achieves capacity when block sizes are asymptotically large with a successive cancellation decoder. However, with the block sizes used in industry, the performance of the successive cancellation is poor compared to well-defined and implemented coding schemes such as low-density parity-check code (LDPC) and turbo code. Polar performance can be improved with successive cancellation list decoding, but its usability in real applications is still questionable due to very poor implementation efficiencies caused by the iterative approach. ^[3]

In October 2016, Huawei announced that it had achieved 27 Gbit/s in 5G field trial tests using polar codes for channel coding. The improvements have been introduced so that the channel performance has now almost closed the gap to the Shannon limit, which sets the bar for the maximum rate for a given bandwidth and a given noise level. ^[4]

In November 2016, 3GPP agreed to adopt polar codes for the eMBB (Enhanced Mobile Broadband) control channels for the 5G NR (New Radio) interface. At the same meeting, 3GPP agreed to use LDPC for the corresponding data channel. ^[5]

PAC code

In 2020, Arıkan introduced a novel polar coding method dubbed polarization-adjusted convolutional (PAC) codes. At short blocklengths, such codes outperform both convolutional codes and CRC-aided list decoding of conventional polar codes. ^{[6] [7]}

Neural Polar Decoders

Neural Polar Decoders (NPDs) ^[8] are an advancement in channel coding that combine neural networks (NNs) with polar codes, providing unified decoding for channels with or without memory, without requiring an explicit channel model. They use four neural networks to approximate the functions of polar decoding: the embedding (E) NN, the check-node (F) NN, the bit-node (G) NN, and the embedding-to-LLR (H) NN. The weights of these NNs are determined by estimating the mutual information of the synthetic channels. By the end of training, the weights of the NPD are fixed and can then be used for decoding.

The computational complexity of NPDs is determined by the parameterization of the neural networks, unlike successive cancellation (SC) trellis decoders ^[9] , whose complexity is determined by the channel model and are typically used for finite-state channels (FSCs). The computational complexity of NPDs is ${\textstyle O(kdN\log _{2}N)}$, where ${\displaystyle k}$ is the number of hidden units in the neural networks, ${\displaystyle d}$ is the dimension of the embedding, and ${\displaystyle N}$ is the block length. In contrast, the computational complexity of SC trellis decoders is ${\displaystyle O(|{\mathcal {S}}|^{3}N\log _{2}N)}$, where ${\displaystyle {\mathcal {S}}}$ is the state space of the channel model.

NPDs can be integrated into SC decoding ^[1] schemes such as SC list decoding and CRC-aided SC decoding ^[10] . They are also compatible with non-uniform and i.i.d. input distributions by integrating them into the Honda-Yamamoto scheme ^[11] . This flexibility allows NPDs to be used in various decoding scenarios, improving error correction performance while maintaining manageable computational complexity.

References

1. Arikan, Erdal (2009). "Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Memoryless Channels". IEEE Transactions on Information Theory. 55 (7): 3051–3073. doi:10.1109/TIT.2009.2021379. ISSN   0018-9448.
2. Blake, Christopher G. (2017). "Energy Consumption of Error Control Coding Circuits" (PDF). University of Toronto . Retrieved 2019-10-18.
3. Arikan, Erdal, et al. "Challenges and some new directions in channel coding." arXiv:1504.03916 (2015).
4. "Huawei achieves 27Gbps 5G speeds with Polar Code" . Retrieved 2016-10-10.
5. "3GPP RAN1 meeting #87 final report". 3GPP. Retrieved 31 August 2017.^{[ dead link ]}
6. Moradi, Mohsen, et al. "Performance and complexity of sequential decoding of PAC codes." arXiv:2012.04990 (2020).
7. Yao, Hanwen; Fazeli, Arman; Vardy, Alexander (2021). "List Decoding of Arıkan's PAC Codes". Entropy. 23 (7): 841. arXiv: 2005.13711 . Bibcode:2021Entrp..23..841Y. doi: 10.3390/e23070841 . PMC   8303677 . PMID   34209050.
8. Aharoni, Ziv; Huleihel, Bashar; Pfister, Henry D.; Permuter, Haim H. (2023-09-06), Data-Driven Neural Polar Codes for Unknown Channels With and Without Memory, doi:10.48550/arXiv.2309.03148 , retrieved 2024-07-15
9. Wang, Runxin; Honda, Junya; Yamamoto, Hirosuke; Liu, Rongke; Hou, Yi (2015). "Construction of polar codes for channels with memory". 2015 IEEE Information Theory Workshop - Fall (ITW). IEEE: 187–191. doi:10.1109/ITWF.2015.7360760. ISBN   978-1-4673-7852-9.
10. Tal, Ido; Vardy, Alexander (2015). "List Decoding of Polar Codes". IEEE Transactions on Information Theory. 61 (5): 2213–2226. doi:10.1109/TIT.2015.2410251. ISSN   0018-9448.
11. Honda, Junya; Yamamoto, Hirosuke (2013). "Polar Coding Without Alphabet Extension for Asymmetric Models". IEEE Transactions on Information Theory. 59 (12): 7829–7838. doi:10.1109/TIT.2013.2282305. ISSN   0018-9448.

External links

• AFF3CT home page: A Fast Forward Error Correction Toolbox for high speed polar code simulations in software