Coding gain

Last updated

In coding theory and related engineering problems, coding gain is the measure in the difference between the signal-to-noise ratio (SNR) levels between the uncoded system and coded system required to reach the same bit error rate (BER) levels when used with the error correcting code (ECC).

Coding theory study of the properties of codes and their fitness for a specific application

Coding theory is the study of the properties of codes and their respective fitness for specific applications. Codes are used for data compression, cryptography, error detection and correction, data transmission and data storage. Codes are studied by various scientific disciplines—such as information theory, electrical engineering, mathematics, linguistics, and computer science—for the purpose of designing efficient and reliable data transmission methods. This typically involves the removal of redundancy and the correction or detection of errors in the transmitted data.

Signal-to-noise ratio is a measure used in science and engineering that compares the level of a desired signal to the level of background noise. SNR is defined as the ratio of signal power to the noise power, often expressed in decibels. A ratio higher than 1:1 indicates more signal than noise.

Template:Needs improvement

Contents

Example

If the uncoded BPSK system in AWGN environment has a bit error rate (BER) of 10−2 at the SNR level 4  dB, and the corresponding coded (e.g., BCH) system has the same BER at an SNR of 2.5 dB, then we say the coding gain = 4 dB − 2.5 dB = 1.5 dB, due to the code used (in this case BCH).

The decibel is a unit of measurement used to express the ratio of one value of a power or field quantity to another on a logarithmic scale, the logarithmic quantity being called the power level or field level, respectively. It can be used to express a change in value or an absolute value. In the latter case, it expresses the ratio of a value to a fixed reference value; when used in this way, a suffix that indicates the reference value is often appended to the decibel symbol. For example, if the reference value is 1 volt, then the suffix is "V", and if the reference value is one milliwatt, then the suffix is "m".

In coding theory, the BCH codes or Bose–Chaudhuri–Hocquenghem codes form a class of cyclic error-correcting codes that are constructed using polynomials over a finite field. BCH codes were invented in 1959 by French mathematician Alexis Hocquenghem, and independently in 1960 by Raj Bose and D. K. Ray-Chaudhuri. The name Bose–Chaudhuri–Hocquenghem arises from the initials of the inventors' surnames.

Power-limited regime

In the power-limited regime (where the nominal spectral efficiency [b/2D or b/s/Hz], i.e. the domain of binary signaling), the effective coding gain of a signal set at a given target error probability per bit is defined as the difference in dB between the required to achieve the target with and the required to achieve the target with 2-PAM or (2×2)-QAM (i.e. no coding). The nominal coding gain is defined as

Spectral efficiency, spectrum efficiency or bandwidth efficiency refers to the information rate that can be transmitted over a given bandwidth in a specific communication system. It is a measure of how efficiently a limited frequency spectrum is utilized by the physical layer protocol, and sometimes by the media access control.

Pulse-amplitude modulation form of signal modulation where the message information is encoded in the amplitude of a series of signal pulse

Pulse-amplitude modulation (PAM), is a form of signal modulation where the message information is encoded in the amplitude of a series of signal pulses. It is an analog pulse modulation scheme in which the amplitudes of a train of carrier pulses are varied according to the sample value of the message signal. Demodulation is performed by detecting the amplitude level of the carrier at every single period.

Quadrature amplitude modulation (QAM) is the name of a family of digital modulation methods and a related family of analog modulation methods widely used in modern telecommunications to transmit information. It conveys two analog message signals, or two digital bit streams, by changing (modulating) the amplitudes of two carrier waves, using the amplitude-shift keying (ASK) digital modulation scheme or amplitude modulation (AM) analog modulation scheme. The two carrier waves of the same frequency are out of phase with each other by 90°, a condition known as orthogonality and as quadrature. Being the same frequency, the modulated carriers add together, but can be coherently separated (demodulated) because of their orthogonality property. Another key property is that the modulations are low-frequency/low-bandwidth waveforms compared to the carrier frequency, which is known as the narrowband assumption.

This definition is normalized so that for 2-PAM or (2×2)-QAM. If the average number of nearest neighbors per transmitted bit is equal to one, the effective coding gain is approximately equal to the nominal coding gain . However, if , the effective coding gain is less than the nominal coding gain by an amount which depends on the steepness of the vs. curve at the target . This curve can be plotted using the union bound estimate (UBE)

where Q is the Gaussian probability-of-error function.

Error function sigmoid shape special function which occurs in probability, statistics and partial differential equations

In mathematics, the error function is a special function (non-elementary) of sigmoid shape that occurs in probability, statistics, and partial differential equations describing diffusion. It is defined as:

For the special case of a binary linear block code with parameters , the nominal spectral efficiency is and the nominal coding gain is kd/n.

Example

The table below lists the nominal spectral efficiency, nominal coding gain and effective coding gain at for Reed–Muller codes of length :

Code (dB) (dB)
[8,7,2] 1.75 7/4 2.43 4 2.0
[8,4,4] 1.0 2 3.01 4 2.6
[16,15,2] 1.88 15/8 2.73 8 2.1
[16,11,4] 1.38 11/4 4.39 13 3.7
[16,5,8] 0.63 5/2 3.98 6 3.5
[32,31,2] 1.94 31/16 2.87 16 2.1
[32,26,4] 1.63 13/4 5.12 48 4.0
[32,16,8] 1.00 4 6.02 39 4.9
[32,6,16] 0.37 3 4.77 10 4.2
[64,63,2] 1.97 63/32 2.94 32 1.9
[64,57,4] 1.78 57/16 5.52 183 4.0
[64,42,8] 1.31 21/4 7.20 266 5.6
[64,22,16] 0.69 11/2 7.40 118 6.0
[64,7,32] 0.22 7/2 5.44 18 4.6

Bandwidth-limited regime

In the bandwidth-limited regime (, i.e. the domain of non-binary signaling), the effective coding gain of a signal set at a given target error rate is defined as the difference in dB between the required to achieve the target with and the required to achieve the target with M-PAM or (M×M)-QAM (i.e. no coding). The nominal coding gain is defined as

This definition is normalized so that for M-PAM or (M×M)-QAM. The UBE becomes

where is the average number of nearest neighbors per two dimensions.

See also

Related Research Articles

Synchrotron radiation

Synchrotron radiation is the electromagnetic radiation emitted when charged particles are accelerated radially, i.e., when they are subject to an acceleration perpendicular to their velocity. It is produced, for example, in synchrotrons using bending magnets, undulators and/or wigglers. If the particle is non-relativistic, then the emission is called cyclotron emission. If, on the other hand, the particles are relativistic, sometimes referred to as ultrarelativistic, the emission is called synchrotron emission. Synchrotron radiation may be achieved artificially in synchrotrons or storage rings, or naturally by fast electrons moving through magnetic fields. The radiation produced in this way has a characteristic polarization and the frequencies generated can range over the entire electromagnetic spectrum which is also called continuum radiation.

The Knudsen number (Kn) is a dimensionless number defined as the ratio of the molecular mean free path length to a representative physical length scale. This length scale could be, for example, the radius of a body in a fluid. The number is named after Danish physicist Martin Knudsen (1871–1949).

Onsager reciprocal relations

In thermodynamics, the Onsager reciprocal relations express the equality of certain ratios between flows and forces in thermodynamic systems out of equilibrium, but where a notion of local equilibrium exists.

In mathematics, the Hamilton–Jacobi equation (HJE) is a necessary condition describing extremal geometry in generalizations of problems from the calculus of variations, and is a special case of the Hamilton–Jacobi–Bellman equation. It is named for William Rowan Hamilton and Carl Gustav Jacob Jacobi.

Yule–Simon distribution

In probability and statistics, the Yule–Simon distribution is a discrete probability distribution named after Udny Yule and Herbert A. Simon. Simon originally called it the Yule distribution.

The equilibrium constant of a chemical reaction is the value of its reaction quotient at chemical equilibrium, a state approached by a dynamic chemical system after sufficient time has elapsed at which its composition has no measurable tendency towards further change. For a given set of reaction conditions, the equilibrium constant is independent of the initial analytical concentrations of the reactant and product species in the mixture. Thus, given the initial composition of a system, known equilibrium constant values can be used to determine the composition of the system at equilibrium. However, reaction parameters like temperature, solvent, and ionic strength may all influence the value of the equilibrium constant.

Inverse-gamma distribution

In probability theory and statistics, the inverse gamma distribution is a two-parameter family of continuous probability distributions on the positive real line, which is the distribution of the reciprocal of a variable distributed according to the gamma distribution. Perhaps the chief use of the inverse gamma distribution is in Bayesian statistics, where the distribution arises as the marginal posterior distribution for the unknown variance of a normal distribution, if an uninformative prior is used, and as an analytically tractable conjugate prior, if an informative prior is required.

The Ostwald–Freundlich equation governs boundaries between two phases; specifically, it relates the surface tension of the boundary to its curvature, the ambient temperature, and the vapor pressure or chemical potential in the two phases.

Hayashi track luminosity-temperature relationship obeyed by infant stars

The Hayashi track is a luminosity–temperature relationship obeyed by infant stars of less than 3 M in the pre-main-sequence phase of stellar evolution. It is named after Japanese astrophysicist Chushiro Hayashi. On the Hertzsprung–Russell diagram, which plots luminosity against temperature, the track is a nearly vertical curve. After a protostar ends its phase of rapid contraction and becomes a T Tauri star, it is extremely luminous. The star continues to contract, but much more slowly. While slowly contracting, the star follows the Hayashi track downwards, becoming several times less luminous but staying at roughly the same surface temperature, until either a radiative zone develops, at which point the star starts following the Henyey track, or nuclear fusion begins, marking its entry onto the main sequence.

In fluid mechanics, Kelvin's circulation theorem states In a barotropic ideal fluid with conservative body forces, the circulation around a closed curve moving with the fluid remains constant with time. Stated mathematically:

Mathematical descriptions of the electromagnetic field Formulations of electromagnetism

There are various mathematical descriptions of the electromagnetic field that are used in the study of electromagnetism, one of the four fundamental interactions of nature. In this article, several approaches are discussed, although the equations are in terms of electric and magnetic fields, potentials, and charges with currents, generally speaking.

A hydrogen-like ion is any atomic nucleus which has one electron and thus is isoelectronic with hydrogen. These ions carry the positive charge , where is the atomic number of the atom. Examples of hydrogen-like ions are He+, Li2+, Be3+ and B4+. Because hydrogen-like ions are two-particle systems with an interaction depending only on the distance between the two particles, their (non-relativistic) Schrödinger equation can be solved in analytic form, as can the (relativistic) Dirac equation. The solutions are one-electron functions and are referred to as hydrogen-like atomic orbitals.

The Cauchy number (Ca) is a dimensionless number in continuum mechanics used in the study of compressible flows. It is named after the French mathematician Augustin Louis Cauchy. When the compressibility is important the elastic forces must be considered along with inertial forces for dynamic similarity. Thus, the Cauchy Number is defined as the ratio between inertial and the compressibility force in a flow and can be expressed as

In the mathematical theory of conformal and quasiconformal mappings, the extremal length of a collection of curves is a measure of the size of that is invariant under conformal mappings. More specifically, suppose that is an open set in the complex plane and is a collection of paths in and is a conformal mapping. Then the extremal length of is equal to the extremal length of the image of under . One also works with the conformal modulus of , the reciprocal of the extremal length. The fact that extremal length and conformal modulus are conformal invariants of makes them useful tools in the study of conformal and quasi-conformal mappings. One also works with extremal length in dimensions greater than two and certain other metric spaces, but the following deals primarily with the two dimensional setting.

In continuum mechanics, a compatible deformation tensor field in a body is that unique tensor field that is obtained when the body is subjected to a continuous, single-valued, displacement field. Compatibility is the study of the conditions under which such a displacement field can be guaranteed. Compatibility conditions are particular cases of integrability conditions and were first derived for linear elasticity by Barré de Saint-Venant in 1864 and proved rigorously by Beltrami in 1886.

The Zwanzig projection operator is a mathematical device used in statistical mechanics. It operates in the linear space of phase space functions and projects onto the linear subspace of "slow" phase space functions. It was introduced by Robert Zwanzig to derive a generic master equation. It is mostly used in this or similar context in a formal way to derive equations of motion for some "slow" collective variables.

In mathematical physics, the Belinfante–Rosenfeld tensor is a modification of the energy–momentum tensor that is constructed from the canonical energy–momentum tensor and the spin current so as to be symmetric yet still conserved.

In probability theory and statistics, the generalized multivariate log-gamma (G-MVLG) distribution is a multivariate distribution introduced by Demirhan and Hamurkaroglu in 2011. The G-MVLG is a flexible distribution. Skewness and kurtosis are well controlled by the parameters of the distribution. This enables one to control dispersion of the distribution. Because of this property, the distribution is effectively used as a joint prior distribution in Bayesian analysis, especially when the likelihood is not from the location-scale family of distributions such as normal distribution.

Quantum stochastic calculus is a generalization of stochastic calculus to noncommuting variables. The tools provided by quantum stochastic calculus are of great use for modeling the random evolution of systems undergoing measurement, as in quantum trajectories. Just as the Lindblad master equation provides a quantum generalization to the Fokker-Planck equation, quantum stochastic calculus allows for the derivation of quantum stochastic differential equations (QSDE) that are analogous to classical Langevin equations.

Short integer solution (SIS) and ring-SIS problems are two average-case problems that are used in lattice-based cryptography constructions. Lattice-based cryptography began in 1996 from a seminal work by Ajtai who presented a family of one-way functions based on SIS problem. He showed that it is secure in an average case if the shortest vector problem is hard in a worst-case scenario.

References

MIT OpenCourseWare, 6.451 Principles of Digital Communication II, Lecture Notes sections 5.3, 5.5, 6.3, 6.4