Blackwell channel

Last updated

The Blackwell channel is a deterministic broadcast channel model used in coding theory and information theory. It was first proposed by mathematician David Blackwell. [1] In this model, a transmitter transmits one of three symbols to two receivers. For two of the symbols, both receivers receive exactly what was sent; the third symbol, however, is received differently at each of the receivers. This is one of the simplest examples of a non-trivial capacity result for a non-stochastic channel.

Contents

Definition

The Blackwell channel is composed of one input (transmitter) and two outputs (receivers). The channel input is ternary (three symbols) and is selected from {0, 1, 2}. This symbol is broadcast to the receivers; that is, the transmitter sends one symbol simultaneously to both receivers. Each of the channel outputs is binary (two symbols), labeled {0, 1}.

Whenever a 0 is sent, both outputs receive a 0. Whenever a 1 is sent, both outputs receive a 1. When a 2 is sent, however, the first output is 0 and the second output is 1. Therefore, the symbol 2 is confused by each of the receivers in a different way.

The operation of the channel is memoryless and completely deterministic.

Capacity of the Blackwell channel

The capacity of the channel was found by S. I. Gel'fand. [2] [3] It is defined by the region:

1. R1 = 1, 0 R2 ½
2. R1 = H(a), R2 = 1 a, for ⅓  a  ½
3. R1 + R2 = log2 3, log2 3 - ⅔  R1  
4. R1 = 1 a, R2 = H(a), for ⅓ a ½
5. 0 R1 ½, R2 = 1

A solution was also found by Pinkser et al. (1995). [4]

Related Research Articles

In information theory and coding theory with applications in computer science and telecommunication, error detection and correction or error control are techniques that enable reliable delivery of digital data over unreliable communication channels. Many communication channels are subject to channel noise, and thus errors may be introduced during transmission from the source to a receiver. Error detection techniques allow detecting such errors, while error correction enables reconstruction of the original data in many cases.

Information theory studies the quantification, storage, and communication of information. It was originally proposed by Claude Shannon in 1948 to find fundamental limits on signal processing and communication operations such as data compression, in a landmark paper titled "A Mathematical Theory of Communication". Its impact has been crucial to the success of the Voyager missions to deep space, the invention of the compact disc, the feasibility of mobile phones, the development of the Internet, the study of linguistics and of human perception, the understanding of black holes, and numerous other fields.

In telecommunications, orthogonal frequency-division multiplexing (OFDM) is a method of encoding digital data on multiple carrier frequencies. OFDM has developed into a popular scheme for wideband digital communication, used in applications such as digital television and audio broadcasting, DSL internet access, wireless networks, power line networks, and 4G mobile communications.

Circulator passive non-reciprocal three- or four-port device, in which a microwave or radio frequency signal entering any port is transmitted to the next port in rotation (only)

A circulator is a passive, non-reciprocal three- or four-port device, in which a microwave or radio-frequency signal entering any port is transmitted to the next port in rotation (only). A port in this context is a point where an external waveguide or transmission line, connects to the device. For a three-port circulator, a signal applied to port 1 only comes out of port 2; a signal applied to port 2 only comes out of port 3; a signal applied to port 3 only comes out of port 1, so to up to a phase-factor, the scattering matrix for an ideal three-port circulator is

Communication channel a physical or logical connection used for transmission of information

A communication channel refers either to a physical transmission medium such as a wire, or to a logical connection over a multiplexed medium such as a radio channel in telecommunications and computer networking. A channel is used to convey an information signal, for example a digital bit stream, from one or several senders to one or several receivers. A channel has a certain capacity for transmitting information, often measured by its bandwidth in Hz or its data rate in bits per second.

Information-theoretic security is a cryptosystem whose security derives purely from information theory; the system cannot be broken even if the adversary has unlimited computing power. The cryptosystem is considered cryptanalytically unbreakable if the adversary does not have enough information to break the encryption.

Space–time code used to improve the reliability of data transmission in wireless communication systems

A space–time code (STC) is a method employed to improve the reliability of data transmission in wireless communication systems using multiple transmit antennas. STCs rely on transmitting multiple, redundant copies of a data stream to the receiver in the hope that at least some of them may survive the physical path between transmission and reception in a good enough state to allow reliable decoding.

In the field of wireless communication, macrodiversity is a kind of space diversity scheme using several receiver antennas and/or transmitter antennas for transferring the same signal. The distance between the transmitters is much longer than the wavelength, as opposed to microdiversity where the distance is in the order of or shorter than the wavelength.

Binary erasure channel

disambiguation: Landauer's principle

Precoding is a generalization of beamforming to support multi-stream transmission in multi-antenna wireless communications. In conventional single-stream beamforming, the same signal is emitted from each of the transmit antennas with appropriate weighting such that the signal power is maximized at the receiver output. When the receiver has multiple antennas, single-stream beamforming cannot simultaneously maximize the signal level at all of the receive antennas. In order to maximize the throughput in multiple receive antenna systems, multi-stream transmission is generally required.

In telecommunications, dirty paper coding (DPC) or Costa precoding is a technique for efficient transmission of digital data through a channel subjected to some interference known to the transmitter. The technique consists of precoding the data in order to cancel the interference. Dirty-paper coding achieves the channel capacity, without a power penalty and without requiring the receiver to know the interfering signal.

In coding theory, concatenated codes form a class of error-correcting codes that are derived by combining an inner code and an outer code. They were conceived in 1966 by Dave Forney as a solution to the problem of finding a code that has both exponentially decreasing error probability with increasing block length and polynomial-time decoding complexity. Concatenated codes became widely used in space communications in the 1970s.

Multi-user MIMO (MU-MIMO) is a set of multiple-input and multiple-output (MIMO) technologies for wireless communication, in which a set of users or wireless terminals, each with one or more antennas, communicate with each other. In contrast, single-user MIMO considers a single multi-antenna transmitter communicating with a single multi-antenna receiver. In a similar way that OFDMA adds multiple access (multi-user) capabilities to OFDM, MU-MIMO adds multiple access (multi-user) capabilities to MIMO. MU-MIMO has been investigated since the beginning of research into multi-antenna communication.

MIMO Use of multiple antennas in radio

In radio, multiple-input and multiple-output, or MIMO, is a method for multiplying the capacity of a radio link using multiple transmission and receiving antennas to exploit multipath propagation. MIMO has become an essential element of wireless communication standards including IEEE 802.11n (Wi-Fi), IEEE 802.11ac (Wi-Fi), HSPA+ (3G), WiMAX (4G), and Long Term Evolution. More recently, MIMO has been applied to power-line communication for 3-wire installations as part of ITU G.hn standard and HomePlug AV2 specification.

In digital communications, a turbo equalizer is a type of receiver used to receive a message corrupted by a communication channel with intersymbol interference (ISI). It approaches the performance of a maximum a posteriori (MAP) receiver via iterative message passing between a soft-in soft-out (SISO) equalizer and a SISO decoder. It is related to turbo codes in that a turbo equalizer may be considered a type of iterative decoder if the channel is viewed as a non-redundant convolutional code. The turbo equalizer is different from classic a turbo-like code, however, in that the 'channel code' adds no redundancy and therefore can only be used to remove non-gaussian noise.

A deletion channel is a communications channel model used in coding theory and information theory. In this model, a transmitter sends a bit, and the receiver either receives the bit or does not receive anything without being notified that the bit was dropped. Determining the capacity of the deletion channel is an open problem.

Multiple-input, multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) is the dominant air interface for 4G and 5G broadband wireless communications. It combines multiple-input, multiple-output (MIMO) technology, which multiplies capacity by transmitting different signals over multiple antennas, and orthogonal frequency-division multiplexing (OFDM), which divides a radio channel into a large number of closely spaced subchannels to provide more reliable communications at high speeds. Research conducted during the mid-1990s showed that while MIMO can be used with other popular air interfaces such as time-division multiple access (TDMA) and code-division multiple access (CDMA), the combination of MIMO and OFDM is most practical at higher data rates.

Ranjan Kumar Mallik is an Indian electrical and communications engineer and a professor at the Department of Electrical Engineering of the Indian Institute of Technology, Delhi. He held the Jai Gupta Chair at IIT Delhi from 2007 to 2012 and the Brigadier Bhopinder Singh Chair from 2012 to 2017. He is known for his researches on multiple-input multi-output systems and is an elected fellow of all the three major Indian science academies viz. Indian Academy of Sciences, Indian National Science Academy, and The National Academy of Sciences, India. He is also an elected fellow of The World Academy of Sciences, Indian National Academy of Engineering, and The Institute of Electrical and Electronics Engineers, Inc.

In information theory, the interference channel is the basic model used to analyze the effect of interference in communication channels. The model consists of two pairs of users communicating through a shared channel. The problem of interference between two mobile users in close proximity or crosstalk between two parallel landlines are two examples where this model is applicable.

References

  1. L Breiman; D Blackwell; A J Thomasian (1958). "Proof of shannon's transmission theorem for finite-state indecomposable channels". The Annals of Mathematical Statistics . United States: Institute of Mathematical Statistics. 29 (4): 1209–2220. doi:10.1214/aoms/1177706452.
  2. S I Gel'fand (1977). "Capacity of one broadcast channel". Problemy Peredachi Informatsii. Moscow, Russia: Russian Academy of Sciences, Branch of Informatics, Computer Equipment and Automatization. 13 (3): 106–108.
  3. E van der Meulen (1977). "A survey of multi-way channels in information theory: 1961-1976". IEEE Transactions on Information Theory . New York City, New York, United States: Institute of Electrical and Electronics Engineers. 23 (1): 1–37. doi:10.1109/tit.1977.1055652.
  4. M Pinsker; S. Prelov; S. Verdú (November 1995). "Sensitivity of Channel Capacity". IEEE Transactions on Information Theory . New York City, New York, United States: Institute of Electrical and Electronics Engineers. 41 (6): 1877–1888. doi:10.1109/18.476313.