Anamorphic stretch transform

Last updated

An anamorphic stretch transform (AST) also referred to as warped stretch transform is a physics-inspired signal transform that emerged from time stretch dispersive Fourier transform. The transform can be applied to analog temporal signals such as communication signals, or to digital spatial data such as images. [1] [2] The transform reshapes the data in such a way that its output has properties conducive for data compression and analytics. The reshaping consists of warped stretching in the Fourier domain. The name "Anamorphic" is used because of the metaphoric analogy between the warped stretch operation and warping of images in anamorphosis [3] and surrealist artworks. [4]

Contents

Operation principle

An anamorphic stretch transform (AST) [5] [6] is a mathematical transformation in which analog or digital data is stretched and warped in a context-aware manner, such that it results in nonuniform Fourier domain sampling. The transformation is defined as:

where is the input optical spectrum, is the spectral phase added by AST ( being the AST warp kernel), and and denote the optical and envelope modulation frequencies, respectively. The detailed of the reshaping depends on the sparsity and redundancy of the input signal and can be obtained by a mathematical function, which is called "stretched modulation distribution" or "modulation intensity distribution" (not to be confused with a different function of the same name used in mechanical diagnostics).

The stretched modulation distribution is a 3D representation of a type of bilinear time–frequency distribution similar, but not the same, as other time-frequency distributions. [7] [8] [9] [10] One can interpret the added phasor term to represent the effect of a time-shift on the spectral autocorrelation of the signal. As a result, the distribution can be used to show the effects of the AST spectral phase on the temporal duration and intensity envelope bandwidth of the output signal, which is useful in visualizing the time-bandwidth product of the signal. [11]

Sparsity requirement

AST applies a tailored group dispersion to different spectral features. [11] [12] [13] [14] By matching the group delay dispersion to the spectrum of the particular signal of interest, it performs frequency to time mapping in a tailored fashion. Information rich portions of the spectrum are stretched in time more than sparse regions of the spectrum making them easier to capture with a real-time analog-to-digital converter (ADC), similar to the methodology used in time-stretch ADC technology. This property has been called "self-adaptive stretching". Because the operation is specific to the spectrum of the signal, it does not require knowledge about the instantaneous time domain behavior of the signal. Hence no real-time adaptive control is needed. The parameters of AST are designed using the statistical spectral (not instantaneous) property of signal family of interest in the target application. [15] Once the parameters are designed, they do not need to respond to the instantaneous value of the signal. The resulting non-uniform sampling, where information rich portions of the signal are sampled at a higher rate than the sparse regions, can be exploited for data compression. As any other data compression method, the maximum compression that can be achieved using AST is signal dependent. [14]

Limitations and challenges

The reconstruction accuracy and lossy nature of this compression method have been analyzed previously. [14] The system reshapes the spectro-temporal structure of the signal such that nearly all the signal energy is within the bandwidth of the real-time digitizer of the acquisition system. Because of the limited bandwidth and the limited resolution of the digitizer, as measured by its effective number of bits (ENOB), the reconstruction will never be ideal, and therefore, this is a lossy compression method. Because of this, only modest compression can be achieved in practice.

Alternatively, the reconstruction process can be greatly simplified if the information desired is encoded in the spectral envelope of the input signal instead of the temporal envelope. In such a scenario, the true output can be reconstructed simply by directly de-warping the measured output given the designed warp kernel. This has been achieved experimentally for optical image compression. [16]

Digital implementation

In the digital implementation of AST (DAST) that is performed in 2D and applied to digital images, an appropriately designed warp kernel stretches the input in a way that reduces the overall spatial bandwidth and hence the sampling requirement. The previous equation for AST can be rewritten in discrete form for DAST as: ,

where is the digital version of the warp kernel. Similar to the case of 1-D temporal waveforms, the warped waveform can then be sampled at a lower rate than what was previously possible with naïve uniform downsampling. This property, known as "feature-selective stretching", can be used for digital image compression. There are two challenges in DAST, (1) image reconstruction, and (2) design the warping kernel. The warped mapping is typically performed in the frequency domain. Reconstruction (inverse mapping) of the spatial image via Fourier transform require knowledge of phase in addition to amplitude of the warped image. In the original AST [5] and DAST papers, [17] ideal phase recovery was assumed to show the useful impact of warp transformation. However, as mentioned above, it has also been shown that phase recovery and signal reconstruction depends on the signal to noise ratio (SNR). [14] Finite SNR will compromise the quality of phase recovery and data compression. Because of this challenge, practical implementation of anamorphic data compression is not achieved yet. With respect to the challenge of finding the right kernel, an algorithm has recently been reported. [15]

Similar to the simplified reconstruction approach above mentioned above, a digital implementation for image compression which uses direct warping has also been recently reported. [18] In this alternative data compression method, information-rich portions of the data are dilated in a process that emulates the effect of group velocity dispersion on temporal signals. With this coding operation, the data can be downsampled at a lower rate than without it, even when considering the overhead in transmitting the warping information. In contrast to previous implementation of the warped stretch compression, here the decoding can be performed without the need of phase recovery.

Relation to phase stretch transform

The phase stretch transform or PST is a computational approach to signal and image processing. One of its utilities is for feature detection and classification. Both phase stretch transform and AST transform the image by emulating propagation through a diffractive medium with engineered 3D dispersive property (refractive index). The difference between the two mathematical operations is that AST uses the magnitude of the complex amplitude after transformation but phase stretch transform employs the phase of the complex amplitude after transformation. Also, the details of the filter kernel are different in the two cases.

Applications

Image compression

Anamorphic (warped) stretch transform is a physics-based mathematical operation that reduces the signal bandwidth without proportionally increasing the size of the signal, thus providing space-bandwidth product compression. Its digital implementation emulates the physical effect by a non-uniform allocation of pixel density. This operation may be used as a pre-processing operation that may enhance conventional image compression techniques. [19]

Time domain signals

This lossy transformation may make it possible to capture and digitize signals that are faster than the speed of the sensor and the digitizer, and also to minimize the volume of the data generated in the process. The transformation causes the signal to be reshaped is such a way that sharp features are stretched (in Fourier domain) more than coarse features. Upon subsequent uniform sampling this causes more digital samples to be allocated to sharp spectral features where they are needed the most, and fewer to sparse portions of the spectrum where they would be redundant. The reconstruction accuracy is subject to the signal to noise ratio and will never be ideal.

See also

Related Research Articles

Phase modulation (PM) is a modulation pattern for conditioning communication signals for transmission. It encodes a message signal as variations in the instantaneous phase of a carrier wave. Phase modulation is one of the two principal forms of angle modulation, together with frequency modulation.

For a device such as an amplifier or telecommunications system, group delay and phase delay are device performance properties that help to characterize time delay, which is the amount of time for the various frequency components of a signal to pass through the device from input to output. If this timing does not sufficiently meet certain requirements, the device will contribute to signal distortion. For example, sufficient amounts of distortion equates to poor fidelity in video or audio, or to a high bit-error rate in a digital bit stream.

Wavelet

A wavelet is a wave-like oscillation with an amplitude that begins at zero, increases, and then decreases back to zero. It can typically be visualized as a "brief oscillation" like one recorded by a seismograph or heart monitor. Generally, wavelets are intentionally crafted to have specific properties that make them useful for signal processing.

A chirp is a signal in which the frequency increases (up-chirp) or decreases (down-chirp) with time. In some sources, the term chirp is used interchangeably with sweep signal. It is commonly applied to sonar, radar, and laser systems, and to other applications, such as in spread-spectrum communications.

Angle modulation is a class of carrier modulation that is used in telecommunications transmission systems. The class comprises frequency modulation (FM) and phase modulation (PM), and is based on altering the frequency or the phase, respectively, of a carrier signal to encode the message signal. This contrasts with varying the amplitude of the carrier, practiced in amplitude modulation (AM) transmission, the earliest of the major modulation methods used widely in early radio broadcasting.

In control theory and signal processing, a linear, time-invariant system is said to be minimum-phase if the system and its inverse are causal and stable.

In mathematics and in signal processing, the Hilbert transform is a specific linear operator that takes a function, u(t) of a real variable and produces another function of a real variable H(u)(t). This linear operator is given by convolution with the function . The Hilbert transform has a particularly simple representation in the frequency domain: It imparts a phase shift of ±90° to every frequency component of a function, the sign of the shift depending on the sign of the frequency. The Hilbert transform is important in signal processing, where it is a component of the analytic representation of a real-valued signal u(t). The Hilbert transform was first introduced by David Hilbert in this setting, to solve a special case of the Riemann–Hilbert problem for analytic functions.

In mathematics, certain systems of partial differential equations are usefully formulated, from the point of view of their underlying geometric and algebraic structure, in terms of a system of differential forms. The idea is to take advantage of the way a differential form restricts to a submanifold, and the fact that this restriction is compatible with the exterior derivative. This is one possible approach to certain over-determined systems, for example, including Lax pairs of integrable systems. A Pfaffian system is specified by 1-forms alone, but the theory includes other types of example of differential system. To elaborate, a Pfaffian system is a set of 1-forms on a smooth manifold.

Spectral phase interferometry for direct electric-field reconstruction

In ultrafast optics, spectral phase interferometry for direct electric-field reconstruction (SPIDER) is an ultrashort pulse measurement technique originally developed by Chris Iaconis and Ian Walmsley.

Heat kernel Fundamental solution to the heat equation, given boundary values

In the mathematical study of heat conduction and diffusion, a heat kernel is the fundamental solution to the heat equation on a specified domain with appropriate boundary conditions. It is also one of the main tools in the study of the spectrum of the Laplace operator, and is thus of some auxiliary importance throughout mathematical physics. The heat kernel represents the evolution of temperature in a region whose boundary is held fixed at a particular temperature, such that an initial unit of heat energy is placed at a point at time t = 0.

Multiphoton intrapulse interference phase scan (MIIPS) is a method used in ultrashort laser technology that simultaneously measures, and compensates femtosecond laser pulses using an adaptive pulse shaper. When an ultrashort laser pulse reaches a duration of less than a few hundred femtosecond, it becomes critical to characterize its duration, its temporal intensity curve, or its electric field as a function of time. Classical photodetectors measuring the intensity of light are still too slow to allow for a direct measurement, even with the fastest photodiodes or streak cameras.

The method of reassignment is a technique for sharpening a time-frequency representation by mapping the data to time-frequency coordinates that are nearer to the true region of support of the analyzed signal. The method has been independently introduced by several parties under various names, including method of reassignment, remapping, time-frequency reassignment, and modified moving-window method. In the case of the spectrogram or the short-time Fourier transform, the method of reassignment sharpens blurry time-frequency data by relocating the data according to local estimates of instantaneous frequency and group delay. This mapping to reassigned time-frequency coordinates is very precise for signals that are separable in time and frequency with respect to the analysis window.

The topological derivative is, conceptually, a derivative of a shape functional with respect to infinitesimal changes in its topology, such as adding an infinitesimal hole or crack. When used in higher dimensions than one, the term topological gradient is also used to name the first-order term of the topological asymptotic expansion, dealing only with infinitesimal singular domain perturbations. It has applications in shape optimization, topology optimization, image processing and mechanical modeling.

Curvelets are a non-adaptive technique for multi-scale object representation. Being an extension of the wavelet concept, they are becoming popular in similar fields, namely in image processing and scientific computing.

The time-stretch analog-to-digital converter (TS-ADC), also known as the time-stretch enhanced recorder (TiSER), is an analog-to-digital converter (ADC) system that has the capability of digitizing very high bandwidth signals that cannot be captured by conventional electronic ADCs. Alternatively, it is also known as the photonic time-stretch (PTS) digitizer, since it uses an optical frontend. It relies on the process of time-stretch, which effectively slows down the analog signal in time before it can be digitized by a standard electronic ADC.

In the field of time–frequency analysis, several signal formulations are used to represent the signal in a joint time–frequency domain.

Serial time-encoded amplified imaging/microscopy or stretched time-encoded amplified imaging/microscopy' (STEAM) is a fast real-time optical imaging method that provides MHz frame rate, ~100 ps shutter speed, and ~30 dB optical image gain. Based on the Photonic Time Stretch technique, STEAM holds world records for shutter speed and frame rate in continuous real-time imaging. STEAM employs the Photonic Time Stretch with internal Raman amplification to realize optical image amplification to circumvent the fundamental trade-off between sensitivity and speed that affects virtually all optical imaging and sensing systems. This method uses a single-pixel photodetector, eliminating the need for the detector array and readout time limitations. Avoiding this problem and featuring the optical image amplification for dramatic improvement in sensitivity at high image acquisition rates, STEAM's shutter speed is at least 1000 times faster than the state-of-the-art CCD and CMOS cameras. Its frame rate is 1000 times faster than fastest CCD cameras and 10-100 times faster than fastest CMOS cameras.

Time stretch dispersive Fourier transform (TS-DFT), otherwise known as time-stretch transform (TST), temporal Fourier transform or photonic time-stretch (PTS) is a spectroscopy technique that uses optical dispersion instead of a grating or prism to separate the light wavelengths and analyze the optical spectrum in real-time. It employs group-velocity dispersion (GVD) to transform the spectrum of a broadband optical pulse into a time stretched temporal waveform. It is used to perform Fourier transformation on an optical signal on a single shot basis and at high frame rates for real-time analysis of fast dynamic processes. It replaces a diffraction grating and detector array with a dispersive fiber and single-pixel detector, enabling ultrafast real-time spectroscopy and imaging. Its nonuniform variant, warped-stretch transform, realized with nonlinear group delay, offers variable-rate spectral domain sampling, as well as the ability to engineer the time-bandwidth product of the signal's envelope to match that of the data acquisition systems acting as an information gearbox.

The spectrum of a chirp pulse describes its characteristics in terms of its frequency components. This frequency-domain representation is an alternative to the more familiar time-domain waveform, and the two versions are mathematically related by the Fourier transform.
The spectrum is of particular interest when pulses are subject to signal processing. For example, when a chirp pulse is compressed by its matched filter, the resulting waveform contains not only a main narrow pulse but, also, a variety of unwanted artifacts many of which are directly attributable to features in the chirp's spectral characteristics.
The simplest way to derive the spectrum of a chirp, now that computers are widely available, is to sample the time-domain waveform at a frequency well above the Nyquist limit and call up an FFT algorithm to obtain the desired result. As this approach was not an option for the early designers, they resorted to analytic analysis, where possible, or to graphical or approximation methods, otherwise. These early methods still remain helpful, however, as they give additional insight into the behavior and properties of chirps.

Phase stretch transform

Phase stretch transform (PST) is a computational approach to signal and image processing. One of its utilities is for feature detection and classification. PST is related to time stretch dispersive Fourier transform. It transforms the image by emulating propagation through a diffractive medium with engineered 3D dispersive property. The operation relies on symmetry of the dispersion profile and can be understood in terms of dispersive eigenfunctions or stretch modes. PST performs similar functionality as phase-contrast microscopy, but on digital images. PST can be applied to digital images and temporal data.

References

  1. Matthew Chin. "New data compression method reduces big-data bottleneck; outperforms, enhances JPEG". UCLA Newsroom.
  2. "'Warping' Compresses Big Data". 30 December 2013.
  3. J. L. Hunt, B. G. Nickel, and C. Gigault, "Anamorphic images", American Journal of Physics 68, 232–237 (2000).
  4. Editors of Phaidon Press (2001). "The 20th-Century art book." (Reprinted. ed.). London: Phaidon Press. ISBN   0714835420.
  5. 1 2 Asghari, Mohammad H.; Jalali, Bahram (2013-09-16). "Anamorphic transformation and its application to time–bandwidth compression". Applied Optics. The Optical Society. 52 (27): 6735-6743. arXiv: 1307.0137 . doi:10.1364/ao.52.006735. ISSN   1559-128X.
  6. M. H. Asghari and B. Jalali, "Demonstration of analog time-bandwidth compression using anamorphic stretch transform", Frontiers in Optics (FIO 2013), Paper: FW6A.2, Orlando, USA.
  7. L. Cohen, Time-Frequency Analysis, Prentice-Hall, New York, 1995. ISBN   978-0135945322
  8. B. Boashash, ed., "Time-Frequency Signal Analysis and Processing – A Comprehensive Reference", Elsevier Science, Oxford, 2003.
  9. S. Qian and D. Chen, Joint Time-Frequency Analysis: Methods and Applications, Chap. 5, Prentice Hall, N.J., 1996.
  10. J. W. Goodman, that describes the dependence of intensity or power on the frequency and time duration of the modulation. It provides insight on how information bandwidth and signal duration are modified upon nonlinear dispersion in the time domain, or upon nonlinear diffraction in the spatial domain. "Introduction to Fourier Optics", McGraw-Hill Book Co (1968).
  11. 1 2 Jalali, Bahram; Chan, Jacky; Asghari, Mohammad H. (2014-07-22). "Time–bandwidth engineering". Optica. The Optical Society. 1 (1): 23-31. doi: 10.1364/optica.1.000023 . ISSN   2334-2536.
  12. Asghari, Mohammad H.; Jalali, Bahram (2013-09-16). "Anamorphic transformation and its application to time–bandwidth compression". Applied Optics. The Optical Society. 52 (27): 6735. arXiv: 1307.0137 . doi:10.1364/ao.52.006735. ISSN   1559-128X.
  13. Asghari, Mohammad H.; Jalali, Bahram (2014-03-17). "Experimental demonstration of optical real-time data compression". Applied Physics Letters. AIP Publishing. 104 (11): 111101. doi:10.1063/1.4868539. ISSN   0003-6951.
  14. 1 2 3 4 Chan, J.; Mahjoubfar, A.; Asghari, M.; Jalali, B. (2014). "Reconstruction in time-bandwidth compression systems". Applied Physics Letters. AIP Publishing. 105 (22): 221105. arXiv: 1409.0609 . doi:10.1063/1.4902986. ISSN   0003-6951.
  15. 1 2 Mahjoubfar, Ata; Chen, Claire Lifan; Jalali, Bahram (2015-11-25). "Design of Warped Stretch Transform". Scientific Reports. Springer Science and Business Media LLC. 5 (1): 17148. doi: 10.1038/srep17148 . ISSN   2045-2322.
  16. Chen, Claire Lifan; Mahjoubfar, Ata; Jalali, Bahram (2015-04-23). "Optical Data Compression in Time Stretch Imaging". PLOS ONE. 10 (4): e0125106. doi:10.1371/journal.pone.0125106. ISSN   1932-6203. PMC   4408077 . PMID   25906244.
  17. Asghari, M. H.; Jalali, B. (2014). "Discrete Anamorphic Transform for Image Compression". IEEE Signal Processing Letters. Institute of Electrical and Electronics Engineers (IEEE). 21 (7): 829–833. doi:10.1109/lsp.2014.2319586. ISSN   1070-9908.
  18. Chan, Jacky C. K.; Mahjoubfar, Ata; Chen, Claire L.; Jalali, Bahram (2016-07-01). "Context-Aware Image Compression". PLOS ONE. 11 (7): e0158201. Bibcode:2016PLoSO..1158201C. doi:10.1371/journal.pone.0158201. ISSN   1932-6203. PMC   4930214 . PMID   27367904.
  19. M. H. Asghari and B. Jalali, "Image compression using the feature-selective stretch transform", 13th IEEE International Symposium on Signal Processing and Information Technology (ISSPIT 2013), Athens, Greece.