Ultrasound Localization Microscopy

Last updated

Ultrasound Localization Microscopy (ULM) is an advanced ultrasound imaging technique. By localizing microbubbles, ULM overcomes the physical limit of diffraction, achieving sub-wavelength level resolution and qualifying as a super-resolution technique. [1] [2]

Contents

ULM is primarily utilized in vascular imaging. Because of its deep penetration depth and high resolution, tiny vessels deep within the tissue become visible. This capability gives ULM a significant advantage in diagnosing diseases associated with microvascular development and angiogenesis, such as cancer, diabetes, and certain neurodegenerative diseases. [3]

Principle

ULM animation with progressive reconstruction of a rat brain's vascularity. [4]

ULM requires multiple image frames that highlight microbubbles (MBs) and approximates the real vasculature by accumulating the located centroids of MBs across the frames. [5] MBs, typically far smaller than the transmitted wavelength, act as point reflectors/emitters of ultrasonic waves, which re-emit waves in a nonlinear fashion. As such, their reflected ultrasound signals are strong and separable from the surrounding tissue, which has the effect of highlighting microvasculature. Their signals, however, are still subject to the diffraction limit, meaning that when two MBs are too close to each other (at a distance shorter than half of the transmitted wavelength), they become indistinguishable.

ULM overcomes this limitation by controlling the sparsity of MBs to ensure minimal interference or overlap in their responses. [2] [6] [7] Computation techniques are then applied to determine the location of each MB, specifically the centroid of its response. The accumulation of these located centroids should closely resemble the actual vasculature.

The general workflow can be summarized as follows: [2]

  1. Acquire a video of the target area where MBs are flowing;
  2. Isolate the MB signal from the surrounding tissue in each video frame;
  3. Locate the centers of the isolated MBs;
  4. Optional: Track the movement of each MB across the frames;
  5. Accumulate the located centroids from all frames to form an image.

Microbubble Localization

The detection process in ULM focuses exclusively on signals originating from microbubbles (MBs), as background signals can impair the accuracy of localization and MB tracking. It is crucial to obtain clear images of MBs before proceeding with any downstream processing. Notably, MBs are in motion within vessels, whereas the surrounding tissue remains mostly static after motion correction. This spatial-temporal difference is captured in both the radio-frequency (RF) data and the consecutive frames of the acquired video. Different localization algorithms can be used to locate the MBs:

  1. Deterministic

Common algorithms include frame-to-frame subtraction [7] and singular value decomposition. [8] The performance of different algorithms depends on the image data type and application. [7] A benchmark comparison from 2022 [9] ranks the performance of deterministic MB localization methods noting that Radial Symmetry and Gaussian fitting were the two localization algorithms consistently rated highly on every quantitative index; however, Gaussian fitting was almost 50 times slower than Radial Symmetry. As an alternative, trilateration based on RF data bypasses computational beamforming and shows promise to refine scatterer positions. [10]

  1. Deep Learning

With the increasing popularity of deep neural networks, their adoption for ULM generally improves the reliability of MB detection. [4] [10] To overcome long ULM processing times, networks are directly trained on RF data to precisely pinpoint wavefronts and skip beamforming. [4]

Tracking

Because MBs are exclusively intravascular, microbubble displacement can be interpolated between different localizations along a path. [3] Essentially, if a series of localizations are close enough to one another in some limited number of successive frames, those localizations can be assumed to be the same microbubble along a certain path, and the path of those microbubbles may be interpolated from the data. Thus, the velocity and direction of the microbubbles (and thus blood) can be determined at a micrometer scale.

Difficulties arise with MB tracking with regard to limited microbubble detection; for example, a vessel with only a single microbubble detected might appear to be a 5 micrometer capillary but instead be a larger arteriole. As such, a certain number of tracks is necessary to properly image a vessel of a certain depth; that number is equal to the width of the vessel divided by the super-resolved pixel size. This further feeds into the balancing act of microbubble concentration—more microbubbles means more signals and localizations, but too many microbubbles will also restrict the efficacy of localization, reducing the superresolution capabilities.

Motion Correction

Usually, there is an additional motion correction step to adjust for deformations caused by living subject. The motion artifact can be particularly problematic for clinical use. [5] Though ULM achieves resolutions under 10 micrometers, "motion in the body or from the ultrasound transducer can be several orders of magnitudes beyond this level". [3] [11] For example, body motion could be on the scale of 0.5 mm, while ULM resolutions may be 5 to 10 micrometers. In addition, ULM requires "many localizations over many frames"—in other words, image acquisition times on the timescale of minutes with kilohertz frame rates. The movement to resolution ratio and long acquisition times required for ULM mean that motion correction is vitally important to improving the achievable image quality.

Applications

ULM provides "unprecedentedly detailed in-vivo microvascular architectures and robust hemodynamic parameters", and does so without Doppler angle dependence. [12] In contrast to CEUS, ULM provides typically a 10x improvement in image resolution and provides direct and quantitative data regarding blood flow speed. In practice, ULM may be performed in addition to CEUS, as CEUS can be performed in real-time while ULM requires post-processing of data.

Common clinical applications which could benefit from the addition of ULM include imaging microvasculature in developing tumors, microvasculature imaging in liver/kidney disease, and microvasculature imaging of rheumatoid arthritis. Much research is currently being performed with regard to ULM for the imaging of brain microvasculature and coronary microvasculature, where the 10x improvement in resolution over CEUS and direct, quantitative hemodynamic information is critical to gleaning information with regard to microvascular structure and hemodynamic properties. [12]

However, ULM has significant barriers in regard to common clinical application, namely high frame rates and intense computational demands. This is because ULM requires many localizations over many frames. As such, kilohertz frame rates over minutes are necessary to acquire a ULM dataset. This requires not only time and appropriate hardware but also an understanding of the proper MB concentrations for clinical use, which differs depending on the selected commercial contrast agents. Indeed, "complete control of the MB concentration in the blood stream cannot be achieved, and this varies in different organs, applications and patients, and in the different brands of MBs administered. Meanwhile, the ‘ideal’ MB concentration and MB count necessary for robust ULM imaging remains elusive, and requires further investigation". [12] Furthermore, imaging validation for ULM in-vivo damage is currently limited, lacking a gold-standard. ULM also cannot be performed in real-time, as significant post-processing of data is required to actually reconstruct an image, which has a significant computational cost and is accordingly temporally expensive. [12]

See also

Related Research Articles

<span class="mw-page-title-main">Medical ultrasound</span> Diagnostic and therapeutic technique

Medical ultrasound includes diagnostic techniques using ultrasound, as well as therapeutic applications of ultrasound. In diagnosis, it is used to create an image of internal body structures such as tendons, muscles, joints, blood vessels, and internal organs, to measure some characteristics or to generate an informative audible sound. The usage of ultrasound to produce visual images for medicine is called medical ultrasonography or simply sonography, or echography. The practice of examining pregnant women using ultrasound is called obstetric ultrasonography, and was an early development of clinical ultrasonography. The machine used is called an ultrasound machine, a sonograph or an echograph. The visual image formed using this technique is called an ultrasonogram, a sonogram or an echogram.

<span class="mw-page-title-main">Elastography</span> Any of several imaging modalities that map degrees of soft-tissue elasticity and stiffness

Elastography is any of a class of medical imaging modalities that map the elastic properties and stiffness of soft tissue. The main idea is that whether the tissue is hard or soft will give diagnostic information about the presence or status of disease. For example, cancerous tumours will often be harder than the surrounding tissue, and diseased livers are stiffer than healthy ones.

Super-resolution imaging (SR) is a class of techniques that enhance (increase) the resolution of an imaging system. In optical SR the diffraction limit of systems is transcended, while in geometrical SR the resolution of digital imaging sensors is enhanced.

<span class="mw-page-title-main">Contrast-enhanced ultrasound</span> Medical imaging technique

Contrast-enhanced ultrasound (CEUS) is the application of ultrasound contrast medium to traditional medical sonography. Ultrasound contrast agents rely on the different ways in which sound waves are reflected from interfaces between substances. This may be the surface of a small air bubble or a more complex structure. Commercially available contrast media are gas-filled microbubbles that are administered intravenously to the systemic circulation. Microbubbles have a high degree of echogenicity. There is a great difference in echogenicity between the gas in the microbubbles and the soft tissue surroundings of the body. Thus, ultrasonic imaging using microbubble contrast agents enhances the ultrasound backscatter, (reflection) of the ultrasound waves, to produce a sonogram with increased contrast due to the high echogenicity difference. Contrast-enhanced ultrasound can be used to image blood perfusion in organs, measure blood flow rate in the heart and other organs, and for other applications.

<span class="mw-page-title-main">Mathias Fink</span> French physicist

Mathias Fink, born in 1945 in Grenoble, is a French physicist, professor at ESPCI Paris and member of the French Academy of Sciences.

<span class="mw-page-title-main">Vertico spatially modulated illumination</span>

Vertico spatially modulated illumination (Vertico-SMI) is the fastest light microscope for the 3D analysis of complete cells in the nanometer range. It is based on two technologies developed in 1996, SMI and SPDM. The effective optical resolution of this optical nanoscope has reached the vicinity of 5 nm in 2D and 40 nm in 3D, greatly surpassing the λ/2 resolution limit applying to standard microscopy using transmission or reflection of natural light according to the Abbe resolution limit That limit had been determined by Ernst Abbe in 1873 and governs the achievable resolution limit of microscopes using conventional techniques.

Preclinical imaging is the visualization of living animals for research purposes, such as drug development. Imaging modalities have long been crucial to the researcher in observing changes, either at the organ, tissue, cell, or molecular level, in animals responding to physiological or environmental changes. Imaging modalities that are non-invasive and in vivo have become especially important to study animal models longitudinally. Broadly speaking, these imaging systems can be categorized into primarily morphological/anatomical and primarily molecular imaging techniques. Techniques such as high-frequency micro-ultrasound, magnetic resonance imaging (MRI) and computed tomography (CT) are usually used for anatomical imaging, while optical imaging, positron emission tomography (PET), and single photon emission computed tomography (SPECT) are usually used for molecular visualizations.

Super-resolution microscopy is a series of techniques in optical microscopy that allow such images to have resolutions higher than those imposed by the diffraction limit, which is due to the diffraction of light. Super-resolution imaging techniques rely on the near-field or on the far-field. Among techniques that rely on the latter are those that improve the resolution only modestly beyond the diffraction-limit, such as confocal microscopy with closed pinhole or aided by computational methods such as deconvolution or detector-based pixel reassignment, the 4Pi microscope, and structured-illumination microscopy technologies such as SIM and SMI.

Photo-activated localization microscopy and stochastic optical reconstruction microscopy (STORM) are widefield fluorescence microscopy imaging methods that allow obtaining images with a resolution beyond the diffraction limit. The methods were proposed in 2006 in the wake of a general emergence of optical super-resolution microscopy methods, and were featured as Methods of the Year for 2008 by the Nature Methods journal. The development of PALM as a targeted biophysical imaging method was largely prompted by the discovery of new species and the engineering of mutants of fluorescent proteins displaying a controllable photochromism, such as photo-activatible GFP. However, the concomitant development of STORM, sharing the same fundamental principle, originally made use of paired cyanine dyes. One molecule of the pair, when excited near its absorption maximum, serves to reactivate the other molecule to the fluorescent state.

<span class="mw-page-title-main">Eric Betzig</span> American physicist

Robert Eric Betzig is an American physicist who works as a professor of physics and professor of molecular and cell biology at the University of California, Berkeley. He is also a senior fellow at the Janelia Farm Research Campus in Ashburn, Virginia.

Super-resolution dipole orientation mapping (SDOM) is a form of fluorescence polarization microscopy (FPM) that achieved super resolution through polarization demodulation. It was first described by Karl Zhanghao and others in 2016. Fluorescence polarization (FP) is related to the dipole orientation of chromophores, making fluorescence polarization microscopy possible to reveal structures and functions of tagged cellular organelles and biological macromolecules. In addition to fluorescence intensity, wavelength, and lifetime, the fourth dimension of fluorescence—polarization—can also provide intensity modulation without the restriction to specific fluorophores; its investigation in super-resolution microscopy is still in its infancy.

<span class="mw-page-title-main">Functional ultrasound imaging</span> Ultrasound technique

Functional ultrasound imaging (fUS) is a medical ultrasound imaging technique of detecting or measuring changes in neural activities or metabolism, for example, the loci of brain activity, typically through measuring blood flow or hemodynamic changes. The method can be seen as an extension of Doppler imaging.

Speckle variance optical coherence tomography (SV-OCT) is an imaging algorithm for functional optical imaging. Optical coherence tomography is an imaging modality that uses low-coherence interferometry to obtain high resolution, depth-resolved volumetric images. OCT can be used to capture functional images of blood flow, a technique known as optical coherence tomography angiography (OCT-A). SV-OCT is one method for OCT-A that uses the variance of consecutively acquired images to detect flow at the micron scale. SV-OCT can be used to measure the microvasculature of tissue. In particular, it is useful in ophthalmology for visualizing blood flow in retinal and choroidal regions of the eye, which can provide information on the pathophysiology of diseases.

Deep learning in photoacoustic imaging

Deep learning in photoacoustic imaging combines the hybrid imaging modality of photoacoustic imaging (PA) with the rapidly evolving field of deep learning. Photoacoustic imaging is based on the photoacoustic effect, in which optical absorption causes a rise in temperature, which causes a subsequent rise in pressure via thermo-elastic expansion. This pressure rise propagates through the tissue and is sensed via ultrasonic transducers. Due to the proportionality between the optical absorption, the rise in temperature, and the rise in pressure, the ultrasound pressure wave signal can be used to quantify the original optical energy deposition within the tissue.

<span class="mw-page-title-main">Suliana Manley</span> American biophysicist

Suliana Manley is an American biophysicist. Her research focuses on the development of high-resolution optical instruments, and their application in studying the organization and dynamics of proteins. She is a professor at École Polytechnique Fédérale de Lausanne and heads the Laboratory of Experimental Biophysics.

<span class="mw-page-title-main">Video super-resolution</span> Generating high-resolution video frames from given low-resolution ones

Video super-resolution (VSR) is the process of generating high-resolution video frames from the given low-resolution video frames. Unlike single-image super-resolution (SISR), the main goal is not only to restore more fine details while saving coarse ones, but also to preserve motion consistency.

A specific branch of contrast-enhanced ultrasound, acoustic angiography is a minimally invasive and non-ionizing medical imaging technique used to visualize vasculature. Acoustic angiography was first developed by the Dayton Laboratory at North Carolina State University and provides a safe, portable, and inexpensive alternative to the most common methods of angiography such as Magnetic Resonance Angiography and Computed Tomography Angiography. Although ultrasound does not traditionally exhibit the high resolution of MRI or CT, high-frequency ultrasound (HFU) achieves relatively high resolution by sacrificing some penetration depth. HFU typically uses waves between 20 and 100 MHz and achieves resolution of 16-80μm at depths of 3-12mm. Although HFU has exhibited adequate resolution to monitor things like tumor growth in the skin layers, on its own it lacks the depth and contrast necessary for imaging blood vessels. Acoustic angiography overcomes the weaknesses of HFU by combining contrast-enhanced ultrasound with the use of a dual-element ultrasound transducer to achieve high resolution visualization of blood vessels at relatively deep penetration levels.

Ultrasound-switchable fluorescence (USF) imaging is a deep optics imaging technique. In last few decades, fluorescence microscopy has been highly developed to image biological samples and live tissues. However, due to light scattering, fluorescence microscopy is limited to shallow tissues. Since fluorescence is characterized by high contrast, high sensitivity, and low cost which is crucial to investigate deep tissue information, developing fluorescence imaging technique with high depth-to-resolution ratio would be promising.. Recently, ultrasound-switchable fluorescence imaging has been developed to achieve high signal-to-noise ratio (SNR) and high spatial resolution imaging without sacrificing image depth.

Focused-ultrasound-mediated diagnostics or FUS-mediated diagnostics are an area of clinical diagnostic tools that use ultrasound to detect diseases and cancers. Although ultrasound has been used for imaging in various settings, focused-ultrasound refers to the detection of specific cells and biomarkers under flow combining ultrasound with lasers, microbubbles, and imaging techniques. Current diagnostic techniques for detecting tumors and diseases using biopsies often include invasive procedures and require improved accuracy, especially in cases such as glioblastoma and melanoma. The field of FUS-mediated diagnostics targeting cells and biomarkers is being investigated for overcoming these limitations.

Francisco Balzarotti is an Argentinian scientist known for his work in super-resolution microscopy, particularly MINFLUX. He is a Group Leader at the Research Institute of Molecular Pathology (IMP) in Vienna, Austria.

References

  1. ↑ Couture, Olivier; Besson, Benoit; Montaldo, Gabriel; Fink, Mathias; Tanter, Mickael (2011). "Microbubble ultrasound super-localization imaging (MUSLI)". 2011 IEEE International Ultrasonics Symposium. pp. 1285–1287. doi:10.1109/ULTSYM.2011.6293576. ISBN   978-1-4577-1252-4.
  2. 1 2 3 Errico, Claudia; Pierre, Juliette; Pezet, Sophie; Desailly, Yann; Lenkei, Zsolt; Couture, Olivier; Tanter, Mickael (November 2015). "Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging". Nature. 527 (7579): 499–502. doi:10.1038/nature16066. PMID   26607546. S2CID   4447059.
  3. 1 2 3 Christensen-Jeffries, Kirsten; Couture, Olivier; Dayton, Paul A.; Eldar, Yonina C.; Hynynen, Kullervo; Kiessling, Fabian; O'Reilly, Meaghan; Pinton, Gianmarco F.; Schmitz, Georg; Tang, Meng-Xing; Tanter, Mickael; van Sloun, Ruud J.G. (April 2020). "Super-resolution Ultrasound Imaging". Ultrasound in Medicine & Biology. 46 (4): 865–891. doi:10.1016/j.ultrasmedbio.2019.11.013. PMC   8388823 . PMID   31973952.
  4. 1 2 3 Hahne, Christopher; Chabouh, Georges; Chavignon, Arthur; Couture, Olivier; Sznitman, Raphael (2024). "RF-ULM: Ultrasound Localization Microscopy Learned from Radio-Frequency Wavefronts" (PDF). IEEE Transactions on Medical Imaging: 1–1. doi:10.1109/TMI.2024.3391297.
  5. 1 2 Dencks, Stefanie; Schmitz, Georg (August 2023). "Ultrasound localization microscopy". Zeitschrift für Medizinische Physik. 33 (3): 292–308. doi:10.1016/j.zemedi.2023.02.004. PMC   10517400 . PMID   37328329.
  6. ↑ Couture, Olivier; Hingot, Vincent; Heiles, Baptiste; Muleki-Seya, Pauline; Tanter, Mickael (August 2018). "Ultrasound Localization Microscopy and Super-Resolution: A State of the Art". IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 65 (8): 1304–1320. doi:10.1109/tuffc.2018.2850811. PMID   29994673.
  7. 1 2 3 Desailly, Yann; Couture, Olivier; Fink, Mathias; Tanter, Mickael (21 October 2013). "Sono-activated ultrasound localization microscopy" (PDF). Applied Physics Letters. 103 (17). doi:10.1063/1.4826597.
  8. ↑ Demene, Charlie; Deffieux, Thomas; Pernot, Mathieu; Osmanski, Bruno-Felix; Biran, Valerie; Gennisson, Jean-Luc; Sieu, Lim-Anna; Bergel, Antoine; Franqui, Stephanie; Correas, Jean-Michel; Cohen, Ivan; Baud, Olivier; Tanter, Mickael (November 2015). "Spatiotemporal Clutter Filtering of Ultrafast Ultrasound Data Highly Increases Doppler and fUltrasound Sensitivity". IEEE Transactions on Medical Imaging. 34 (11): 2271–2285. doi:10.1109/tmi.2015.2428634. PMID   25955583. S2CID   2757005.
  9. ↑ Heiles, Baptiste; Chavignon, Arthur; Hingot, Vincent; Lopez, Pauline; Teston, Eliott; Couture, Olivier (17 February 2022). "Performance benchmarking of microbubble-localization algorithms for ultrasound localization microscopy" (PDF). Nature Biomedical Engineering. 6 (5): 605–616. doi:10.1038/s41551-021-00824-8. PMID   35177778. S2CID   246943634.
  10. 1 2 Hahne, Christopher; Sznitman, Raphael (2023). "Geometric Ultrasound Localization Microscopy". Medical Image Computing and Computer Assisted Intervention – MICCAI 2023 (PDF). Lecture Notes in Computer Science. Vol. 14229. pp. 217–227. arXiv: 2306.15548 . doi:10.1007/978-3-031-43999-5_21. ISBN   978-3-031-43998-8.
  11. ↑ Renaudin, Noémi; Demené, Charlie; Dizeux, Alexandre; Ialy-Radio, Nathalie; Pezet, Sophie; Tanter, Mickael (August 2022). "Functional ultrasound localization microscopy reveals brain-wide neurovascular activity on a microscopic scale". Nature Methods. 19 (8): 1004–1012. doi:10.1038/s41592-022-01549-5. PMC   9352591 . PMID   35927475.
  12. 1 2 3 4 Yi, Hui-ming; Lowerison, Matthew R.; Song, Peng-fei; Zhang, Wei (February 2022). "A Review of Clinical Applications for Super-resolution Ultrasound Localization Microscopy". Current Medical Science. 42 (1): 1–16. doi:10.1007/s11596-021-2459-2. PMID   35167000. S2CID   246815755.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.