Ultrasound Localization Microscopy

Last updated

Ultrasound Localization Microscopy (ULM) is an advanced ultrasound imaging technique. By localizing microbubbles, ULM overcomes the physical limit of diffraction, achieving sub-wavelength level resolution and qualifying as a super-resolution technique. [1] [2]

Contents

ULM is primarily utilized in vascular imaging. Because of its deep penetration depth and high resolution, tiny vessels deep within the tissue become visible. This capability gives ULM a significant advantage in diagnosing diseases associated with microvascular development and angiogenesis, such as cancer, diabetes, and certain neurodegenerative diseases. [3]

Principle

ULM animation with progressive reconstruction of a rat brain's vascularity. [4]

ULM requires multiple image frames that highlight microbubbles (MBs) and approximates the real vasculature by accumulating the located centroids of MBs across the frames. [5] MBs, typically far smaller than the transmitted wavelength, act as point reflectors/emitters of ultrasonic waves, which re-emit waves in a nonlinear fashion. As such, their reflected ultrasound signals are strong and separable from the surrounding tissue, which has the effect of highlighting microvasculature. Their signals, however, are still subject to the diffraction limit, meaning that when two MBs are too close to each other (at a distance shorter than half of the transmitted wavelength), they become indistinguishable.

ULM overcomes this limitation by controlling the sparsity of MBs to ensure minimal interference or overlap in their responses. [2] [6] [7] Computation techniques are then applied to determine the location of each MB, specifically the centroid of its response. The accumulation of these located centroids should closely resemble the actual vasculature.

The general workflow can be summarized as follows: [2]

  1. Acquire a video of the target area where MBs are flowing;
  2. Isolate the MB signal from the surrounding tissue in each video frame;
  3. Locate the centers of the isolated MBs;
  4. Optional: Track the movement of each MB across the frames;
  5. Accumulate the located centroids from all frames to form an image.

Microbubble Localization

The detection process in ULM focuses exclusively on signals originating from microbubbles (MBs), as background signals can impair the accuracy of localization and MB tracking. It is crucial to obtain clear images of MBs before proceeding with any downstream processing. Notably, MBs are in motion within vessels, whereas the surrounding tissue remains mostly static after motion correction. This spatial-temporal difference is captured in both the radio-frequency (RF) data and the consecutive frames of the acquired video. Different localization algorithms can be used to locate the MBs:

  1. Deterministic

Common algorithms include frame-to-frame subtraction [7] and singular value decomposition. [8] The performance of different algorithms depends on the image data type and application. [7] A benchmark comparison from 2022 [9] ranks the performance of deterministic MB localization methods noting that Radial Symmetry and Gaussian fitting were the two localization algorithms consistently rated highly on every quantitative index; however, Gaussian fitting was almost 50 times slower than Radial Symmetry. As an alternative, trilateration based on RF data bypasses computational beamforming and shows promise to refine scatterer positions. [10]

  1. Deep Learning

With the increasing popularity of deep neural networks, their adoption for ULM generally improves the reliability of MB detection. [4] [10] To overcome long ULM processing times, networks are directly trained on RF data to precisely pinpoint wavefronts and skip beamforming. [4]

Tracking

Because MBs are exclusively intravascular, microbubble displacement can be interpolated between different localizations along a path. [3] Essentially, if a series of localizations are close enough to one another in some limited number of successive frames, those localizations can be assumed to be the same microbubble along a certain path, and the path of those microbubbles may be interpolated from the data. Thus, the velocity and direction of the microbubbles (and thus blood) can be determined at a micrometer scale.

Difficulties arise with MB tracking with regard to limited microbubble detection; for example, a vessel with only a single microbubble detected might appear to be a 5 micrometer capillary but instead be a larger arteriole. As such, a certain number of tracks is necessary to properly image a vessel of a certain depth; that number is equal to the width of the vessel divided by the super-resolved pixel size. This further feeds into the balancing act of microbubble concentration—more microbubbles means more signals and localizations, but too many microbubbles will also restrict the efficacy of localization, reducing the superresolution capabilities.

Motion Correction

Usually, there is an additional motion correction step to adjust for deformations caused by living subject. The motion artifact can be particularly problematic for clinical use. [5] Though ULM achieves resolutions under 10 micrometers, "motion in the body or from the ultrasound transducer can be several orders of magnitudes beyond this level". [3] [11] For example, body motion could be on the scale of 0.5 mm, while ULM resolutions may be 5 to 10 micrometers. In addition, ULM requires "many localizations over many frames"—in other words, image acquisition times on the timescale of minutes with kilohertz frame rates. The movement to resolution ratio and long acquisition times required for ULM mean that motion correction is vitally important to improving the achievable image quality.

Applications

ULM provides "unprecedentedly detailed in-vivo microvascular architectures and robust hemodynamic parameters", and does so without Doppler angle dependence. [12] In contrast to CEUS, ULM provides typically a 10x improvement in image resolution and provides direct and quantitative data regarding blood flow speed. In practice, ULM may be performed in addition to CEUS, as CEUS can be performed in real-time while ULM requires post-processing of data.

Common clinical applications which could benefit from the addition of ULM include imaging microvasculature in developing tumors, microvasculature imaging in liver/kidney disease, and microvasculature imaging of rheumatoid arthritis. Much research is currently being performed with regard to ULM for the imaging of brain microvasculature and coronary microvasculature, where the 10x improvement in resolution over CEUS and direct, quantitative hemodynamic information is critical to gleaning information with regard to microvascular structure and hemodynamic properties. [12]

However, ULM has significant barriers in regard to common clinical application, namely high frame rates and intense computational demands. This is because ULM requires many localizations over many frames. As such, kilohertz frame rates over minutes are necessary to acquire a ULM dataset. This requires not only time and appropriate hardware but also an understanding of the proper MB concentrations for clinical use, which differs depending on the selected commercial contrast agents. Indeed, "complete control of the MB concentration in the blood stream cannot be achieved, and this varies in different organs, applications and patients, and in the different brands of MBs administered. Meanwhile, the ‘ideal’ MB concentration and MB count necessary for robust ULM imaging remains elusive, and requires further investigation". [12] Furthermore, imaging validation for ULM in-vivo damage is currently limited, lacking a gold-standard. ULM also cannot be performed in real-time, as significant post-processing of data is required to actually reconstruct an image, which has a significant computational cost and is accordingly temporally expensive. [12]

See also

Related Research Articles

<span class="mw-page-title-main">Medical ultrasound</span> Diagnostic and therapeutic technique

Medical ultrasound includes diagnostic techniques using ultrasound, as well as therapeutic applications of ultrasound. In diagnosis, it is used to create an image of internal body structures such as tendons, muscles, joints, blood vessels, and internal organs, to measure some characteristics or to generate an informative audible sound. The usage of ultrasound to produce visual images for medicine is called medical ultrasonography or simply sonography, or echography. The practice of examining pregnant women using ultrasound is called obstetric ultrasonography, and was an early development of clinical ultrasonography. The machine used is called an ultrasound machine, a sonograph or an echograph. The visual image formed using this technique is called an ultrasonogram, a sonogram or an echogram.

<span class="mw-page-title-main">Elastography</span> Any of several imaging modalities that map degrees of soft-tissue elasticity and stiffness

Elastography is any of a class of medical imaging modalities that map the elastic properties and stiffness of soft tissue. The main idea is that whether the tissue is hard or soft will give diagnostic information about the presence or status of disease. For example, cancerous tumours will often be harder than the surrounding tissue, and diseased livers are stiffer than healthy ones.

Super-resolution imaging (SR) is a class of techniques that enhance (increase) the resolution of an imaging system. In optical SR the diffraction limit of systems is transcended, while in geometrical SR the resolution of digital imaging sensors is enhanced.

<span class="mw-page-title-main">Photoacoustic imaging</span> Imaging using the photoacoustic effect

Photoacoustic imaging or optoacoustic imaging is a biomedical imaging modality based on the photoacoustic effect. Non-ionizing laser pulses are delivered into biological tissues and part of the energy will be absorbed and converted into heat, leading to transient thermoelastic expansion and thus wideband ultrasonic emission. The generated ultrasonic waves are detected by ultrasonic transducers and then analyzed to produce images. It is known that optical absorption is closely associated with physiological properties, such as hemoglobin concentration and oxygen saturation. As a result, the magnitude of the ultrasonic emission, which is proportional to the local energy deposition, reveals physiologically specific optical absorption contrast. 2D or 3D images of the targeted areas can then be formed.

<span class="mw-page-title-main">Contrast-enhanced ultrasound</span> Medical imaging technique

Contrast-enhanced ultrasound (CEUS) is the application of ultrasound contrast medium to traditional medical sonography. Ultrasound contrast agents rely on the different ways in which sound waves are reflected from interfaces between substances. This may be the surface of a small air bubble or a more complex structure. Commercially available contrast media are gas-filled microbubbles that are administered intravenously to the systemic circulation. Microbubbles have a high degree of echogenicity. There is a great difference in echogenicity between the gas in the microbubbles and the soft tissue surroundings of the body. Thus, ultrasonic imaging using microbubble contrast agents enhances the ultrasound backscatter, (reflection) of the ultrasound waves, to produce a sonogram with increased contrast due to the high echogenicity difference. Contrast-enhanced ultrasound can be used to image blood perfusion in organs, measure blood flow rate in the heart and other organs, and for other applications.

<span class="mw-page-title-main">Characterization (materials science)</span> Study of material structure and properties

Characterization, when used in materials science, refers to the broad and general process by which a material's structure and properties are probed and measured. It is a fundamental process in the field of materials science, without which no scientific understanding of engineering materials could be ascertained. The scope of the term often differs; some definitions limit the term's use to techniques which study the microscopic structure and properties of materials, while others use the term to refer to any materials analysis process including macroscopic techniques such as mechanical testing, thermal analysis and density calculation. The scale of the structures observed in materials characterization ranges from angstroms, such as in the imaging of individual atoms and chemical bonds, up to centimeters, such as in the imaging of coarse grain structures in metals.

Acoustic microscopy is microscopy that employs very high or ultra high frequency ultrasound. Acoustic microscopes operate non-destructively and penetrate most solid materials to make visible images of internal features, including defects such as cracks, delaminations and voids.

<span class="mw-page-title-main">Mathias Fink</span> French physicist

Mathias Fink, born in 1945 in Grenoble, is a French physicist, professor at ESPCI Paris and member of the French Academy of Sciences.

<span class="mw-page-title-main">Vertico spatially modulated illumination</span>

Vertico spatially modulated illumination (Vertico-SMI) is the fastest light microscope for the 3D analysis of complete cells in the nanometer range. It is based on two technologies developed in 1996, SMI and SPDM. The effective optical resolution of this optical nanoscope has reached the vicinity of 5 nm in 2D and 40 nm in 3D, greatly surpassing the λ/2 resolution limit applying to standard microscopy using transmission or reflection of natural light according to the Abbe resolution limit That limit had been determined by Ernst Abbe in 1873 and governs the achievable resolution limit of microscopes using conventional techniques.

Ultrasound-modulated optical tomography (UOT), also known as Acousto-Optic Tomography (AOT), is a hybrid imaging modality that combines light and sound; it is a form of tomography involving ultrasound. It is used in imaging of biological soft tissues and has potential applications for early cancer detection. As a hybrid modality which uses both light and sound, UOT provides some of the best features of both: the use of light provides strong contrast and sensitivity ; these two features are derived from the optical component of UOT. The use of ultrasound allows for high resolution, as well as a high imaging depth. However, the difficulty of tackling the two fundamental problems with UOT have caused UOT to evolve relatively slowly; most work in the field is limited to theoretical simulations or phantom / sample studies.

Microbubbles are bubbles smaller than one hundredth of a millimetre in diameter, but larger than one micrometre. They have widespread application in industry, medicine, life science, and food technology. The composition of the bubble shell and filling material determine important design features such as buoyancy, crush strength, thermal conductivity, and acoustic properties.

Super-resolution microscopy is a series of techniques in optical microscopy that allow such images to have resolutions higher than those imposed by the diffraction limit, which is due to the diffraction of light. Super-resolution imaging techniques rely on the near-field or on the far-field. Among techniques that rely on the latter are those that improve the resolution only modestly beyond the diffraction-limit, such as confocal microscopy with closed pinhole or aided by computational methods such as deconvolution or detector-based pixel reassignment, the 4Pi microscope, and structured-illumination microscopy technologies such as SIM and SMI.

Ultrasound computer tomography (USCT), sometimes also Ultrasound computed tomography, Ultrasound computerized tomography or just Ultrasound tomography, is a form of medical ultrasound tomography utilizing ultrasound waves as physical phenomenon for imaging. It is mostly in use for soft tissue medical imaging, especially breast imaging.

Super-resolution photoacoustic imaging is a set of techniques used to enhance spatial resolution in photoacoustic imaging. Specifically, these techniques primarily break the optical diffraction limit of the photoacoustic imaging system. It can be achieved in a variety of mechanisms, such as blind structured illumination, multi-speckle illumination, or photo-imprint photoacoustic microscopy in Figure 1.

<span class="mw-page-title-main">Photoacoustic microscopy</span>

Photoacoustic microscopy is an imaging method based on the photoacoustic effect and is a subset of photoacoustic tomography. Photoacoustic microscopy takes advantage of the local temperature rise that occurs as a result of light absorption in tissue. Using a nanosecond pulsed laser beam, tissues undergo thermoelastic expansion, resulting in the release of a wide-band acoustic wave that can be detected using a high-frequency ultrasound transducer. Since ultrasonic scattering in tissue is weaker than optical scattering, photoacoustic microscopy is capable of achieving high-resolution images at greater depths than conventional microscopy methods. Furthermore, photoacoustic microscopy is especially useful in the field of biomedical imaging due to its scalability. By adjusting the optical and acoustic foci, lateral resolution may be optimized for the desired imaging depth.

<span class="mw-page-title-main">Functional ultrasound imaging</span>

Functional ultrasound imaging (fUS) is a medical ultrasound imaging technique of detecting or measuring changes in neural activities or metabolism, for example, the loci of brain activity, typically through measuring blood flow or hemodynamic changes. The method can be seen as an extension of Doppler imaging.

Deep learning in photoacoustic imaging

Deep learning in photoacoustic imaging combines the hybrid imaging modality of photoacoustic imaging (PA) with the rapidly evolving field of deep learning. Photoacoustic imaging is based on the photoacoustic effect, in which optical absorption causes a rise in temperature, which causes a subsequent rise in pressure via thermo-elastic expansion. This pressure rise propagates through the tissue and is sensed via ultrasonic transducers. Due to the proportionality between the optical absorption, the rise in temperature, and the rise in pressure, the ultrasound pressure wave signal can be used to quantify the original optical energy deposition within the tissue.

A specific branch of contrast-enhanced ultrasound, acoustic angiography is a minimally invasive and non-ionizing medical imaging technique used to visualize vasculature. Acoustic angiography was first developed by the Dayton Laboratory at North Carolina State University and provides a safe, portable, and inexpensive alternative to the most common methods of angiography such as Magnetic Resonance Angiography and Computed Tomography Angiography. Although ultrasound does not traditionally exhibit the high resolution of MRI or CT, high-frequency ultrasound (HFU) achieves relatively high resolution by sacrificing some penetration depth. HFU typically uses waves between 20 and 100 MHz and achieves resolution of 16-80μm at depths of 3-12mm. Although HFU has exhibited adequate resolution to monitor things like tumor growth in the skin layers, on its own it lacks the depth and contrast necessary for imaging blood vessels. Acoustic angiography overcomes the weaknesses of HFU by combining contrast-enhanced ultrasound with the use of a dual-element ultrasound transducer to achieve high resolution visualization of blood vessels at relatively deep penetration levels.

Ultrasound-switchable fluorescence (USF) imaging is a deep optics imaging technique. In last few decades, fluorescence microscopy has been highly developed to image biological samples and live tissues. However, due to light scattering, fluorescence microscopy is limited to shallow tissues. Since fluorescence is characterized by high contrast, high sensitivity, and low cost which is crucial to investigate deep tissue information, developing fluorescence imaging technique with high depth-to-resolution ratio would be promising.. Recently, ultrasound-switchable fluorescence imaging has been developed to achieve high signal-to-noise ratio (SNR) and high spatial resolution imaging without sacrificing image depth.


Focused-ultrasound-mediated diagnostics or FUS-mediated diagnostics are an area of clinical diagnostic tools that use ultrasound to detect diseases and cancers. Although ultrasound has been used for imaging in various settings, focused-ultrasound refers to the detection of specific cells and biomarkers under flow combining ultrasound with lasers, microbubbles, and imaging techniques. Current diagnostic techniques for detecting tumors and diseases using biopsies often include invasive procedures and require improved accuracy, especially in cases such as glioblastoma and melanoma. The field of FUS-mediated diagnostics targeting cells and biomarkers is being investigated for overcoming these limitations.

References

  1. ↑ Couture, Olivier; Besson, Benoit; Montaldo, Gabriel; Fink, Mathias; Tanter, Mickael (2011). "Microbubble ultrasound super-localization imaging (MUSLI)". 2011 IEEE International Ultrasonics Symposium. pp. 1285–1287. doi:10.1109/ULTSYM.2011.6293576. ISBN   978-1-4577-1252-4.
  2. 1 2 3 Errico, Claudia; Pierre, Juliette; Pezet, Sophie; Desailly, Yann; Lenkei, Zsolt; Couture, Olivier; Tanter, Mickael (November 2015). "Ultrafast ultrasound localization microscopy for deep super-resolution vascular imaging". Nature. 527 (7579): 499–502. doi:10.1038/nature16066. PMID   26607546. S2CID   4447059.
  3. 1 2 3 Christensen-Jeffries, Kirsten; Couture, Olivier; Dayton, Paul A.; Eldar, Yonina C.; Hynynen, Kullervo; Kiessling, Fabian; O'Reilly, Meaghan; Pinton, Gianmarco F.; Schmitz, Georg; Tang, Meng-Xing; Tanter, Mickael; van Sloun, Ruud J.G. (April 2020). "Super-resolution Ultrasound Imaging". Ultrasound in Medicine & Biology. 46 (4): 865–891. doi:10.1016/j.ultrasmedbio.2019.11.013. PMC   8388823 . PMID   31973952.
  4. 1 2 3 Hahne, Christopher; Chabouh, Georges; Couture, Olivier; Sznitman, Raphael (3 September 2023). "Learning Super-Resolution Ultrasound Localization Microscopy from Radio-Frequency Data". 2023 IEEE International Ultrasonics Symposium (IUS). pp. 1–4. arXiv: 2311.04081 . doi:10.1109/IUS51837.2023.10307592. ISBN   979-8-3503-4645-9.
  5. 1 2 Dencks, Stefanie; Schmitz, Georg (August 2023). "Ultrasound localization microscopy". Zeitschrift für Medizinische Physik. 33 (3): 292–308. doi:10.1016/j.zemedi.2023.02.004. PMC   10517400 . PMID   37328329.
  6. ↑ Couture, Olivier; Hingot, Vincent; Heiles, Baptiste; Muleki-Seya, Pauline; Tanter, Mickael (August 2018). "Ultrasound Localization Microscopy and Super-Resolution: A State of the Art". IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control. 65 (8): 1304–1320. doi:10.1109/tuffc.2018.2850811. PMID   29994673.
  7. 1 2 3 Desailly, Yann; Couture, Olivier; Fink, Mathias; Tanter, Mickael (21 October 2013). "Sono-activated ultrasound localization microscopy" (PDF). Applied Physics Letters. 103 (17). doi:10.1063/1.4826597.
  8. ↑ Demene, Charlie; Deffieux, Thomas; Pernot, Mathieu; Osmanski, Bruno-Felix; Biran, Valerie; Gennisson, Jean-Luc; Sieu, Lim-Anna; Bergel, Antoine; Franqui, Stephanie; Correas, Jean-Michel; Cohen, Ivan; Baud, Olivier; Tanter, Mickael (November 2015). "Spatiotemporal Clutter Filtering of Ultrafast Ultrasound Data Highly Increases Doppler and fUltrasound Sensitivity". IEEE Transactions on Medical Imaging. 34 (11): 2271–2285. doi:10.1109/tmi.2015.2428634. PMID   25955583. S2CID   2757005.
  9. ↑ Heiles, Baptiste; Chavignon, Arthur; Hingot, Vincent; Lopez, Pauline; Teston, Eliott; Couture, Olivier (17 February 2022). "Performance benchmarking of microbubble-localization algorithms for ultrasound localization microscopy" (PDF). Nature Biomedical Engineering. 6 (5): 605–616. doi:10.1038/s41551-021-00824-8. PMID   35177778. S2CID   246943634.
  10. 1 2 Hahne, Christopher; Sznitman, Raphael (2023). Geometric Ultrasound Localization Microscopy. Lecture Notes in Computer Science. Vol. 14229. pp. 217–227. arXiv: 2306.15548 . doi:10.1007/978-3-031-43999-5_21. ISBN   978-3-031-43998-8.{{cite book}}: |journal= ignored (help)
  11. ↑ Renaudin, Noémi; Demené, Charlie; Dizeux, Alexandre; Ialy-Radio, Nathalie; Pezet, Sophie; Tanter, Mickael (August 2022). "Functional ultrasound localization microscopy reveals brain-wide neurovascular activity on a microscopic scale". Nature Methods. 19 (8): 1004–1012. doi:10.1038/s41592-022-01549-5. PMID   35927475.
  12. 1 2 3 4 Yi, Hui-ming; Lowerison, Matthew R.; Song, Peng-fei; Zhang, Wei (February 2022). "A Review of Clinical Applications for Super-resolution Ultrasound Localization Microscopy". Current Medical Science. 42 (1): 1–16. doi:10.1007/s11596-021-2459-2. PMID   35167000. S2CID   246815755.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.