Augmented reality-assisted surgery

Last updated

Augmented reality-assisted surgery (ARAS) is a surgical tool utilizing technology that superimposes a computer-generated image on a surgeon's view of the operative field, thus providing a composite view for the surgeon of the patient with a computer generated overlay enhancing the operative experience. In addition, augmented reality interfaces (ARI) with ARAS allow for non-physical contact by recognizing speech from surgeons and lowering the chances of physical contamination while operating. [1] ARAS can be used for training, preparation for an operation, or performance of an operation. Surgeons are a great way in which these procedures are implemented into medicine. ARAS can be performed using a wide array of technology, including an optical head-mounted display (OHMD)—such as the Google Glass XE 22.1 or Vuzix STAR 1200 XL. A study recorded a relatively positive reaction among trainees towards this technology in the operation room as the ARAS device guided them through a procedure. [2] Some ARAS devices also provide a digital overlay from robotic and laparoscopic surgery feeds. [3] Augmented reality assisted surgery devices have been growing in use in various medical fields such as imagining, interactive body mapping, and modeling possible cancerous growths. [1] It is also being used as a way to plan before executing a complicated surgery. This technology has some specialized uses in urological and cardiovascular areas. [2] [4] [5] [6]

Specialized uses

A subset of called augmented reality-assisted urologic surgery (ARAUS) specifically aids with urological surgery. This intraoperative training tool was first described and utilized by Tariq S. Hakky, Ryan M. Dickey, and Larry I. Lipshultz within the Scott Department of Urology, Baylor College of Medicine, and Daniel R. Martinez, Rafael E. Carrion, and Philippe E. Spiess within the Sexual Medicine Program in the Department of Urology, at the University of South Florida. [2] It was initially used to teach medical residents how to place a penile implant from start to finish via an application downloaded onto the OHMD. Intraoperatively, an optical display camera output feed combined with software allowing for the detection of points of interest enabled faculty to interact with residents during the placement of the penile implant. Both faculty and residents demonstrated a high degree of satisfaction of the ARAUS experience, and it was shown to be an effective tool in training urological surgical technique. Advantages of ARAUS include real-time feedback of residents during suy and superior visibility and interaction between faculty and residents. [2] [4]

ARAS has also been applied to the cardiovascular realm. Terry Peters of the University of Western Ontario in London, Canada has teamed up with other researchers at the Robarts Research Institute to implement ARAS towards the goal of improving repairs to the heart's mitral valve and replacement of the aortic valve. [5] In an interview for the Medical Augmented Reality Blog, Peters stated that his research team could not only use ARAS to "[improve] the speed and safety of the cardiac valve repair procedure"; they also conducted "the evaluation of an AR environment to plan brain-tumor removal, and the development of an ARF-enhanced system for ultrasound-guided spinal injections." [6]

Holosurical Inc has developed the clinically tested ARAI™ surgical navigation system that provides real-time patient-specific 3D anatomical visualization for presurgical planning, intraoperative guidance, and postsurgical data analytics. [7] The augmented reality component of the system allows the surgeon to focus their attention on the patient's internal anatomy, without actually exposing it. On January 10, 2019, HoloSurgical Inc completed the 1st spine surgery in the world using augmented reality, artificial intelligence-based navigation system. [8] The system was developed by AI pioneer Pawel Lewicki PhD, surgeon Kris Siemionow MD, PhD, and engineer Cristian Luciano PhD. [9]

Related Research Articles

<span class="mw-page-title-main">Urology</span> Medical specialty on the urinary and reproductive systems

Urology, also known as genitourinary surgery, is the branch of medicine that focuses on surgical and medical diseases of the urinary system and the reproductive organs. Organs under the domain of urology include the kidneys, adrenal glands, ureters, urinary bladder, urethra, and the male reproductive organs.

<span class="mw-page-title-main">Penis enlargement</span> Technique aimed to increase the size of a human penis

Penis enlargement, or male enhancement, is any technique aimed to increase the size of a human penis. Some methods aim to increase total length, others the shaft's girth, and yet others the glans and foreskin size. Techniques include surgery, supplements, ointments, patches, and physical methods like pumping, jelqing, and traction.

Image-guided surgery (IGS) is any surgical procedure where the surgeon uses tracked surgical instruments in conjunction with preoperative or intraoperative images in order to directly or indirectly guide the procedure. Image guided surgery systems use cameras, ultrasonic, electromagnetic or a combination of fields to capture and relay the patient's anatomy and the surgeon's precise movements in relation to the patient, to computer monitors in the operating room or to augmented reality headsets. This is generally performed in real-time though there may be delays of seconds or minutes depending on the modality and application.

<span class="mw-page-title-main">Prostatectomy</span> Surgical removal of all or part of the prostate gland

Prostatectomy is the surgical removal of all or part of the prostate gland. This operation is done for benign conditions that cause urinary retention, as well as for prostate cancer and for other cancers of the pelvis.

<span class="mw-page-title-main">Robot-assisted surgery</span> Surgical procedure

Robot-assisted surgery or robotic surgery are any types of surgical procedures that are performed using robotic systems. Robotically assisted surgery was developed to try to overcome the limitations of pre-existing minimally-invasive surgical procedures and to enhance the capabilities of surgeons performing open surgery.

<span class="mw-page-title-main">Radical retropubic prostatectomy</span>

Radical retropubic prostatectomy is a surgical procedure in which the prostate gland is removed through an incision in the abdomen. It is most often used to treat individuals who have early prostate cancer. Radical retropubic prostatectomy can be performed under general, spinal, or epidural anesthesia and requires blood transfusion less than one-fifth of the time. Radical retropubic prostatectomy is associated with complications such as urinary incontinence and impotence, but these outcomes are related to a combination of individual patient anatomy, surgical technique, and the experience and skill of the surgeon.

<span class="mw-page-title-main">Penile implant</span> Medical device

A penile implant is an implanted device intended for the treatment of erectile dysfunction, Peyronie's disease, ischemic priapism, deformity and any traumatic injury of the penis, and for phalloplasty or metoidioplasty, including in gender-affirming surgery. Men also opt for penile implants for aesthetic purposes. Men's satisfaction and sexual function is influenced by discomfort over genital size which leads to seek surgical and non-surgical solutions for penis alteration. Although there are many distinct types of implants, most fall into one of two categories: malleable and inflatable transplants.

Urethroplasty is the surgical repair of an injury or defect within the walls of the urethra. Trauma, iatrogenic injury and infections are the most common causes of urethral injury/defect requiring repair. Urethroplasty is regarded as the gold standard treatment for urethral strictures and offers better outcomes in terms of recurrence rates than dilatations and urethrotomies. It is probably the only useful modality of treatment for long and complex strictures though recurrence rates are higher for this difficult treatment group.

Computer-assisted surgery (CAS) represents a surgical concept and set of methods, that use computer technology for surgical planning, and for guiding or performing surgical interventions. CAS is also known as computer-aided surgery, computer-assisted intervention, image-guided surgery, digital surgery and surgical navigation, but these are terms that are more or less synonymous with CAS. CAS has been a leading factor in the development of robotic surgery.

<span class="mw-page-title-main">Mahendra Bhandari</span> Indian surgeon

Mahendra Bhandari is an Indian surgeon who has made substantial contributions to the specialty of urology, medical training, hospital administration, robotic surgery and medical ethics. For his efforts, he was awarded the Padma Shri by the government of India in 2000. Bhandari is currently Senior Bio-scientist and Director of Robotic Surgery Research & Education at the Vattikuti Urology Institute (VUI) in Detroit, MI. He was the Symposium coordinator of the International Robotic Urology Symposium. He also has been the CEO of the Vattikuti Foundation since 2010.

da Vinci Surgical System Robotic surgical system

The da Vinci Surgical System is a robotic surgical system that uses a minimally invasive surgical approach. The system is manufactured by the company Intuitive Surgical. The system is used for prostatectomies, increasingly for cardiac valve repair and for renal and gynecologic surgical procedures.

<span class="mw-page-title-main">Mani Menon</span>

Mani Menon, born 9 July 1948 in Trichur, India, is an American surgeon whose work has helped to lay the foundation for modern Robotic Cancer Surgery. He is the founding director and the Raj and Padma Vattikuti Distinguished Chair of the Vattikuti Urology Institute at the Henry Ford Hospital in Detroit, MI, where he established the first cancer-oriented robotics program in the world. Menon is widely regarded for his role in the development of robotic surgery techniques for the treatment of patients with prostate, kidney, and bladder cancers, as well as for the development of robotic kidney transplantation.

<span class="mw-page-title-main">Ashutosh Tewari</span> American urologist, oncologist

Ashutosh K. Tewari is the chairman of urology at the Icahn School of Medicine at Mount Sinai Hospital in New York City. He is a board certified American urologist, oncologist, and principal investigator. Before moving to the Icahn School of Medicine in 2013, he was the founding director of both the Center for Prostate Cancer at Weill Cornell Medical College and the LeFrak Center for Robotic Surgery at NewYork–Presbyterian Hospital. Tewari was the Ronald P. Lynch endowed Chair of Urologic Oncology and the hospital's director of robotic prostatectomy, treating patients with prostate, urinary bladder and other urological cancers. He is the current president of the Society for Urologic Robotic Surgeons (SURS) and the Committee Chair of the Prostate Program. Tewari is a world-leading urological surgeon, and has performed over 10,000 robotically assisted procedures using the da Vinci Surgical System. Academically, he is recognized as a world-renowned expert on urologic oncology with over 250 peer reviewed published papers to his credit; he is on such lists as America's Top Doctors, New York Magazine's Best Doctors, and Who's Who in the World. In 2012, he was given the American Urological Association Gold Cystoscope Award for "outstanding contributions to the field of urologic oncology, most notably the treatment of prostate cancer and the development of novel techniques to improve the outcomes of robotic prostatectomy."

<span class="mw-page-title-main">Hybrid operating room</span> Type of surgical theatre

A hybrid operating room is a very advanced surgical theatre that is equipped with advanced medical imaging devices such as fixed C-Arms, X-ray tomography (CT) scanners or magnetic resonance imaging (MRI) scanners. These imaging devices enable minimally-invasive surgery. Minimally-invasive surgery is intended to be less traumatic for the patient and minimize incisions on the patient and perform surgery procedure through one or several small cuts.

<span class="mw-page-title-main">Michael Stifelman</span> American physician and urologist

Michael D. Stifelman Michael D. Stifelman, M.D., is Chair of Urology at Hackensack University Medical Center, Director of Robotic Surgery at Hackensack Meridian Health, and Professor and Inaugural Chair of Urology at Hackensack Meridian School of Medicine.

Touch Surgery is a London, New York City, Sydney and Auckland-based health technology app and trading name for the company Digital Surgery LTD. Digital Surgery is a health tech company shaping the future of surgery through the convergence of surgical expertise and technology. The app was first discussed in 2010. The Touch Surgery mobile app is a mobile surgical training platform designed to simulate surgical procedures. As of October 2019, The Touch Surgery mobile app included surgical instructions for about 200 surgical procedures in 17 different specialties.

Narmada Prasad Gupta is an Indian urologist, medical researcher, writer and the chairman of Academics and Research Division Urology at the Medanta, the Medicity, New Delhi. He is credited with over 10,000 urological surgical procedures and the highest number of urology robotics (URobotic) surgeries in India. He is a former head of the department of urology of the All India Institute of Medical Sciences Delhi and a former president of the Urological Society of India. He received the Dr. B. C. Roy Award, the highest Indian award in the medical category, from the Medical Council of India in 2005. The government of India awarded him the fourth highest civilian honour of the Padma Shri, in 2007, for his contributions to Indian medicine.

<span class="mw-page-title-main">The Urology Foundation</span> Charity organization

The Urology Foundation (TUF) is a charity that works across the UK and Ireland with the aim of improving the knowledge and skills of surgeons who operate on diseases of the male and female urinary-tract system and the male reproductive organs and funds research to improve outcomes of all urological conditions and urological cancers.

Kamran Ahmed is a Professor and a Urological Surgeon who is affiliated with Sheikh Khalifa Medical City, Abu Dhabi, UAE, Khalifa University, Abu Dhabi and King's College London, United Kingdom.

<span class="mw-page-title-main">Larry Lipshultz</span> American urologist

Larry I. Lipshultz is an American urologist, surgeon, researcher, and teacher. He currently serves as Professor of Urology, Lester and Sue Smith Endowed Chair in Reproductive Medicine, and Chief of the Scott Department of Urology's Division of Male Reproductive Medicine and Surgery at Baylor College of Medicine, Houston, Texas.

References

  1. 1 2 Thomas, Daniel (2016). "Dr". International Journal of Surgery (London, England). 36 (Pt A). Elsevier: 25. doi: 10.1016/j.ijsu.2016.10.003 . PMID   27741424.
  2. 1 2 3 4 Hakky, Tariq; Martinez, Daniel; Lipshultz, Larry; Spiess, Philippe; Carrion, Rafael (2015). "Augmented Reality Assisted Urologic Surgery (ARAUS): A surgical training tool". The Journal of Urology. 193 (4): e271. doi:10.1016/j.juro.2015.02.1254.
  3. Scopis Surgical Navigation (23 November 2012). Scopis Augmented Reality: Path guidance to craniopharyngioma . Retrieved 16 February 2016 via YouTube.
  4. 1 2 Dickey, R.M.; Srikishen, N.; Lipshultz, L.I.; et al. (2016). "Augmented reality assisted surgery: A urologic training tool". Asian Journal of Andrology. 18 (5): 732–4. doi: 10.4103/1008-682X.166436 . PMC   5000796 . PMID   26620455.
  5. 1 2 Peters, Terry (21 May 2015). "Augmented-Reality Assisted Surgery on the Beating Heart". IEEE Toronto. Archived from the original on 16 February 2016. Retrieved 16 February 2016.
  6. 1 2 Bichlmeier, Christoph (8 November 2014). "Interview with Terry Peters – Bringing Research to Clinical Practice". Medical Augmented Reality Blog. Archived from the original on 16 February 2016. Retrieved 16 February 2016.
  7. "HoloSurgical completes 1st spine surgery using augmented reality, AI-based navigation system". 10 January 2019.
  8. "HoloSurgical announces first surgical procedure utilising ARAI system". 14 January 2019.
  9. "Company – Holosurgical Inc". Archived from the original on 2019-08-08. Retrieved 2020-02-27.