The Dextroscope is a medical equipment system that creates a virtual reality (VR) environment in which surgeons can plan neurosurgical and other surgical procedures. [1]
The Dextroscope is designed to show a patient's 3D anatomical relationships and pathology in great detail. Although its main purpose is for planning surgery, the dextroscope has also proven useful in research in cardiology, [2] [3] radiology and medical education. [4]
The Dextroscope started as a research project in the mid-90s at the Kent Ridge Digital Labs research institute (part of Singapore's Agency for Science, Technology and Research (A*STAR)). It was initially named the Virtual Workbench [5] and underwent commercialization in 2000 by the company Volume Interactions Pte Ltd with the name Dextroscope. The Dextroscope was selected in 2021 by A*STAR as one of the 30 innovations and inventions that pushed scientific boundaries, made an economic impact or improved lives over its 30 years history (A*STAR@30: 30 Innovations and Inventions Over Three Decades).
The Dextroscope was designed to be a practical variation of Virtual Reality which introduced an alternative to the prevalent trend of full immersion of the 1990s. Instead of immersing the whole user into a virtual reality, it just immersed the neurosurgeon into the patient data.
The Dextroscope allows its user to interact intuitively with a Virtual Patient. This Virtual Patient is composed of computer-generated 3D multi-modal images obtained from any DICOM tomographic data including CT, MRI, MRA, MRV, functional MRI and CTA, PET, SPECT and Tractography. The Dextroscope can work with any multi-modality combination, supporting polygonal meshes as well. [6]
The surgeon sits at the Dextroscope 3D interaction console and manipulates the Virtual Patient using both hands, similar to real life. Using stereoscopic visualisations displayed via a mirror, the surgeon sees the Virtual Patient floating behind the mirror but within easy reach of the hands. The surgeon uses flexible 3D hand movements to rotate and manipulate the object of interest. The Dextroscope allows virtual segmentation of organs and structures, making accurate 3D measurements, etc.
In one hand the surgeon holds a handle with a switch that, when pressed, allows the 3D image to be moved freely as if it were an object held in real space. The other hand holds a pencil shaped stylus that the surgeon uses to select tools from a virtual control panel and perform detailed manipulations on the 3D image.
The surgeon does not see the stylus, handle or his/her hands directly, as they are hidden behind the surface of the mirror. Instead he/she sees a virtual handle and stylus calibrated to appear in exactly the same position as the real handle and stylus. The virtual handle can serve as a drill tool, measurement tool, cutter, etc. [5]
The Dextroscope allows surgeons to interact with and manipulate the Virtual Patient, such as simulating inter-operative viewpoints or the removal of bone and soft tissue. The surgeon is able to reach inside and manipulate the image interior.
The Dextroscope provides virtual tools to manipulate the 3D image. The surgeon can use them within the virtual person to extract surgically relevant structures like the cortex or a tumor , [7] extract blood vessels, [8] or to adjust the color and transparency of displayed structures to see deep inside the patient. The surgeon can simulated the removal of bone using a simulated skull drilling tool.
Typical structures that can be segmented are tumors, blood vessels, aneurysms, parts of the skull base, and organs. Segmentation is done either automatically (when the structures are demarcated clearly by their outstanding image intensity - such as the cortex) or through user interaction (using for example an outlining tool to define the extent of the structure manually).
A virtual ‘pick’ tool allows the user to pick a segmented object and uncouple it from its surroundings for closer inspection. A measurement tool provides accurate measurement of straight and curving 3D structures such as the scalp, and measure angles, such as those between vessels or bony structures (for example, when planning the insertion of a screw into the spine).
The use of the Dextroscope has been reported for several neurosurgical clinical scenarios; [1] [9] [10]
- cerebral arteriovenous malformations [11] [12]
- cranial nerve decompression (in cases of trigeminal neuralgia and hemifacial spasm) [16] [17] [18]
- meningiomas (convexity, falcine or parasagittal) [19] [20] [21]
- ependymomas or subependymomas [13] [22]
- craniopagus twin separation [23] [24]
- transnasal approaches [25] [26] [27]
- key-hole approaches [28] [29] [30]
- and a great variety of deep-brain and skull base tumors [32] [33] (pituitary adenomas, craniopharyngiomas, arachnoid cysts, colloid cysts, cavernomas [34] , [35] hemangioblastomas, chordomas, epidermoids, gliomas, [36] jugular schwannomas, aqueductal stenosis, stenosis of Monro foramen, hippocampal sclerosis). [13] [37] [38]
Brain and spine pathology, such as cervical fractures of the spine, syringomyelia, and sacral nerve root neurinomas have been evaluated. [39]
For other uses of the Dextroscope in neurosurgery refer to [40] [41] [42] [43] [44] [45] [46] [47] [48] [49] [50] [51] . [52]
The Dextroscope has been applied also outside of neurosurgery to benefit any patient presenting a surgical challenge: an anatomical or structural complexity that requires planning of the surgical (or interventional) approach, for example, ENT [53] orthopedic, trauma and cranio-facial surgery, [54] [55] [56] [57] [58] [59] cardiac surgery [60] and liver resection . [61] [62]
Dextroscope is not just for surgeons – radiologists use it, too. The rapid growth in multi-modal diagnostic imaging data routinely available has increased their workload tremendously. Using the Dextroscope, radiologists can reconstruct multimodal models from high volumes of 2D slices – hence facilitating a better understanding of the 3D anatomical structures and helping with the diagnosis.
Furthermore, the Dextroscope virtual reality environment helps bridge the gap between radiology and surgery - by allowing the radiologist to easily demonstrate to surgeons important 3D structures in a way that surgeons are familiar with.
This demonstration capability makes it also useful as a base for medical educators in which to convey 3D information to students. [63] In order to reach a larger group of people in a classroom or auditorium, a version was manufactured called Dextrobeam. [64]
The Dextroscope was installed, (among other medical and research institutions) at:
Medical/research institution | Main use |
---|---|
Hirslanden Hospital (Zurich, Switzerland) | Neurosurgery |
St Louis University Hospital (St Louis, US) | Neurosurgery |
Stanford University Medical Center (San Francisco, US) | Neurosurgery and craniomaxillofacial surgery |
Johns Hopkins Hospital (Baltimore, US) | Radiology research |
Rutgers New Jersey Medical School (Newark, US) | Neurosurgery, ENT |
Hospital of the University of Pennsylvania (Philadelphia, US) | Neurosurgery and cardiovascular radiology |
Weill Cornell Brain and Spine Center (New York, US) | Neurosurgery |
Johannes Gutenberg University Mainz (Germany) | Neurosurgery and medical education |
Hospital del Mar (Barcelona, Spain) | Neurosurgery |
Université Catholique de Louvain, Cliniques Universitaires St-Luc (Brussels, Belgium) | Neurosurgery |
Istituto Neurologico C. Besta (Milan, Italy) | Neurosurgery |
Royal London Hospital (London, UK) | Neurosurgery |
Faculty of Medicine, University of Barcelona (Barcelona, Spain) | Neurosurgery research & neuroanatomy |
Inselpital (Bern, Switzerland) | ENT |
School of Medicine, University of Split (Split, Croatia) | Neurophysiology research |
National Neuroscience Institute (Singapore) | Neurosurgery |
SINAPSE Institute (Singapore) | Neurosurgery research |
Prince of Wales Hospital (Hong Kong) | Neurosurgery and orthopedics |
Hua Shan Hospital (Shanghai, China) | Neurosurgery |
Advanced Surgery Training Centre of the National University Hospital (Singapore) | Medical education |
Fujian Medical University (Fuzhou, China) | Neurosurgery and maxillofacial surgery |
The Dextroscope was a pre-operative planning system which created 3D patient-specific virtual models. To bring the patient data into the operating room, in particular to neurosurgery, the DEX-Ray [65] augmented reality neurosurgical navigation system was developed in 2006-2008. DEX-Ray overlaid 3D virtual patient information over a video stream obtained from a proprietary handheld tracked video probe designed by the company. This allowed image guidance by displaying co-registered planning data over the real images of the patient seen by the video camera, so that the clinician had 'see-through' visualization on the patient's head, and helped plan the craniotomy and guide during the intervention. The DEX-Ray was clinically tested at the Singapore National Neuroscience Institute (Singapore) and at the Hospital Clinic Barcelona (Spain). It was not released as a commercial product.
The Dextroscope and Dextrobeam were products of Volume Interactions Pte Ltd (a member of the Bracco Group), a company spun-off from the Kent Ridge Digital Labs research institute in Singapore. They received USA FDA 510(K) - class II (2002) clearance, CE Marking - class I (2002), China SFDA Registration - class II (2004) and Taiwan Registration - type P (Radiology) (2007). For a comprehensive overview of the Dextroscope refer to the Springer International Publishing book chaper. [66]
Neurosurgery or neurological surgery, known in common parlance as brain surgery, is the medical specialty concerned with the surgical treatment of disorders which affect any portion of the nervous system including the brain, spinal cord and peripheral nervous system.
Image-guided surgery (IGS) is any surgical procedure where the surgeon uses tracked surgical instruments in conjunction with preoperative or intraoperative images in order to directly or indirectly guide the procedure. Image guided surgery systems use cameras, ultrasonic, electromagnetic or a combination of fields to capture and relay the patient's anatomy and the surgeon's precise movements in relation to the patient, to computer monitors in the operating room or to augmented reality headsets. This is generally performed in real-time though there may be delays of seconds or minutes depending on the modality and application.
Currarino syndrome is an inherited congenital disorder where either the sacrum is not formed properly, or there is a mass in the presacral space in front of the sacrum, and there are malformations of the anus or rectum. It occurs in approximately 1 in 100,000 people.
Patient registration is used to correlate the reference position of a virtual 3D dataset gathered by computer medical imaging with the reference position of the patient. This procedure is crucial in computer assisted surgery, in order to insure the reproducitibility of the preoperative registration and the clinical situation during surgery. The use of the term "patient registration" out of this context can lead to a confusion with the procedure of registering a patient into the files of a medical institution.
Computer-assisted surgery (CAS) represents a surgical concept and set of methods, that use computer technology for surgical planning, and for guiding or performing surgical interventions. CAS is also known as computer-aided surgery, computer-assisted intervention, image-guided surgery, digital surgery and surgical navigation, but these are terms that are more or less synonymous with CAS. CAS has been a leading factor in the development of robotic surgery.
Surgical planning is the preoperative method of pre-visualising a surgical intervention, in order to predefine the surgical steps and furthermore the bone segment navigation in the context of computer-assisted surgery. The surgical planning is most important in neurosurgery and oral and maxillofacial surgery. The transfer of the surgical planning to the patient is generally made using a medical navigation system.
Nicholas Theodore is an American neurosurgeon and researcher at Johns Hopkins University School of Medicine. He is known for his work in spinal trauma, minimally invasive surgery, robotics, and personalized medicine. He is Director of the Neurosurgical Spine Program at Johns Hopkins and Co-Director of the Carnegie Center for Surgical Innovation at Johns Hopkins.
Michael L. J. Apuzzo is an American academic neurological surgeon, the Edwin M. Todd/Trent H. Wells, Jr. Professor Emeritus of Neurological Surgery and Radiation Oncology, Biology, and Physics at the Keck School of Medicine, of the University of Southern California. He is also editor emeritus of the peer-reviewed journals World Neurosurgery and Neurosurgery. He is distinguished adjunct professor of neurosurgery at the Yale School of Medicine, distinguished professor of advanced neurosurgery and neuroscience and senior advisor, at the Neurological Institute, Wexner Medical School, The Ohio State University, and adjunct professor of neurosurgery, Weill Cornell Medicine, Department of Neurological Surgery & Weill Cornell Brain and Spine Center.
Curtis Dickman is an American researcher, author, and retired Neurosurgeon. He is recognized internationally for his pioneering work in the fields of Spinal Surgery, Surgery of the Craniocervical Junction, Spinal Biomechanics, and Thoracoscopic Neurosurgery.
Endoscopic endonasal surgery is a minimally invasive technique used mainly in neurosurgery and otolaryngology. A neurosurgeon or an otolaryngologist, using an endoscope that is entered through the nose, fixes or removes brain defects or tumors in the anterior skull base. Normally an otolaryngologist performs the initial stage of surgery through the nasal cavity and sphenoid bone; a neurosurgeon performs the rest of the surgery involving drilling into any cavities containing a neural organ such as the pituitary gland. The use of endoscope was first introduced in Transsphenoidal Pituitary Surgery by R Jankowsky, J Auque, C Simon et al. in 1992 G.
James Rutka is a Canadian neurosurgeon from Toronto, Canada. Rutka served as RS McLaughlin Professor and Chair of the Department of Surgery in the Faculty of Medicine at the University of Toronto from 2011 – 2022. He subspecializes in pediatric neurosurgery at The Hospital for Sick Children (SickKids), and is a Senior Scientist in the Research Institute at SickKids. His main clinical interests include the neurosurgical treatment of children with brain tumours and epilepsy. His research interests lie in the molecular biology of human brain tumours – specifically in the determination of the mechanisms by which brain tumours grow and invade. He is the Director of the Arthur and Sonia Labatt Brain Tumour Research Centre at SickKids, and Editor-in-Chief of the Journal of Neurosurgery.
Volume Interactions Pte Ltd was a company that pioneered in the 1990s the use Virtual Reality technology in surgery planning. The company created and marketed the Dextroscope, the first commercial surgical planning system that used virtual reality principles going beyond the mouse and keyboard. The Dextroscope introduced a variation of Virtual Reality technology that didn't use Head-Mounted display that provided a natural and comfortable interface to work with multi-modality 3D medical images for long periods of time. This environment was applied to the planning of patient-specific surgical approaches for several clinical disciplines, including neurosurgery, Ear-Nose-Throat, and liver surgery. The Dextroscope received world-wide attention by being involved in the planning of several craniopagus twin separations, most notably the Zambian twins (1997) and the German twins (2004) at Johns Hopkins Hospital led by Dr Benjamin Carson, and the Nepali twins separation at the Singapore General Hospital in 2001.
Yoko Kato is a Japanese neurosurgeon. She is professor and chair of the Department of Neurosurgery at Fujita Health University. She was the first woman in Japan to be promoted to full professor of neurosurgery.
The Dextrobeam is a highly interactive console that enables collaborative examination of three-dimensional (3-D) medical imaging data for planning, discussing, or teaching neurosurgical approaches and strategies. The console is designed to work in combination with a 3D stereoscopic display. The console enables two-handed interaction by means of two 6 Degree-of-Freedom motion tracking devices. A set of built-in software tools gives users the ability to manipulate and interact with patients’ imaging data in a natural and intuitive way.
Antonio Bernardo is an Italian-American neurosurgeon and academic physician. He is a professor of Neurological Surgery and the Director of the Neurosurgical Innovations and Training Center for Skull Base and Microneurosurgery in the Department of Neurological Surgery at Weill Cornell Medical College. He has gained significant notoriety for his expertise in skull base and cerebrovascular surgery, and has published extensively on minimally invasive neurosurgery. He is a pioneer in the use of 3D technology in neurosurgery and a strong advocate for competency-based training in surgery.
Jawad Youssef Fares is a Lebanese physician-scientist. He was selected for the Forbes 30 Under 30 list in science and healthcare for his contribution to solving healthcare problems in the developing world. He also featured twice in the Forbes Middle East 30 Under 30, and was selected as one of the top 10 young scientists in the world by Genetic Engineering and Biotechnology News. In 2019, Fares was elected as a Fellow of The World Academy of Medical Sciences, and in 2021 was one of the Young Physician Leaders selected by the InterAcademy Partnership.
Rolando Fausto Del Maestro is an Italian-born Canadian neurosurgeon, the William Feindel Professor Emeritus in neuro-oncology and director of the Neurosurgical Simulation Research Center at the Montreal Neurological Institute and Hospital, where he has been involved in simulating real brain surgery by creating virtual setting scenarios, founded upon the principles of flight simulation.
Global neurosurgery is a field at the intersection of public health and clinical neurosurgery. It aims to expand provision of improved and equitable neurosurgical care globally.
Claire Karekezi is a Rwandan neurosurgeon at the Rwanda Military Hospital in Kigali, Rwanda. As the first female neurosurgeon in Rwanda, and one of the eight Rwandan neurosurgeons serving a population of 14 million, Karekezi serves as an advocate for women in neurosurgery. She has become an inspiration for young people pursuing neurosurgery, particularly young women.
Sandi Lam is a Canadian pediatric neurosurgeon and is known for her research in minimally invasive endoscopic hemispherectomy for patients with epilepsy. Lam is the Vice Chair for Pediatric Neurological Surgery at Northwestern University and the Division Chief of Pediatric Neurosurgery at Lurie Children's Hospital. She has spent her career advancing pediatric brain surgery capabilities globally through her work in Kenya performing surgeries as well as training and mentoring local residents and fellows.