TriDAR

Last updated March 18, 2024

TriDAR, or Triangulation and LIDAR Automated Rendezvous and Docking,^[1] is a relative navigation vision system developed by Neptec Design Group and funded by the Canadian Space Agency and NASA. It provides guidance information that can be used to guide an unmanned vehicle during rendezvous and docking operations in space. TriDAR does not rely on any reference markers positioned on the target spacecraft. Instead, TriDAR relies on a laser based 3D sensor and a thermal imager. TriDAR's proprietary software uses the geometric information contained in successive 3D images to match against the known shape of the target object and calculate its position and orientation.

TriDAR made its inaugural demonstration space flight on board Space Shuttle Discovery on the STS-128 mission, launched on 28 August 2009. On STS-128, TriDAR provided astronauts with real-time guidance information during rendezvous and docking with the International Space Station (ISS). It automatically acquired and tracked the ISS using only knowledge about its shape. This marked the first time a 3D sensor based "targetless" tracking vision system was used in space.

Background

To date, most operational tracking solutions for pose estimation and tracking on-orbit have relied on cooperative markers placed on the target object(s). The Space Vision System (SVS) used black on white or white on black dot targets. These targets were imaged with Space Shuttle or International Space Station (ISS) video cameras to compute the relative pose of ISS modules to be assembled.^[2]

The Trajectory Control System (TCS) was used on board the space shuttle to provide guidance information during rendezvous and docking with the International Space Station (ISS). This laser-based system tracks retro reflectors located on the ISS to provide bearing, range and closing rate information. While reliable, target based systems have operational limitations as targets must be installed on target payloads. This is not always practical or even possible.^[3] For example, servicing existing satellites that do not have reflectors installed would require a targetless tracking capability.

STS-128

TriDAR was tested in space for the first time on board Space Shuttle Discovery during the STS-128 mission to the ISS. The objective of the test was to demonstrate the capability of the TriDAR system to track an object in space without using targets markers such as retro-reflectors. For this mission, TriDAR was located in the payload bay on the Orbiter Docking System (ODS) next to the Shuttle's Trajectory Control System (TCS).

The system was activated during rendezvous when the Shuttle was approximately 75 km (47 mi) away from the ISS. Once in range of the 3D sensor, TriDAR automatically determined bearing and range to the ISS. During rendezvous, TriDAR entered shape based tracking which provided full 6 degree of freedom guidance and closing rate. Key system information was provided in real-time to the crew via enhanced docking displays on a laptop computer located on the shuttle's crew compartment.

The system was designed to perform the entire mission autonomously. It self-monitored its tracking solution and automatically re-acquired the ISS if tracking had been lost. TriDAR was also tested during undocking and fly-around operations.

STS-131

TriDAR was again carried on board Space Shuttle Discovery during the STS-131 mission to the International Space Station. The TriDAR operated during shuttle rendezvous with the ISS, and acquired useful data up till the shuttle R-bar Pitch Maneuver. At that point, a cabling issue resulted in a loss of communications.^[4] Using a backup cable for undock and flyaround, the TriDAR operated "flawlessly", according to flight director Richard Jones.^[5]

STS-135

TriDAR was on board Space Shuttle Atlantis during the STS-135 mission to the International Space Station.^[1]

Capabilities

TriDAR builds on recent developments in 3D sensing technologies and computer vision achieving lighting immunity in space vision systems.^[6]^[7]^[8] This technology provides the ability to automatically rendezvous and dock with vehicles that were not designed for such operations.

The system includes a 3D active sensor, a thermal imager and Neptec's model based tracking software. Using only knowledge about the target spacecraft's geometry and 3D data acquired from the sensor, the system computes the 6 Degree Of Freedom (6DOF) relative pose directly. The computer vision algorithms developed by Neptec allow this process to happen in real-time on a flight computer while achieving the necessary robustness and reliability expected for mission critical operations. Fast data acquisition has been achieved by implementing a smart scanning strategy referred to as More Information Less Data (MILD) where only the necessary data to perform the pose estimation is acquired by the sensor. This strategy minimizes the requirements on acquisition time, data bandwidth, memory and processing power.

Hardware

The TriDAR sensor is a hybrid 3D camera that combines auto-synchronous laser triangulation technology with laser radar (LIDAR) in a single optical package. This configuration takes advantage of the complementary nature of these two imaging technologies to provide 3D data at both short and long range without compromising on performance.^[9] The laser triangulation subsystem is largely based on the Laser Camera System (LCS) used to inspect the Space Shuttle's thermal protection system after each launch.^[10] By multiplexing the two active subsystem's optical paths, the TriDAR can provide the functionalities of two 3D scanners into a compact package. The subsystems also share the same control and processing electronics thus providing further savings compared to using two separate 3D sensors. A thermal imager is also included to extend the range of the system beyond the LIDAR operating range.

Applications

Because of its wide operating range, the TriDAR sensor can be used for several applications within the same mission. TriDAR can be used for rendezvous and docking, planetary landing, rover navigation, site and vehicle inspection. TriDAR's capabilities for planetary exploration have been demonstrated recently during field trials in Hawaii held by NASA and the Canadian Space Agency (CSA). For these tests, TriDAR was mounted on Carnegie Mellon University's Scarab lunar rover and enabled it to automatically navigate to its destination. Once the rover arrived at its destination, TriDAR was used to acquire high resolution 3D images of the surrounding area, searching for ideal drill sites to obtain lunar samples.

TriDAR applications are not limited to space. TriDAR technology is the basis of Neptec's OPAL product. OPAL provides vision to helicopter crews when their vision has been obscured by brownouts or whiteouts. TriDAR technology can also be applied to numerous terrestrial applications such as automated vehicles, hazard detection, radiotherapy patient positioning, assembly of large structure as well as human body tracking for motion capture or video game controls.

Related Research Articles

STS-114 was the first "Return to Flight" Space Shuttle mission following the Space Shuttle Columbia disaster. Discovery launched at 10:39 EDT, July 26, 2005. The launch, 907 days after the loss of Columbia, was approved despite unresolved fuel sensor anomalies in the external tank that had prevented the shuttle from launching on July 13, its originally scheduled date.

STS-121 was a 2006 NASA Space Shuttle mission to the International Space Station (ISS) flown by Space ShuttleDiscovery. The main purposes of the mission were to test new safety and repair techniques introduced following the Columbia disaster of February 2003 as well as to deliver supplies, equipment and German European Space Agency (ESA) astronaut Thomas Reiter to the ISS.

STS-115 was a Space Shuttle mission to the International Space Station (ISS) flown by Space ShuttleAtlantis. It was the first assembly mission to the ISS after the Columbia disaster, following the two successful Return to Flight missions, STS-114 and STS-121. STS-115 launched from LC-39B at the Kennedy Space Center on September 9, 2006, at 11:14:55 EDT.

The Shuttle–Mir program was a collaborative 11-mission space program between Russia and the United States that involved American Space Shuttles visiting the Russian space station Mir, Russian cosmonauts flying on the Shuttle, and an American astronaut flying aboard a Soyuz spacecraft to engage in long-duration expeditions aboard Mir.

A space rendezvous is a set of orbital maneuvers during which two spacecraft, one of which is often a space station, arrive at the same orbit and approach to a very close distance. Rendezvous requires a precise match of the orbital velocities and position vectors of the two spacecraft, allowing them to remain at a constant distance through orbital station-keeping. Rendezvous may or may not be followed by docking or berthing, procedures which bring the spacecraft into physical contact and create a link between them.

STS-119 was a Space Shuttle mission to the International Space Station (ISS) which was flown by Space Shuttle Discovery during March 2009. It delivered and assembled the fourth starboard Integrated Truss Segment (S6), and the fourth set of solar arrays and batteries to the station. The launch took place on March 15, 2009, at 19:43 EDT. Discovery successfully landed on March 28, 2009, at 15:13 pm EDT.

The Orbiter Boom Sensor System (OBSS) was a 50-foot boom carried on board NASA's Space Shuttles. The boom was grappled by the Canadarm and served as an extension of the arm, doubling its length to a combined total of 100 feet. At the far end of the boom was an instrumentation package of cameras and lasers used to scan the leading edges of the wings, the nose cap, and the crew compartment after each lift-off and before each landing. If flight engineers suspected potential damage to other areas, as evidenced in imagery captured during lift-off or the rendezvous pitch maneuver, then additional regions could be scanned.

<span class="mw-page-title-main">STS-122</span> 2008 American crewed spaceflight to the ISS

STS-122 was a NASA Space Shuttle mission to the International Space Station (ISS), flown by the Space ShuttleAtlantis. STS-122 marked the 24th shuttle mission to the ISS, and the 121st Space Shuttle flight overall.

STS-127 was a NASA Space Shuttle mission to the International Space Station (ISS). It was the twenty-third flight of Space ShuttleEndeavour. The primary purpose of the STS-127 mission was to deliver and install the final two components of the Japanese Experiment Module: the Exposed Facility, and the Exposed Section of the Experiment Logistics Module (ELM-ES). When Endeavour docked with the ISS on this mission in July 2009, it set a record for the most humans in space at the same time in the same vehicle, the first time thirteen people have been at the station at the same time. Together they represented all ISS program partners and tied the general record of thirteen people in space with the first such occurrence of 1995.

STS-133 was the 133rd mission in NASA's Space Shuttle program; during the mission, Space Shuttle Discovery docked with the International Space Station. It was Discovery's 39th and final mission. The mission launched on February 24, 2011, and landed on March 9, 2011. The crew consisted of six American astronauts, all of whom had been on prior spaceflights, headed by Commander Steven Lindsey. The crew joined the long-duration six person crew of Expedition 26, who were already aboard the space station. About a month before lift-off, one of the original crew members, Tim Kopra, was injured in a bicycle accident. He was replaced by Stephen Bowen.

<span class="mw-page-title-main">STS-123</span> 2008 American crewed spaceflight to the ISS

STS-123 was a Space Shuttle mission to the International Space Station (ISS) which was flown by Space Shuttle Endeavour. STS-123 was the 1J/A ISS assembly mission. The original launch target date was February 14, 2008, but after the delay of STS-122, the shuttle was launched on March 11, 2008. It was the twenty-fifth shuttle mission to visit the ISS, and delivered the first module of the Japanese laboratory, Japanese Experiment Module (Kibō), and the Canadian Special Purpose Dexterous Manipulator, (SPDM) Dextre robotics system to the station. The mission duration was 15 days and 18 hours, and it was the first mission to fully utilize the Station-to-Shuttle Power Transfer System (SSPTS), allowing space station power to augment the shuttle power systems. The mission set a record for a shuttle's longest stay at the ISS.

STS-128 was a NASA Space Shuttle mission to the International Space Station (ISS) that launched on August 28, 2009. Space ShuttleDiscovery carried the Multi-Purpose Logistics Module Leonardo as its primary payload. Leonardo contained a collection of experiments for studying the physics and chemistry of microgravity. Three spacewalks were carried out during the mission, which removed and replaced a materials processing experiment outside ESA's Columbus module, and returned an empty ammonia tank assembly.

STS-129 was a NASA Space Shuttle mission to the International Space Station (ISS). Atlantis was launched on November 16, 2009, at 14:28 EST, and landed at 09:44 EST on November 27, 2009, on runway 33 at the Kennedy Space Center's Shuttle Landing Facility. It was also the last Shuttle mission of the 2000s.

STS-130 was a NASA Space Shuttle mission to the International Space Station (ISS). Space ShuttleEndeavour's primary payloads were the Tranquility module and the Cupola, a robotic control station with six windows around its sides and another in the center, providing a 360-degree view around the station. Endeavour launched at 04:14 EST on February 8, 2010 and landed at 22:22 EST on February 21, 2010, on runway 15 at the Kennedy Space Center's Shuttle Landing Facility.

STS-131 was a NASA Space Shuttle mission to the International Space Station (ISS). Space ShuttleDiscovery launched on April 5, 2010, at 6:21 am from LC-39A, and landed at 9:08 am on April 20, 2010, on runway 33 at the Kennedy Space Center's Shuttle Landing Facility. The mission marked the longest flight for Space Shuttle Discovery.

STS-132 was a NASA Space Shuttle mission, during which Space Shuttle Atlantis docked with the International Space Station on May 16, 2010. STS-132 was launched from the Kennedy Space Center on May 14, 2010. The primary payload was the Russian Rassvet Mini-Research Module, along with an Integrated Cargo Carrier-Vertical Light Deployable (ICC-VLD). Atlantis landed at the Kennedy Space Center on May 26, 2010.

STS-134 was the penultimate mission of NASA's Space Shuttle program and the 25th and last spaceflight of Space ShuttleEndeavour. This flight delivered the Alpha Magnetic Spectrometer and an ExPRESS Logistics Carrier to the International Space Station. Mark Kelly served as the mission commander. STS-134 was expected to be the final Space Shuttle mission if STS-135 did not receive funding from Congress. However, in February 2011, NASA stated that STS-135 would fly "regardless" of the funding situation. STS-135, flown by Atlantis, took advantage of the processing for STS-335, the Launch on Need mission that would have been necessary if the STS-134 crew became stranded in orbit.

STS-135 was the 135th and final mission of the American Space Shuttle program. It used the orbiter Atlantis and hardware originally processed for the STS-335 contingency mission, which was not flown. STS-135 launched on July 8, 2011, and landed on July 21, 2011, following a one-day mission extension. The four-person crew was the smallest of any shuttle mission since STS-6 in April 1983. The mission's primary cargo was the Multi-Purpose Logistics Module (MPLM) Raffaello and a Lightweight Multi-Purpose Carrier (LMC), which were delivered to the International Space Station (ISS). The flight of Raffaello marked the only time that Atlantis carried an MPLM.

Neptec Design Group is an Ottawa-based Canadian vision systems company that provides machine vision solutions for space, industrial, and military applications. Privately owned and founded in 1990, Neptec supplies operational systems to NASA's Space Shuttle and International Space Station programs as one of their prime contractors. In 2000, Neptec expanded its technology to include active 3D imaging systems and 3D processing software. This led to the development of the Laser Camera System, an operational system used by NASA to inspect a shuttle's external surfaces during flight. Neptec also used this system to develop the TriDAR, a 3D imaging and tracking system designed for automated on-orbit rendezvous, inspection, and docking. It combines the LCS with a long range LIDAR sensor into the same optical path.

Docking and berthing of spacecraft is the joining of two space vehicles. This connection can be temporary, or partially permanent such as for space station modules.

References

1 2 "End of the Shuttle Program Final Flight of Atlantis: Canada's Contribution" (Press release). Canadian Space Agency. 28 June 2011. Retrieved 2 July 2011.
↑ MacLean, S. G.; Pinkney, H. F. L. (1993). "Machine Vision in Space". Canadian Aeronautics and Space Journal . 39 (2): 63–77.
↑ Obermark, J.; Creamer, G.; Kelm, B.; Wagner, W.; Henshaw, C. Glen (2007). Howard, Richard T; Richards, Robert D (eds.). "SUMO/FREND: vision system for autonomous satellite grapple". Proc. SPIE. Sensors and Systems for Space Applications. 6555: 65550. Bibcode:2007SPIE.6555E..0YO. doi:10.1117/12.720284. S2CID 110928354.
↑ Gebhardt, Chris (2010). "STS-131 Discovery Undocking STORRM TriDAR Highlighted". NASA Spaceflight. Retrieved 17 April 2010.
↑ Presenters: Brandi Dean (17 April 2010). "STS-131 Flight Day 13: Status briefing". Status Briefings. Houston, Texas. 7:45 minutes in. NASA TV. NASA TV Media Channel.
↑ Ruel, S.; English, C.; Anctil, M.; Church, P. (2005). ^3DLASSO: Real-time pose estimation from 3D data for autonomous satellite servicing (PDF). 8th International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS 2005). 5–8 September 2005. Munich, Germany.
↑ Ruel, S.; English, C.; Anctil, M.; Daly, J.; Smith, C.; Zhu, S. (2006). Howard, Richard T; Richards, Robert D (eds.). "Real-time 3D vision solution for on-orbit autonomous rendezvous and docking". Proc. SPIE. Spaceborne Sensors III. 6220: 622009. Bibcode:2006SPIE.6220E..09R. doi:10.1117/12.665354. S2CID 129358605.
↑ Ruel, S.; Luu, T.; Anctil, M.; Gagnon, S. (2006). Target Localization from 3D data for On-Orbit Autonomous Rendezvous & Docking. 2006 IEEE Aerospace Conference. 1-8 March 2008. Big Sky, Montana. doi:10.1109/AERO.2008.4526516.
↑ English, C.; Zhu, X.; Smith, C.; Ruel, S.; Christie, I. (2005). TriDAR: A hybrid sensor for exploiting the complementary nature of triangulation and LIDAR technologies (PDF). 8th International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS 2005). 5–8 September 2005. Munich, Germany.
↑ Deslauriers, A.; Showalter, I.; Montpool, A.; Taylor, R.; Christie, I. (2005). Shuttle TPS inspection using triangulation scanning technology. SPIE: Spaceborne Sensors II. 28 March 2005. Orlando, Florida. Bibcode:2005SPIE.5798...26D. doi:10.1117/12.603692.

External links

Neptec website

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[csa20110628-1] 1 2 "End of the Shuttle Program Final Flight of Atlantis: Canada's Contribution" (Press release). Canadian Space Agency. 28 June 2011. Retrieved 2 July 2011.

[2] MacLean, S. G.; Pinkney, H. F. L. (1993). "Machine Vision in Space". Canadian Aeronautics and Space Journal . 39 (2): 63–77.

[3] Obermark, J.; Creamer, G.; Kelm, B.; Wagner, W.; Henshaw, C. Glen (2007). Howard, Richard T; Richards, Robert D (eds.). "SUMO/FREND: vision system for autonomous satellite grapple". Proc. SPIE. Sensors and Systems for Space Applications. 6555: 65550. Bibcode:2007SPIE.6555E..0YO. doi:10.1117/12.720284. S2CID 110928354.

[obss-4] Gebhardt, Chris (2010). "STS-131 Discovery Undocking STORRM TriDAR Highlighted". NASA Spaceflight. Retrieved 17 April 2010.

[obss2-5] Presenters: Brandi Dean (17 April 2010). "STS-131 Flight Day 13: Status briefing". Status Briefings. Houston, Texas. 7:45 minutes in. NASA TV. NASA TV Media Channel.

[6] Ruel, S.; English, C.; Anctil, M.; Church, P. (2005). ^3DLASSO: Real-time pose estimation from 3D data for autonomous satellite servicing (PDF). 8th International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS 2005). 5–8 September 2005. Munich, Germany.

[7] Ruel, S.; English, C.; Anctil, M.; Daly, J.; Smith, C.; Zhu, S. (2006). Howard, Richard T; Richards, Robert D (eds.). "Real-time 3D vision solution for on-orbit autonomous rendezvous and docking". Proc. SPIE. Spaceborne Sensors III. 6220: 622009. Bibcode:2006SPIE.6220E..09R. doi:10.1117/12.665354. S2CID 129358605.

[8] Ruel, S.; Luu, T.; Anctil, M.; Gagnon, S. (2006). Target Localization from 3D data for On-Orbit Autonomous Rendezvous & Docking. 2006 IEEE Aerospace Conference. 1-8 March 2008. Big Sky, Montana. doi:10.1109/AERO.2008.4526516.

[9] English, C.; Zhu, X.; Smith, C.; Ruel, S.; Christie, I. (2005). TriDAR: A hybrid sensor for exploiting the complementary nature of triangulation and LIDAR technologies (PDF). 8th International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS 2005). 5–8 September 2005. Munich, Germany.

[10] Deslauriers, A.; Showalter, I.; Montpool, A.; Taylor, R.; Christie, I. (2005). Shuttle TPS inspection using triangulation scanning technology. SPIE: Spaceborne Sensors II. 28 March 2005. Orlando, Florida. Bibcode:2005SPIE.5798...26D. doi:10.1117/12.603692.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]