DARPA Robotics Challenge

DARPA Robotics Challenge timeline

The DARPA Robotics Challenge (DRC) was a prize competition funded by the US Defense Advanced Research Projects Agency. Held from 2012 to 2015, it aimed to develop semi-autonomous ground robots that could do "complex tasks in dangerous, degraded, human-engineered environments." ^[1] The DRC followed the DARPA Grand Challenge and DARPA Urban Challenge. It began in October 2012 and was to run for about 33 months with three competitions: a Virtual Robotics Challenge (VRC) that took place in June 2013; and two live hardware challenges, the DRC Trials in December 2013 and the DRC Finals in June 2015. ^{[2] [3]}

Besides spurring development of semi-autonomous robots, the DRC also sought to make robotic software and systems development more accessible beyond the end of the program. To that end, the DRC funded the adaptation of the GAZEBO robot simulator by the Open Source Robotics Foundation (OSRF) for DRC purposes and the construction of six Boston Dynamics ATLAS robots that were given to the teams that performed best in the VRC. ^[4]

Dr. Gill Pratt, Program Manager DARPA Robotics Challenge described DARPA and its goals with the Robotics Challenge: ^[5]

DARPA's role is to spur innovation. And we do it by focused, short term efforts. We pick things that are not impossible, but also not very low risk. So we take very high risk gambles, and those risks have tremendous payoffs. So if we’re successful it means that these robots are actually going to be able to make a difference. In particular, in disaster scenarios making society more resilient. The lesson of the original challenge [DARPA Grand Challenge - driverless cars] is that persistence pays. It’s important if you know the technology is almost there and you can sort of see the light at the end of the tunnel, a little bit of persistence will pay off. What I’m hoping for in the trials is that some of the teams will score some points. I don’t think that any team is going to score all the points that there are. Maybe no teams will even score half the points that there are. But I think some teams will do moderately well. My expectation is that the robots are going to be slow. What we’re looking for right now is for the teams to just do as well as roughly that one year old child. If we can get there, then we think that we have good reason to believe that some of these teams with continued persistence for another year will actually be able to demonstrate robots that show the utility that these things might have in a real disaster scenario. DARPA is in the innovation business, not in the development business. So, what we do is we wait for technology to be almost ready for something big to happen, and then we add a focused effort to catalyze the something. It doesn’t mean that we take it all the way into a system that’s deployed or to the marketplace. We rely on the commercial sector to do that. But we provide the impetus, the extra push the technology needs to do that.

Challenge details

Illustration of example disaster response scenario

"Robosimian"

The Robotics Challenge will focus on disaster or emergency-response scenarios. Although the requirements may change as the contest progresses, the initial task requirements for robot entries is: ^[4]

1. Drive a utility vehicle at the site.

2. Travel dismounted across rubble.

3. Remove debris blocking an entryway.

4. Open a door and enter a building.

5. Climb an industrial ladder and traverse an industrial walkway.

6. Use a tool to break through a concrete panel.

7. Locate and close a valve near a leaking pipe.

8. Connect a fire hose to a standpipe and turn on a valve.

The competition has been broken into multiple tracks. Tracks A and B receive DARPA funding, while Tracks C and D will receive no DARPA funding initially. Tracks B and C will go through the Virtual Robotics Challenge (VRC), after which successful teams may receive funding for subsequent stages. ^[4] Applications for tracks A and B closed in May 2012. ^[6] The track C application window closed on 18 December 2012, though late applications were still being considered as of January 2013, ^[7] though participants may still download the DRC Simulator, an open-source application created by the Open Source Robotics Foundation. ^[8] Track D was open for registration through October 2013. ^[9]

The signup site for Tracks C and D (no funding) shows illustrations of robots with most largely conforming to humanoid layouts (bipedal with two arms). Other configurations may be possible, however, as illustrated by the "Robosimian" illustration proposed by NASA Jet Propulsion Laboratory. ^{[10] [11]}

Differences

Unlike previous Challenges, entrants to the DRC need not build their robots from scratch. DARPA will provide to some participants "a robotic hardware platform with arms, legs, torso and head. ^[1] In August 2012, DARPA announced that it would pay about $10.9 million to Boston Dynamics to build seven platforms based on the PETMAN project by August 2014. ^{[12] [13] [14]}

The contest will also include "supervised autonomy" tasks in which non-expert operators will be allowed/required to complete tasks using the robotic vehicle. The Challenge will focus on the ability to complete such supervised autonomy tasks "despite low fidelity (low bandwidth, high latency, intermittent) communications." ^[4]

Trials

The DRC Trials occurred on December 20 and 21, 2013 in Florida. During the trials the robots were still teleoperated for the vast majority of tasks. ^[15] The 16 teams that competed in the Trials were:

Team	Points*	Track	Vehicle	Terrain	Ladder	Debris	Door	Wall	Valve	Hose
SCHAFT	27	D (A†)	1	4	4	4	2	4	4	4
IHMC Robotics	20	B	x	4	0	1	4	4	3	4
Tartan Rescue	18	A	x	1	1	4	2	4	4	2
MIT	16	B	0	3	1	1	1	4	4	2
RoboSimian	14	A	x	2	x	4	2	0	4	2
Team TRACLabs	11	B	x	1	1	1	1	1	4	2
WRECS	11	C	1	2	2	0	0	0	4	2
KAIST	8	D	1	1	4	0	0	0	1	1
HKU	3	B	x	1	0	0	1	0	1	0
DRC-HUBO	3	A	0	0	2	0	x	0	1	0
CHIRON	0	D	0	x	x	0	x	x	0	x
NASA-JSC	0	A	x	x	x	0	0	x	0	0
MOJAVATON	0	D	x	0	x	0	0	0	0	0

* Maximal attainable number of points was 32 ^[16]

^† Team SCHAFT was originally track A, but switched to track D after Google's acquisition. ^[17]

X = Did not Attempt ^[18]

The top 8 teams (SCHAFT through TROOPER) were initially eligible for funding. However, after the completion of the trials, Team SCHAFT elected to move to Track D, as a self-funded project. SCHAFT was acquired by Google, which also acquired autonomous vehicle technologies from teams that competed in the DARPA Grand Challenge. The move of SCHAFT to track D frees up DARPA funding for additional finalists. THOR, ViGIR, and KAIST, each of which earned 8 points during the trials, will now compete in the finals, with KAIST continuing as a track D self-funded team. Team THOR and Team ViGIR will split the DARPA funding, and Team THOR will further split into two teams after the move of its leader to a different university. ^[19]

Finals

Mobile Manipulation Robot Momaro

The DRC Finals took place at the Fairplex in Pomona, California on June 5 and 6, 2015. Twenty-five of the top robotics organizations in the world gathered to compete for $3.5 million in prizes as they attempted a simulated disaster-response course. ^[21] The 25 teams competing for the Finals are: ^[22]

Team	Country	Affiliation	Robot (architecture)
TARTAN RESCUE	USA	CMU NREC	Chimp
TEAM AERO	Japan	Unknown	(4 legs)
TEAM AIST-NEDO	Japan	AIST
TEAM DRC-HUBO AT UNLV	USA	UNLV	Metal Rebel (Hubo)
TEAM GRIT	USA	Colorado Mesa University	(4 legs)
TEAM HECTOR	Germany	Darmstadt University	Johnny 05 (THORMANG)
TEAM HKU	Hong Kong	Hong Kong University	(Atlas)
TEAM HRP2-TOKYO	Japan	Jouhou System Kougaku
TEAM IHMC ROBOTICS	USA	Institute for Human & Machine Cognition	Running Man (Atlas)
TEAM INTELLIGENT PIONEER	China	Institute of Advanced Manufacturing Technology
TEAM KAIST	South Korea	KAIST	Hubo (Hubo)
TEAM MIT	USA	MIT	(Atlas)
TEAM NEDO-HYDRA	Japan	University of Tokyo, Chiba Institute of Technology, Osaka University, Kobe University
TEAM NEDO-JSK	Japan	University of Tokyo
TEAM NIMBRO RESCUE	Germany	University of Bonn	Momaro
TEAM ROBOSIMIAN	USA	Jet Propulsion Lab, Caltech [23] [ circular reference ]
TEAM ROBOTIS	South Korea	ROBOTIS CO., LTD [24]	THORMANG (THORMANG)
TEAM SNU	South Korea	Seoul National University	(THORMANG)
TEAM THOR	USA	UCLA, UPenn	THOR-RD (THORMANG)
TEAM TRACLABS	USA	TRACLabs	(Atlas)
TEAM TROOPER	USA	Lockheed Martin Advanced Technology Laboratories	(Atlas)
TEAM VALOR	USA	Virginia Tech	ESCHER
TEAM VIGIR	USA,   Germany	Virginia Tech, Darmstadt University, Oregon State University, TORC Robotics, Cornell University	Florian (Atlas)
TEAM IIT WALK-MAN	Italy	Italian Institute of Technology, University of Pisa	WALK-MAN
TEAM WPI-CMU	USA	Worcester Polytechnic Institute, CMU	Warner (Atlas)

Results

In the Finals, three teams had a perfect score of 8. The tie was broken by their total time. First place went to Team KAIST with their DRC-Hubo robot and a winning time of 44 minutes and 28 seconds. Second place went to IHMC for Running Man, and third to Tartan Rescue of CMU NREC for Chimp. ^{[25] [26] [27]}

The robots performed better than expected. But there were a variety of failures indicating how difficult robotics remains. ^[28] For example, Running Man fell over while waving to the crowd after successfully completing all 8 tasks.

Position	Team	Final score	Time (min)
1	TEAM KAIST	8	44:28
2	TEAM IHMC ROBOTICS	8	50:26
3	TARTAN RESCUE	8	55:15
4	TEAM NIMBRO RESCUE	7	34:00
5	TEAM ROBOSIMIAN	7	47:59
6	TEAM MIT	7	50:25
7	TEAM WPI-CMU	7	56:06
8	TEAM DRC-HUBO AT UNLV	6	57:41
9	TEAM TRACLABS	5	49:00
10	TEAM AIST-NEDO	5	52:30
11	TEAM NEDO-JSK	4	58:39
12	TEAM SNU	4	59:33
13	TEAM THOR	3	27:47
14	TEAM HRP2-TOKYO	3	30:06
15	TEAM ROBOTIS	3	30:23
16	TEAM VIGIR	3	48:49
17	TEAM IIT WALK-MAN	2	36:35
18	TEAM TROOPER	2	42:32
19	TEAM HECTOR	1	02:44
20	TEAM VALOR	0	0
21	TEAM AERO	0	0
22	TEAM GRIT	0	0
23	TEAM HKU	0	0

See also

• DARPA Grand Challenge

References

1. "DARPA ROBOTICS CHALLENGE (DRC)". Archived from the original on 20 January 2013. Retrieved 14 January 2013.
2. "Teams selected to compete in DARPA robotics challenge - The Tartan". thetartan.org. Retrieved November 22, 2019.
3. "DRC Finals Announcement". Archived from the original on 1 July 2014. Retrieved 26 June 2014.
4. "DARPA Robotics Challenge" . Retrieved 23 October 2012.
5. "DARPA Challenge History". YouTube . Retrieved 24 April 2014.
6. "DARPA Robotics Challenge Q&A Round 3". Archived from the original on 27 September 2014. Retrieved 14 January 2013.
7. "DARPA DRC | Register Your Team (track C)". Archived from the original on 2013-09-27. Retrieved 2013-01-15.
8. DARPA DRC | Simulator
9. "DARPA DRC | Participate". Archived from the original on 2013-08-05. Retrieved 2013-01-15.
10. DARPA DRC | About The Disaster Robotics Challenge Archived April 27, 2016, at the Wayback Machine
11. "robots.net - DARPA Robotics Challenge Kick Off". Archived from the original on 2012-11-12. Retrieved 2012-11-22.
12. "FBO.gov has moved". fbohome.sam.gov. Retrieved November 22, 2019.
13. "Contract". www.defense.gov. Retrieved November 22, 2019.
14. "Debut of Atlas Robot". www.darpa.mil. Retrieved November 22, 2019.
15. "The Darpa Robotics Challenge" . Retrieved 5 January 2014.
16. "DARPA Robotics Challenge Trials: Final Results". IEEE Spectrum. 2013-12-21. Retrieved 2013-12-21.
17. "FIELD OF COMPETITORS EXPANDS FOR DRC FINALS". 2014-03-12. Archived from the original on 2014-05-30. Retrieved 2014-05-29.
18. "DRC Trials Scores Analysis Anonymous v11 DISTAR 22423.pptx" (PDF). 2014-12-21. Archived from the original (PDF) on 2015-01-05. Retrieved 2015-01-05.
19. "FIELD OF COMPETITORS EXPANDS FOR DRC FINALS". 2014-03-12. Archived from the original on 2014-05-30. Retrieved 2014-05-29.
20. Schwarz, Max; Rodehutskors, Tobias; Droeschel, David; Beul, Marius; Schreiber, Michael; Araslanov, Nikita; Ivanov, Ivan; Lenz, Christian; Razlaw, Jan; Schüller, Sebastian; Schwarz, David (2017). "NimbRo Rescue: Solving Disaster-response Tasks with the Mobile Manipulation Robot Momaro". Journal of Field Robotics. 34 (2): 400–425. arXiv: 1810.01345 . doi:10.1002/rob.21677. ISSN   1556-4967. S2CID   40627652.
21. "Home | DRC Finals". Archived from the original on 2016-04-28. Retrieved 2015-12-30.
22. "DRC Finals - Qualified Teams". Archived from the original on 2015-05-22. Retrieved 2015-06-19.
23. Jet Propulsion Laboratory
24. "ROBOTIS". 로보티즈. Retrieved November 22, 2019.
25. "South Korea's Team KAIST wins 2015 DARPA Robotics Challenge". Gizmag. 2015-06-08. Retrieved 2015-07-04.
26. The Economist. June 13, 2015. p81
27. Robots from Republic of Korea and United States take home $3.5 million in prizes Archived April 27, 2016, at the Wayback Machine
28. "A Celebration of Risk (a.k.a., Robots Take a Spill)". DARPAtv. 2015-06-06. Retrieved 2015-07-04.

External links

• Darpa Robotics Challenge official page
• Journal of Field Robotics Special Issue: The DARPA Robotics Challenge Finals