Andrej Karpathy

Last updated

Andrej Karpathy
Andrej Karpathy, OpenAI.png
Karpathy at Stanford in 2016
Born
Andrej Karpathy

(1986-10-23) 23 October 1986 (age 38)
Bratislava, Czechoslovakia (now Slovakia)
Alma mater
Awards Innovators Under 35 (2020)
Scientific career
Fields Machine Learning
Computer Vision
Artificial intelligence [1]
Institutions
Thesis Connecting Images and Natural Language  (2016)
Doctoral advisor Fei-Fei Li
Website karpathy.ai OOjs UI icon edit-ltr-progressive.svg

Andrej Karpathy (born 23 October 1986 [2] ) is a Slovak-Canadian computer scientist who served as the director of artificial intelligence and Autopilot Vision at Tesla. He co-founded and formerly worked at OpenAI, [3] [4] [5] where he specialized in deep learning and computer vision. [6] [7] [1] [8]

Contents

Education and early life

Karpathy was born in Bratislava, Czechoslovakia (now Slovakia) [9] [10] [11] [12] and moved with his family to Toronto when he was 15. [13] He completed his Computer Science and Physics bachelor's degrees at University of Toronto in 2009 [14] and his master's degree at University of British Columbia in 2011, [14] where he worked on physically-simulated figures (for example, a simulated runner or a simulated person in a crowd) with his adviser Michiel van de Panne.

Karpathy received a PhD from Stanford University in 2015 under the supervision of Fei-Fei Li, focusing on the intersection of natural language processing and computer vision, and deep learning models suited for this task. [15] [16]

Career and research

He authored and was the primary instructor of the first deep learning course at Stanford, CS 231n: Convolutional Neural Networks for Visual Recognition. [17] It became one of the largest classes at Stanford, growing from 150 students in 2015 to 750 in 2017. [18]

Karpathy is a founding member of the artificial intelligence research group OpenAI, [19] [20] where he was a research scientist from 2015 to 2017. [18] In June 2017 he became Tesla's director of artificial intelligence and reported to Elon Musk. [21] [7] [22] He was named one of MIT Technology Review's Innovators Under 35 for 2020. [23] After taking a several months-long sabbatical from Tesla, he announced he was leaving the company in July 2022. [24] As of February 2023, he makes YouTube videos on how to create artificial neural networks. [25]

It was reported on February 9 2023 that Karpathy had announced he was returning to OpenAI. [26]

A year later on February 13 2024, an OpenAI spokesperson confirmed that Karpathy had left OpenAI. [27]

On 16 July 2024 Karpathy announced in his X account, that he starts a new AI+Education company called Eureka Labs. [28] According to Eureka Labs, there first product will be the AI course, LLM101n. [29]

Related Research Articles

<span class="mw-page-title-main">Elon Musk</span> South African-born businessman (born 1971)

Elon Reeve Musk is a businessman known for his key roles in the space company SpaceX and the automotive company Tesla, Inc. His other involvements include ownership of X Corp., the company that operates the social media platform X, and his role in the founding of the Boring Company, xAI, Neuralink, and OpenAI. Musk is the wealthiest individual in the world; as of November 2024, Forbes estimates his net worth to be US$323 billion. Musk has been described as an American oligarch due to his extensive influence over public discourse, social media, industry, politics, and government policy.

<span class="mw-page-title-main">Tesla, Inc.</span> American electric vehicle and clean energy company

Tesla, Inc. is an American multinational automotive and clean energy company. Headquartered in Austin, Texas, it designs, manufactures and sells battery electric vehicles (BEVs), stationary battery energy storage devices from home to grid-scale, solar panels and solar shingles, and related products and services.

<span class="mw-page-title-main">George Hotz</span> American software engineer

George Francis Hotz, alias geohot, is an American security hacker, entrepreneur, and software engineer. He is known for developing iOS jailbreaks, reverse engineering the PlayStation 3, and for the subsequent lawsuit brought against him by Sony. From September 2015 onwards, he has been working on his vehicle automation machine learning company comma.ai. Since November 2022, Hotz has been working on tinygrad, a deep learning framework.

<span class="mw-page-title-main">Kimbal Musk</span> South African-American entrepreneur (born 1972)

Kimbal James Musk is a Canadian-American businessman and restaurateur. He co-owns The Kitchen Restaurant Group, a collection of restaurants in Colorado, Chicago, and Austin. He is the co-founder and chairman of Big Green, a 501(c)(3) nonprofit that has built hundreds of outdoor classrooms called Learning Gardens in schoolyards across the United States. Musk is also the co-founder and chairman of Square Roots, an urban farming company growing food in hydroponic, indoor, climate controlled shipping containers. Musk currently sits on the boards of Tesla Inc. and SpaceX; his brother Elon is the current CEO of both companies. He was on the board of Chipotle Mexican Grill from 2013 to 2019. He is the brother of Elon Musk, Tosca Musk, son of Errol and Maye Musk, and a major shareholder in Tesla.

<span class="mw-page-title-main">Andrew Ng</span> American artificial intelligence researcher

Andrew Yan-Tak Ng is a British-American computer scientist and technology entrepreneur focusing on machine learning and artificial intelligence (AI). Ng was a cofounder and head of Google Brain and was the former Chief Scientist at Baidu, building the company's Artificial Intelligence Group into a team of several thousand people.

<span class="mw-page-title-main">Future of Life Institute</span> International nonprofit research institute

The Future of Life Institute (FLI) is a nonprofit organization which aims to steer transformative technology towards benefiting life and away from large-scale risks, with a focus on existential risk from advanced artificial intelligence (AI). FLI's work includes grantmaking, educational outreach, and advocacy within the United Nations, United States government, and European Union institutions.

<span class="mw-page-title-main">Fei-Fei Li</span> Chinese-American computer scientist (born 1976)

Fei-Fei Li is a Chinese-American computer scientist, known for establishing ImageNet, the dataset that enabled rapid advances in computer vision in the 2010s. She is the Sequoia Capital professor of computer science at Stanford University and former board director at Twitter. Li is a co-director of the Stanford Institute for Human-Centered Artificial Intelligence and a co-director of the Stanford Vision and Learning Lab. She served as the director of the Stanford Artificial Intelligence Laboratory from 2013 to 2018.

OpenAI is an American artificial intelligence (AI) research organization founded in December 2015 and headquartered in San Francisco, California. Its stated mission is to develop "safe and beneficial" artificial general intelligence (AGI), which it defines as "highly autonomous systems that outperform humans at most economically valuable work". As a leading organization in the ongoing AI boom, OpenAI is known for the GPT family of large language models, the DALL-E series of text-to-image models, and a text-to-video model named Sora. Its release of ChatGPT in November 2022 has been credited with catalyzing widespread interest in generative AI.

<span class="mw-page-title-main">Tesla Autopilot</span> Suite of advanced driver-assistance system features by Tesla

Tesla Autopilot is an advanced driver-assistance system (ADAS) developed by Tesla that amounts to partial vehicle automation. Tesla provides "Base Autopilot" on all vehicles, which includes lane centering and traffic-aware cruise control. Owners may purchase or subscribe to Full Self-Driving (FSD) which adds semi-autonomous navigation that responds to traffic lights and stop signs, lane change assistance, self-parking, and the ability to summon the car from a garage or parking spot.

PyTorch is a machine learning library based on the Torch library, used for applications such as computer vision and natural language processing, originally developed by Meta AI and now part of the Linux Foundation umbrella. It is one of the most popular deep learning frameworks, alongside others such as TensorFlow and PaddlePaddle, offering free and open-source software released under the modified BSD license. Although the Python interface is more polished and the primary focus of development, PyTorch also has a C++ interface.

<span class="mw-page-title-main">Pieter Abbeel</span> Machine learning researcher at Berkeley

Pieter Abbeel is a professor of electrical engineering and computer sciences, Director of the Berkeley Robot Learning Lab, and co-director of the Berkeley AI Research (BAIR) Lab at the University of California, Berkeley. He is also the co-founder of Covariant, a venture-funded start-up that aims to teach robots new, complex skills, and co-founder of Gradescope, an online grading system that has been implemented in over 500 universities across the USA. He is best known for his cutting-edge research in robotics and machine learning, particularly in deep reinforcement learning. In 2021, he joined AIX Ventures as an Investment Partner. AIX Ventures is a venture capital fund that invests in artificial intelligence startups.

Elon Musk is the CEO or owner of multiple companies including Tesla, SpaceX, and X Corp, and has expressed many views on a wide variety of subjects, ranging from politics to science.

<span class="mw-page-title-main">Criticism of Tesla, Inc.</span> Systemic criticism of Tesla, Inc. and its products and leadership

Tesla, Inc. has been criticized for its cars, workplace culture, business practices, and occupational safety. Many of the criticisms are also directed toward Elon Musk, the company's CEO and Product Architect. Critics have also accused Tesla of deceptive marketing, unfulfilled promises, and fraud. The company is currently facing criminal and civil investigations into its self-driving claims. Critics have highlighted Tesla's downplaying of issues, and Tesla's alleged retaliation against several whistleblowers.

<span class="mw-page-title-main">Optimus (robot)</span> Humanoid robot being developed by Tesla

Optimus, also known as Tesla Bot, is a general-purpose robotic humanoid under development by Tesla, Inc. It was announced at the company's Artificial Intelligence (AI) Day event on August 19, 2021, and a prototype was shown in 2022. CEO Elon Musk stated in 2022 that he thinks Optimus "has the potential to be more significant than [Tesla's] vehicle business over time." Media and expert opinions based on corporate showcases have been mixed.

Tesla Dojo is a supercomputer designed and built by Tesla for computer vision video processing and recognition. It is used for training Tesla's machine learning models to improve its Full Self-Driving (FSD) advanced driver-assistance system. According to Tesla, it went into production in July 2023.

<span class="mw-page-title-main">Lex Fridman</span> Russian-American scientist and podcast host (born 1983)

Lex Fridman is a Russian-American computer scientist and podcaster. Since 2018, he has hosted the Lex Fridman Podcast, where he interviews notable figures from various fields such as science, technology, sports, and politics.

<span class="mw-page-title-main">Meta AI</span> Artificial intelligence division of Meta Platforms

Meta AI is a company owned by Meta that develops artificial intelligence and augmented and artificial reality technologies. Meta AI deems itself an academic research laboratory, focused on generating knowledge for the AI community, and should not be confused with Meta's Applied Machine Learning (AML) team, which focuses on the practical applications of its products.

Shivon Alice Zilis is a Canadian technology executive and venture capitalist.

Tesla Autopilot, an advanced driver-assistance system for Tesla vehicles, uses a suite of sensors and an onboard computer. It has undergone several hardware changes and versions since 2014, most notably moving to an all-camera-based system by 2023, in contrast with ADAS from other companies, which include radar and sometimes lidar sensors.

References

  1. 1 2 Andrej Karpathy publications indexed by Google Scholar OOjs UI icon edit-ltr-progressive.svg
  2. ↑ "Self-reported on twitter". Archived from the original on 23 August 2021. Retrieved 25 April 2019.
  3. ↑ "Tesla's Autopilot chief steps down after two years". 26 April 2018. Retrieved 9 August 2018.
  4. ↑ Metz, Cade (7 November 2017). "A.I. Researchers Leave Elon Musk Lab to Begin Robotics Start-Up". The New York Times. Retrieved 9 August 2018.
  5. ↑ Metz, Cade (19 April 2017). "A.I. Researchers Are Making More Than $1 Million, Even at a Nonprofit". The New York Times. Retrieved 9 August 2018.
  6. ↑ "The Guy Who Taught AI to 'Remember' Is Launching a Startup". 28 July 2018. Retrieved 9 August 2018.
  7. 1 2 "Elon Musk has poached a top mind in AI research—from himself". 21 June 2017. Retrieved 9 August 2018.
  8. ↑ Andrej Karpathy on Medium
  9. ↑ "The Slovak, who leads the development of AI at Tesla, is leaving. It was an honor, says Musk – Živé.sk". 14 July 2022. Retrieved 19 July 2022.
  10. ↑ Živé.sk (25 June 2020). "Šéf AI v Tesle: Rodák zo Slovenska je medzi TOP 35 mladými novátormi". Živé.sk (in Slovak). Retrieved 19 July 2022.
  11. ↑ today, newsy (28 March 2022). "The Slovak, who leads AI in Tesla, left the company for several months. He jokes with Musk about TikTok". Newsy Today. Retrieved 19 July 2022.[ permanent dead link ]
  12. ↑ "Slovák Andrej Karpathy z Tesly patrí podľa MIT medzi 35 top inovátorov". TeslaMagazin.sk (in Slovak). 23 June 2020. Retrieved 19 July 2022.
  13. ↑ "Next Generation Machine Learning - Training Deep Learning Models in a Browser: Andrej Karpathy Interview | DataScienceWeekly.org". DataScienceWeekly.org. Retrieved 12 November 2018.
  14. 1 2 "Andrej Karpathy Academic Website". cs.stanford.edu. Retrieved 12 November 2018.
  15. ↑ Karpathy, Andrej (2016). Connecting Images and Natural Language. stanford.edu (PhD thesis). Stanford University.
  16. ↑ "Does 'robo-journalism' pose a threat to reporters?". 23 March 2017. Retrieved 9 August 2018.
  17. ↑ "Stanford University CS231n: Convolutional Neural Networks for Visual Recognition". cs231n.stanford.edu. Retrieved 8 September 2022.
  18. 1 2 "Andrej Karpathy". karpathy.ai. Retrieved 8 September 2022.
  19. ↑ "Introducing OpenAI". OpenAI. 12 December 2015. Retrieved 8 September 2022.
  20. ↑ Fan, Shelly (20 December 2015). "Inside OpenAI: Will Transparency Protect Us From Artificial Intelligence Run Amok?". Singularity Hub. Retrieved 8 September 2022.
  21. ↑ Etherington, Darrell (21 June 2017). "Tesla hires deep learning expert Andrej Karpathy to lead Autopilot vision". TechCrunch. Retrieved 10 November 2023.
  22. ↑ "Tesla hired a top AI expert to lead a critical aspect of Autopilot -- here's what we know". 22 June 2017. Retrieved 9 August 2018.
  23. ↑ "Andrej Karpathy (Innovators Under 35 2020)". MIT Technology Review. Retrieved 8 September 2022.
  24. ↑ Kolodny, Lora (13 July 2022). "Tesla AI leader Andrej Karpathy announces he's leaving the company". CNBC. Retrieved 14 July 2022.
  25. ↑ "Andrej Karpathy - YouTube". youtube.com. Retrieved 4 February 2023.
  26. ↑ @karpathy (9 February 2023). "Some personal news: I am joining OpenAI (again :)). Like many others both in/out of AI, I am very inspired by the impact of their work and I have personally benefited greatly from it. The future potential is especially exciting; it is a great pleasure to jump back in and build!🪄" (Tweet) – via Twitter.
  27. ↑ "OpenAI Researcher Andrew Karpathy Departs". 13 February 2024. Retrieved 13 February 2024.
  28. ↑ @karpathy (16 July 2024). "Excited to share that I am starting an AI+Education company called Eureka Labs🪄" (Tweet) – via Twitter.
  29. ↑ "Eureka Labs". eurekalabs.ai. Retrieved 1 December 2024.
  1. Official Website of Eureka Labs
  2. Official GitHub Account of Eureka Labs
  3. Official Discord Account of Eureka Labs
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.