Clarifai

Last updated

Clarifai
Company typePrivate
Industry Computer Vision
Founded2013 (New York City)
Headquarters,
U.S.
Area served
Worldwide
Key people
Matthew Zeiler (Founder & CEO)
Number of employees
120+
Website clarifai.com

Clarifai Inc. is an artificial intelligence (AI) company that specializes in computer vision and uses machine learning and deep neural networks to identify and analyze images and videos.

Contents

Clarifai is headquartered in Wilmington, DE with two satellite offices in San Francisco and Tallinn, Estonia.

History

Clarifai was founded in 2013 by Matthew Zeiler, a Ph.D. student who recently placed in the top 5 spots of the 2013 ImageNet Challenge. [1] [2] [3] Initially, the company offered free and paid versions of image and video recognition via their API and a consumer-facing iPhone app called Forevery. [4] [5] In 2014 Style Me Pretty, a wedding lifestyle website which used the technology to provide images that are personally adapted to the user, became Clarifai's first customer. [6]

In 2016, Clarifai released version 2 of their API, adding custom training and visual search to its platform. [7] [8]

In 2017 the company moved all research work to a San Francisco office and all government-related endeavors to an office in Washington D.C. [9] Later that year, the company announced a mobile SDK, which allowed users to run their platform without an internet connection. [10] [11] [12] In 2018 Clarifai released an on-premise solution.[ buzzword ] [13] In 2019, Clarifai opened a new office in Estonia's capital city Tallinn. [14]

Funding

In 2015, Clarifai raised $10 million in its Series A funding round, led by Union Square Ventures (USV). [15] After the 2016 launch of their v2 API, Menlo Ventures led their $30 million Series B round, with participation from USV, Lux Capital, and Osage University Partners. [16] In October 2021, Clarifai closed a $60 million Series C funding round led by New Enterprise Associates (NEA), with participation from existing investors Menlo Ventures, Union Square Ventures, Lux Capital, LDV Capital, Corazon Capital, NYU Innovation Venture Fund, and new investors CPP Investment Board, NextEquity Partners, SineWave Ventures, and Trousdale Capital. The amount raised brings the company's total funding to $100 million. [17]

Technology

The core of Clarifai's technology is based on convolutional neural networks, which Zeiler focused on for his PhD work. [18] It is a process which enables a computer to learn from data examples and draw its own conclusions, giving applications the ability to predict correct tags for images or videos.

The platform includes the ability to moderate content, perform visual search, visual similarity, and organize media collections. It has pre-built recognition models that can identify a specific set of concepts like food or travel, NSFW, and its general model which can identify a range of concepts including objects, ideas, and emotion. [19] It also has the ability to create custom models which can identify other arbitrary objects such as cars or breeds of dogs. [20] The 2018 Model 1.5 with machine-labeled datasets claims to recognize up to 11,000 concepts from object detection, as well as things like mood or theme. [21]

Clients

In 2017, Clarifai had about 100 customers. Their technology was used by Unilever, Ubisoft, BuzzFeed, and also by companies producing medical devices and drones. [6]

Military work

In 2018 Zeiler disclosed that the company was a participant in Project Maven, a US Department of Defense AI program. [22] The disclosure, in a blog post on the company website, came after a Wired story reported that a former employee had filed a wrongful termination suit. The suit alleged that she was dismissed for requesting that Clarifai disclose a 2017 server compromise to the Pentagon and other customers. [23] Zeiler asserted (in a company blog, posted on June 13, 2018, in response to the server-breach controversy) that the breach involved only "an isolated research server", and that customers were notified following an external security audit. [22] In late January, 2019, several Clarifai employees posted an open letter on a company message board expressing concerns that the June 13 blog-post of Zeiler’s contained implications of Clarifai’s complicit involvement with potentially unethical uses of AI technology, e.g. automated warfare. These allegations are part of the societal concern over the ethical development and use of AI, which has been growing alongside the pace of AI’s advancement. [24]

Related Research Articles

<span class="mw-page-title-main">Gengo</span> Japanese web-based translation platform

Gengo was a web-based translation platform headquartered in Tokyo.

<span class="mw-page-title-main">Salesforce</span> American software company

Salesforce, Inc. is an American cloud-based software company headquartered in San Francisco, California. It provides applications focused on sales, customer service, marketing automation, e-commerce, analytics, artificial intelligence, and application development.

<span class="mw-page-title-main">Box, Inc.</span> Cloud content management program

Box, Inc. is a public company based in Redwood City, California. It develops and markets cloud-based content management, collaboration, and file sharing tools for businesses. Box was founded in 2005 by Aaron Levie and Dylan Smith. Initially, it focused on consumers, but around 2009 and 2010 Box pivoted to focus on business users. The company raised about $500 million over numerous funding rounds before going public in 2015. Its software allows users to store and manage files in an online folder system accessible from any device. Users can then comment on the files, share them, apply workflows, and implement security and governance policies.

<span class="mw-page-title-main">Wix.com</span> Israeli software company

Wix.com Ltd. or simply Wix is an Israeli software company, publicly listed in the US, that provides cloud-based web development services. It offers tools for creating HTML5 websites for desktop and mobile platforms using online drag-and-drop editing. Along with its headquarters and other offices in Israel, Wix also has offices in Brazil, Canada, Germany, India, Ireland, Japan, Lithuania, Poland, the Netherlands, the United States, Ukraine, and Singapore.

<span class="mw-page-title-main">Lucidworks</span> Software company

Lucidworks is a San Francisco, California-based software company that specializes in commerce, customer service, and workplace applications.

<span class="mw-page-title-main">Figure Eight Inc.</span> American software company

Figure Eight was a human-in-the-loop machine learning and artificial intelligence company based in San Francisco.

<span class="mw-page-title-main">Lux Capital</span> American venture capital firm

Lux Capital is a venture capital firm based in New York City. It was founded in 2000, and focuses on investments in emerging technologies.

AH Capital Management, LLC is an American privately held venture capital firm, founded in 2009 by Marc Andreessen and Ben Horowitz. The company is headquartered in Menlo Park, California. As of April 2023, Andreessen Horowitz ranks first on the list of venture capital firms by assets under management, with $42 billion as of May 2024.

Twilio Inc. is an American cloud communications company based in San Francisco, California, which provides programmable communication tools for making and receiving phone calls, sending and receiving text messages, and performing other communication functions using its web service APIs.

Canopy Labs is a customer analytics company headquartered in Toronto, Ontario, Canada, with offices in San Francisco. It was founded in 2012 and offers SaaS marketing analytics for businesses and organizations. The company is an alumnus of the Y Combinator accelerator program. Canopy Labs was acquired by Drop.

Headquartered in Tel Aviv Cortica utilizes unsupervised learning methods to recognize and analyze digital images and video. The technology developed by the Cortica team is based on research of the function of the human brain.

Pond5 is a New York–based online marketplace for royalty-free media. The company licenses stock footage, stock music, stock photography, sound effects, Adobe After Effects templates, and 3D models. Pond5 claims to have the world's largest collection of stock footage, and that they host more than 44 million clips as of January 2025.

Algolia is a French proprietary search-as-a-service platform, with its headquarters in San Francisco and offices in Paris and London. Its main product is a web search platform for individual websites.

CloudSight, Inc. is a Los Angeles, California–based technology company that specializes in captioning and understanding images using AI.

<span class="mw-page-title-main">UiPath</span> Romanian-American developer of robotic process automation software

UiPath Inc. is a global software company that makes robotic process automation (RPA) software. It was founded in Bucharest, Romania, by Daniel Dines and Marius Tîrcă. Its headquarters are in New York City. The company's software monitors user activity to automate repetitive front and back office tasks, including those performed using other business software such as customer relationship management or enterprise resource planning (ERP) software.

<span class="mw-page-title-main">Puls (company)</span> American tech services company

Puls is a San Francisco–based startup founded by Eyal Ronen and Itai Hirsch in 2015. The company provides in-home services such as repairs to all household appliances. The user books an appointment for a technician to visit the user's location to fix said problem.

aiMotive is an autonomous vehicle technology company. The company aims to work with automotive manufacturers and Tier1s to enable automated technologies. aiMotive describes its approach as "vision-first", a system that primarily relies on cameras and artificial intelligence to detect its surroundings. The technology is designed to be implemented by automobile manufacturers to create autonomous vehicles, which can operate in all conditions and locations. In September 2017, PSA Group teamed up with AImotive.

<span class="mw-page-title-main">Speechmatics</span>

Speechmatics is a technology company based in Cambridge, England, which develops automatic speech recognition software (ASR) based on recurrent neural networks and statistical language modelling. Speechmatics was originally named Cantab Research Ltd when founded in 2006 by speech recognition specialist Dr. Tony Robinson.

References

  1. Tilley, Aaron. "Every AI Powerhouse Wanted This Whiz Kid. He's Taking Them on Instead". Forbes. Retrieved January 31, 2018.
  2. "How Matthew Zeiler Created 'Clarifai' – The Image And Video Recognition API For Building Smart Apps". CrazyEngineers. Retrieved January 31, 2018.
  3. Gershgorn, Dave. "The data that transformed AI research—and possibly the world". Quartz. Retrieved May 22, 2018.
  4. "The AI Startup Google Should Probably Snatch Up Fast". WIRED. Retrieved May 22, 2018.
  5. Hernandez, Daniela. "This app will actually make you look at your millions of forgotten photos". Splinter. Retrieved June 7, 2018.
  6. 1 2 Tilley, Aaron. "Every AI Powerhouse Wanted This Whiz Kid. He's Taking Them On Instead". Forbes. Retrieved June 17, 2020.
  7. "Clarifai Wants You to Correct AI's Biggest Gaffes". WIRED. Retrieved May 22, 2018.
  8. "Deep learning startup Clarifai raises $30 million". VentureBeat. October 25, 2016. Retrieved May 22, 2018.
  9. "Visual search startup Clarifai beefs up its AI team with a new San Francisco office – TechCrunch". techcrunch.com. February 2, 2017. Retrieved May 22, 2018.
  10. "AI company Clarifai says its new face recognition technology won't be racist". Fast Company. May 1, 2017. Retrieved May 22, 2018.
  11. "How Machine-Learning AI Is Going To Make Your Phone Even Smarter". Fast Company. July 12, 2017. Retrieved May 22, 2018.
  12. "Clarifai launches SDK for training AI on your iPhone". VentureBeat. July 12, 2017. Retrieved May 22, 2018.
  13. "Clarifai rolls out an on-premise visual search tool for businesses – TechCrunch". techcrunch.com. March 12, 2018. Retrieved May 22, 2018.
  14. "Clarifai Expands its Global Presence with a New Office in Tallinn, Estonia". MarTech Series. February 11, 2020. Retrieved June 3, 2020.
  15. "Deep-learning startup Clarifai gets $10M to make business hires, add features". VentureBeat. April 28, 2015. Retrieved May 22, 2018.
  16. "Clarifai raises $30M to give developers visual search capabilities – TechCrunch". techcrunch.com. October 25, 2016. Retrieved May 22, 2018.
  17. "Clarifai moves beyond computer vision to manage companies' unstructured data – TechCrunch". techcrunch.com. October 15, 2021. Retrieved October 15, 2021.
  18. Zeiler, Matthew D.; Fergus, Rob (November 12, 2013). "Visualizing and Understanding Convolutional Networks". arXiv: 1311.2901 [cs.CV].
  19. "Models". Clarifai. Retrieved May 22, 2018.
  20. "Clarifai Raises $30 Million to Innovate Artificial Intelligence for Everyone". Techvibes. October 31, 2016. Retrieved May 22, 2018.
  21. "Clarifai improves General Model 1.5 with machine-labeled datasets". VentureBeat. October 4, 2018. Retrieved November 19, 2018.
  22. 1 2 Zeiler, Matthew (June 14, 2018). "Why We're a Part of Project Maven". Clarifai. Archived from the original on July 8, 2018. Retrieved July 8, 2018.
  23. Simonite, Tom (June 12, 2018). "Startup Working on Contentious Pentagon AI Project was Hacked". Wired. Retrieved July 8, 2018.
  24. Is Ethical A.I. Even Possible? The New York Times, 2019