FindFace

Last updated
FindFace
Type of site
 Social networking service
Available inRussian, English
OwnerNtech Lab Ltd
Created byArtem Kukharenko, Alexander Kabakov, Maxim Perlin
URL findface.pro
RegistrationOptional
Launched2016;8 years ago (2016)
Current statusactive

FindFace is a face recognition technology developed by the Russian company NtechLab that specializes in neural network tools. The company provides a line of services for the state and various business sectors based on FindFace algorithm. Previously, the technology was used as a web service that helped to find people on the VK social network using their photos.

Contents

Technology

In 2015 NTechLab algorithm won The MegaFace Benchmark challenge, organized by University of Washington. [1]

In May 2016, NtechLab was admitted to the official testing of biometrics technology by NIST among the three Russian companies. According to the results of testing, the algorithm took the first position in the ranking of the global benchmark Facial Recognition Vendor Test.

In the spring of 2017, NtechLabs algorithm again has been ranked first in the Facial Recognition Vendor Test. [2]

Also in March 2017, NtechLabs FindFace algorithm won in the EmotionNet Challenge automatic emotion recognition competition organized by Ohio State University. [3] 37 development teams took part in the competition, and only 2 of them were able to fulfill the conditions in full.

In the fall of 2017, NtechLab won the facial recognition technology competition organized jointly by NIST and IARPA, in two nominations out of three (“Identification Speed” and “Verification Accuracy”). [4]

In September 2018, the NtechLab algorithm for recognizing pedestrian silhouettes won a prize in the Wider Pedestrian Challenge, a competition for detecting pedestrians and cyclists organized by Amazon and SenseTime. [5]

FindFace employs a facial recognition neural network [6] algorithm developed by N-Tech.Lab [7] [8] to match faces in the photographs uploaded by its users against faces in photographs published on VK, [9] with a reported accuracy of 70 percent. [10] Different sources point to NTech Lab's technology accuracy from 85.081% [11] to 99%. [12]

History

The technology was made public as a web service that helps to find people on the social network VK using their photos in February 2016. [13]

In May 2016 the number of visitors to the service exceeded 1 million people.

In August 2016 NtechLab co-founder Artem Kukharenko, handed over the post of head of the company to Mikhail Ivanov. [14]

In September 2018, the service stopped providing a facility to search people's social profiles, as it was transformed by NtechLab into a line of services for various business sectors .

Application cases

In 2016–2018 NtechLab presented several scenarios for using FindFace technology, which later formed the basis of the company's commercial products:

• In June 2016, the FindFace service was introduced at the Alfa Future People festival: guests of the event could identify themselves with the use of an application, and then obtain the possibility to receive their photos, taken during the event, through their social network profiles. Participation in the experiment was voluntary and did not violate the confidentiality of festival visitors. [15]

• In 2017, NtechLab face recognition algorithms were built into the Moscow city video surveillance system operated by the Moscow Department of Information Technology . The system uses the database of the Ministry of Internal Affairs to find correspondences to it on video. The alleged use of the system is the search for criminals and the fight against terrorism. [16]

• In February 2018, it became known that NtechLab technologies will be used in Tatarstan. As it was announced in early 2019, a pilot project in Almetyevsk showed the effectiveness of technology in ensuring public safety. [17]

• In April 2018, it has been announced that the NtechLab face recognition algorithm will be implemented in the large Leto shopping and entertainment complex in St.Petersburg. The Leto authorities will collect a non-personal information on visitors without identifying them. The analysis will help to determine the demographic composition of customers, identify repeated visits, estimate the amount of time spent by visitors on purchases, compare customer behavior in different stores .

• In July 2018, the NtechLab application has been implemented in the water amusement park Līvu Akvaparks in Jurmala. After visiting the park, his clients were able to simplify the search for all the photographs containing their image .

• The FindFace Security application, implemented in several cities during the FIFA 2018 World Cup in Russia, made it possible to detain more than 180 people included in the offenders' bases, some of whom were on the federal wanted list .

• Thanks to the FindFace Security application, it was possible to prevent the theft of the Bud sponsorship cup as part of one of the matches of the FIFA World Cup 2018 in Russia. With the help of video cameras, it was possible to restore the chain of events and identify those involved, one of whom was discovered and detained at one of the subsequent matches. [18]

Developers

The NtechLab company that created the service was founded in 2015 by a graduate of the Moscow State University Faculty of Computational Mathematics and Cybernetics Artem Kukharenko and businessman Alexander Kabakov. In December 2021 Alexander Kabakov resigned from the board of directors of NtechLab. [19] Artem Kukharenko also resigned from the company. [20]

Controversial use

In 2022, NTechLab was accused of assisting the Russian and Belarus government by tracking thousands of political activists which led to their unconstitutional detentions and arrests. [21]

In 2016, FindFace generated controversy because it was once used to deanonymize Russian pornography actresses and alleged prostitutes. [6] [22] These efforts were organized by users of a Russian imageboard Dvach who claimed that women in the sex industry are “corrupt and deceptive”, according to Global Voices . [23] In addition, FindFace has been characterized as a major step in the erosion of anonymity. [7] [24]

See also

Related Research Articles

<span class="mw-page-title-main">Affective computing</span> Area of research in computer science aiming to understand the emotional state of users

Affective computing is the study and development of systems and devices that can recognize, interpret, process, and simulate human affects. It is an interdisciplinary field spanning computer science, psychology, and cognitive science. While some core ideas in the field may be traced as far back as to early philosophical inquiries into emotion, the more modern branch of computer science originated with Rosalind Picard's 1995 paper on affective computing and her book Affective Computing published by MIT Press. One of the motivations for the research is the ability to give machines emotional intelligence, including to simulate empathy. The machine should interpret the emotional state of humans and adapt its behavior to them, giving an appropriate response to those emotions.

<span class="mw-page-title-main">Facial recognition system</span> Technology capable of matching a face from an image against a database of faces

A facial recognition system is a technology potentially capable of matching a human face from a digital image or a video frame against a database of faces. Such a system is typically employed to authenticate users through ID verification services, and works by pinpointing and measuring facial features from a given image.

<span class="mw-page-title-main">Face detection</span> Identification of human faces in images

Face detection is a computer technology being used in a variety of applications that identifies human faces in digital images. Face detection also refers to the psychological process by which humans locate and attend to faces in a visual scene.

<span class="mw-page-title-main">Three-dimensional face recognition</span> Mode of facial recognition

Three-dimensional face recognition is a modality of facial recognition methods in which the three-dimensional geometry of the human face is used. It has been shown that 3D face recognition methods can achieve significantly higher accuracy than their 2D counterparts, rivaling fingerprint recognition.

<span class="mw-page-title-main">Yandex</span> Russian multinational technology company

Yandex LLC is a Russian technology company that provides Internet-related products and services including a web browser, search engine, cloud computing, web mapping, online food ordering, streaming media, online shopping, and a ridesharing company.

<span class="mw-page-title-main">VK (company)</span> Russian internet company

VK, known as Mail.ru Group until 12 October 2021, is a Russian technology company. It started in 1998 as the parent company of Mail.ru, an e-mail service and went on to become a major corporate figure in the Russian-speaking segment of the Internet.

<span class="mw-page-title-main">VK (service)</span> Russian social media and social networking service

VK is a Russian online social media and social networking service based in Saint Petersburg. VK is available in multiple languages but it is predominantly used by Russian speakers. VK users can message each other publicly or privately, edit these messages, create groups, public pages, and events; share and tag images, audio, and video; and play browser-based games.

Facial Profiler was a free Facebook app created to promote Coca-Cola Zero by the advertising agency Crispin Porter + Bogusky. The app used face recognition technology to search a database of voluntarily participating Facebook users to match people based on appearance. The software's algorithm analyzed face attributes like skin color, face structure and angles of the face. Once matched, users could contact their look-alike via their Facebook profile.

Face.com was an Israeli technology company that developed a platform for efficient and accurate facial recognition in photos uploaded via web and mobile applications. Face.com apps and API services scanned billions of photos monthly and tagged faces in those photos, tying them to social networking information. As of February 2011, the company had "discovered" 18 billion faces across its API and Facebook applications.

Yandex Search is a search engine owned by the company Yandex, based in Russia. In January 2015, Yandex Search generated 51.2% of all of the search traffic in Russia according to LiveInternet.

Affectiva is a software development company that created artificial intelligence. In 2021, the company was acquired by SmartEye. The company claimed its AI understood human emotions, cognitive states, activities and the objects people use, by analyzing facial and vocal expressions. The offshoot of MIT Media Lab, Affectiva created a new technological category of Artificial Emotional Intelligence, namely, Emotion AI.

IDEMIA is a French multinational technology company headquartered in Courbevoie, France. It provides identity-related security services, and sells facial recognition and other biometric identification products and software to private companies and governments.

Identity-based security is a type of security that focuses on access to digital information or services based on the authenticated identity of an entity. It ensures that the users and services of these digital resources are entitled to what they receive. The most common form of identity-based security involves the login of an account with a username and password. However, recent technology has evolved into fingerprinting or facial recognition.

DeepFace is a deep learning facial recognition system created by a research group at Facebook. It identifies human faces in digital images. The program employs a nine-layer neural network with over 120 million connection weights and was trained on four million images uploaded by Facebook users. The Facebook Research team has stated that the DeepFace method reaches an accuracy of 97.35% ± 0.25% on Labeled Faces in the Wild (LFW) data set where human beings have 97.53%. This means that DeepFace is sometimes more successful than human beings. As a result of growing societal concerns Meta announced that it plans to shut down Facebook facial recognition system, deleting the face scan data of more than one billion users. This change will represent one of the largest shifts in facial recognition usage in the technology's history. Facebook planned to delete by December 2021 more than one billion facial recognition templates, which are digital scans of facial features. However, it did not plan to eliminate DeepFace which is the software that powers the facial recognition system. The company has also not ruled out incorporating facial recognition technology into future products, according to Meta spokesperson.

<span class="mw-page-title-main">Joy Buolamwini</span> Computer scientist and digital activist

Joy Adowaa Buolamwini is a Canadian-American computer scientist and digital activist formerly based at the MIT Media Lab. She founded the Algorithmic Justice League (AJL), an organization that works to challenge bias in decision-making software, using art, advocacy, and research to highlight the social implications and harms of artificial intelligence (AI).

Amazon Rekognition is a cloud-based software as a service (SaaS) computer vision platform that was launched in 2016. It has been sold to, and used by, a number of United States government agencies, including U.S. Immigration and Customs Enforcement (ICE) and Orlando, Florida police, as well as private entities.

Clearview AI, Inc. is an American facial recognition company, providing software primarily to law enforcement and other government agencies. The company's algorithm matches faces to a database of more than 20 billion images collected from the Internet, including social media applications. Founded by Hoan Ton-That and Richard Schwartz, the company maintained a low profile until late 2019, until its usage by law enforcement was first reported.

Hoan Ton-That is an Australian entrepreneur. He is the co-founder and chief executive officer of Clearview AI, a United States-based technology company that creates facial recognition software.

<span class="mw-page-title-main">Algorithmic Justice League</span> Digital advocacy non-profit organization

The Algorithmic Justice League (AJL) is a digital advocacy non-profit organization based in Cambridge, Massachusetts. Founded in 2016 by computer scientist Joy Buolamwini, the AJL uses research, artwork, and policy advocacy to increase societal awareness regarding the use of artificial intelligence (AI) in society and the harms and biases that AI can pose to society. The AJL has engaged in a variety of open online seminars, media appearances, and tech advocacy initiatives to communicate information about bias in AI systems and promote industry and government action to mitigate against the creation and deployment of biased AI systems. In 2021, Fast Company named AJL as one of the 10 most innovative AI companies in the world.

Toloka, based in Amsterdam, is a crowdsourcing and generative AI services provider.

References

  1. ↑ BiometricUpdate.com. Russian startup tops UW facial recognition challenge. Dec 17, 2015.
  2. ↑ HighTech FM. В США российский алгоритм распознавания лиц признали самым точным. Ильдар Нигматуллин. 31 мая 2017
  3. ↑ Emotion Challenge Results
  4. ↑ Russia No. 1 In Facial Recognition, According To Official Washington Spycraft Techies. Kenneth Rapoza. Nov 28, 2017. Forbes.
  5. ↑ Wider Pedestrian Challenge official site.
  6. 1 2 Chiel, Ethan (2016-04-29). "This Face Recognition Company Is Causing Havoc in Russia—and Could Come to the U.S. Soon". Fusion. Archived from the original on 2016-07-09. Retrieved 2016-07-05.
  7. 1 2 Frankle, Jonathan (2016-05-23). "How Russia's New Facial Recognition App Could End Anonymity". The Atlantic. Retrieved 2016-07-05.
  8. ↑ Findface.ru. "FindFace.ru - сервис знакомств по фотографии". FindFace. Retrieved 2016-07-05.
  9. ↑ Walker, Shaun (2016-05-17). "Face recognition app taking Russia by storm may bring end to public anonymity". The Guardian. Retrieved 2016-07-05.
  10. ↑ Guarino, Ben (2016-05-18). "Russia's new FindFace app identifies strangers in a crowd with 70 percent accuracy". Washington Post. Retrieved 2016-07-05.
  11. ↑ Megaface FaceScrub Results
  12. ↑ "Picking Out One from a Billion: the Face Recognition System From NTechlab". Intel Tech Innovation. 2016-09-27. Archived from the original on 2019-02-12. Retrieved 2017-02-26.
  13. ↑ Russia’s new FindFace app identifies strangers in a crowd with 70 percent accuracy. Ben Guarino. May 18, 2016. The Washington Post
  14. ↑ 20 молодых и перспективных: герои завтрашнего дня. May 25 2017 RBC.
  15. ↑ "Российский стартап FindFace продаст «Билайну» для фестиваля Alfa Future People услуги по распознаванию лиц посетителей. Andrey Frolov. 29 Jun 2016 VC.RU". Archived from the original on 26 May 2021. Retrieved 19 February 2019.
  16. ↑ Devin Coldewey. Moscow officially turns on facial recognition for its city wide camera network. Techcrunch
  17. ↑ Система распознавания лиц в Альметьевске обнаружила шестерых разыскиваемых. Полина Петрова, "Ъ-Казань".
  18. ↑ «Дочка» «Ростеха» не дала украсть в России кубок чемпионата мира по футболу. CNEWS. 26 Jul 2018
  19. ↑ "Кабаков Александр Владимирович". TAdviser.ru. Retrieved 2022-06-28.
  20. ↑ "Сооснователи NtechLab покинули компанию". CNews.ru (in Russian). Retrieved 2022-11-13.
  21. ↑ "NtechLab — превращая землю в Ад для сограждан". 3 June 2022.
  22. ↑ Cuthbertson, Anthony (2016-04-29). "Porn stars and sex workers targeted with facial recognition app". Newsweek. Retrieved 2016-07-05.
  23. ↑ Rothrock, Kevin (2016-04-22). "Facial Recognition Service Becomes a Weapon Against Russian Porn Actresses". Global Voices Advocacy. Retrieved 2016-07-05.
  24. ↑ Burgett, Gannon (2016-05-18). "FindFace is a new facial recognition app that could end public privacy". Digital Trends. Retrieved 2016-07-05.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.