Artisto

Last updated
Artisto
Original author(s) Mail.ru Group
Developer(s) Mail.ru Group
Initial release29 July 2016;7 years ago (2016-07-29)
Stable release
1.4 / 19 August 2016;7 years ago (2016-08-19)
Operating system iOS 8.0 or later; [1]
Android 4.2 or later; [2]
Available in English, Russian
Type Video
License Freeware
Website artisto.my.com

Artisto is a video processing application with art and movie effects filters based on neural network algorithms created in 2016 by Mail.ru Group machine learning specialists.

Contents

At the moment the application can process videos up to 10 seconds long [3] and offers users 21 filters, [4] [5] including those based on the works of famous artists (e.g. Blue Dream — Pablo Picasso), theme-based (Rio-2016 — related to the 2016 Summer Olympics in Rio de Janeiro) and others. The app works with both pre-recorded videos and videos recorded with the application.

History

Information on the application first appeared on Mail.ru Group Vice President Anna Artamonova's FB page on July 29, 2016. [6] At the moment of posting there was only an Android version available. According to Anna, the application's first version only took eight days to develop. On July 31, the application was added to the AppStore for free download. [7]

From this moment and continuing into the present, Artisto has been the world's first app that uses neural networks for editing short videos, processing them in the style of famous artworks or any other source image. [8] Prisma (app) application developers promise to deliver similar functionality at any moment. [9]

The application soon won recognition and started to attract the attention of both international brands (e.g. Korean auto manufacturer Kia Motors) and popular singers and musicians. [10]

According to the independent App Annie analysis system, within the first two weeks on the market the application made it onto the TOP download lists in nine countries. [11]

Technology

The idea of transferring styles from works of famous artists to images was first mentioned in September 2015 after the publication of Leon Gatys's article "A Neural Algorithm of Artistic Style", [12] where he described the algorithm in detail. The major shortcoming of this algorithm is its slow performance, which is up to dozens of seconds depending on the algorithm's settings.[ citation needed ]

In March 2016, Russian researcher Dmitry Ulyanov's article was published, where he invented a way to improve the generation of stylized pictures using additional neuron generator network training. [13] With this approach, stylized images can be generated within just dozens of milliseconds. Seventeen days after Ulyanov's article, Justin Johnson published an article containing an identical idea, [14] the only difference being the structure of the generator network.

The Artisto application was developed using these open-source technologies, which Mail.ru Group's machine learning specialists improved for faster video processing and better quality. [15]

Related Research Articles

<span class="mw-page-title-main">Artificial neural network</span> Computational model used in machine learning, based on connected, hierarchical functions

Artificial neural networks are a branch of machine learning models that are built using principles of neuronal organization discovered by connectionism in the biological neural networks constituting animal brains.

Computer art is any art in which computers play a role in production or display of the artwork. Such art can be an image, sound, animation, video, CD-ROM, DVD-ROM, video game, website, algorithm, performance or gallery installation. Many traditional disciplines are now integrating digital technologies and, as a result, the lines between traditional works of art and new media works created using computers has been blurred. For instance, an artist may combine traditional painting with algorithm art and other digital techniques. As a result, defining computer art by its end product can thus be difficult. Computer art is bound to change over time since changes in technology and software directly affect what is possible.

<span class="mw-page-title-main">Outline of artificial intelligence</span> Overview of and topical guide to artificial intelligence

The following outline is provided as an overview of and topical guide to artificial intelligence:

AForge.NET is a computer vision and artificial intelligence library originally developed by Andrew Kirillov for the .NET Framework.

<span class="mw-page-title-main">Deep learning</span> Branch of machine learning

Deep learning is part of a broader family of machine learning methods, which is based on artificial neural networks with representation learning. The adjective "deep" in deep learning refers to the use of multiple layers in the network. Methods used can be either supervised, semi-supervised or unsupervised.

<span class="mw-page-title-main">Convolutional neural network</span> Artificial neural network

Convolutional neural network (CNN) is a regularized type of feed-forward neural network that learns feature engineering by itself via filters optimization. Vanishing gradients and exploding gradients, seen during backpropagation in earlier neural networks, are prevented by using regularized weights over fewer connections. For example, for each neuron in the fully-connected layer 10,000 weights would be required for processing an image sized 100 × 100 pixels. However, applying cascaded convolution kernels, only 25 neurons are required to process 5x5-sized tiles Higher-layer features are extracted from wider context windows, compared to lower-layer features.

<span class="mw-page-title-main">Quantum machine learning</span> Interdisciplinary research area at the intersection of quantum physics and machine learning

Quantum machine learning is the integration of quantum algorithms within machine learning programs.

<span class="mw-page-title-main">DeepDream</span> Software program

DeepDream is a computer vision program created by Google engineer Alexander Mordvintsev that uses a convolutional neural network to find and enhance patterns in images via algorithmic pareidolia, thus creating a dream-like appearance reminiscent of a psychedelic experience in the deliberately overprocessed images.

<span class="mw-page-title-main">Yury Melnichek</span>

Yury Melnichek a Swiss-Belarusian tech-entrepreneur, venture investor and software engineer. Born in Minsk (Belarus), now living in Zurich (Switzerland). Founder of free a cartographic service Maps.me, AIMATTER company. In spring 2018, together with his business partner Andrei Avsievich, founded an investment company Bulba Ventures to invest in Belarusian and ready-to-relocate to Belarus startups. Apart from investment activities Yury provides consulting services in venture investment, mobile applications marketing and also consults IT-companies and startups working with machine learning, computer vision and data science.

<span class="mw-page-title-main">My World@Mail.Ru</span> Social network

My World@Mail.Ru is a social networking service which is a part of Mail.ru portal.

<span class="mw-page-title-main">DeepArt</span> Art creation website

DeepArt or DeepArt.io was a website that allowed users to create artistic images by using an algorithm to redraw one image using the stylistic elements of another image. with "A Neural Algorithm of Artistic Style" a Neural Style Transfer algorithm that was developed by several of its creators to separate style elements from a piece of art. The tool allows users to create imitation works of art using the style of various artists. The neural algorithm is used by the Deep Art website to create a representation of an image provided by the user by using the 'style' of another image provided by the user. A similar program, Prisma, is an iOS and Android app that was based on the open source programming that underlies DeepArt.

<span class="mw-page-title-main">Prisma (app)</span> A photo-editing application

Prisma is a photo-editing mobile application that uses neural networks and artificial intelligence to apply artistic effects to transform images.

Picas is free art photo editing application which uses deep neural network and artificial intelligence to automatically redraw photos to artistic effects.

<span class="mw-page-title-main">Outline of machine learning</span> Overview of and topical guide to machine learning

The following outline is provided as an overview of and topical guide to machine learning. Machine learning is a subfield of soft computing within computer science that evolved from the study of pattern recognition and computational learning theory in artificial intelligence. In 1959, Arthur Samuel defined machine learning as a "field of study that gives computers the ability to learn without being explicitly programmed". Machine learning explores the study and construction of algorithms that can learn from and make predictions on data. Such algorithms operate by building a model from an example training set of input observations in order to make data-driven predictions or decisions expressed as outputs, rather than following strictly static program instructions.

<span class="mw-page-title-main">Neural style transfer</span> Type of software algorithm for image manipulation

Neural style transfer (NST) refers to a class of software algorithms that manipulate digital images, or videos, in order to adopt the appearance or visual style of another image. NST algorithms are characterized by their use of deep neural networks for the sake of image transformation. Common uses for NST are the creation of artificial artwork from photographs, for example by transferring the appearance of famous paintings to user-supplied photographs. Several notable mobile apps use NST techniques for this purpose, including DeepArt and Prisma. This method has been used by artists and designers around the globe to develop new artwork based on existent style(s).

<span class="mw-page-title-main">Deep reinforcement learning</span> Machine learning that combines deep learning and reinforcement learning

Deep reinforcement learning is a subfield of machine learning that combines reinforcement learning (RL) and deep learning. RL considers the problem of a computational agent learning to make decisions by trial and error. Deep RL incorporates deep learning into the solution, allowing agents to make decisions from unstructured input data without manual engineering of the state space. Deep RL algorithms are able to take in very large inputs and decide what actions to perform to optimize an objective. Deep reinforcement learning has been used for a diverse set of applications including but not limited to robotics, video games, natural language processing, computer vision, education, transportation, finance and healthcare.

Synthetic media is a catch-all term for the artificial production, manipulation, and modification of data and media by automated means, especially through the use of artificial intelligence algorithms, such as for the purpose of misleading people or changing an original meaning. Synthetic media as a field has grown rapidly since the creation of generative adversarial networks, primarily through the rise of deepfakes as well as music synthesis, text generation, human image synthesis, speech synthesis, and more. Though experts use the term "synthetic media," individual methods such as deepfakes and text synthesis are sometimes not referred to as such by the media but instead by their respective terminology Significant attention arose towards the field of synthetic media starting in 2017 when Motherboard reported on the emergence of AI altered pornographic videos to insert the faces of famous actresses. Potential hazards of synthetic media include the spread of misinformation, further loss of trust in institutions such as media and government, the mass automation of creative and journalistic jobs and a retreat into AI-generated fantasy worlds. Synthetic media is an applied form of artificial imagination.

Energy-based generative neural networks is a class of generative models, which aim to learn explicit probability distributions of data in the form of energy-based models whose energy functions are parameterized by modern deep neural networks. Its name is due to the fact that this model can be derived from the discriminative neural networks. The parameter of the neural network in this model is trained in a generative manner by Markov chain Monte Carlo(MCMC)-based maximum likelihood estimation. The learning process follows an ''analysis by synthesis'' scheme, where within each learning iteration, the algorithm samples the synthesized examples from the current model by a gradient-based MCMC method, e.g., Langevin dynamics, and then updates the model parameters based on the difference between the training examples and the synthesized ones. This process can be interpreted as an alternating mode seeking and mode shifting process, and also has an adversarial interpretation. The first energy-based generative neural network is the generative ConvNet proposed in 2016 for image patterns, where the neural network is a convolutional neural network. The model has been generalized to various domains to learn distributions of videos, and 3D voxels. They are made more effective in their variants. They have proven useful for data generation, data recovery, data reconstruction.

References

  1. "Artisto – Video Editor with Unique Art Filters and Movie Effects". Itunes.apple.com. 2016-07-31. Retrieved 2016-08-23.
  2. "Artisto Video Editor with Unique Art Filters and Mo..." play.google.com. 2016-07-29. Retrieved 2016-08-23.
  3. "Artisto app is like Prisma for video, turning videos into instant art". mashable.com. 2016-08-06. Retrieved 2016-08-23.
  4. Ivan Mehta (2016-08-10). "Meet Prisma's Competitors In Photos And Video: Alter And Artisto". huffingtonpost.in. Archived from the original on 2016-08-14. Retrieved 2016-08-23.
  5. Uzair Ahmad (2016-08-14). "Give Artistic look like Prisma to your Videos using Artisto Android App". teamandroid.com. Retrieved 2016-08-23.
  6. "Mail.Ru Group разработал аналог Prisma для обработки видео". kommersant.ru. 2016-07-29. Retrieved 2016-08-23.
  7. "Artisto transforms your videos into moving paintings". engadget.com. 2016-08-03. Retrieved 2016-08-23.
  8. Onsa Mustafa (2016-08-10). "Artisto- A Video Editing App Uses Neural Network Similar to Prisma". phoneworld.com.pk. Retrieved 2016-08-23.
  9. Mark Melin (2016-07-27). "Prisma App's Video Editing Feature Coming Soon To Android, iOS". valuewalk.com. Retrieved 2016-08-23.[ permanent dead link ]
  10. "On the steps of Prisma: Mail.Ru Group applies neural network technologies to videos". ewdn.com. 2016-08-04. Retrieved 2016-08-23.
  11. "Artisto – Video Editor with Unique Art Filters and Movie Effects". appannie.com. 2016-07-30. Retrieved 2016-08-23.
  12. Gatys LA, Ecker AS, Bethge M (August 26, 2015). "A Neural Algorithm of Artistic Style". Computer Vision and Pattern Recognition: 16. arXiv: 1508.06576 . Bibcode:2015arXiv150806576G.
  13. Ulyanov D, Lebedev V, Vedaldi A, Lempitsky V (March 10, 2016). "Texture Networks: Feed-forward Synthesis of Textures and Stylized Images". Computer Vision and Pattern Recognition: 10. arXiv: 1603.03417v1 . Bibcode:2016arXiv160303417U.
  14. Ulyanov D, Johnson J, Alahi A, Fei-Fei L (March 27, 2016). "Perceptual Losses for Real-Time Style Transfer and Super-Resolution". Computer Vision and Pattern Recognition. Department of Computer Science, Stanford University: 18. arXiv: 1603.08155 . Bibcode:2016arXiv160308155J.
  15. "Mail.ru launches video-filter app Aristo to compete with Prisma". venturebeat.com. 2016-08-06. Retrieved 2016-08-23.