Computational creativity

Last updated
Edmond de Belamy, an artwork generated by a generative adversarial network Edmond de Belamy.png
Edmond de Belamy, an artwork generated by a generative adversarial network

Computational creativity (also known as artificial creativity, mechanical creativity, creative computing or creative computation) is a multidisciplinary endeavour that is located at the intersection of the fields of artificial intelligence, cognitive psychology, philosophy, and the arts (e.g., computational art as part of computational culture).

Contents

The goal of computational creativity is to model, simulate or replicate creativity using a computer, to achieve one of several ends: [1]

The field of computational creativity concerns itself with theoretical and practical issues in the study of creativity. Theoretical work on the nature and proper definition of creativity is performed in parallel with practical work on the implementation of systems that exhibit creativity, with one strand of work informing the other.

The applied form of computational creativity is known as media synthesis.

Theoretical issues

Theoretical approaches concern the essence of creativity. Especially, under what circumstances it is possible to call the model a "creative" if eminent creativity is about rule-breaking or the disavowal of convention. This is a variant of Ada Lovelace's objection to machine intelligence, as recapitulated by modern theorists such as Teresa Amabile. [2] If a machine can do only what it was programmed to do, how can its behavior ever be called creative?

Indeed, not all computer theorists would agree with the premise that computers can only do what they are programmed to do [3] —a key point in favor of computational creativity.

Defining creativity in computational terms

Because no single perspective or definition seems to offer a complete picture of creativity, the AI researchers Newell, Shaw and Simon [4] developed the combination of novelty and usefulness into the cornerstone of a multi-pronged view of creativity, one that uses the following four criteria to categorize a given answer or solution as creative:

  1. The answer is novel and useful (either for the individual or for society)
  2. The answer demands that we reject ideas we had previously accepted
  3. The answer results from intense motivation and persistence
  4. The answer comes from clarifying a problem that was originally vague

Margaret Boden focused on the first two of these criteria, arguing instead that creativity (at least when asking whether computers could be creative) should be defined as "the ability to come up with ideas or artifacts that are new, surprising, and valuable". [5] .

Mihali Csikszentmihalyi argued that creativity had to be considered instead in a social context, and his DIFI (Domain-Individual-Field Interaction) framework has since strongly influenced the field. [6] . In DIFI, an individual produces works whose novelty and value are assessed by the field -- other people in society -- providing feedback and ultimately adding the work, now deemed creative, to the domain of societal works from which an individual might be later influenced.

Whereas the above reflects a top-down approach to computational creativity, an alternative thread has developed among bottom-up computational psychologists involved in artificial neural network research. During the late 1980s and early 1990s, for example, such generative neural systems were driven by genetic algorithms. [7] Experiments involving recurrent nets [8] were successful in hybridizing simple musical melodies and predicting listener expectations.

Machine learning for computational creativity

An image generated by a text-to-image model with the prompt "an astronaut riding a horse, by da Vinci" An astronaut riding a horse (da Vinci) 2022-08-28.png
An image generated by a text-to-image model with the prompt "an astronaut riding a horse, by da Vinci"

While traditional computational approaches to creativity rely on the explicit formulation of prescriptions by developers and a certain degree of randomness in computer programs, machine learning methods allow computer programs to learn on heuristics from input data enabling creative capacities within the computer programs. [9] Especially, deep artificial neural networks allow to learn patterns from input data that allow for the non-linear generation of creative artefacts. Before 1989, artificial neural networks have been used to model certain aspects of creativity. Peter Todd (1989) first trained a neural network to reproduce musical melodies from a training set of musical pieces. Then he used a change algorithm to modify the network's input parameters. The network was able to randomly generate new music in a highly uncontrolled manner. [8] [10] [11] In 1992, Todd [12] extended this work, using the so-called distal teacher approach that had been developed by Paul Munro, [13] Paul Werbos, [14] D. Nguyen and Bernard Widrow, [15] Michael I. Jordan and David Rumelhart. [16] In the new approach there are two neural networks, one of which is supplying training patterns to another. In later efforts by Todd, a composer would select a set of melodies that define the melody space, position them on a 2-d plane with a mouse-based graphic interface, and train a connectionist network to produce those melodies, and listen to the new "interpolated" melodies that the network generates corresponding to intermediate points in the 2-d plane.

Key concepts from the literature

Some high-level and philosophical themes recur throughout the field of computational creativity.[ clarification needed ]

Important categories of creativity

Margaret Boden [17] [18] refers to creativity that is novel merely to the agent that produces it as "P-creativity" (or "psychological creativity"), and refers to creativity that is recognized as novel by society at large as "H-creativity" (or "historical creativity").

Exploratory and transformational creativity

Boden also distinguishes between the creativity that arises from an exploration within an established conceptual space, and the creativity that arises from a deliberate transformation or transcendence of this space. She labels the former as exploratory creativity and the latter as transformational creativity, seeing the latter as a form of creativity far more radical, challenging, and rarer than the former. Following the criteria from Newell and Simon elaborated above, we can see that both forms of creativity should produce results that are appreciably novel and useful (criterion 1), but exploratory creativity is more likely to arise from a thorough and persistent search of a well-understood space (criterion 3) -- while transformational creativity should involve the rejection of some of the constraints that define this space (criterion 2) or some of the assumptions that define the problem itself (criterion 4). Boden's insights have guided work in computational creativity at a very general level, providing more an inspirational touchstone for development work than a technical framework of algorithmic substance. However, Boden's insights are also the subject of formalization, most notably in the work by Geraint Wiggins. [19]

Generation and evaluation

The criterion that creative products should be novel and useful means that creative computational systems are typically structured into two phases, generation and evaluation. In the first phase, novel (to the system itself, thus P-Creative) constructs are generated; unoriginal constructs that are already known to the system are filtered at this stage. This body of potentially creative constructs is then evaluated, to determine which are meaningful and useful and which are not. This two-phase structure conforms to the Geneplore model of Finke, Ward and Smith, [20] which is a psychological model of creative generation based on empirical observation of human creativity.

Co-creation

While much of computational creativity research focuses on independent and automatic machine-based creativity generation, many researchers are inclined towards a collaboration approach. [21] This human-computer interaction is sometimes categorized under the creativity support tools development. These systems aim to provide an ideal framework for research, integration, decision-making, and idea generation. [22] [23] Recently, deep learning approaches to imaging, sound and natural language processing, resulted in the modeling of productive creativity development frameworks. [24] [25]

Innovation

Computational creativity is increasingly being discussed in the innovation and management literature as the recent development in AI may disrupt entire innovation processes and fundamentally change how innovations will be created. [26] [24] Philip Hutchinson [21] highlights the relevance of computational creativity for creating innovation and introduced the concept of “self-innovating artificial intelligence” (SAI) to describe how companies make use of AI in innovation processes to enhance their innovative offerings. SAI is defined as the organizational utilization of AI with the aim of incrementally advancing existing or developing new products, based on insights from continuously combining and analyzing multiple data sources. As AI becomes a general purpose technology, the spectrum of products to be developed with SAI will broaden from simple to increasingly complex. This implies that computational creativity leads to a shift of creativity-related skills for humans.

Combinatorial creativity

A great deal, perhaps all, of human creativity can be understood as a novel combination of pre-existing ideas or objects. [27] Common strategies for combinatorial creativity include:

The combinatorial perspective allows us to model creativity as a search process through the space of possible combinations. The combinations can arise from composition or concatenation of different representations, or through a rule-based or stochastic transformation of initial and intermediate representations. Genetic algorithms and neural networks can be used to generate blended or crossover representations that capture a combination of different inputs.

Conceptual blending

Mark Turner and Gilles Fauconnier [28] [29] propose a model called Conceptual Integration Networks that elaborates upon Arthur Koestler's ideas about creativity [30] as well as work by Lakoff and Johnson, [31] by synthesizing ideas from Cognitive Linguistic research into mental spaces and conceptual metaphors. Their basic model defines an integration network as four connected spaces:

  • A first input space (contains one conceptual structure or mental space)
  • A second input space (to be blended with the first input)
  • A generic space of stock conventions and image-schemas that allow the input spaces to be understood from an integrated perspective
  • A blend space in which a selected projection of elements from both input spaces are combined; inferences arising from this combination also reside here, sometimes leading to emergent structures that conflict with the inputs.

Fauconnier and Turner describe a collection of optimality principles that are claimed to guide the construction of a well-formed integration network. In essence, they see blending as a compression mechanism in which two or more input structures are compressed into a single blend structure. This compression operates on the level of conceptual relations. For example, a series of similarity relations between the input spaces can be compressed into a single identity relationship in the blend.

Some computational success has been achieved with the blending model by extending pre-existing computational models of analogical mapping that are compatible by virtue of their emphasis on connected semantic structures. [32] In 2006, Francisco Câmara Pereira [33] presented an implementation of blending theory that employs ideas both from symbolic AI and genetic algorithms to realize some aspects of blending theory in a practical form; his example domains range from the linguistic to the visual, and the latter most notably includes the creation of mythical monsters by combining 3-D graphical models.

Linguistic creativity

Language provides continuous opportunity for creativity, evident in the generation of novel sentences, phrasings, puns, neologisms, rhymes, allusions, sarcasm, irony, similes, metaphors, analogies, witticisms, and jokes. [34] Native speakers of morphologically rich languages frequently create new word-forms that are easily understood, and some have found their way to the dictionary. [35] The area of natural language generation has been well studied, but these creative aspects of everyday language have yet to be incorporated with any robustness or scale.

Hypothesis of creative patterns

In the seminal work of applied linguist Ronald Carter, he hypothesized two main creativity types involving words and word patterns: pattern-reforming creativity, and pattern-forming creativity. [34] Pattern-reforming creativity refers to creativity by the breaking of rules, reforming and reshaping patterns of language often through individual innovation, while pattern-forming creativity refers to creativity via conformity to language rules rather than breaking them, creating convergence, symmetry and greater mutuality between interlocutors through their interactions in the form of repetitions. [36]

Story generation

Substantial work has been conducted in this area of linguistic creation since the 1970s, with the development of James Meehan's TALE-SPIN [37] system. TALE-SPIN viewed stories as narrative descriptions of a problem-solving effort, and created stories by first establishing a goal for the story's characters so that their search for a solution could be tracked and recorded. The MINSTREL [38] system represents a complex elaboration of this basic approach, distinguishing a range of character-level goals in the story from a range of author-level goals for the story. Systems like Bringsjord's BRUTUS [39] elaborate these ideas further to create stories with complex inter-personal themes like betrayal. Nonetheless, MINSTREL explicitly models the creative process with a set of Transform Recall Adapt Methods (TRAMs) to create novel scenes from old. The MEXICA [40] model of Rafael Pérez y Pérez and Mike Sharples is more explicitly interested in the creative process of storytelling, and implements a version of the engagement-reflection cognitive model of creative writing.

Metaphor and simile

Example of a metaphor: "She was an ape."

Example of a simile: "Felt like a tiger-fur blanket." The computational study of these phenomena has mainly focused on interpretation as a knowledge-based process. Computationalists such as Yorick Wilks, James Martin, [41] Dan Fass, John Barnden, [42] and Mark Lee have developed knowledge-based approaches to the processing of metaphors, either at a linguistic level or a logical level. Tony Veale and Yanfen Hao have developed a system, called Sardonicus, that acquires a comprehensive database of explicit similes from the web; these similes are then tagged as bona-fide (e.g., "as hard as steel") or ironic (e.g., "as hairy as a bowling ball", "as pleasant as a root canal"); similes of either type can be retrieved on demand for any given adjective. They use these similes as the basis of an on-line metaphor generation system called Aristotle [43] that can suggest lexical metaphors for a given descriptive goal (e.g., to describe a supermodel as skinny, the source terms "pencil", "whip", "whippet", "rope", "stick-insect" and "snake" are suggested).

Analogy

The process of analogical reasoning has been studied from both a mapping and a retrieval perspective, the latter being key to the generation of novel analogies. The dominant school of research, as advanced by Dedre Gentner, views analogy as a structure-preserving process; this view has been implemented in the structure mapping engine or SME, [44] the MAC/FAC retrieval engine (Many Are Called, Few Are Chosen), ACME (Analogical Constraint Mapping Engine) and ARCS (Analogical Retrieval Constraint System). Other mapping-based approaches include Sapper, [32] which situates the mapping process in a semantic-network model of memory. Analogy is a very active sub-area of creative computation and creative cognition; active figures in this sub-area include Douglas Hofstadter, Paul Thagard, and Keith Holyoak. Also worthy of note here is Peter Turney and Michael Littman's machine learning approach to the solving of SAT-style analogy problems; their approach achieves a score that compares well with average scores achieved by humans on these tests.

Joke generation

Humour is an especially knowledge-hungry process, and the most successful joke-generation systems to date have focussed on pun-generation, as exemplified by the work of Kim Binsted and Graeme Ritchie. [45] This work includes the JAPE system, which can generate a wide range of puns that are consistently evaluated as novel and humorous by young children. An improved version of JAPE has been developed in the guise of the STANDUP system, which has been experimentally deployed as a means of enhancing linguistic interaction with children with communication disabilities. Some limited progress has been made in generating humour that involves other aspects of natural language, such as the deliberate misunderstanding of pronominal reference (in the work of Hans Wim Tinholt and Anton Nijholt), as well as in the generation of humorous acronyms in the HAHAcronym system [46] of Oliviero Stock and Carlo Strapparava.

Neologism

The blending of multiple word forms is a dominant force for new word creation in language; these new words are commonly called "blends" or "portmanteau words" (after Lewis Carroll). Tony Veale has developed a system called ZeitGeist [47] that harvests neological headwords from Wikipedia and interprets them relative to their local context in Wikipedia and relative to specific word senses in WordNet. ZeitGeist has been extended to generate neologisms of its own; the approach combines elements from an inventory of word parts that are harvested from WordNet, and simultaneously determines likely glosses for these new words (e.g., "food traveller" for "gastronaut" and "time traveller" for "chrononaut"). It then uses Web search to determine which glosses are meaningful and which neologisms have not been used before; this search identifies the subset of generated words that are both novel ("H-creative") and useful.

A corpus linguistic approach to the search and extraction of neologism have also shown to be possible. Using Corpus of Contemporary American English as a reference corpus, Locky Law has performed an extraction of neologism, portmanteaus and slang words using the hapax legomena which appeared in the scripts of American TV drama House M.D. [48]

In terms of linguistic research in neologism, Stefan Th. Gries has performed a quantitative analysis of blend structure in English and found that "the degree of recognizability of the source words and that the similarity of source words to the blend plays a vital role in blend formation." The results were validated through a comparison of intentional blends to speech-error blends. [49]

Poetry

More than iron, more than lead, more than gold I need electricity.
I need it more than I need lamb or pork or lettuce or cucumber.
I need it for my dreams.

Racter, from The Policeman's Beard Is Half Constructed

Like jokes, poems involve a complex interaction of different constraints, and no general-purpose poem generator adequately combines the meaning, phrasing, structure and rhyme aspects of poetry. Nonetheless, Pablo Gervás [50] has developed a noteworthy system called ASPERA that employs a case-based reasoning (CBR) approach to generating poetic formulations of a given input text via a composition of poetic fragments that are retrieved from a case-base of existing poems. Each poem fragment in the ASPERA case-base is annotated with a prose string that expresses the meaning of the fragment, and this prose string is used as the retrieval key for each fragment. Metrical rules are then used to combine these fragments into a well-formed poetic structure. Racter is an example of such a software project.

Musical creativity

Computational creativity in the music domain has focused both on the generation of musical scores for use by human musicians, and on the generation of music for performance by computers. The domain of generation has included classical music (with software that generates music in the style of Mozart and Bach) and jazz. [51] Most notably, David Cope [52] has written a software system called "Experiments in Musical Intelligence" (or "EMI") [53] that is capable of analyzing and generalizing from existing music by a human composer to generate novel musical compositions in the same style. EMI's output is convincing enough to persuade human listeners that its music is human-generated to a high level of competence. [54]

In the field of contemporary classical music, Iamus is the first computer that composes from scratch, and produces final scores that professional interpreters can play. The London Symphony Orchestra played a piece for full orchestra, included in Iamus' debut CD, [55] which New Scientist described as "The first major work composed by a computer and performed by a full orchestra". [56] Melomics, the technology behind Iamus, is able to generate pieces in different styles of music with a similar level of quality.

Creativity research in jazz has focused on the process of improvisation and the cognitive demands that this places on a musical agent: reasoning about time, remembering and conceptualizing what has already been played, and planning ahead for what might be played next. [57] The robot Shimon, developed by Gil Weinberg of Georgia Tech, has demonstrated jazz improvisation. [58] Virtual improvisation software based on researches on stylistic modeling carried out by Gerard Assayag and Shlomo Dubnov include OMax, SoMax and PyOracle, are used to create improvisations in real-time by re-injecting variable length sequences learned on the fly from live performer. [59]

In the field of musical composition, the patented works [60] by René-Louis Baron allowed to make a robot that can create and play a multitude of orchestrated melodies, so-called "coherent" in any musical style. All outdoor physical parameter associated with one or more specific musical parameters, can influence and develop each of these songs (in real-time while listening to the song). The patented invention Medal-Composer raises problems of copyright.

Visual and artistic creativity

Computational creativity in the generation of visual art has had some notable successes in the creation of both abstract art and representational art. A well-known program in this domain is Harold Cohen's AARON, [61] which has been continuously developed and augmented since 1973. Though formulaic, Aaron exhibits a range of outputs, generating black-and-white drawings or colour paintings that incorporate human figures (such as dancers), potted plants, rocks, and other elements of background imagery. These images are of a sufficiently high quality to be displayed in reputable galleries.

Other software artists of note include the NEvAr system (for "Neuro-Evolutionary Art") of Penousal Machado. [62] NEvAr uses a genetic algorithm to derive a mathematical function that is then used to generate a coloured three-dimensional surface. A human user is allowed to select the best pictures after each phase of the genetic algorithm, and these preferences are used to guide successive phases, thereby pushing NEvAr's search into pockets of the search space that are considered most appealing to the user.

The Painting Fool , developed by Simon Colton originated as a system for overpainting digital images of a given scene in a choice of different painting styles, colour palettes and brush types. Given its dependence on an input source image to work with, the earliest iterations of the Painting Fool raised questions about the extent of, or lack of, creativity in a computational art system. Nonetheless, The Painting Fool has been extended to create novel images, much as AARON does, from its own limited imagination. Images in this vein include cityscapes and forests, which are generated by a process of constraint satisfaction from some basic scenarios provided by the user (e.g., these scenarios allow the system to infer that objects closer to the viewing plane should be larger and more color-saturated, while those further away should be less saturated and appear smaller). Artistically, the images now created by the Painting Fool appear on a par with those created by Aaron, though the extensible mechanisms employed by the former (constraint satisfaction, etc.) may well allow it to develop into a more elaborate and sophisticated painter.

The artist Krasi Dimtch (Krasimira Dimtchevska) and the software developer Svillen Ranev have created a computational system combining a rule-based generator of English sentences and a visual composition builder that converts sentences generated by the system into abstract art. [63] The software generates automatically indefinite number of different images using different color, shape and size palettes. The software also allows the user to select the subject of the generated sentences or/and the one or more of the palettes used by the visual composition builder.

An emerging area of computational creativity is that of video games. ANGELINA is a system for creatively developing video games in Java by Michael Cook. One important aspect is Mechanic Miner, a system that can generate short segments of code that act as simple game mechanics. [64] ANGELINA can evaluate these mechanics for usefulness by playing simple unsolvable game levels and testing to see if the new mechanic makes the level solvable. Sometimes Mechanic Miner discovers bugs in the code and exploits these to make new mechanics for the player to solve problems with. [65]

In July 2015, Google released DeepDream – an open source [66] computer vision program, created to detect faces and other patterns in images with the aim of automatically classifying images, which uses a convolutional neural network to find and enhance patterns in images via algorithmic pareidolia, thus creating a dreamlike psychedelic appearance in the deliberately over-processed images. [67] [68] [69]

In August 2015, researchers from Tübingen, Germany created a convolutional neural network that uses neural representations to separate and recombine content and style of arbitrary images which is able to turn images into stylistic imitations of works of art by artists such as a Picasso or Van Gogh in about an hour. Their algorithm is put into use in the website DeepArt that allows users to create unique artistic images by their algorithm. [70] [71] [72] [73]

In early 2016, a global team of researchers explained how a new computational creativity approach known as the Digital Synaptic Neural Substrate (DSNS) could be used to generate original chess puzzles that were not derived from endgame databases. [74] The DSNS is able to combine features of different objects (e.g. chess problems, paintings, music) using stochastic methods in order to derive new feature specifications which can be used to generate objects in any of the original domains. The generated chess puzzles have also been featured on YouTube. [75]

Creativity in problem solving

Creativity is also useful in allowing for unusual solutions in problem solving. In psychology and cognitive science, this research area is called creative problem solving. The Explicit-Implicit Interaction (EII) theory of creativity has been implemented using a CLARION-based computational model that allows for the simulation of incubation and insight in problem solving. [76] The emphasis of this computational creativity project is not on performance per se (as in artificial intelligence projects) but rather on the explanation of the psychological processes leading to human creativity and the reproduction of data collected in psychology experiments. So far, this project has been successful in providing an explanation for incubation effects in simple memory experiments, insight in problem solving, and reproducing the overshadowing effect in problem solving.

Debate about "general" theories of creativity

Some researchers feel that creativity is a complex phenomenon whose study is further complicated by the plasticity of the language we use to describe it. We can describe not just the agent of creativity as "creative" but also the product and the method. Consequently, it could be claimed that it is unrealistic to speak of a general theory of creativity.[ citation needed ] Nonetheless, some generative principles are more general than others, leading some advocates to claim that certain computational approaches are "general theories". Stephen Thaler, for instance, proposes that certain modalities of neural networks are generative enough, and general enough, to manifest a high degree of creative capabilities.[ citation needed ]

Criticism of computational creativity

Traditional computers, as mainly used in the computational creativity application, do not support creativity, as they fundamentally transform a set of discrete, limited domain of input parameters into a set of discrete, limited domain of output parameters using a limited set of computational functions. [ citation needed ] As such, a computer cannot be creative, as everything in the output must have been already present in the input data or the algorithms.[ citation needed ] Related discussions and references to related work are captured in work on philosophical foundations of simulation. [77]

Mathematically, the same set of arguments against creativity has been made by Chaitin. [78] Similar observations come from a Model Theory perspective. All this criticism emphasizes that computational creativity is useful and may look like creativity, but it is not real creativity, as nothing new is created, just transformed in well defined algorithms.

Events

The International Conference on Computational Creativity (ICCC) occurs annually, organized by The Association for Computational Creativity. [79] Events in the series include:

Previously, the community of computational creativity has held a dedicated workshop, the International Joint Workshop on Computational Creativity, every year since 1999. Previous events in this series include:[ citation needed ]

The 1st Conference on Computer Simulation of Musical Creativity will be held

See also

Lists

Related Research Articles

Natural language processing (NLP) is an interdisciplinary subfield of computer science and information retrieval. It is primarily concerned with giving computers the ability to support and manipulate human language. It involves processing natural language datasets, such as text corpora or speech corpora, using either rule-based or probabilistic machine learning approaches. The goal is a computer capable of "understanding" the contents of documents, including the contextual nuances of the language within them. To this end, natural language processing often borrows ideas from theoretical linguistics. The technology can then accurately extract information and insights contained in the documents as well as categorize and organize the documents themselves.

Computer science is the study of the theoretical foundations of information and computation and their implementation and application in computer systems. One well known subject classification system for computer science is the ACM Computing Classification System devised by the Association for Computing Machinery.

Artificial consciousness (AC), also known as machine consciousness (MC), synthetic consciousness or digital consciousness, is the consciousness hypothesized to be possible in artificial intelligence. It is also the corresponding field of study, which draws insights from philosophy of mind, philosophy of artificial intelligence, cognitive science and neuroscience. The same terminology can be used with the term "sentience" instead of "consciousness" when specifically designating phenomenal consciousness.

Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of statistical algorithms that can learn from data and generalize to unseen data, and thus perform tasks without explicit instructions. Recently, artificial neural networks have been able to surpass many previous approaches in performance.

Natural language generation (NLG) is a software process that produces natural language output. A widely-cited survey of NLG methods describes NLG as "the subfield of artificial intelligence and computational linguistics that is concerned with the construction of computer systems than can produce understandable texts in English or other human languages from some underlying non-linguistic representation of information".

Bio-inspired computing, short for biologically inspired computing, is a field of study which seeks to solve computer science problems using models of biology. It relates to connectionism, social behavior, and emergence. Within computer science, bio-inspired computing relates to artificial intelligence and machine learning. Bio-inspired computing is a major subset of natural computation.

In cognitive linguistics, conceptual blending, also called conceptual integration or view application, is a theory of cognition developed by Gilles Fauconnier and Mark Turner. According to this theory, elements and vital relations from diverse scenarios are "blended" in a subconscious process, which is assumed to be ubiquitous to everyday thought and language. Much like memetics, it is an attempt to create a unitary account of the cultural transmission of ideas.

The expression computational intelligence (CI) usually refers to the ability of a computer to learn a specific task from data or experimental observation. Even though it is commonly considered a synonym of soft computing, there is still no commonly accepted definition of computational intelligence.

A cognitive architecture refers to both a theory about the structure of the human mind and to a computational instantiation of such a theory used in the fields of artificial intelligence (AI) and computational cognitive science. The formalized models can be used to further refine a comprehensive theory of cognition and as a useful artificial intelligence program. Successful cognitive architectures include ACT-R and SOAR. The research on cognitive architectures as software instantiation of cognitive theories was initiated by Allen Newell in 1990.

<span class="mw-page-title-main">Neural network (biology)</span> Structure in nervous systems

A neural network, also called a neuronal network, is an interconnected population of neurons. Biological neural networks are studied to understand the organization and functioning of nervous systems.

The following outline is provided as an overview of and topical guide to artificial intelligence:

Computational neurogenetic modeling (CNGM) is concerned with the study and development of dynamic neuronal models for modeling brain functions with respect to genes and dynamic interactions between genes. These include neural network models and their integration with gene network models. This area brings together knowledge from various scientific disciplines, such as computer and information science, neuroscience and cognitive science, genetics and molecular biology, as well as engineering.

<span class="mw-page-title-main">Spiking neural network</span> Artificial neural network that mimics neurons

Spiking neural networks (SNNs) are artificial neural networks (ANN) that more closely mimic natural neural networks. In addition to neuronal and synaptic state, SNNs incorporate the concept of time into their operating model. The idea is that neurons in the SNN do not transmit information at each propagation cycle, but rather transmit information only when a membrane potential—an intrinsic quality of the neuron related to its membrane electrical charge—reaches a specific value, called the threshold. When the membrane potential reaches the threshold, the neuron fires, and generates a signal that travels to other neurons which, in turn, increase or decrease their potentials in response to this signal. A neuron model that fires at the moment of threshold crossing is also called a spiking neuron model.

Hierarchical temporal memory (HTM) is a biologically constrained machine intelligence technology developed by Numenta. Originally described in the 2004 book On Intelligence by Jeff Hawkins with Sandra Blakeslee, HTM is primarily used today for anomaly detection in streaming data. The technology is based on neuroscience and the physiology and interaction of pyramidal neurons in the neocortex of the mammalian brain.

Pop music automation is a field of study among musicians and computer scientists with a goal of producing successful pop music algorithmically. It is often based on the premise that pop music is especially formulaic, unchanging, and easy to compose. The idea of automating pop music composition is related to many ideas in algorithmic music, Artificial Intelligence (AI) and computational creativity.

Natural computing, also called natural computation, is a terminology introduced to encompass three classes of methods: 1) those that take inspiration from nature for the development of novel problem-solving techniques; 2) those that are based on the use of computers to synthesize natural phenomena; and 3) those that employ natural materials to compute. The main fields of research that compose these three branches are artificial neural networks, evolutionary algorithms, swarm intelligence, artificial immune systems, fractal geometry, artificial life, DNA computing, and quantum computing, among others.

<span class="mw-page-title-main">DeepDream</span> Software program

DeepDream is a computer vision program created by Google engineer Alexander Mordvintsev that uses a convolutional neural network to find and enhance patterns in images via algorithmic pareidolia, thus creating a dream-like appearance reminiscent of a psychedelic experience in the deliberately overprocessed images.

This glossary of artificial intelligence is a list of definitions of terms and concepts relevant to the study of artificial intelligence, its sub-disciplines, and related fields. Related glossaries include Glossary of computer science, Glossary of robotics, and Glossary of machine vision.

<span class="mw-page-title-main">Artificial intelligence art</span> Machine application of knowledge of human aesthetic expressions

Artificial intelligence art is any visual artwork created through the use of artificial intelligence (AI) programs such as text-to-image models.

Artificial intelligence and machine learning techniques are used in video games for a wide variety of applications such as non-player character (NPC) control and procedural content generation (PCG). Machine learning is a subset of artificial intelligence that uses historical data to build predictive and analytical models. This is in sharp contrast to traditional methods of artificial intelligence such as search trees and expert systems.

References

  1. Anna Jordanous (10 April 2014). "What is Computational Creativity?" . Retrieved 7 January 2019.
  2. Amabile, Teresa (1983), The social psychology of creativity, New York, NY: Springer-Verlag
  3. Minsky, Marvin (1967), "Why programming is a good medium for expressing poorly understood and sloppily formulated ideas" (PDF), Design and Planning II-Computers in Design and Communication, pp. 120–125[ permanent dead link ]
  4. Newell, Allen, Shaw, J. G., and Simon, Herbert A. (1963), The process of creative thinking, H. E. Gruber, G. Terrell and M. Wertheimer (Eds.), Contemporary Approaches to Creative Thinking, pp 63 – 119. New York: Atherton{{citation}}: CS1 maint: multiple names: authors list (link)
  5. Boden, Margaret (1990), The Creative Mind: Myths and Mechanisms, London: Weidenfeld & Nicolson
  6. Feldman, D.H.; Csikszentmihalyi, Mihali; Gardner, H. (1994), Changing the World: A Framework for the Study of Creativity, Prager
  7. Gibson, P. M. (1991) NEUROGEN, musical composition using genetic algorithms and cooperating neural networks, Second International Conference on Artificial Neural Networks: 309-313.
  8. 1 2 Todd, P.M. (1989). "A connectionist approach to algorithmic composition". Computer Music Journal. 13 (4): 27–43. doi:10.2307/3679551. JSTOR   3679551. S2CID   36726968.
  9. Mateja, Deborah; Heinzl, Armin (December 2021). "Towards Machine Learning as an Enabler of Computational Creativity". IEEE Transactions on Artificial Intelligence. 2 (6): 460–475. doi: 10.1109/TAI.2021.3100456 . ISSN   2691-4581. S2CID   238941032.
  10. Bharucha, J.J.; Todd, P.M. (1989). "Modeling the perception of tonal structure with neural nets". Computer Music Journal. 13 (4): 44–53. doi:10.2307/3679552. JSTOR   3679552. S2CID   19286486.
  11. Todd, P.M., and Loy, D.G. (Eds.) (1991). Music and connectionism. Cambridge, MA: MIT Press.
  12. Todd, P.M. (1992). A connectionist system for exploring melody space. In Proceedings of the 1992 International Computer Music Conference (pp. 65-68). San Francisco: International Computer Music Association.
  13. A dual backpropagation scheme for scalar-reward learning. P Munro - Ninth Annual Conference of the Cognitive Science, 1987
  14. Neural networks for control and system identification. PJ Werbos - Decision and Control, 1989.
  15. The truck backer-upper: An example of self-learning in neural networks. D Nguyen, B Widrow - IJCNN'89, 1989.
  16. Forward models: Supervised learning with a distal teacher. MI Jordan, DE Rumelhart - Cognitive Science, 1992.
  17. Boden, Margaret (1990), The Creative Mind: Myths and Mechanisms, London: Weidenfeld & Nicolson
  18. Boden, Margaret (1999), Computer models of creativity., Handbook of Creativity, pp 351373
  19. Wiggins, Geraint (2006), A Preliminary Framework for Description, Analysis and Comparison of Creative Systems, Journal of Knowledge Based Systems 19(7), pp. 449-458, CiteSeerX   10.1.1.581.5208
  20. Finke, R., Ward, T., and Smith, S. (1992), Creative cognition: Theory, research and applications (PDF), Cambridge: MIT press.{{citation}}: CS1 maint: multiple names: authors list (link)
  21. 1 2 Hutchinson, P. (2020). Reinventing innovation management: the impact of self-innovating artificial intelligence. IEEE Transactions on Engineering Management, 68(2), 628-639.
  22. Wang, Kai; Nickerson, Jeffrey V. (September 2017). "A literature review on individual creativity support systems". Computers in Human Behavior. 74: 139–151. doi: 10.1016/j.chb.2017.04.035 . ISSN   0747-5632. S2CID   38485202.
  23. Gabriel, A.; Monticolo, D.; Camargo, M.; Bourgault, M. (September 2016). "Creativity support systems: A systematic mapping study". Thinking Skills and Creativity. 21: 109–122. doi:10.1016/j.tsc.2016.05.009. ISSN   1871-1871.
  24. 1 2 Cockburn, I. M., Henderson, R., & Stern, S. (2018). The impact of artificial intelligence on innovation: An exploratory analysis. In The economics of artificial intelligence: An agenda (pp. 115-146). University of Chicago Press.
  25. Karimi, Pegah; Maher, Mary Lou; Davis, Nicholas; Grace, Kazjon (2019-06-24). "Deep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System". arXiv: 1906.10188 [cs.HC].
  26. "How Generative AI Can Augment Human Creativity". Harvard Business Review. 2023-06-16. ISSN   0017-8012 . Retrieved 2023-06-20.
  27. Margaret Boden (10 May 2010). "Can computer models help us to understand human creativity?" . Retrieved 7 January 2019.
  28. Fauconnier, Gilles, Turner, Mark (2007), The Way We Think, Basic Books{{citation}}: CS1 maint: multiple names: authors list (link)
  29. Fauconnier, Gilles, Turner, Mark (2007), Conceptual Integration Networks, Cognitive Science, 22(2) pp 133–187{{citation}}: CS1 maint: multiple names: authors list (link)
  30. Koestler, Arthur (1964), {The act of creation}, London: Hutchinson, and New York: Macmillan
  31. Lakoff, George; Johnson, Mark (2008), Metaphors we live by, University of Chicago press
  32. 1 2 Veale, Tony, O'Donoghue, Diarmuid (2007), Computation and Blending, Cognitive Linguistics, 11(3-4), special issue on Conceptual Blending{{citation}}: CS1 maint: multiple names: authors list (link)
  33. Pereira, Francisco Câmara (2006), Creativity and Artificial Intelligence: A Conceptual Blending Approach, Applications of Cognitive Linguistics. Amsterdam: Mouton de Gruyter
  34. 1 2 Carter, Ronald (2004). Language and Creativity: The Art of Common Talk. London: Routledge.
  35. Martin, Katherine Connor (January 30, 2018). "From hangry to mansplain: spend a little 'me time' with the latest OED update". Oxford Dictionaries. Archived from the original on February 8, 2018. Retrieved January 4, 2019.
  36. Anh Vo, Thuc; Carter, Ronald (2010), "What can a corpus tell us about creativity?", The Routledge Handbook of Corpus Linguistics, Routledge, doi:10.4324/9780203856949.ch22, ISBN   9780203856949
  37. Meehan, James (1981), TALE-SPIN, Shank, R. C. and Riesbeck, C. K., (eds.), Inside Computer Understanding: Five Programs plus Miniatures. Hillsdale, NJ: Lawrence Erlbaum Associates
  38. Turner, S.R. (1994), The Creative Process: A Computer Model of Storytelling, Hillsdale, NJ: Lawrence Erlbaum Associates
  39. Bringsjord, S., Ferrucci, D. A. (2000), Artificial Intelligence and Literary Creativity. Inside the Mind of BRUTUS, a Storytelling Machine., Hillsdale NJ: Lawrence Erlbaum Associates{{citation}}: CS1 maint: multiple names: authors list (link)
  40. Pérez y Pérez, Rafael, Sharples, Mike (2001), MEXICA: A computer model of a cognitive account of creative writing (PDF), Journal of Experimental and Theoretical Artificial Intelligence, 13, pp 119-139{{citation}}: CS1 maint: multiple names: authors list (link)
  41. Martin, James (1990), A Computational Model of Metaphor Interpretation, Academic Press
  42. Barnden, John (1992), Belief in Metaphor: Taking Commonsense Psychology Seriously, Computational Intelligence 8, pp 520-552
  43. Veale, Tony, Hao, Yanfen (2007), Comprehending and Generating Apt Metaphors: A Web-driven, Case-based Approach to Figurative Language (PDF), Proceedings of AAAI 2007, the 22nd AAAI Conference on Artificial Intelligence. Vancouver, Canada{{citation}}: CS1 maint: multiple names: authors list (link)
  44. Falkenhainer, Brian, Forbus, Ken and Gentner, Dedre (1989), The structure-mapping engine: Algorithm and examples (PDF), Artificial Intelligence, 20(41) pp 1–63{{citation}}: CS1 maint: multiple names: authors list (link)
  45. Binsted, K., Pain, H., and Ritchie, G. (1997), "Children's evaluation of computer-generated punning riddles", Pragmatics & Cognition, 5 (2): 305–354, doi:10.1075/pc.5.2.06bin {{citation}}: CS1 maint: multiple names: authors list (link)
  46. Stock, Oliviero, Strapparava, Carlo (2003), HAHAcronym: Humorous agents for humorous acronyms (PDF), Humor: International Journal of Humor Research, 16(3) pp 297–314{{citation}}: CS1 maint: multiple names: authors list (link)
  47. Veale, Tony (2006), Tracking the Lexical Zeitgeist with Wikipedia and WordNet, Proceedings of ECAI'2006, the 17th European Conference on Artificial Intelligence
  48. Law, Locky (2019). "Creativity and television drama: a corpus-based multimodal analysis of pattern-reforming creativity in House M.D.". Corpora. 14 (2): 135–171. doi:10.3366/cor.2019.0167. S2CID   201903734.
  49. Gries, Stefan T. (2004-01-21). "Shouldn't it be breakfunch? A quantitative analysis of blend structure in English". Linguistics. 42 (3). doi:10.1515/ling.2004.021. ISSN   0024-3949. S2CID   3762246.
  50. Gervás, Pablo (2001), An expert system for the composition of formal Spanish poetry (PDF), vol. 14, Journal of Knowledge-Based Systems, pp. 181–188
  51. Herremans, Dorien; Chuan, Ching-Hua; Chew, Elaine (2017). "A Functional Taxonomy of Music Generation Systems". ACM Computing Surveys. 50 (5): 1–30. arXiv: 1812.04832 . doi:10.1145/3108242. S2CID   54475410.
  52. Cope, David (2006), Computer Models of Musical Creativity, Cambridge, MA: MIT Press
  53. David Cope (1987), "Experiments in Music Intelligence." In Proceedings of the International Computer Music Conference, San Francisco: Computer Music Assn.
  54. "miller-mccune.com". www.miller-mccune.com. Archived from the original on February 26, 2010.
  55. "Iamus' debut CD" via www.youtube.com.
  56. "Computer composer honours Turing's centenary". New Scientist. 5 July 2012.
  57. Assayag, Gérard; Bloch, George; Cont, Arshia; Dubnov, Shlomo (2010), Interaction with Machine Improvisation, Shlomo Argamon, Kevin Burns, Shlomo Dubnov (Ed.), The structure of Style, Springer, Bibcode:2010tsos.book..219A
  58. "A Robot Named Shimon Wants To Jam With You". NPR.org. 22 December 2009.
  59. Dubnov, Shlomo; Surges, Greg (2014), Delegating Creativity: Use of Musical Algorithms in Machine Listening and Composition, Newton Lee (Ed.), Digital Da Vinci, Springer
  60. (in French) Article de presse: « Génération automatique d'œuvres numériques », article sur l'invention Medal de Béatrice Perret du Cray  », Science et Vie Micro
  61. McCorduck, Pamela (1991), Aaron's Code., W.H. Freeman & Co., Ltd.
  62. Machado, Penousal; Romero, Juan, eds. (2008), The Art of Artificial Evolution: A Handbook on Evolutionary Art and Music, Natural Computing Series, Berlin: Springer Verlag, ISBN   9783540728764
  63. "Methods, systems and software for generating sentences, and visual and audio compositions representing said sentences" Canadian Patent 2704163
  64. "Introducing Mechanic Miner". Games By Angelina. 5 November 2012.
  65. "Why I Think Mechanic Miner Is Cool". Games By Angelina. 16 November 2012.
  66. deepdream on GitHub
  67. Szegedy, Christian; Liu, Wei; Jia, Yangqing; Sermanet, Pierre; Reed, Scott E.; Anguelov, Dragomir; Erhan, Dumitru; Vanhoucke, Vincent; Rabinovich, Andrew (2015). "Going deeper with convolutions". IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA, June 7–12, 2015. IEEE Computer Society. pp. 1–9. arXiv: 1409.4842 . doi:10.1109/CVPR.2015.7298594.
  68. Mordvintsev, Alexander; Olah, Christopher; Tyka, Mike (2015). "DeepDream - a code example for visualizing Neural Networks". Google Research. Archived from the original on 2015-07-08.
  69. Mordvintsev, Alexander; Olah, Christopher; Tyka, Mike (2015). "Inceptionism: Going Deeper into Neural Networks". Google Research. Archived from the original on 2015-07-03.
  70. McFarland, Matt (31 August 2015). "This algorithm can create a new Van Gogh or Picasso in just an hour". Washington Post. Retrieved 3 September 2015.
  71. Culpan, Daniel (1 September 2015). "This algorithm can create an imitation Van Gogh in 60 minutes". Wired UK. Retrieved 3 September 2015.
  72. "GitXiv - A Neural Algorithm of Artistic Style". gitxiv.com. Retrieved 3 September 2015.
  73. Gatys, Leon A.; Ecker, Alexander S.; Bethge, Matthias (2015). "A Neural Algorithm of Artistic Style". arXiv: 1508.06576 [cs.CV].
  74. Iqbal, Azlan; Guid, Matej; Colton, Simon; Krivec, Jana; Azman, Shazril; Haghighi, Boshra (2016). The Digital Synaptic Neural Substrate: A New Approach to Computational Creativity. SpringerBriefs in Cognitive Computation. Switzerland: Springer. ISBN   978-3-319-28078-3.
  75. "Chesthetica - YouTube". www.youtube.com.
  76. Helie, S.; Sun, R. (2010). "Incubation, insight, and creative problem solving: A unified theory and a connectionist model". Psychological Review. 117 (3): 994–1024. CiteSeerX   10.1.1.405.2245 . doi:10.1037/a0019532. PMID   20658861.
  77. Tolk, Andreas (2013). "Truth, Trust, and Turing – Implications for Modeling and Simulation". Ontology, Epistemology, and Teleology for Modeling and Simulation. Intelligent Systems Reference Library. Vol. 44. pp. 1–26. doi:10.1007/978-3-642-31140-6_1. ISBN   978-3-642-31139-0.
  78. Chaitin, G. J. (1987). Algorithmic information theory. Cambridge Tracts in Theoretical Computer Science, Cambridge University Press.
  79. "Association for Computational Creativity".
  80. "ICCC 2020". Association for Computational Creativity.
  81. "ICCC 2019". Association for Computational Creativity.
  82. CCSMC 2016, WordPress, 2016.

Further reading

Documentaries