Brain painting

Last updated

Brain painting is a non-invasive P300-based brain-computer interface (BCI) [1] that allows painting without the use of muscular activity. The technology combines electroencephalography, signal processing algorithms and visual stimulation on a monitor to detect where the user focuses his attention, allowing him to voluntarily trigger commands to a painting software. The research project aims at assisting people afflicted with the Locked-in syndrome due to neurological or neuromuscular disease (e.g. amyotrophic lateral sclerosis ALS), who are severely restricted in communication with their environment, and therefore cut off from the possibility of creative expression.

Contents

History

Brain painting was co-developed by Andrea Kübler from the University of Würzburg (Germany) and Adi Hoesle. After development and testing, Brain Painting first appeared in 2010 to general press [2] and to scientific press with a report of evaluation on healthy and locked-in participants [3]

Supported since 2012 by the EU project "BackHome" (FP7-ICT-288566), [4] the BCI has been adapted for independent home use, and installed at locked-in artist's home: Heide Pfützner in 2012 [5] and Jürgen Thiele in 2013. [6] Long-term evaluation by a locked-in end user showed good satisfaction towards the system. [7] After successful crowdfunding support, [8] the artist Heide Pfüztner had an exhibition in summer 2013 in Easdale, Scotland, [9] and from July to December 2014 in Würzburg (Germany) [10]

Related Research Articles

<span class="mw-page-title-main">Locked-in syndrome</span> Condition in which a patient is aware but completely paralysed

Locked-in syndrome (LIS), also known as pseudocoma, is a condition in which a patient is aware but cannot move or communicate verbally due to complete paralysis of nearly all voluntary muscles in the body except for vertical eye movements and blinking. The individual is conscious and sufficiently intact cognitively to be able to communicate with eye movements. Electroencephalography results are normal in locked-in syndrome. Total locked-in syndrome, or completely locked-in state (CLIS), is a version of locked-in syndrome wherein the eyes are paralyzed as well. Fred Plum and Jerome B. Posner coined the term for this disorder in 1966.

<span class="mw-page-title-main">Event-related potential</span> Brain response that is the direct result of a specific sensory, cognitive, or motor event

An event-related potential (ERP) is the measured brain response that is the direct result of a specific sensory, cognitive, or motor event. More formally, it is any stereotyped electrophysiological response to a stimulus. The study of the brain in this way provides a noninvasive means of evaluating brain functioning.

A brain–computer interface (BCI), sometimes called a brain–machine interface (BMI), is a direct communication link between the brain's electrical activity and an external device, most commonly a computer or robotic limb. BCIs are often directed at researching, mapping, assisting, augmenting, or repairing human cognitive or sensory-motor functions. They are often conceptualized as a human–machine interface that skips the intermediary of moving body parts (hands...), although they also raise the possibility of erasing the distinction between brain and machine. BCI implementations range from non-invasive and partially invasive to invasive, based on how physically close electrodes are to brain tissue.

Neurotechnology encompasses any method or electronic device which interfaces with the nervous system to monitor or modulate neural activity.

The sensorimotor rhythm (SMR) is a brain wave. It is an oscillatory idle rhythm of synchronized electric brain activity. It appears in spindles in recordings of EEG, MEG, and ECoG over the sensorimotor cortex. For most individuals, the frequency of the SMR is in the range of 7 to 11 Hz.

<span class="mw-page-title-main">P300 (neuroscience)</span> Event-related potential

The P300 (P3) wave is an event-related potential (ERP) component elicited in the process of decision making. It is considered to be an endogenous potential, as its occurrence links not to the physical attributes of a stimulus, but to a person's reaction to it. More specifically, the P300 is thought to reflect processes involved in stimulus evaluation or categorization.

Neuroergonomics is the application of neuroscience to ergonomics. Traditional ergonomic studies rely predominantly on psychological explanations to address human factors issues such as: work performance, operational safety, and workplace-related risks. Neuroergonomics, in contrast, addresses the biological substrates of ergonomic concerns, with an emphasis on the role of the human nervous system.

In neurology and neuroscience research, steady state visually evoked potentials (SSVEPs) are signals that are natural responses to visual stimulation at specific frequencies. When the retina is excited by a visual stimulus ranging from 3.5 Hz to 75 Hz, the brain generates electrical activity at the same frequency of the visual stimulus.

<span class="mw-page-title-main">Human–computer interaction</span> Academic discipline studying the relationship between computer systems and their users

Human–computer interaction (HCI) is research in the design and the use of computer technology, which focuses on the interfaces between people (users) and computers. HCI researchers observe the ways humans interact with computers and design technologies that allow humans to interact with computers in novel ways. A device that allows interaction between human being and a computer is known as a "Human-computer Interface (HCI)".

Smart hoMes for All (SM4All) is an international scientific research project funded by the European Community. It started on September 1, 2008, and will end on August 31, 2011. The SM4All project aims at studying and developing an innovative middleware platform for inter-working of smart embedded services in immersive and personcentric environments, through the use of composability and semantic techniques, in order to guarantee dynamicity, dependability and scalability, while preserving the privacy and security of the platform and its users. This is applied to the challenging scenario of private/home/building in presence of users with different abilities and needs.

Imagined speech is thinking in the form of sound – "hearing" one's own voice silently to oneself, without the intentional movement of any extremities such as the lips, tongue, or hands. Logically, imagined speech has been possible since the emergence of language, however, the phenomenon is most associated with its investigation through signal processing and detection within electroencephalograph (EEG) data as well as data obtained using alternative non-invasive, brain–computer interface (BCI) devices.

The BCI Research Award is an annual award for innovative research in the field of brain-computer interfaces. It is organized by the BCI Award Foundation. The prize is $3000 for first, $2000 for second, and $1000 for third place. The prizes are provided by g.tec medical engineering, Cortec, Intheon and IEEE Brain.. Christoph Guger and Dean Krusienski are the chairmen of the Foundation.

intendiX is a commercial brain-computer interface (BCI) environment. It is a personal BCI that anyone can use without technical training or outside support at home or in a hospital. Users can control any smart home device such as a television, music player, air conditioner and light. intendiX can control other devices as well, such as mobile robots or games.

<span class="mw-page-title-main">Catherine G. Wolf</span> American psychologist and computer scientist

Catherine Gody Wolf was an American psychologist and expert in human-computer interaction. She was the author of more than 100 research articles and held six patents in the areas of human-computer interaction, artificial intelligence, and collaboration. Wolf was known for her work at IBM's Thomas J. Watson Research Center in Yorktown Heights, NY, where she was a 19-year staff researcher.

BCI2000 is a software suite for brain–computer interface research. It is commonly used for data acquisition, stimulus presentation, and brain monitoring applications. BCI2000 supports a variety of data acquisition systems, brain signals, and study/feedback paradigms. During operation, BCI2000 stores data in a common format, along with all relevant event markers and information about system configuration. BCI2000 also includes several tools for data import/conversion and export facilities into ASCII.

<span class="mw-page-title-main">OpenBCI</span> Open-source brain-computer interface platform

OpenBCI is an open-source brain–computer interface platform, created by Joel Murphy and Conor Russomanno, after a successful Kickstarter campaign in late 2013.

<span class="mw-page-title-main">Muse (headband)</span> Brain activity sensing headband

Muse is a brain activity sensing headband. The device measures brain activity via 4 electroencephalography (EEG) sensors. An accompanying mobile app converts the EEG signal into audio feedback that is fed to the user via headphones. Muse is manufactured by InteraXon, a company based in Toronto, Ontario, Canada that was founded in 2007 by Ariel Garten, Trevor Coleman, Chris Aimone, and Steve Mann originally at 330 Dundas Street West, in Toronto, Ontario, Canada. Development of the Muse product began in 2003, and after several rounds of fundraising, was released to the public in May 2014. In 2018, the company launched Muse 2, which also measures heart rate, breath, and body movement.

<span class="mw-page-title-main">Mind-controlled wheelchair</span>

A mind-controlled wheelchair is a motorized wheelchair controlled by a brain–computer interface. Such a wheelchair could be of great importance to patients with locked-in syndrome (LIS), in which a patient is aware but cannot move or communicate verbally due to complete paralysis of nearly all voluntary muscles in the body except the eyes. Such wheelchairs can also be used in case of muscular dystrophy, a disease that weakens the musculoskeletal system and hampers locomotion.

Conor Russomanno is an American entrepreneur, inventor, and public speaker, specializing in the development of advanced human-computer interfaces. He is the co-founder and CEO of OpenBCI, a company dedicated to open source innovation of brain-computer interface technologies. Russomanno has also served as an adjunct professor at Parsons School of Design and NYU Tisch School of the Arts, and as a Research Affiliate at the MIT Media Lab. In 2018, he was honored on the Forbes 30 Under 30 list in the category of Science. In April 2023, Russomanno delivered a TED Talk that featured a spectacular assistive technology BCI and AR demonstration to help a friend living with severe motor disabilities, Christian Bayerlein, fly a drone over the audience.

<span class="mw-page-title-main">Thorsten O. Zander</span> German scientist (born 1975)

Thorsten O. Zander is a German scientist who introduced the concept of passive brain-computer interface. He co-founded Zander Labs, a German-Dutch company in the field of passive brain computer interface (pBCI) and neuro-adaptive technology (NAT).

References

  1. ↑ Fazel-Rezai, Reza; Allison, Brendan Z.; Guger, Christoph; Sellers, Eric W.; Kleih, Sonja C.; Kübler, Andrea (2012). "P300 brain computer interface: current challenges and emerging trends". Frontiers in Neuroengineering. 5: 14. doi: 10.3389/fneng.2012.00014 . PMC   3398470 . PMID   22822397.
  2. ↑ Isabelle, Bareither (18 November 2010). "Malen mit Gedanken: Hirn an Rechner, bitte mehr Blau!". Der Spiegel.
  3. ↑ Münßinger, Jana I.; Halder, Sebastian; Kleih, Sonja C.; Furdea, Adrian; Raco, Valerio; Hösle, Adi; Kübler, Andrea (2010). "Brain Painting: First Evaluation of a New Brain–Computer Interface Application with ALS-Patients and Healthy Volunteers". Frontiers in Neuroscience. 4: 182. doi: 10.3389/fnins.2010.00182 . PMC   2996245 . PMID   21151375.
  4. ↑ Maria, Sanchez. "BackHome: technological assistance in the transition from hospital to home for patients with severe disabilities". Digital Agenda for Europe, European Commission, Blog.
  5. ↑ Lena, Stallmach (2013-07-17). "Kommunizieren mit Gehirn-Computer-Schnittstellen Wenn Geistesblitze den digitalen Pinsel führen". Neue Zürcher Zeitung.
  6. ↑ GIP-Team (2014-02-21). "Brain Painting: Die Kunst im Kopf". GIP Intensivpflege.
  7. ↑ Holz, Elisa M.; Botrel, Loic; Kübler, Andrea (2013). "Bridging gaps: long-term independent BCI home-use by a locked-in end-user". Proceedings of TOBI Workshop I. pp. 35–36.
  8. ↑ Heide, Pfützner. "Brain on Fire - Mein Hirn Brennt". Startnext.com.
  9. ↑ "Heide Pfuetzner: Exhibition opening - Brain on Fire". Easdale Island Hall. Archived from the original on 2014-08-27.
  10. ↑ Online-Magazin der Universität Würzburg. "Sonntagsfrühstück für die Seele". einBLICK. Archived from the original on 2014-10-06. Retrieved 2014-08-14.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.