Louis B. Rosenberg

Last updated

Louis Barry Rosenberg
Louis Barry Rosenberg (2022).jpg
Rosenberg in 2022
Alma mater Stanford University
UCLA School of Theater, Film and Television
Children Zoe Rosenberg
Scientific career
Fields Artificial intelligence, augmented reality, virtual reality, haptic technology
Institutions
Thesis "Virtual fixtures": perceptual overlays enhance operator performance in telepresence tasks  (1994)
Doctoral advisor Larry John Leifer

Louis Barry Rosenberg (born 1969) is an American engineer, researcher, inventor, and entrepreneur. [1] He researches augmented reality, virtual reality, and artificial intelligence. He was the Cotchett Endowed Professor of Educational Technology at the California Polytechnic State University, San Luis Obispo. He founded the Immersion Corporation and Unanimous A.I., and he wrote the screenplay for the 2009 romantic comedy film, Lab Rats.

Contents

As a researcher, Rosenberg is known for developing artificial swarm intelligence to amplify the collective intelligence of networked human groups (2014–2023), [2] [3] [4] for his work developing the haptic computer mouse and GUI (1993–1999) [5] [6] and for his work developing augmented reality at Air Force Research Laboratory (1991–1994). [7] [8] [9]

He is the author of several books including Our Next Reality from Hachette Book Group about the future of AI and immersive media. [10] [11]

Rosenberg has more than 300 patents mostly in the field of haptic technology and virtual and augmented reality. [12] [13]

Early life and family

Rosenberg in 1992 developing early Augmented Reality / Mixed Reality system (US Air Force, Virtual Fixtures project) Louis Barry Rosenberg (AR Research) V2 CLN - 1992.jpg
Rosenberg in 1992 developing early Augmented Reality / Mixed Reality system (US Air Force, Virtual Fixtures project)

Louis Rosenberg was born in 1969. [14] His parents purchased his first computer in 1980 and he began writing programs. He has said, "If I spelled things wrong it would give me a syntax error and let me try again... that's a helpful feature for someone who is dyslexic." [15]

Rosenberg earned a B.S. (1991), M.S. (1993), and Ph.D. (1994) in Mechanical Engineering from Stanford University. [16] His daughter, Zoe Rosenberg, is an animal rights activist. [17]

Career

From 1991 to 1994, Rosenberg was a researcher of virtual and augmented reality at Stanford University, [18] NASA Ames Research Center, [19] and Air Force Research Laboratory (formerly Armstrong Laboratory). [20] [21]

In 1993, Rosenberg founded Immersion Corporation, and later served as its CEO until 2000. [22] [23]

In 1999, Logitech released the first haptic-enabled computer mouse using FEELit technology he developed with other researchers at Immersion Corporation. [24] [25] [26] As CEO, he brought the company public on NASDAQ in 1999 and it remains public today trading as "IMMR" as a part of Russell 2000 component. [27] [28] [29]

In 2002, Rosenberg founded Outland Research, a company that developed augmented reality technology. [13]

In 2005, Rosenberg joined the faculty of California Polytechnic State University, San Luis Obispo (Cal Poly), as an assistant professor. [30] Later, he became the Cotchett Endowed Professor of Educational Technology at Cal Poly. [31] [32] [33]

In 2014, Rosenberg founded Unanimous A.I. on the basis of a novel technology known as Artificial Swarm Intelligence, which is based on the decision-making abilities of biological swarms and is utilized to enhance the collective intelligence of networked human groups. [34] [35] [36]

Rosenberg has been a vocal critic of the potential risks that virtual reality, augmented reality, and artificial intelligence pose to society in recent years. [37] [38] As an author, he has written about these technologies for VentureBeat [39] and Big Think . [13]

Research

In 2014, Rosenberg started research in a relatively new sub-field of AI, now known as, artificial swarm intelligence (swarm AI in short), that aims to amplify the intelligence of human groups using AI algorithms modeled on biological swarms. [8] [40] [41] [42] [43] In 2014, he founded Unanimous A.I., an artificial intelligence company. [2] [44] He has served as the company's CEO since the company was founded. [8]

Rosenberg conducted early research into virtual and augmented reality at NASA's Ames Research Center and at the Air Force Research Laboratory, developing the Virtual Fixtures platform, one of the first prototype augmented reality systems to enable human subjects to interact with mixed reality of real and virtual objects. [22] [26] [45] [46]

From 2018 to 2020, Rosenberg collaborated with researchers at Stanford University School of Medicine on a National Science Foundation funded study conducted on groups of radiologists, which was published in Nature Digital Medicine on "Human–machine partnership with artificial intelligence for chest radiograph diagnosis", related to the symbiosis of human experts and AI deep learning algorithms. [47] [48] [4] [49] With the help of researchers from the Massachusetts Institute of Technology (MIT), he studied applications of Swarm AI in order to create so-called "hive minds" of financial analysts for equity markets. [50] [48]

Rosenberg's research has focused on using AI algorithms modeled on biological swarms to support group decision-making in various fields including forecasting, estimation, and diagnosis. [40] [41] [8]

Writing

Rosenberg studied screenwriting at UCLA School of Theater, Film and Television. [51] In 2009, he wrote the screenplay for the short romantic comedy film Lab Rats directed by Sam Washington. The short won awards at the Moondance International Film Festival and the Ventura Film Festival. [52] He also wrote a feature film screenplay entitled The Manuscript in collaboration with another writer, Joe Rosenbaum, which was sold in 2018 for screen adaptation. [53] [54]

In 2024, Rosenberg co-authored the book Our Next Reality with Alvin Graylin about the future of artificial intelligence and spatial computing (mixed reality). [11] [10] Per Dava Newman, "the book describes a picture of convergent paths with symbiotic AI where human agency can be retained". [10] The book's foreword was written by Neal Stephenson, the science fiction author of the book Snow Crash and the term Metaverse. [55] :45

Selected publications

Virtual Fixtures (Medical Concept 1991) Virtual Fixtures (Medical Concept 1991) XR2020.jpg
Virtual Fixtures (Medical Concept 1991)

Related Research Articles

<span class="mw-page-title-main">Virtual reality</span> Computer-simulated experience

Virtual reality (VR) is a simulated experience that employs pose tracking and 3D near-eye displays to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment, education and business. Other distinct types of VR-style technology include augmented reality and mixed reality, sometimes referred to as extended reality or XR, although definitions are currently changing due to the nascence of the industry.

<span class="mw-page-title-main">Augmented reality</span> View of the real world with computer-generated supplementary features

Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. AR can be defined as a system that incorporates three basic features: a combination of real and virtual worlds, real-time interaction, and accurate 3D registration of virtual and real objects. The overlaid sensory information can be constructive, or destructive. This experience is seamlessly interwoven with the physical world such that it is perceived as an immersive aspect of the real environment. In this way, augmented reality alters one's ongoing perception of a real-world environment, whereas virtual reality completely replaces the user's real-world environment with a simulated one.

Haptic technology is technology that can create an experience of touch by applying forces, vibrations, or motions to the user. These technologies can be used to create virtual objects in a computer simulation, to control virtual objects, and to enhance remote control of machines and devices (telerobotics). Haptic devices may incorporate tactile sensors that measure forces exerted by the user on the interface. The word haptic, from the Greek: ἁπτικός (haptikos), means "tactile, pertaining to the sense of touch". Simple haptic devices are common in the form of game controllers, joysticks, and steering wheels.

Swarm intelligence (SI) is the collective behavior of decentralized, self-organized systems, natural or artificial. The concept is employed in work on artificial intelligence. The expression was introduced by Gerardo Beni and Jing Wang in 1989, in the context of cellular robotic systems.

<span class="mw-page-title-main">Dario Floreano</span> Swiss-Italian roboticist and engineer

Dario Floreano is a Swiss-Italian roboticist and engineer. He is Director of the Laboratory of Intelligent System (LIS) at the École Polytechnique Fédérale de Lausanne in Switzerland and was the founding director of the Swiss National Centre of Competence in Research (NCCR) Robotics.

<span class="mw-page-title-main">Metaverse</span> Collective three-dimensional virtual shared space

The metaverse is a loosely defined term referring to virtual worlds in which users represented by avatars interact, usually in 3D and usually focused on social and economic connection.

<i>Rainbows End</i> (Vinge novel) 2006 novel by Vernor Vinge

Rainbows End is a 2006 science fiction novel by Vernor Vinge. It was awarded the 2007 Hugo Award for Best Novel. The book is set in San Diego, California, in 2025, in a variation of the fictional world Vinge explored in his 2002 Hugo-winning novella "Fast Times at Fairmont High" and 2004's "Synthetic Serendipity". Vinge has tentative plans for a sequel, picking up some of the loose threads left at the end of the novel. The many technological advances depicted in the novel suggest that the world is undergoing ever-increasing change, following the technological singularity, a recurring subject in Vinge's fiction and nonfiction writing.

<span class="mw-page-title-main">Immersion Corporation</span> American technology company and patent litigator

Immersion Corporation is an Aventura, Florida based developer and licensor of touch feedback technology, also known as haptic technology. Immersion Corporation has been accused of being a patent troll. Founded in 1993 by Louis Rosenberg, it is currently headed by lawyer Francis Jose, who serves as both chief executive officer and general counsel.

<span class="mw-page-title-main">Intelligence amplification</span> Use of information technology to augment human intelligence

Intelligence amplification (IA) refers to the effective use of information technology in augmenting human intelligence. The idea was first proposed in the 1950s and 1960s by cybernetics and early computer pioneers.

A virtual fixture is an overlay of augmented sensory information upon a user's perception of a real environment in order to improve human performance in both direct and remotely manipulated tasks. Developed in the early 1990s by Louis Rosenberg at the U.S. Air Force Research Laboratory (AFRL), Virtual Fixtures was a pioneering platform in virtual reality and augmented reality technologies.

<span class="mw-page-title-main">Immersion (virtual reality)</span> Perception of being physically present in a non-physical world

Immersion into virtual reality (VR) is a perception of being physically present in a non-physical world. The perception is created by surrounding the user of the VR system in images, sound or other stimuli that provide an engrossing total environment.

A projection augmented model is an element sometimes employed in virtual reality systems. It consists of a physical three-dimensional model onto which a computer image is projected to create a realistic looking object. Importantly, the physical model is the same geometric shape as the object that the PA model depicts.

Virtual intelligence (VI) is the term given to artificial intelligence that exists within a virtual world. Many virtual worlds have options for persistent avatars that provide information, training, role-playing, and social interactions.

Affective haptics is the emerging area of research which focuses on the study and design of devices and systems that can elicit, enhance, or influence the emotional state of a human by means of sense of touch. The research field is originated with the Dzmitry Tsetserukou and Alena Neviarouskaya papers on affective haptics and real-time communication system with rich emotional and haptic channels. Driven by the motivation to enhance social interactivity and emotionally immersive experience of users of real-time messaging, virtual, augmented realities, the idea of reinforcing (intensifying) own feelings and reproducing (simulating) the emotions felt by the partner was proposed. Four basic haptic (tactile) channels governing our emotions can be distinguished:

  1. physiological changes
  2. physical stimulation
  3. social touch
  4. emotional haptic design.

Visuo-haptic mixed reality (VHMR) is a branch of mixed reality that has the ability of merging visual and tactile perceptions of both virtual and real objects with a collocated approach. The first known system to overlay augmented haptic perceptions on direct views of the real world is the Virtual Fixtures system developed in 1992 at the US Air Force Research Laboratories. Like any emerging technology, the development of the VHMR systems is accompanied by challenges that, in this case, deal with the efforts to enhance the multi-modal human perception with the user-computer interface and interaction devices at the moment available. Visuo-haptic mixed reality (VHMR) consists of adding to a real scene the ability to see and touch virtual objects. It requires the use of see-through display technology for visually mixing real and virtual objects and haptic devices necessary to provide haptic stimuli to the user while interacting with the virtual objects. A VHMR setup allows the user to perceive visual and kinesthetic stimuli in a co-located manner, i.e., the user can see and touch virtual objects at the same spatial location. This setup overcomes the limits of the traditional one, i.e, display and haptic device, because the visuo-haptic co-location of the user's hand and a virtual tool improve the sensory integration of multimodal cues and makes the interaction more natural. But it also comes with technological challenges in order to improve the naturalness of the perceptual experience.

uSens, Inc. is a Silicon Valley startup founded in 2014 in San Jose, California. The company's core team includes researchers and developers who build interactive and immersive computer-vision tracking solutions. The uSens team has extensive experience in artificial intelligence (AI), computer vision, 3D Human–computer interaction (HCI) technology and augmented reality and virtual reality. uSens has been applying computer vision and AI technologies in AR/VR, Automotive and smartphones. 

<span class="mw-page-title-main">Unanimous A.I.</span> American technology company specializing in artificial swarm intelligence

Unanimous AI is an American technology company provides artificial swarm intelligence (ASI) technology. Unanimous AI provides a "human swarming" platform "swarm.ai" that allows distributed groups of users to collectively predict answers to questions. This process has resulted in successful predictions of major events such as the Kentucky Derby, the Oscars, the Stanley Cup, Presidential Elections, and the World Series.

<span class="mw-page-title-main">VRTO</span> International exhibition and professional conference

Started in 2015 by Keram Malicki-Sanchez as a virtual reality Meetup Group in Toronto, VRTO launched the VRTO Virtual & Augmented Reality World Conference & Expo in June 2016 – an international exhibition and professional conference exploring arts, culture and science through immersive technologies. Its inaugural year – held at the Mattamy Centre – featured keynotes from University of Toronto Professor Steve Mann, Hollywood film director Brett Leonard – director of The Lawnmower Man, Chief Digital Officer Ana Serrano of the Canadian Film Centre and Phil Lelyveld of USC.

<span class="mw-page-title-main">Domenico Prattichizzo</span>

Domenico Prattichizzo is an Italian scientist with a strong and international recognized expertise in the fields of Haptics, Robotics and, Wearable technology. His researches find their main applications in virtual and augmented reality scenarios and in the rehabilitation of people with upper and lower limbs, visual and cognitive impairments.

Meta AI is an artificial intelligence laboratory owned by Meta Platforms Inc. Meta AI develops various forms of artificial intelligence, developing augmented and artificial reality technologies. Meta AI is an academic research laboratory focused on generating knowledge for the AI community. This is in contrast to Facebook's Applied Machine Learning (AML) team, which focuses on practical applications of its products.

References

  1. Burrows, Peter (October 21, 1996). "Trying To Stick It To Microsoft". Bloomberg. Archived from the original on September 19, 2022.
  2. 1 2 Oxenham, Simon (December 15, 2016). "Why bees could be the secret to superhuman intelligence". BBC.
  3. Collins, Terry (May 30, 2016). "AI startup taps human 'swarm' intelligence to predict winners". CNET.
  4. 1 2 Liu, Fan (September 27, 2018). "Artificial swarm intelligence diagnoses pneumonia better than individual computer or doctor". Stanford Daily.
  5. Eisenberg, Anne (February 25, 1999). "What's Next; Snuggling Up to Touchly-Feely Mouse". The New York Times.
  6. Noer, Michael (September 21, 1998). "Desktop fingerprints". Forbes.
  7. Witt, Toni (March 19, 2022). "XR pioneer calls for metaverse regulation". VentureBeat.
  8. 1 2 3 4 J.Ryan, Kevin (June 14, 2018). "This Startup Correctly Predicted the Oscars, World Series, and Super Bowl. Here's What It's Doing Next". Inc.
  9. Robinson, Dan (October 4, 2018). "Meet the tech pioneer behind Unanimous AI – who wants to revolutionise healthcare and betting markets".
  10. 1 2 3 "Our Next Reality". December 6, 2023. Retrieved March 14, 2024.
  11. 1 2 DeVon, Cheyenne (February 8, 2024). "Apple calls its Vision Pro a 'spatial computer'—here's what that means". CNBC. Retrieved March 14, 2024.
  12. "Google Patents". patents.google.com.
  13. 1 2 3 "Louis Rosenberg". Big Think. Retrieved March 26, 2023.
  14. "Louis B. Rosenberg in the U.S., Public Records Index, 1950-1993, Volume 1" . www.ancestry.com. Retrieved November 8, 2022.
  15. Ketchum, Pat (Spring 2007). "Dyslexia To Design: Professor Pioneers New Learning Synergy". Cal Poly Magazine. 11 (1): 24–25. A firm believer in the power of technology to help people learn, he says his career has allowed him to focus on studying human perception, bending the rules, twisting the perspective -and using his personal experiences with dyslexia as a source of insight.
  16. "Louis Rosenberg, PhD 94, MS 93, BS 91 in Mechanical Engineering". Stanford University Alumni.
  17. "Activist". The Tribune. April 27, 2018. pp. A4. Retrieved October 15, 2022.
  18. "VSEL/Telepresence home page". Virtual Space Exploration Lab and related Telepresence projects. March 9, 1994. Retrieved March 26, 2023.
  19. "Force Feedback Joystick | NASA Spinoff". NASA Spinoff. 1997. Retrieved March 26, 2023.
  20. "Louis Rosenberg". IEEE Xplore. Retrieved March 26, 2023.
  21. "Will Augmented Reality Lead the Next Communication Revolution?". BU College of Communication. September 14, 2018. Retrieved March 26, 2023.
  22. 1 2 "Feel Me". Forbes Archives. March 20, 2000.
  23. Baxter, Brian (September 2, 2021). "Immersion Elevates Legal Head to CEO Amid Patent Battles". Bloomberg Law .
  24. "Mousing with Good Vibrations". Wired. August 11, 1990.
  25. Takahashi, Dean (November 20, 1997). "New Mice Let You Shimmy And Shake Across Your Screen". The Wall Street Journal .
  26. 1 2 "Force Feedback Joystick". NASA Spinoff.
  27. "IMMERSION CORP (IMMR) IPO". NASDAQ.com.
  28. "Equity Market Offerings Set For This Week". The New York Times. November 8, 1999 via NYTimes.com.
  29. "Ftse Russell". FTSE Russell.
  30. "Mechanical Engineering Highlights". Cal Poly College of Engineering 2005-2006 Annual Report: 17. 2006. Other new faculty included Bently Endowed Professor Julia Wu and Assistant Professor Lou Rosenberg.
  31. Wilson, Nick (February 18, 2017). "San Luis Obispo firm uses bees as inspiration for predicting outcomes". The Tribune . San Luis Obispo, California. Archived from the original on March 4, 2017. Retrieved October 14, 2022.
  32. Rosenberg, Louis (June 21, 2004). "The Design of a Constructivist Learning Experience that uses GPS Technology". ED-MEDIA Worldwide Conference on Educational Multimedia, Hypermedia and Telecommunications Proceedings: Lugano, Switzerland: 4837–4841. NOTE: At the time of publication, the author Louis Rosenberg, was affiliated with Santa Clara University. Currently, January 2008, he is a faculty member of the Department of Graduate Studies in Education in the College of Education at California Polytechnic State University- San Luis Obispo.
  33. "MEʼs Rosenberg honored as one of SLOʼs "Top 20 under 40"". Engineering Advantage: 16. Spring 2007.
  34. "AI-Human "Hive Mind" Diagnoses Pneumonia - IEEE Spectrum". spectrum.ieee.org.
  35. "Unanimous AI launches Swarm, a platform for 'amplifying' business decision-making with AI, in beta". March 5, 2019.
  36. "How 'artificial swarm intelligence' uses people to make better predictions than experts". TechRepublic. January 22, 2016.
  37. "Tech Pioneer Warns Rise Of AI Will Be As Dangerous As Alien Invasion". UNILAD. May 15, 2022.
  38. "AI Weekly: Is AI alien invasion imminent?". May 19, 2022.
  39. Rosenberg, Louis (February 24, 2023). "The profound danger of conversational AI". VentureBeat. Retrieved March 26, 2023.
  40. 1 2 Gent, Edd (May 13, 2020). "How AI can help us harness our 'collective intelligence'". BBC.
  41. 1 2 Purdy, Mark; Ray Eitel-Porter, Ray; Klymenko, Max (April 23, 2020). "How Swarm Intelligence Blends Global and Local Insight". MIT Sloan Management Review.
  42. "How 'artificial swarm intelligence' uses people to make better predictions than experts". Tech Republic. January 22, 2016.
  43. "Artificial Swarm Intelligence and The Power of the Human Element". Cal Poly Business. November 21, 2019.
  44. Cuthbertson, Anthony (January 25, 2016). "Swarm Intelligence: AI Algorithm Predicts the Future". Newsweek.
  45. Makhataeva, Zhanat; Varol, Huseyin Atakan (June 2020). "Augmented Reality for Robotics: A Review (Section: A Brief History of AR)". Robotics. MDPI. 9 (2): 21. doi: 10.3390/robotics9020021 .
  46. "Will Augmented Reality Lead the Next Communication Revolution?". sites.bu.edu. Center for Mobile Communication Studies. Retrieved October 14, 2022.
  47. Patel, Bhavik N.; Rosenberg, Louis; Willcox, Gregg; Baltaxe, David; Lyons, Mimi; Irvin, Jeremy; Rajpurkar, Pranav; Amrhein, Timothy; Gupta, Rajan; Halabi, Safwan; Langlotz, Curtis; Lo, Edward; Mammarappallil, Joseph; Mariano, A. J.; Riley, Geoffrey; Seekins, Jayne; Shen, Luyao; Zucker, Evan; Lungren, Matthew P. (February 2019). "Human–machine partnership with artificial intelligence for chest radiograph diagnosis". npj Digital Medicine. 2: 111. doi:10.1038/s41746-019-0189-7. PMC   6861262 . PMID   31754637.
  48. 1 2 "SBIR Phase I: MedSwarm, an Artificial Intelligence System for Medical Decision Making". National Science Foundation.
  49. Scudellari, Megan (September 13, 2018). "AI-Human "Hive Mind" Diagnoses Pneumonia A small group of doctors moderated by AI algorithms made a more accurate diagnosis than individual physicians or AI alone". IEEE Spectrum.
  50. "Prepare for the power of the swarm! by Hazel Tang, March 8 2021". Artificial Intelligence in Medicine. March 8, 2021.
  51. Messer, Erin C. (April 9, 2014). "Local publisher Outland Pictures' new graphic novel, 'Monkey Room,' explores the collective unconscious". New Times . Retrieved October 14, 2022.
  52. "Dr. Louis B. Rosenberg Bio". Lifeboat Foundation.
  53. Ritman, Alex (February 15, 2018). "Scott Eastwood Joins Thriller 'Manuscript,' Nick Cassavetes to Direct (Exclusive)". The Hollywood Reporter.
  54. "'Paper Trail' grows with SKE". Variety. October 25, 2011.
  55. Stephenson, Neal (1992). Snow Crash (2003 paperback ed.). New York: Bantam Books. ISBN   9780553898194.