Shree K. Nayar

Last updated
Shree K. Nayar
Shree K. Nayar.jpg
Born
Nationality American
Alma mater Birla Institute of Technology, Mesra
North Carolina State University, Raleigh
Carnegie Mellon University, Pittsburgh
Known forComputational Cameras
Physics Based Computer Vision
Oren–Nayar Reflectance Model
Bigshot Camera for Education
AwardsDavid Marr Prize
Columbia Great Teacher Award
National Academy of Engineering
American Academy of Arts and Sciences
Scientific career
Fields Computational imaging, computer vision, computer graphics, robotics, human-computer interactions
Institutions Columbia University
Academic advisorsKatsushi Ikeuchi
Takeo Kanade

Shree K. Nayar is an engineer and computer scientist known for his contributions to the fields of computer vision, computational imaging, and computer graphics. He is the T. C. Chang Professor of Computer Science in the School of Engineering at Columbia University. [1] Nayar co-directs the Columbia Vision and Graphics Center and is the head of the Computer Vision Laboratory (CAVE), [2] which develops advanced imaging and computer vision systems. [3] Nayar also served as a director of research at Snap Inc. He was elected member of the US National Academy of Engineering in 2008 and the American Academy of Arts and Sciences in 2011 for his pioneering work on computational cameras and physics based computer vision.

Contents

Education and career

Nayar received a B.E. in electrical engineering from Birla Institute of Technology in Mesra, in 1984, [4] and an M.S. in electrical and computer engineering from North Carolina State University in Raleigh in 1986. [5] He received a Ph.D. in electrical and computer engineering from The Robotics Institute at Carnegie Mellon University in Pittsburgh in 1991.

Nayar worked as a research engineer for Taylor Instruments in New Delhi in 1984. From 1986 to 1990 he was a graduate research assistant at The Robotics Institute at Carnegie Mellon University. In the summer of 1989, he was a visiting researcher at Hitachi Ltd. in Yokohama, Japan. He joined the faculty of the Computer Science Department at Columbia University in 1991, and in 2009 he became chair of the department. Nayar also served as a director of research at Snap Inc.

Research

Nayar's research is in the field of computational imaging [1] and computer vision and focuses on the creation of novel cameras, physics based models for vision and graphics, and algorithms for image understanding. [2] [6] [7] [8] [9] [10] His work is motivated by applications in the fields of machine vision, digital imaging, computer graphics, robotics, and human-computer interactions. Nayar developed the concept of computational cameras [1] and is a leading researcher in the field of computational imaging and computer vision. The field of computational photography is organized according to a taxonomy proposed by him. [11]

Nayar's inventions include cameras that can capture 360 degree, [10] high dynamic range, [9] and three-dimensional images. He demonstrated the concept of a self-powered camera that can produce video using power harvested by the light captured by the camera without requiring an external power source. [12] [13] [14] His method of using assorted pixels for single-shot high dynamic range imaging [15] has been incorporated into image sensors that are currently being used by cameras in smartphones, tablets and other mobile devices.  In 2017, Popular Photography published a profile of Nayar that describes his impact on digital imaging and smartphone cameras. [16]

Nayar developed the Oren–Nayar Reflectance Model in collaboration with Michael Oren in 1994, which is widely used in commercial graphics rendering packages. In 2009, he created the Bigshot Camera, a kid-friendly digital camera designed for experiential learning. [17] [18] [19] Workshops and programs designed around the Bigshot camera have been used to educate middle school students around the world, in particular in underserved communities. As of August 2021, he has published over 300 scientific publications, holds over 80 patents on inventions related to imaging, computer vision and robotics, his publications have been cited close to 60,000 times, and he has an h-index of 129. [20] In March 2021, Nayar made publicly available a lecture series titled First Principles of Computer Vision. [21]

Recognition

Nayar has received several best paper awards for his scientific publications, including the David Marr Prize in 1990 and 1995, and the Helmholtz Prize in 2019. Early in his career, he received the National Young Investigator Award from the National Science Foundation in 1991 and the Packard Fellowship from the David and Lucile Packard Foundation in 1992. For the impact of his research, he has been honored with the NTT Distinguished Scientific Achievement Award from NTT Corporation in 1994, the Appreciation Honor from Sony Corporation in 2014, the 2016 Invention Award [14] from Popular Science magazine, the PAMI Distinguished Award [22] from IEEE in 2019, and the Funai Achievement Award [23] from the Information Processing Society of Japan in 2021. He has been recognized for his talents as a teacher with the Keck Engineering Teaching Excellence Award from the W. M. Keck Foundation in 1995, the Columbia Great Teacher Award [24] from the Society of Columbia Graduates [25] in 2006, and the Distinguished Faculty Teaching Award from the Columbia Engineering Alumni Association in 2015. He received the Alumni Achievement Award from Carnegie Mellon University in 2009 and the Distinguished Alumnus Award from the Birla Institute of Technology, Mesra, in 2021. For his pioneering research contributions and inventions in the fields of computational imaging and computer vision, he was elected to the National Academy of Engineering [26] in 2008, the American Academy of Arts and Sciences in 2011, and the National Academy of Inventors in 2014.

Related Research Articles

<span class="mw-page-title-main">John Hopcroft</span> American computer scientist (born 1939)

John Edward Hopcroft is an American theoretical computer scientist. His textbooks on theory of computation and data structures are regarded as standards in their fields. He is the IBM Professor of Engineering and Applied Mathematics in Computer Science at Cornell University, Co-Director of the Center on Frontiers of Computing Studies at Peking University, and the Director of the John Hopcroft Center for Computer Science at Shanghai Jiao Tong University.

<span class="mw-page-title-main">Computer science and engineering</span> University academic program

Computer science and engineering (CSE) is an academic program at many universities which comprises approaches of computer science and computer engineering. There is no clear division in computing between science and engineering, just like in the field of materials science and engineering. However, some classes are historically more related to computer science, and other to computer engineering. CSE is also a term often used in Europe to translate the name of technical or engineering informatics academic programs. It is offered in both undergraduate as well postgraduate with specializations.

<span class="mw-page-title-main">Computational photography</span> Set of digital image capture and processing techniques

Computational photography refers to digital image capture and processing techniques that use digital computation instead of optical processes. Computational photography can improve the capabilities of a camera, or introduce features that were not possible at all with film-based photography, or reduce the cost or size of camera elements. Examples of computational photography include in-camera computation of digital panoramas, high-dynamic-range images, and light field cameras. Light field cameras use novel optical elements to capture three dimensional scene information which can then be used to produce 3D images, enhanced depth-of-field, and selective de-focusing. Enhanced depth-of-field reduces the need for mechanical focusing systems. All of these features use computational imaging techniques.

<span class="mw-page-title-main">Courant Institute of Mathematical Sciences</span> Division of New York University, US (founded 1935)

The Courant Institute of Mathematical Sciences is the mathematics research school of New York University (NYU). Founded in 1935, it is named after Richard Courant, one of the founders of the Courant Institute and also a mathematics professor at New York University from 1936 to 1972, and serves as a center for research and advanced training in computer science and mathematics. It is located on Gould Plaza next to the Stern School of Business and the economics department of the College of Arts and Science.

<span class="mw-page-title-main">Birla Institute of Technology, Mesra</span> Engineering Institution in Jharkhand, India

Birla Institute of Technology, Mesra is a government funded technical institute (GFTI) situated at Ranchi, Jharkhand, India. It was declared as a deemed university under Section 3 of the UGC Act.

<span class="mw-page-title-main">Marc Levoy</span>

Marc Levoy is a computer graphics researcher and Professor Emeritus of Computer Science and Electrical Engineering at Stanford University, a vice president and Fellow at Adobe Inc., and a Distinguished Engineer at Google. He is noted for pioneering work in volume rendering, light fields, and computational photography.

<span class="mw-page-title-main">Takeo Kanade</span> Japanese computer scientist

Takeo Kanade is a Japanese computer scientist and one of the world's foremost researchers in computer vision. He is U.A. and Helen Whitaker Professor at Carnegie Mellon School of Computer Science. He has approximately 300 peer-reviewed academic publications and holds around 20 patents.

<span class="mw-page-title-main">Mark Horowitz</span> American electrical engineer (1957–)

Mark A. Horowitz is an American electrical engineer, computer scientist, inventor, and entrepreneur who is the Yahoo! Founders Professor in the School of Engineering and the Fortinet Founders Chair of the Department of Electrical Engineering at Stanford University. He holds a joint appointment in the Electrical Engineering and Computer Science departments and previously served as the Chair of the Electrical Engineering department from 2008 to 2012. He is a co-founder, the former chairman, and the former chief scientist of Rambus Inc.. Horowitz has authored over 700 published conference and research papers and is among the most highly-cited computer architects of all time. He is a prolific inventor and holds 374 patents as of 2023.

Ronald Baecker is an Emeritus Professor of Computer Science and Bell Chair in Human-Computer Interaction at the University of Toronto (UofT), and Adjunct Professor of Computer Science at Columbia University. He was the co-founder of the Dynamic Graphics Project (DGP), and the founder of the Knowledge Media Design Institute (KMDI) and the Technologies for Aging Gracefully Lab (TAGlab) at UofT. He was the founder of Canada's research network on collaboration technologies (NECTAR), a founding researcher of AGE-WELL, Canada's Technology and Agine research network, the founder of Springer Nature's Synthesis Lectures on Technology and Health, and the founder of computers-society.org. He also started five software companies between 1976 and 2015. He is currently an ACM Distinguished Speaker.

<span class="mw-page-title-main">Computer graphics (computer science)</span> Sub-field of computer science

Computer graphics is a sub-field of computer science which studies methods for digitally synthesizing and manipulating visual content. Although the term often refers to the study of three-dimensional computer graphics, it also encompasses two-dimensional graphics and image processing.

<span class="mw-page-title-main">Bigshot (digital camera)</span>

Bigshot is a digital camera designed by Shree K. Nayar at Columbia University's Computer Vision Laboratory for experiential learning. The design was conceived in 2006, went into prototype in 2009, had trials in 2011, and was put into production and worldwide distribution in August 2013.

Bir Bhanu is the Marlan and Rosemary Bourns Endowed University of California Presidential Chair in Engineering, the Distinguished Professor of Electrical and Computer Engineering, and Cooperative Professor of Computer Science and Engineering, Mechanical Engineering and Bioengineering, at the Marlan and Rosemary Bourns College of Engineering at the University of California, Riverside (UCR). He is the first Founding Faculty of the Marlan and Rosemary Bourns College of Engineering at UCR and served as the Founding Chair of Electrical Engineering from 1/1991 to 6/1994 and the Founding Director of the Center for Research in Intelligent Systems (CRIS) from 4/1998 to 6/2019. He has been the director of Visualization and Intelligent Systems Laboratory (VISLab) at UCR since 1991. He was the Interim Chair of the Department of Bioengineering at UCR from 7/2014 to 6/2016. Additionally, he has been the Director of the NSF Integrative Graduate Education, Research and Training (IGERT) program in Video Bioinformatics at UC Riverside. Dr. Bhanu has been the principal investigator of various programs for NSF, DARPA, NASA, AFOSR, ONR, ARO and other agencies and industries in the areas of object/target recognition, learning and vision, image/video understanding, image/video databases with applications in security, defense, intelligence, biological and medical imaging and analysis, biometrics, autonomous navigation and industrial machine vision.

<span class="mw-page-title-main">Demetri Terzopoulos</span> American professor of computer science

Demetri Terzopoulos is a Greek-Canadian-American computer scientist and entrepreneur. He is currently a Distinguished Professor and Chancellor's Professor of Computer Science in the Henry Samueli School of Engineering and Applied Science at the University of California, Los Angeles, where he directs the UCLA Computer Graphics & Vision Laboratory.

<span class="mw-page-title-main">Fei-Fei Li</span> Chinese American computer scientist (born 1976)

Fei-Fei Li is a China-born American computer scientist, known for establishing ImageNet, the dataset that enabled rapid advances in computer vision in the 2010s. She is Sequoia Capital professor of computer science at Stanford University and former board director at Twitter. Li is a co-director of the Stanford Institute for Human-Centered Artificial Intelligence and a co-director of the Stanford Vision and Learning Lab. She served as the director of the Stanford Artificial Intelligence Laboratory from 2013 to 2018.

<span class="mw-page-title-main">Dimitris Metaxas</span> American computer scientist

Dimitris Metaxas is a distinguished professor and the chair of the Computer Science Department at Rutgers University, where he directs the Center for Computational Biomedicine Imaging and Modeling (CBIM).

<span class="mw-page-title-main">Subhasis Chaudhuri</span>

Subhasis Chaudhuri is an Indian electrical engineer and the director at the Indian Institute of Technology, Bombay. He is a former K. N. Bajaj Chair Professor of the Department of Electrical Engineering of IIT Bombay. He is known for his pioneering studies on computer vision and is an elected fellow of all the three major Indian science academies viz. the National Academy of Sciences, India, Indian Academy of Sciences, and Indian National Science Academy. He is also a fellow of Institute of Electrical and Electronics Engineers, and the Indian National Academy of Engineering. The Council of Scientific and Industrial Research, the apex agency of the Government of India for scientific research, awarded him the Shanti Swarup Bhatnagar Prize for Science and Technology, one of the highest Indian science awards, in 2004 for his contributions to Engineering Sciences.

<span class="mw-page-title-main">Hanspeter Pfister</span> Swiss computer scientist

Hanspeter Pfister is a Swiss computer scientist. He is the An Wang Professor of Computer Science at the Harvard John A. Paulson School of Engineering and Applied Sciences and an affiliate faculty member of the Center for Brain Science at Harvard University. His research in visual computing lies at the intersection of scientific visualization, information visualization, computer graphics, and computer vision and spans a wide range of topics, including biomedical image analysis and visualization, image and video analysis, and visual analytics in data science.

<span class="mw-page-title-main">Michael F. Cohen</span> American computer scientist

Michael F. Cohen is an American computer scientist and researcher in computer graphics. He is currently a Senior Fellow at Meta in their Generative AI Group. He was a senior research scientist at Microsoft Research for 21 years until he joined Facebook in 2015. In 1998, he received the ACM SIGGRAPH CG Achievement Award for his work in developing radiosity methods for realistic image synthesis. He was elected a Fellow of the Association for Computing Machinery in 2007 for his "contributions to computer graphics and computer vision." In 2019, he received the ACM SIGGRAPH Steven A. Coons Award for Outstanding Creative Contributions to Computer Graphics for “his groundbreaking work in numerous areas of research—radiosity, motion simulation & editing, light field rendering, matting & compositing, and computational photography”.

<span class="mw-page-title-main">Michael Kass</span> American computer scientist

Michael Kass is an American computer scientist best known for his work in computer graphics and computer vision. He has won an Academy Award and the SIGGRAPH Computer Graphics Achievement Award and is an ACM Fellow.

Wolfgang Heidrich is a German-Canadian computer scientist and Professor at the King Abdullah University of Science and Technology (KAUST), for which he served as the director of Visual Computing Center from 2014 to 2021. He was previously a professor at the University of British Columbia (UBC), where he was a Dolby Research Chair (2008-2013). His research has combined methods from computer graphics, optics, machine vision, imaging, inverse methods, and perception to develop new Computational Imaging and Display technologies. His more recent interest focuses on hardware-software co-design of the next generation of imaging systems, with applications such as high dynamic range (HDR) imaging, compact computational cameras, hyper-spectral cameras, wavefront sensors, to name just a few.

References

  1. 1 2 3 "Computational Imaging". graphics.stanford.edu. Stanford University: Broad Area Colloquium. 2001. Retrieved 2021-08-28.
  2. 1 2 "CAVE | Computer Vision Laboratory". www.cs.columbia.edu. Retrieved 2021-08-28.
  3. "Shree K. Nayar | Short Biography". .cs.columbia.edu. Retrieved 2013-04-08.
  4. "Birla Institute of Technology, Mesra". alumni.bitmesra.ac.in. Retrieved 2021-08-28.
  5. "Shree Nayar • Electrical and Computer Engineering". North Carolina State University. Retrieved 2021-08-28.
  6. Anne Eisenberg (29 July 2004). "WHAT'S NEXT; Fleeting Experience, Mirrored in Your Eyes". The New York Times.
  7. Steven Levy (2004-07-11). "MEET THE EYE CAM - Newsweek and The Daily Beast". Newsweek.com. Retrieved 2013-04-08.
  8. Reed, Susan E. (31 January 2002). "In the Labs; Equipment Check: Backpack, Goggles . . ". The New York Times.
  9. 1 2 Eisenberg, Anne (7 September 2000). "WHAT'S NEXT; New Image Technology Can Drive Shadows Away". The New York Times.
  10. 1 2 Deutsch, Claudia H. (3 February 1997). "One Camera That Offers Many Views". The New York Times.
  11. "CAVE | Projects: What is a Computational Camera?". www1.cs.columbia.edu. Retrieved 2021-08-28.
  12. "'Eternal' camera can take pictures forever". BBC News. 2015-04-17. Retrieved 2021-08-28.
  13. "This Camera Is Powered by Light". Discover Magazine. Retrieved 2021-08-28.
  14. 1 2 "A Self-Powered Camera". Popular Science. 2019-03-18. Retrieved 2021-08-28.
  15. "Sony IMX378: Comprehensive Breakdown of the Google Pixel's Sensor and its Features". xda-developers. 2016-10-12. Retrieved 2021-08-28.
  16. "The Camera Man". www.magzter.com. Retrieved 2021-08-28.
  17. "Bigshot: Home - Team". Bigshotcamera.org. Archived from the original on 2012-07-21. Retrieved 2013-04-08.
  18. "BigShot: Snap-together camera introduces kids to tech, and to their world". CSMonitor.com. 2010-01-06. Retrieved 2013-04-08.
  19. "Bigshot Camera: Change Observer". Design Observer. Retrieved 2013-04-08.
  20. "Google Scholar Record of S. Nayar".
  21. "First Principles of Computer Vision - YouTube". www.youtube.com. Retrieved 2021-08-28.
  22. "Shree Nayar Honored for Pioneering Research in Computer Vision". www.cs.columbia.edu. 2019-10-01. Retrieved 2021-08-28.
  23. Japan, Information Processing Society of. "FUNAI Achievement Award-Information Processing Society of Japan". www.ipsj.or.jp. Retrieved 2021-08-28.
  24. "Great Teacher Award - WikiCU, the Columbia University wiki encyclopedia". www.wikicu.com. Retrieved 2021-08-28.
  25. "Society of Columbia Graduates - WikiCU, the Columbia University wiki encyclopedia". www.wikicu.com. Retrieved 2021-08-28.
  26. "Shree K. Nayar | Curriculum Vitae". www.cs.columbia.edu. Retrieved 2021-08-28.