Samy Bengio

Last updated
Samy Bengio
Born1965 (age 58–59)
Paris, France
NationalityCanadian
Alma mater Université de Montréal
Relatives Yoshua Bengio (brother)
Scientific career
Fields Computer science
Institutions Apple, Google, IDIAP Research Institute, Microcell Labs
Thesis Optimisation d'une règle d'apprentissage pour réseaux de neurones artificiels (Optimization of a learning rule for artificial neural networks)  (1993)
Website bengio.abracadoudou.com

Samy Bengio is a Canadian computer scientist, Senior Director of AI and Machine Learning Research at Apple, [1] and a former long-time scientist at Google [2] known for leading a large group of researchers working in machine learning including adversarial settings. Bengio left Google shortly after the company fired his report, Timnit Gebru, without first notifying him. [3] [4] At the time, Bengio said that he had been "stunned" by what happened to Gebru. [5] He is also among the three authors who developed Torch in 2002, [6] the ancestor of PyTorch, [7] one of today's two largest machine learning frameworks. [8]

Contents

Education

Bengio obtained his Ph.D. in Computer Science in 1993 with a thesis titled Optimization of a Parametric Learning Rule for Neural Networks from the Université de Montréal. Before that, Bengio got an M.Sc. in Computer Science in 1989 with a thesis on Integration of Traditional and Intelligence Tutoring Systems from the same university, together with a B.Sc. in Computer Science in 1986.

Scientific contributions

According to DBLP, Samy Bengio has authored around 250 scientific papers on neural networks, machine learning, deep learning, statistics, computer vision and natural language processing. [9] The most cited [10] of these include some of the early works sparking the 2010s deep learning revolution by showing how to explore the many learned representations obtained through deep learning, [11] one of the first deep learning approaches to image captioning, [12] efforts to understand why deep learning works [13] leading to many follow-up works. [14] He also worked on the first evidence that adversarial examples can exist in the real world, i.e. one can really change a physical object such that a machine learning system would be fooled [15] and one of the first works on zero-shot recognition, i.e., recognizing classes never seen during training. [16]

Professional activities

Bengio worked at the IDIAP Research Institute and the École Polytechnique Fédérale de Lausanne in Switzerland, from 1999 to 2007. [17]

He was General Chair of the Conference on Neural Information Processing Systems (NeurIPS) in 2018 [18] served as program chair of NeurIPS in 2017 [19] and is currently a board member. [20] He was also program chair of ICLR (2015-2016) [21] and sits on its board (2018-2020). [22]

Bengio is also an editor of the Journal of Machine Learning Research . [23]

Personal life

Samy Bengio was born to two Moroccan Jews who emigrated to France and Canada. He is the brother of Turing Award winner Yoshua Bengio. [24] Both of them lived in Morocco for a year during their father's military service there. [24] His father, Carlo Bengio, was a pharmacist who wrote theatre pieces and ran a Sephardic theatrical troupe in Montreal that played Judeo-Arabic pieces. [25] [26] His mother, Célia Moreno, is also an artist who played in one of the major theatre scenes of Morocco that was run by Tayeb Seddiki in the 1970s. [27]

Related Research Articles

<span class="mw-page-title-main">Jürgen Schmidhuber</span> German computer scientist

Jürgen Schmidhuber is a German computer scientist noted for his work in the field of artificial intelligence, specifically artificial neural networks. He is a scientific director of the Dalle Molle Institute for Artificial Intelligence Research in Switzerland. He is also director of the Artificial Intelligence Initiative and professor of the Computer Science program in the Computer, Electrical, and Mathematical Sciences and Engineering (CEMSE) division at the King Abdullah University of Science and Technology (KAUST) in Saudi Arabia.

<span class="mw-page-title-main">Geoffrey Hinton</span> British computer scientist (born 1947)

Geoffrey Everest Hinton is a British-Canadian computer scientist, cognitive scientist, cognitive psychologist, known for his work on artificial neural networks which earned him the title as the "Godfather of AI".

<span class="mw-page-title-main">Conference on Neural Information Processing Systems</span> Machine-learning and computational-neuroscience conference

The Conference and Workshop on Neural Information Processing Systems is a machine learning and computational neuroscience conference held every December. Along with ICLR and ICML, it is one of the three primary conferences of high impact in machine learning and artificial intelligence research.

<span class="mw-page-title-main">Yann LeCun</span> French computer scientist (born 1960)

Yann André LeCun is a French-American computer scientist working primarily in the fields of machine learning, computer vision, mobile robotics and computational neuroscience. He is the Silver Professor of the Courant Institute of Mathematical Sciences at New York University and Vice President, Chief AI Scientist at Meta.

The AAAI Conference on Artificial Intelligence (AAAI) is a leading international academic conference in artificial intelligence held annually. It ranks 4th in terms of H5 Index in Google Scholar's list of top AI publications, after ICLR, NeurIPS, and ICML. It is supported by the Association for the Advancement of Artificial Intelligence. Precise dates vary from year to year, but paper submissions are generally due at the end of August to beginning of September, and the conference is generally held during the following February. The first AAAI was held in 1980 at Stanford University, Stanford California.

<span class="mw-page-title-main">Deep learning</span> Branch of machine learning

Deep learning is a subset of machine learning that focuses on utilizing neural networks to perform tasks such as classification, regression, and representation learning. The field takes inspiration from biological neuroscience and is centered around stacking artificial neurons into layers and "training" them to process data. The adjective "deep" refers to the use of multiple layers in the network. Methods used can be either supervised, semi-supervised or unsupervised.

Google Brain was a deep learning artificial intelligence research team that served as the sole AI branch of Google before being incorporated under the newer umbrella of Google AI, a research division at Google dedicated to artificial intelligence. Formed in 2011, it combined open-ended machine learning research with information systems and large-scale computing resources. It created tools such as TensorFlow, which allow neural networks to be used by the public, and multiple internal AI research projects, and aimed to create research opportunities in machine learning and natural language processing. It was merged into former Google sister company DeepMind to form Google DeepMind in April 2023.

<span class="mw-page-title-main">Yoshua Bengio</span> Canadian computer scientist

Yoshua Bengio is a Canadian computer scientist, most noted for his work on artificial neural networks and deep learning. He is a professor at the Department of Computer Science and Operations Research at the Université de Montréal and scientific director of the Montreal Institute for Learning Algorithms (MILA).

<span class="mw-page-title-main">Ian Goodfellow</span> American computer scientist (born 1987)

Ian J. Goodfellow is an American computer scientist, engineer, and executive, most noted for his work on artificial neural networks and deep learning. He is a research scientist at Google DeepMind, was previously employed as a research scientist at Google Brain and director of machine learning at Apple, and has made several important contributions to the field of deep learning, including the invention of the generative adversarial network (GAN). Goodfellow co-wrote, as the first author, the textbook Deep Learning (2016) and wrote the chapter on deep learning in the authoritative textbook of the field of artificial intelligence, Artificial Intelligence: A Modern Approach.

Yee-Whye Teh is a professor of statistical machine learning in the Department of Statistics, University of Oxford. Prior to 2012 he was a reader at the Gatsby Charitable Foundation computational neuroscience unit at University College London. His work is primarily in machine learning, artificial intelligence, statistics and computer science.

<span class="mw-page-title-main">International Conference on Learning Representations</span> Academic conference in machine learning

The International Conference on Learning Representations (ICLR) is a machine learning conference typically held in late April or early May each year. Along with NeurIPS and ICML, it is one of the three primary conferences of high impact in machine learning and artificial intelligence research.

<span class="mw-page-title-main">Mila (research institute)</span> Research laboratory in Montreal, Canada

Mila - Quebec AI Institute is a research institute in Montreal, Quebec, focusing mainly on machine learning research. Approximately 1000 students and researchers and 100 faculty members, were part of Mila in 2022. Along with Alberta's Amii and Toronto's Vector Institute, Mila is part of the Pan-Canadian Artificial Intelligence Strategy.

Artificial neural networks (ANNs) are models created using machine learning to perform a number of tasks. Their creation was inspired by biological neural circuitry. While some of the computational implementations ANNs relate to earlier discoveries in mathematics, the first implementation of ANNs was by psychologist Frank Rosenblatt, who developed the perceptron. Little research was conducted on ANNs in the 1970s and 1980s, with the AAAI calling this period an "AI winter".

<span class="mw-page-title-main">Joseph Keshet</span> Israeli professor of Computer Science

Joseph (Yossi) Keshet is an Israeli professor in the Electrical and Computer Engineering Faculty of the Technion.

<span class="mw-page-title-main">Black in AI</span> Technology research organization

Black in AI, formally called the Black in AI Workshop, is a technology research organization and affinity group, founded by computer scientists Timnit Gebru and Rediet Abebe in 2017. It started as a conference workshop, later pivoting into an organization. Black in AI increases the presence and inclusion of Black people in the field of artificial intelligence (AI) by creating space for sharing ideas, fostering collaborations, mentorship, and advocacy.

<span class="mw-page-title-main">François Chollet</span> Machine learning researcher

François Chollet is a French software engineer and artificial intelligence researcher currently working at Google. Chollet is the creator of the Keras deep-learning library, released in 2015. His research focuses on computer vision, the application of machine learning to formal reasoning, abstraction, and how to achieve greater generality in artificial intelligence.

Oriol Vinyals is a Spanish machine learning researcher at DeepMind. He is currently technical lead on Gemini, along with Noam Shazeer and Jeff Dean.

Mi Zhang is a computer scientist at Ohio State University, where he is an Associate Professor of Computer Science and Engineering and the director of AIoT and Machine Learning Systems Lab. He is best known for his work in Edge AI, Artificial Intelligence of Things (AIoT), machine learning systems, and mobile health.

Sébastien Bubeck is a French-American computer scientist and mathematician. He is currently Microsoft's Vice President of Applied Research and leads the Machine Learning Foundations group at Microsoft Research Redmond. Bubeck was formerly professor at Princeton University and a researcher at the University of California, Berkeley. He is known for his contributions to online learning, optimization and more recently studying deep neural networks, and in particular transformer models.

AI safety is an interdisciplinary field focused on preventing accidents, misuse, or other harmful consequences arising from artificial intelligence (AI) systems. It encompasses machine ethics and AI alignment, which aim to ensure AI systems are moral and beneficial, as well as monitoring AI systems for risks and enhancing their reliability. The field is particularly concerned with existential risks posed by advanced AI models.

References

  1. ↑ "Apple hires ex-Google AI scientist who resigned after colleagues' firings". Reuters. 2021-05-03. Retrieved 2021-05-21.
  2. ↑ "Another prominent Google scientist is leaving the company amid fallout from fired AI researcher". CNBC. 6 April 2021. Retrieved 2021-04-09.
  3. ↑ Dave, Jeffrey Dastin, Paresh (2020-12-17). "Google staff demand exec step aside after ethicist's firing - document". Reuters. Retrieved 2021-06-11.{{cite news}}: CS1 maint: multiple names: authors list (link)
  4. ↑ Schiffer, Zoe (2021-04-06). "Google AI manager resigns following controversial firings of two top researchers". The Verge. Retrieved 2021-06-11.
  5. ↑ "Samy Bengio". www.facebook.com. Retrieved 2021-06-11.
  6. ↑ Collobert, Ronan; Bengio, Samy; Marithoz, Johnny (2002). Torch: A Modular Machine Learning Software Library. CiteSeerX   10.1.1.8.9850 .
  7. ↑ Yegulalp, Serdar (2017-01-19). "Facebook brings GPU-powered machine learning to Python". InfoWorld. Retrieved 2021-02-23.
  8. ↑ "The State of Machine Learning Frameworks in 2019". The Gradient. 2019-10-10. Retrieved 2021-02-23.
  9. ↑ "dblp: Samy Bengio". dblp.org. Retrieved 2021-02-24.
  10. ↑ "Samy Bengio". scholar.google.com. Retrieved 2021-02-24.
  11. ↑ Erhan, Dumitru; Bengio, Yoshua; Courville, Aaron; Manzagol, Pierre-Antoine; Vincent, Pascal; Bengio, Samy (2010-03-01). "Why Does Unsupervised Pre-training Help Deep Learning?". The Journal of Machine Learning Research. 11: 625–660. ISSN   1532-4435.
  12. ↑ Vinyals, Oriol; Toshev, Alexander; Bengio, Samy; Erhan, Dumitru (June 2015). "Show and tell: A neural image caption generator". 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. pp. 3156–3164. arXiv: 1411.4555 . doi:10.1109/cvpr.2015.7298935. ISBN   978-1-4673-6964-0. S2CID   1169492.
  13. ↑ Zhang, Chiyuan; Bengio, Samy; Hardt, Moritz; Recht, Benjamin; Vinyals, Oriol (March 2021). "Understanding deep learning (still) requires rethinking generalization". Communications of the ACM. 64 (3): 107–115. doi: 10.1145/3446776 . ISSN   0001-0782. S2CID   231991101.
  14. ↑ "Google Scholar". scholar.google.com. Retrieved 2021-02-24.
  15. ↑ Kurakin, Alexey; Goodfellow, Ian J.; Bengio, Samy (2018-07-27), "Adversarial Examples in the Physical World", Artificial Intelligence Safety and Security, Boca Raton, FL: Chapman and Hall/CRC, pp. 99–112, arXiv: 1607.02533 , doi:10.1201/9781351251389-8, ISBN   978-1-351-25138-9, S2CID   1257772 , retrieved 2021-02-24
  16. ↑ Frome, Andrea; Corrado, Greg S.; Shlens, Jonathon; Bengio, Samy; Dean, Jeffrey; Ranzato, Marc'Aurelio; Mikolov, Tomas (2013-12-05). "DeViSE: a deep visual-semantic embedding model". Proceedings of the 26th International Conference on Neural Information Processing Systems - Volume 2. NIPS'13. Lake Tahoe, Nevada: Curran Associates Inc.: 2121–2129.
  17. ↑ "Samy Bengio: de l'IDIAP à Google" (in French). 2008-04-11.{{cite journal}}: Cite journal requires |journal= (help)
  18. ↑ "2018 Organizing Committee". nips.cc. Retrieved 2021-02-23.
  19. ↑ "NIPS 2017 Committees". nips.cc. Retrieved 2021-02-23.
  20. ↑ "Board, Neural Information Processing Systems". nips.cc. Retrieved 2021-02-23.
  21. ↑ "ICLR 2015 -". iclr.cc. Retrieved 2021-02-24.
  22. ↑ "2020 Board". iclr.cc. Retrieved 2021-02-24.
  23. ↑ "Samy Bengio | Simons Institute for the Theory of Computing". simons.berkeley.edu. 17 October 2017. Retrieved 2021-02-23.
  24. 1 2 "Interview: The Bengio Brothers". Eye On AI. 28 March 2019. Retrieved 2021-02-24.
  25. ↑ Levy, Elias (2019-05-08). "À la mémoire de Carlo Bengio". The Canadian Jewish News. Retrieved 2021-02-24.
  26. ↑ Tahiri, Lalla Nouzha (July 2017). Le théâtre juif marocain : une mémoire en exil : remémoration, représentation et transmission (Thèse ou essai doctoral accepté thesis) (in French). Montréal (Québec, Canada): Université du Québec à Montréal.
  27. ↑ "Célia Moréno, une marocaine au Québec". Mazagan24 - Portail d'El Jadida (in French). 2020-11-14. Retrieved 2021-02-24.
This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.