Information engineering

Last updated

Information engineering is the engineering discipline that deals with the generation, distribution, analysis, and use of information, data, and knowledge in systems. [1] [2] [3] [4] [5] The field first became identifiable in the early 21st century.

Contents

Object detection for a stop sign Intersection over Union - object detection bounding boxes.jpg
Object detection for a stop sign

The components of information engineering include more theoretical fields such as machine learning, artificial intelligence, control theory, signal processing, and information theory, and more applied fields such as computer vision, natural language processing, bioinformatics, medical image computing, cheminformatics, autonomous robotics, mobile robotics, and telecommunications. [1] [2] [5] [6] [7] Many of these originate from computer science, as well as other branches of engineering such as computer engineering, electrical engineering, and bioengineering.

An example of clustering in machine learning SLINK-density-data.svg
An example of clustering in machine learning

The field of information engineering is based heavily on mathematics, particularly probability, statistics, calculus, linear algebra, optimization, differential equations, variational calculus, and complex analysis.

Information engineers often[ citation needed ] hold a degree in information engineering or a related area, and are often part of a professional body such as the Institution of Engineering and Technology or Institute of Measurement and Control. [8] [9] [10] They are employed in almost all industries due to the widespread use of information engineering.

History

In the 1980s/1990s term information engineering referred to an area of software engineering which has come to be known as data engineering in the 2010s/2020s. [11]

Elements

Machine learning and statistics

Machine learning is the field that involves the use of statistical and probabilistic methods to let computers "learn" from data without being explicitly programmed. [12] Data science involves the application of machine learning to extract knowledge from data.

Subfields of machine learning include deep learning, supervised learning, unsupervised learning, reinforcement learning, semi-supervised learning, and active learning.

Causal inference is another related component of information engineering.

Control theory

Control theory refers to the control of (continuous) dynamical systems, with the aim being to avoid delays, overshoots, or instability. [13] Information engineers tend to focus more on control theory rather than the physical design of control systems and circuits (which tends to fall under electrical engineering).

Subfields of control theory include classical control, optimal control, and nonlinear control.

Signal processing

Signal processing refers to the generation, analysis and use of signals, which could take many forms such as image, sound, electrical, or biological. [14]

An example of how the 2D Fourier transform can be used to remove unwanted information from an X-ray scan Use of Fourier transformation chest radiography.jpg
An example of how the 2D Fourier transform can be used to remove unwanted information from an X-ray scan

Information theory

Information theory studies the analysis, transmission, and storage of information. Major subfields of information theory include coding and data compression. [15]

Computer vision

Computer vision is the field that deals with getting computers to understand image and video data at a high level. [16]

Natural language processing

Natural language processing deals with getting computers to understand human (natural) languages at a high level. This usually means text, but also often includes speech processing and recognition. [17]

Bioinformatics

Bioinformatics is the field that deals with the analysis, processing, and use of biological data. [18] This usually means topics such as genomics and proteomics, and sometimes also includes medical image computing.

Cheminformatics

Cheminformatics is the field that deals with the analysis, processing, and use of chemical data. [19]

Robotics

Robotics in information engineering focuses mainly on the algorithms and computer programs used to control robots. As such, information engineering tends to focus more on autonomous, mobile, or probabilistic robots. [20] [21] [22] Major subfields studied by information engineers include control, perception, SLAM, and motion planning. [20] [21]

Tools

In the past some areas in information engineering such as signal processing used analog electronics, but nowadays most information engineering is done with digital computers. Many tasks in information engineering can be parallelized, and so nowadays information engineering is carried out using CPUs, GPUs, and AI accelerators. [23] [24] There has also been interest in using quantum computers for some subfields of information engineering such as machine learning and robotics. [25] [26] [27]

See also

Related Research Articles

Computer vision tasks include methods for acquiring, processing, analyzing and understanding digital images, and extraction of high-dimensional data from the real world in order to produce numerical or symbolic information, e.g. in the forms of decisions. Understanding in this context means the transformation of visual images into descriptions of the world that make sense to thought processes and can elicit appropriate action. This image understanding can be seen as the disentangling of symbolic information from image data using models constructed with the aid of geometry, physics, statistics, and learning theory.

<span class="mw-page-title-main">Signal processing</span> Field of electrical engineering

Signal processing is an electrical engineering subfield that focuses on analyzing, modifying and synthesizing signals, such as sound, images, potential fields, seismic signals, altimetry processing, and scientific measurements. Signal processing techniques are used to optimize transmissions, digital storage efficiency, correcting distorted signals, subjective video quality, and to also detect or pinpoint components of interest in a measured signal.

Pattern recognition is the task of assigning a class to an observation based on patterns extracted from data. While similar, pattern recognition (PR) is not to be confused with pattern machines (PM) which may possess (PR) capabilities but their primary function is to distinguish and create emergent pattern. PR has applications in statistical data analysis, signal processing, image analysis, information retrieval, bioinformatics, data compression, computer graphics and machine learning. Pattern recognition has its origins in statistics and engineering; some modern approaches to pattern recognition include the use of machine learning, due to the increased availability of big data and a new abundance of processing power.

Computer science is the study of the theoretical foundations of information and computation and their implementation and application in computer systems. One well known subject classification system for computer science is the ACM Computing Classification System devised by the Association for Computing Machinery.

Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of statistical algorithms that can learn from data and generalize to unseen data, and thus perform tasks without explicit instructions. Recently, generative artificial neural networks have been able to surpass many previous approaches in performance.

Mechatronics engineering, also called mechatronics, is an interdisciplinary branch of engineering that focuses on the integration of mechanical engineering, electrical engineering, electronic engineering and software engineering, and also includes a combination of robotics, computer science, telecommunications, systems, control, and product engineering.

<span class="mw-page-title-main">Theoretical computer science</span> Subfield of computer science and mathematics

Theoretical computer science (TCS) is a subset of general computer science and mathematics that focuses on mathematical aspects of computer science such as the theory of computation, formal language theory, the lambda calculus and type theory.

Cheminformatics refers to the use of physical chemistry theory with computer and information science techniques—so called "in silico" techniques—in application to a range of descriptive and prescriptive problems in the field of chemistry, including in its applications to biology and related molecular fields. Such in silico techniques are used, for example, by pharmaceutical companies and in academic settings to aid and inform the process of drug discovery, for instance in the design of well-defined combinatorial libraries of synthetic compounds, or to assist in structure-based drug design. The methods can also be used in chemical and allied industries, and such fields as environmental science and pharmacology, where chemical processes are involved or studied.

The expression computational intelligence (CI) usually refers to the ability of a computer to learn a specific task from data or experimental observation. Even though it is commonly considered a synonym of soft computing, there is still no commonly accepted definition of computational intelligence.

Unconventional computing is computing by any of a wide range of new or unusual methods. It is also known as alternative computing.

<span class="mw-page-title-main">McGill University School of Computer Science</span>

The School of Computer Science (SOCS) is an academic department in the Faculty of Science at McGill University in Montreal, Quebec, Canada. The school is the second most funded computer science department in Canada. It currently has 34 faculty members, 60 Ph.D. students and 100 Master's students.

Computational informatics is a subfield of informatics that emphasizes issues in the design of computing solutions rather than its underlying infrastructure. Computational informatics can also be interpreted as the use of computational methods in the information sciences.

The following outline is provided as an overview of and topical guide to robotics:

Natural computing, also called natural computation, is a terminology introduced to encompass three classes of methods: 1) those that take inspiration from nature for the development of novel problem-solving techniques; 2) those that are based on the use of computers to synthesize natural phenomena; and 3) those that employ natural materials to compute. The main fields of research that compose these three branches are artificial neural networks, evolutionary algorithms, swarm intelligence, artificial immune systems, fractal geometry, artificial life, DNA computing, and quantum computing, among others.

<span class="mw-page-title-main">Electronic engineering</span> Electronic engineering involved in the design of electronic circuits, devices, and their systems

Electronic engineering is a sub-discipline of electrical engineering that emerged in the early 20th century and is distinguished by the additional use of active components such as semiconductor devices to amplify and control electric current flow. Previously electrical engineering only used passive devices such as mechanical switches, resistors, inductors, and capacitors.

<span class="mw-page-title-main">Marta Kwiatkowska</span> British computer scientist

Marta Zofia Kwiatkowska is a Polish theoretical computer scientist based in the United Kingdom.

This glossary of artificial intelligence is a list of definitions of terms and concepts relevant to the study of artificial intelligence, its sub-disciplines, and related fields. Related glossaries include Glossary of computer science, Glossary of robotics, and Glossary of machine vision.

The following outline is provided as an overview of and topical guide to machine learning:

<span class="mw-page-title-main">TUM School of Computation, Information and Technology</span>

The TUM School of Computation, Information and Technology (CIT) is a school of the Technical University of Munich, established in 2022 by the merger of three former departments. As of 2022, it is structured into the Department of Mathematics, the Department of Computer Engineering, the Department of Computer Science, and the Department of Electrical Engineering.

References

  1. 1 2 "2009 lecture | Past Lectures | BCS/IET Turing lecture | Events | BCS – The Chartered Institute for IT". www.bcs.org. Retrieved 11 October 2018.
  2. 1 2 Brady, Michael (2009). "Information Engineering & its future". Institution of Engineering and Technology, Turing Lecture. Retrieved 4 October 2018.
  3. Roberts, Stephen. "Introduction to Information Engineering" (PDF). Oxford Information Engineering. Retrieved 4 October 2018.
  4. "Department of Information Engineering, CUHK". www.ie.cuhk.edu.hk. Retrieved 3 October 2018.
  5. 1 2 "Information Engineering | Department of Engineering". www.eng.cam.ac.uk. Retrieved 3 October 2018.
  6. "Information Engineering Main/Home Page". www.robots.ox.ac.uk. Retrieved 3 October 2018.
  7. "Information Engineering". warwick.ac.uk. Retrieved 3 October 2018.
  8. "Academic Partners and Affiliates 2017/2018 – The IET". www.theiet.org. Archived from the original on 4 October 2018. Retrieved 3 October 2018.
  9. "Electronic and Information Engineering – Imperial College London". Times Higher Education (THE). Retrieved 3 October 2018.
  10. "Accreditation of the MEng | CUED undergraduate teaching". teaching.eng.cam.ac.uk. Retrieved 3 October 2018.
  11. Black, Nathan (15 January 2020). "What is Data Engineering and Why Is It So Important?". QuantHub. Retrieved 31 July 2022.
  12. Bishop, Christopher (2007). Pattern Recognition and Machine Learning. New York: Springer-Verlag New York Inc. ISBN   978-0387310732.
  13. Nise, Norman (2015). Control Systems Engineering. Wiley. ISBN   978-1118170519.
  14. Lyons, Richard (2010). Understanding Digital Signal Processing. Prentice Hall. ISBN   978-0137027415.
  15. Cover, Thomas (2006). Elements of Information Theory. Wiley-Interscience. ISBN   978-0471241959.
  16. Davies, Emlyn (2017). Computer Vision: Principles, Algorithms, Applications, Learning. Academic Press. ISBN   978-0128092842.
  17. Jurafsky, Daniel (2008). Speech and Language Processing. Prentice Hall. ISBN   978-0131873216.
  18. Lesk, Arthur (2014). Introduction to Bioinformatics. Oxford University Press. ISBN   978-0199651566.
  19. Leach, Andrew (2007). An Introduction to Chemoinformatics. Springer. ISBN   978-1402062902.
  20. 1 2 Siegwart, Roland (2011). Introduction to Autonomous Mobile Robots. MIT Press. ISBN   978-0262015356.
  21. 1 2 Kelly, Alonzo (2013). Mobile Robotics. Cambridge University Press. ISBN   978-1107031159.
  22. Thrun, Sebastian (2005). Probabilistic Robotics. MIT Press. ISBN   978-0262201629.
  23. Barker, Colin. "How the GPU became the heart of AI and machine learning | ZDNet". ZDNet. Retrieved 3 October 2018.
  24. Kobielus, James. "Powering artificial intelligence: The explosion of new AI hardware accelerators". InfoWorld. Retrieved 3 October 2018.
  25. Wittek, Peter (2014). Quantum Machine Learning. Academic Press. ISBN   978-0128100400.
  26. Schuld, Maria (2018). Supervised Learning with Quantum Computers. Springer. ISBN   978-3319964232.
  27. Tandon, Prateek (2017). Quantum Robotics. Morgan & Claypool Publishers. ISBN   978-1627059138.