Hidden layer

Last updated
Example of hidden layers in a MLP. Example of a deep neural network.png
Example of hidden layers in a MLP.

In artificial neural networks, a hidden layer is a layer of artificial neurons that is neither an input layer nor an output layer. The simplest examples appear in multilayer perceptrons (MLP), as illustrated in the diagram. [1]

An MLP without any hidden layer is essentially just a linear model. With hidden layers and activation functions, however, nonlinearity is introduced into the model. [1]

In typical machine learning practice, the weights and biases are initialized, then iteratively updated during training via backpropagation. [1]

References

  1. 1 2 3 Zhang, Aston; Lipton, Zachary; Li, Mu; Smola, Alexander J. (2024). "5.1. Multilayer Perceptrons". Dive into deep learning. Cambridge New York Port Melbourne New Delhi Singapore: Cambridge University Press. ISBN   978-1-009-38943-3.


Hopfield dynamics.gif

This artificial neural network-related article is a stub. You can help Wikipedia by expanding it.

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.