Logistic function

Last updated

A logistic function or logistic curve is a common S-shaped curve (sigmoid curve) with the equation

Contents

where

, the value of the function's midpoint;
, the supremum of the values of the function;
, the logistic growth rate or steepness of the curve. [1]
Standard logistic function where
L
=
1
,
k
=
1
,
x
0
=
0
{\displaystyle L=1,k=1,x_{0}=0} Logistic-curve.svg
Standard logistic function where

For values of in the domain of real numbers from to , the S-curve shown on the right is obtained, with the graph of approaching as approaches and approaching zero as approaches .

The logistic function finds applications in a range of fields, including biology (especially ecology), biomathematics, chemistry, demography, economics, geoscience, mathematical psychology, probability, sociology, political science, linguistics, statistics, and artificial neural networks. A generalization of the logistic function is the hyperbolastic function of type I.

The standard logistic function, where , is sometimes simply called the sigmoid. [2] It is also sometimes called the expit, being the inverse of the logit. [3] [4]

History

Original image of a logistic curve, contrasted with what Verhulst called a "logarithmic curve" (in modern terms, "exponential curve") Courbe logistique, Verhulst, 1845.png
Original image of a logistic curve, contrasted with what Verhulst called a "logarithmic curve" (in modern terms, "exponential curve")

The logistic function was introduced in a series of three papers by Pierre François Verhulst between 1838 and 1847, who devised it as a model of population growth by adjusting the exponential growth model, under the guidance of Adolphe Quetelet. [5] Verhulst first devised the function in the mid 1830s, publishing a brief note in 1838, [1] then presented an expanded analysis and named the function in 1844 (published 1845); [lower-alpha 1] [6] the third paper adjusted the correction term in his model of Belgian population growth. [7]

The initial stage of growth is approximately exponential (geometric); then, as saturation begins, the growth slows to linear (arithmetic), and at maturity, growth stops.

Verhulst did not explain the choice of the term "logistic" (French: logistique), but it is presumably in contrast to the logarithmic curve, [8] [lower-alpha 2] and by analogy with arithmetic and geometric. His growth model is preceded by a discussion of arithmetic growth and geometric growth (whose curve he calls a logarithmic curve, instead of the modern term exponential curve), and thus "logistic growth" is presumably named by analogy, logistic being from Ancient Greek : λογῐστῐκός, romanized: logistikós, a traditional division of Greek mathematics. [lower-alpha 3]

The term is unrelated to the military and management term logistics, which is instead from French : logis "lodgings", though some believe the Greek term also influenced logistics; see Logistics § Origin for details. [ citation needed ]

Mathematical properties

The standard logistic function is the logistic function with parameters , , , which yields

In practice, due to the nature of the exponential function , it is often sufficient to compute the standard logistic function for over a small range of real numbers, such as a range contained in [−6, +6], as it quickly converges very close to its saturation values of 0 and 1.

The logistic function has the symmetry property that

Thus, is an odd function.

The logistic function is an offset and scaled hyperbolic tangent function:

or

This follows from

Derivative

The logistic function and its first 3 derivatives Logistic function derivatives.png
The logistic function and its first 3 derivatives

The standard logistic function has an easily calculated derivative. The derivative is known as the density of the logistic distribution:

Integral

Conversely, its antiderivative can be computed by the substitution , since , so (dropping the constant of integration)

In artificial neural networks, this is known as the softplus function and (with scaling) is a smooth approximation of the ramp function, just as the logistic function (with scaling) is a smooth approximation of the Heaviside step function.

Logistic differential equation

The unique standard logistic function is the solution of the simple first-order non-linear ordinary differential equation

with boundary condition . This equation is the continuous version of the logistic map. Note that the reciprocal logistic function is solution to a simple first-order linear ordinary differential equation. [9]

The qualitative behavior is easily understood in terms of the phase line: the derivative is 0 when the function is 1; and the derivative is positive for between 0 and 1, and negative for above 1 or less than 0 (though negative populations do not generally accord with a physical model). This yields an unstable equilibrium at 0 and a stable equilibrium at 1, and thus for any function value greater than 0 and less than 1, it grows to 1.

The logistic equation is a special case of the Bernoulli differential equation and has the following solution:

Choosing the constant of integration gives the other well known form of the definition of the logistic curve:

More quantitatively, as can be seen from the analytical solution, the logistic curve shows early exponential growth for negative argument, which reaches to linear growth of slope 1/4 for an argument near 0, then approaches 1 with an exponentially decaying gap.

The logistic function is the inverse of the natural logit function

and so converts the logarithm of odds into a probability. The conversion from the log-likelihood ratio of two alternatives also takes the form of a logistic curve.

The differential equation derived above is a special case of a general differential equation that only models the sigmoid function for . In many modeling applications, the more general form [10]

can be desirable. Its solution is the shifted and scaled sigmoid .

The hyperbolic-tangent relationship leads to another form for the logistic function's derivative:

which ties the logistic function into the logistic distribution.

Rotational symmetry about (0, 1/2)

The sum of the logistic function and its reflection about the vertical axis, , is

The logistic function is thus rotationally symmetrical about the point (0, 1/2). [11]

Applications

Link [12] created an extension of Wald's theory of sequential analysis to a distribution-free accumulation of random variables until either a positive or negative bound is first equaled or exceeded. Link [13] derives the probability of first equaling or exceeding the positive boundary as , the logistic function. This is the first proof that the logistic function may have a stochastic process as its basis. Link [14] provides a century of examples of "logistic" experimental results and a newly derived relation between this probability and the time of absorption at the boundaries.

In ecology: modeling population growth

Pierre-Francois Verhulst (1804-1849) Pierre Francois Verhulst.jpg
Pierre-François Verhulst (1804–1849)

A typical application of the logistic equation is a common model of population growth (see also population dynamics), originally due to Pierre-François Verhulst in 1838, where the rate of reproduction is proportional to both the existing population and the amount of available resources, all else being equal. The Verhulst equation was published after Verhulst had read Thomas Malthus' An Essay on the Principle of Population , which describes the Malthusian growth model of simple (unconstrained) exponential growth. Verhulst derived his logistic equation to describe the self-limiting growth of a biological population. The equation was rediscovered in 1911 by A. G. McKendrick for the growth of bacteria in broth and experimentally tested using a technique for nonlinear parameter estimation. [15] The equation is also sometimes called the Verhulst-Pearl equation following its rediscovery in 1920 by Raymond Pearl (1879–1940) and Lowell Reed (1888–1966) of the Johns Hopkins University. [16] Another scientist, Alfred J. Lotka derived the equation again in 1925, calling it the law of population growth.

Letting represent population size ( is often used in ecology instead) and represent time, this model is formalized by the differential equation:

where the constant defines the growth rate and is the carrying capacity.

In the equation, the early, unimpeded growth rate is modeled by the first term . The value of the rate represents the proportional increase of the population in one unit of time. Later, as the population grows, the modulus of the second term (which multiplied out is ) becomes almost as large as the first, as some members of the population interfere with each other by competing for some critical resource, such as food or living space. This antagonistic effect is called the bottleneck, and is modeled by the value of the parameter . The competition diminishes the combined growth rate, until the value of ceases to grow (this is called maturity of the population). The solution to the equation (with being the initial population) is

where

where is the limiting value of , the highest value that the population can reach given infinite time (or come close to reaching in finite time). It is important to stress that the carrying capacity is asymptotically reached independently of the initial value , and also in the case that .

In ecology, species are sometimes referred to as -strategist or -strategist depending upon the selective processes that have shaped their life history strategies. Choosing the variable dimensions so that measures the population in units of carrying capacity, and measures time in units of , gives the dimensionless differential equation

Integral

The antiderivative of the ecological form of the logistic function can be computed by the substitution , since

Time-varying carrying capacity

Since the environmental conditions influence the carrying capacity, as a consequence it can be time-varying, with , leading to the following mathematical model:

A particularly important case is that of carrying capacity that varies periodically with period :

It can be shown [17] that in such a case, independently from the initial value , will tend to a unique periodic solution , whose period is .

A typical value of is one year: In such case may reflect periodical variations of weather conditions.

Another interesting generalization is to consider that the carrying capacity is a function of the population at an earlier time, capturing a delay in the way population modifies its environment. This leads to a logistic delay equation, [18] which has a very rich behavior, with bistability in some parameter range, as well as a monotonic decay to zero, smooth exponential growth, punctuated unlimited growth (i.e., multiple S-shapes), punctuated growth or alternation to a stationary level, oscillatory approach to a stationary level, sustainable oscillations, finite-time singularities as well as finite-time death.

In statistics and machine learning

Logistic functions are used in several roles in statistics. For example, they are the cumulative distribution function of the logistic family of distributions, and they are, a bit simplified, used to model the chance a chess player has to beat their opponent in the Elo rating system. More specific examples now follow.

Logistic regression

Logistic functions are used in logistic regression to model how the probability of an event may be affected by one or more explanatory variables: an example would be to have the model

where is the explanatory variable, and are model parameters to be fitted, and is the standard logistic function.

Logistic regression and other log-linear models are also commonly used in machine learning. A generalisation of the logistic function to multiple inputs is the softmax activation function, used in multinomial logistic regression.

Another application of the logistic function is in the Rasch model, used in item response theory. In particular, the Rasch model forms a basis for maximum likelihood estimation of the locations of objects or persons on a continuum, based on collections of categorical data, for example the abilities of persons on a continuum based on responses that have been categorized as correct and incorrect.

Neural networks

Logistic functions are often used in artificial neural networks to introduce nonlinearity in the model or to clamp signals to within a specified interval. A popular neural net element computes a linear combination of its input signals, and applies a bounded logistic function as the activation function to the result; this model can be seen as a "smoothed" variant of the classical threshold neuron.

A common choice for the activation or "squashing" functions, used to clip large magnitudes to keep the response of the neural network bounded, [19] is

which is a logistic function.

These relationships result in simplified implementations of artificial neural networks with artificial neurons. Practitioners caution that sigmoidal functions which are antisymmetric about the origin (e.g. the hyperbolic tangent) lead to faster convergence when training networks with backpropagation. [20]

The logistic function is itself the derivative of another proposed activation function, the softplus.

In medicine: modeling of growth of tumors

Another application of logistic curve is in medicine, where the logistic differential equation is used to model the growth of tumors. This application can be considered an extension of the above-mentioned use in the framework of ecology (see also the Generalized logistic curve, allowing for more parameters). Denoting with the size of the tumor at time , its dynamics are governed by

which is of the type

where is the proliferation rate of the tumor.

If a chemotherapy is started with a log-kill effect, the equation may be revised to be

where is the therapy-induced death rate. In the idealized case of very long therapy, can be modeled as a periodic function (of period ) or (in case of continuous infusion therapy) as a constant function, and one has that

i.e. if the average therapy-induced death rate is greater than the baseline proliferation rate, then there is the eradication of the disease. Of course, this is an oversimplified model of both the growth and the therapy (e.g. it does not take into account the phenomenon of clonal resistance).

In medicine: modeling of a pandemic

A novel infectious pathogen to which a population has no immunity will generally spread exponentially in the early stages, while the supply of susceptible individuals is plentiful. The SARS-CoV-2 virus that causes COVID-19 exhibited exponential growth early in the course of infection in several countries in early 2020. [21] Factors including a lack of susceptible hosts (through the continued spread of infection until it passes the threshold for herd immunity) or reduction in the accessibility of potential hosts through physical distancing measures, may result in exponential-looking epidemic curves first linearizing (replicating the "logarithmic" to "logistic" transition first noted by Pierre-François Verhulst, as noted above) and then reaching a maximal limit. [22]

A logistic function, or related functions (e.g. the Gompertz function) are usually used in a descriptive or phenomenological manner because they fit well not only to the early exponential rise, but to the eventual levelling off of the pandemic as the population develops a herd immunity. This is in contrast to actual models of pandemics which attempt to formulate a description based on the dynamics of the pandemic (e.g. contact rates, incubation times, social distancing, etc.). Some simple models have been developed, however, which yield a logistic solution. [23] [24] [25]

Modeling early COVID-19 cases

Generalized logistic function (Richards growth curve) in epidemiological modeling Combined GLF.jpg
Generalized logistic function (Richards growth curve) in epidemiological modeling

A generalized logistic function, also called the Richards growth curve, has been applied to model the early phase of the COVID-19 outbreak. [26] The authors fit the generalized logistic function to the cumulative number of infected cases, here referred to as infection trajectory. There are different parameterizations of the generalized logistic function in the literature. One frequently used forms is

where are real numbers, and is a positive real number. The flexibility of the curve is due to the parameter : (i) if then the curve reduces to the logistic function, and (ii) as approaches zero, the curve converges to the Gompertz function. In epidemiological modeling, , , and represent the final epidemic size, infection rate, and lag phase, respectively. See the right panel for an example infection trajectory when is set to .

Extrapolated infection trajectories of 40 countries severely affected by COVID-19 and grand (population) average through May 14th COVID 19 Outbreak.jpg
Extrapolated infection trajectories of 40 countries severely affected by COVID-19 and grand (population) average through May 14th

One of the benefits of using a growth function such as the generalized logistic function in epidemiological modeling is its relatively easy application to the multilevel model framework, where information from different geographic regions can be pooled together.

In chemistry: reaction models

The concentration of reactants and products in autocatalytic reactions follow the logistic function. The degradation of Platinum group metal-free (PGM-free) oxygen reduction reaction (ORR) catalyst in fuel cell cathodes follows the logistic decay function, [27] suggesting an autocatalytic degradation mechanism.

In physics: Fermi–Dirac distribution

The logistic function determines the statistical distribution of fermions over the energy states of a system in thermal equilibrium. In particular, it is the distribution of the probabilities that each possible energy level is occupied by a fermion, according to Fermi–Dirac statistics.

In optics: mirage

The logistic function also finds applications in optics, particularly in modelling phenomena such as mirages. Under certain conditions, such as the presence of a temperature or concentration gradient due to diffusion and balancing with gravity, logistic curve behaviours can emerge. [28] [29]

A mirage, resulting from a temperature gradient that modifies the refractive index related to the density/concentration of the material over distance, can be modelled using a fluid with a refractive index gradient due to the concentration gradient. This mechanism can be equated to a limiting population growth model, where the concentrated region attempts to diffuse into the lower concentration region, while seeking equilibrium with gravity, thus yielding a logistic function curve. [28]

In material science: Phase diagrams

See Diffusion bonding.

In linguistics: language change

In linguistics, the logistic function can be used to model language change: [30] an innovation that is at first marginal begins to spread more quickly with time, and then more slowly as it becomes more universally adopted.

In agriculture: modeling crop response

The logistic S-curve can be used for modeling the crop response to changes in growth factors. There are two types of response functions: positive and negative growth curves. For example, the crop yield may increase with increasing value of the growth factor up to a certain level (positive function), or it may decrease with increasing growth factor values (negative function owing to a negative growth factor), which situation requires an inverted S-curve.

Sugarcane S-curve.png
S-curve model for crop yield versus depth of water table. [31]
Barley S-curve.png
Inverted S-curve model for crop yield versus soil salinity. [32]

In economics and sociology: diffusion of innovations

The logistic function can be used to illustrate the progress of the diffusion of an innovation through its life cycle.

In The Laws of Imitation (1890), Gabriel Tarde describes the rise and spread of new ideas through imitative chains. In particular, Tarde identifies three main stages through which innovations spread: the first one corresponds to the difficult beginnings, during which the idea has to struggle within a hostile environment full of opposing habits and beliefs; the second one corresponds to the properly exponential take-off of the idea, with ; finally, the third stage is logarithmic, with , and corresponds to the time when the impulse of the idea gradually slows down while, simultaneously new opponent ideas appear. The ensuing situation halts or stabilizes the progress of the innovation, which approaches an asymptote.

In a sovereign state, the subnational units (constituent states or cities) may use loans to finance their projects. However, this funding source is usually subject to strict legal rules as well as to economy scarcity constraints, specially the resources the banks can lend (due to their equity or Basel limits). These restrictions, which represent a saturation level, along with an exponential rush in an economic competition for money, create a public finance diffusion of credit pleas and the aggregate national response is a sigmoid curve. [33]

In the history of economy, when new products are introduced there is an intense amount of research and development which leads to dramatic improvements in quality and reductions in cost. This leads to a period of rapid industry growth. Some of the more famous examples are: railroads, incandescent light bulbs, electrification, cars and air travel. Eventually, dramatic improvement and cost reduction opportunities are exhausted, the product or process are in widespread use with few remaining potential new customers, and markets become saturated.

Logistic analysis was used in papers by several researchers at the International Institute of Applied Systems Analysis (IIASA). These papers deal with the diffusion of various innovations, infrastructures and energy source substitutions and the role of work in the economy as well as with the long economic cycle. Long economic cycles were investigated by Robert Ayres (1989). [34] Cesare Marchetti published on long economic cycles and on diffusion of innovations. [35] [36] Arnulf Grübler's book (1990) gives a detailed account of the diffusion of infrastructures including canals, railroads, highways and airlines, showing that their diffusion followed logistic shaped curves. [37]

Carlota Perez used a logistic curve to illustrate the long (Kondratiev) business cycle with the following labels: beginning of a technological era as irruption, the ascent as frenzy, the rapid build out as synergy and the completion as maturity. [38]

See also

Notes

  1. The paper was presented in 1844, and published in 1845: "(Lu à la séance du 30 novembre 1844)." "(Read at the session of 30 November 1844).", p. 1.
  2. Verhulst first refers to arithmetic progression and geometric progression, and refers to the geometric growth curve as a logarithmic curve (confusingly, the modern term is instead exponential curve, which is the inverse). He then calls his curve logistic, in contrast to logarithmic, and compares the logarithmic curve and logistic curve in the figure of his paper.
  3. In Ancient Greece, λογῐστῐκός referred to practical computation and accounting, in contrast to ἀριθμητική (arithmētikḗ), the theoretical or philosophical study of numbers. Confusingly, in English, arithmetic refers to practical computation, even though it derives from ἀριθμητική, not λογῐστῐκός. See for example Louis Charles Karpinski, Nicomachus of Gerasa: Introduction to Arithmetic (1926) p. 3: "Arithmetic is fundamentally associated by modern readers, particularly by scientists and mathematicians, with the art of computation. For the ancient Greeks after Pythagoras, however, arithmetic was primarily a philosophical study, having no necessary connection with practical affairs. Indeed the Greeks gave a separate name to the arithmetic of business, λογιστική [accounting or practical logistic] ... In general the philosophers and mathematicians of Greece undoubtedly considered it beneath their dignity to treat of this branch, which probably formed a part of the elementary instruction of children."

Related Research Articles

<span class="mw-page-title-main">Euler's formula</span> Complex exponential in terms of sine and cosine

Euler's formula, named after Leonhard Euler, is a mathematical formula in complex analysis that establishes the fundamental relationship between the trigonometric functions and the complex exponential function. Euler's formula states that, for any real number x, one has

<span class="mw-page-title-main">Exponential function</span> Mathematical function, denoted exp(x) or e^x

The exponential function is a mathematical function denoted by or . Unless otherwise specified, the term generally refers to the positive-valued function of a real variable, although it can be extended to the complex numbers or generalized to other mathematical objects like matrices or Lie algebras. The exponential function originated from the operation of taking powers of a number, but various modern definitions allow it to be rigorously extended to all real arguments , including irrational numbers. Its ubiquitous occurrence in pure and applied mathematics led mathematician Walter Rudin to consider the exponential function to be "the most important function in mathematics".

The logistic map is a polynomial mapping of degree 2, often referred to as an archetypal example of how complex, chaotic behaviour can arise from very simple nonlinear dynamical equations. The map, initially utilized by Edward Lorenz in the 1960s to showcase irregular solutions, was popularized in a 1976 paper by the biologist Robert May, in part as a discrete-time demographic model analogous to the logistic equation written down by Pierre François Verhulst. Mathematically, the logistic map is written

<span class="mw-page-title-main">Hyperbolic functions</span> Collective name of 6 mathematical functions

In mathematics, hyperbolic functions are analogues of the ordinary trigonometric functions, but defined using the hyperbola rather than the circle. Just as the points (cos t, sin t) form a circle with a unit radius, the points (cosh t, sinh t) form the right half of the unit hyperbola. Also, similarly to how the derivatives of sin(t) and cos(t) are cos(t) and –sin(t) respectively, the derivatives of sinh(t) and cosh(t) are cosh(t) and +sinh(t) respectively.

<span class="mw-page-title-main">Sigmoid function</span> Mathematical function having a characteristic S-shaped curve or sigmoid curve

A sigmoid function is any mathematical function whose graph has a characteristic S-shaped curve or sigmoid curve.

<span class="mw-page-title-main">Exponential growth</span> Growth of quantities at rate proportional to the current amount

Exponential growth is a process that increases quantity over time at an ever-increasing rate. It occurs when the instantaneous rate of change of a quantity with respect to time is proportional to the quantity itself. Described as a function, a quantity undergoing exponential growth is an exponential function of time, that is, the variable representing time is the exponent. Exponential growth is the inverse of logarithmic growth.

<span class="mw-page-title-main">Generalised logistic function</span> Mathematical function

The generalized logistic function or curve is an extension of the logistic or sigmoid functions. Originally developed for growth modelling, it allows for more flexible S-shaped curves. The function is sometimes named Richards's curve after F. J. Richards, who proposed the general form for the family of models in 1959.

<span class="mw-page-title-main">Logistic regression</span> Statistical model for a binary dependent variable

In statistics, the logistic model is a statistical model that models the log-odds of an event as a linear combination of one or more independent variables. In regression analysis, logistic regression is estimating the parameters of a logistic model. Formally, in binary logistic regression there is a single binary dependent variable, coded by an indicator variable, where the two values are labeled "0" and "1", while the independent variables can each be a binary variable or a continuous variable. The corresponding probability of the value labeled "1" can vary between 0 and 1, hence the labeling; the function that converts log-odds to probability is the logistic function, hence the name. The unit of measurement for the log-odds scale is called a logit, from logistic unit, hence the alternative names. See § Background and § Definition for formal mathematics, and § Example for a worked example.

In probability and statistics, an exponential family is a parametric set of probability distributions of a certain form, specified below. This special form is chosen for mathematical convenience, including the enabling of the user to calculate expectations, covariances using differentiation based on some useful algebraic properties, as well as for generality, as exponential families are in a sense very natural sets of distributions to consider. The term exponential class is sometimes used in place of "exponential family", or the older term Koopman–Darmois family. Sometimes loosely referred to as "the" exponential family, this class of distributions is distinct because they all possess a variety of desirable properties, most importantly the existence of a sufficient statistic.

The Lotka–Volterra equations, also known as the Lotka–Volterra predator–prey model, are a pair of first-order nonlinear differential equations, frequently used to describe the dynamics of biological systems in which two species interact, one as a predator and the other as prey. The populations change through time according to the pair of equations:

<span class="mw-page-title-main">Pierre François Verhulst</span> Belgian mathematician

Pierre François Verhulst was a Belgian mathematician and a doctor in number theory from the University of Ghent in 1825. He is best known for the logistic growth model.

Population dynamics is the type of mathematics used to model and study the size and age composition of populations as dynamical systems.

<span class="mw-page-title-main">Logistic distribution</span> Continuous probability distribution

In probability theory and statistics, the logistic distribution is a continuous probability distribution. Its cumulative distribution function is the logistic function, which appears in logistic regression and feedforward neural networks. It resembles the normal distribution in shape but has heavier tails. The logistic distribution is a special case of the Tukey lambda distribution.

In mathematics, the matrix exponential is a matrix function on square matrices analogous to the ordinary exponential function. It is used to solve systems of linear differential equations. In the theory of Lie groups, the matrix exponential gives the exponential map between a matrix Lie algebra and the corresponding Lie group.

In probability theory the hypoexponential distribution or the generalized Erlang distribution is a continuous distribution, that has found use in the same fields as the Erlang distribution, such as queueing theory, teletraffic engineering and more generally in stochastic processes. It is called the hypoexponetial distribution as it has a coefficient of variation less than one, compared to the hyper-exponential distribution which has coefficient of variation greater than one and the exponential distribution which has coefficient of variation of one.

The Gompertz curve or Gompertz function is a type of mathematical model for a time series, named after Benjamin Gompertz (1779–1865). It is a sigmoid function which describes growth as being slowest at the start and end of a given time period. The right-side or future value asymptote of the function is approached much more gradually by the curve than the left-side or lower valued asymptote. This is in contrast to the simple logistic function in which both asymptotes are approached by the curve symmetrically. It is a special case of the generalised logistic function. The function was originally designed to describe human mortality, but since has been modified to be applied in biology, with regard to detailing populations.

<span class="mw-page-title-main">Inverse Gaussian distribution</span> Family of continuous probability distributions

In probability theory, the inverse Gaussian distribution is a two-parameter family of continuous probability distributions with support on (0,∞).

In mathematics, an integro-differential equation is an equation that involves both integrals and derivatives of a function.

A population model is a type of mathematical model that is applied to the study of population dynamics.

<span class="mw-page-title-main">Rectifier (neural networks)</span> Activation function

In the context of artificial neural networks, the rectifier or ReLU activation function is an activation function defined as the positive part of its argument:

References

  1. 1 2 Verhulst, Pierre-François (1838). "Notice sur la loi que la population poursuit dans son accroissement" (PDF). Correspondance Mathématique et Physique. 10: 113–121. Retrieved 3 December 2014.
  2. "Sigmoid — PyTorch 1.10.1 documentation".
  3. expit documentation for R's clusterPower package.
  4. "Scipy.special.expit — SciPy v1.7.1 Manual".
  5. Cramer 2002, pp. 3–5.
  6. Verhulst, Pierre-François (1845). "Recherches mathématiques sur la loi d'accroissement de la population" [Mathematical Researches into the Law of Population Growth Increase]. Nouveaux Mémoires de l'Académie Royale des Sciences et Belles-Lettres de Bruxelles. 18: 8 . Retrieved 18 February 2013. Nous donnerons le nom de logistique à la courbe [We will give the name logistic to the curve]
  7. Verhulst, Pierre-François (1847). "Deuxième mémoire sur la loi d'accroissement de la population". Mémoires de l'Académie Royale des Sciences, des Lettres et des Beaux-Arts de Belgique. 20: 1–32. Retrieved 18 February 2013.
  8. Shulman, Bonnie (1998). "Math-alive! using original sources to teach mathematics in social context". PRIMUS . 8 (March): 1–14. doi:10.1080/10511979808965879. The diagram clinched it for me: there two curves labeled "Logistique" and "Logarithmique" are drawn on the same axes, and one can see that there is a region where they match almost exactly, and then diverge.
    I concluded that Verhulst's intention in naming the curve was indeed to suggest this comparison, and that "logistic" was meant to convey the curve's "log-like" quality.
  9. Kocian, Alexander; Carmassi, Giulia; Cela, Fatjon; Incrocci, Luca; Milazzo, Paolo; Chessa, Stefano (7 June 2020). "Bayesian Sigmoid-Type Time Series Forecasting with Missing Data for Greenhouse Crops". Sensors. 20 (11): 3246. Bibcode:2020Senso..20.3246K. doi: 10.3390/s20113246 . PMC   7309099 . PMID   32517314.
  10. Kyurkchiev, Nikolay, and Svetoslav Markov. "Sigmoid functions: some approximation and modelling aspects". LAP LAMBERT Academic Publishing, Saarbrucken (2015).
  11. Raul Rojas. Neural Networks – A Systematic Introduction (PDF). Retrieved 15 October 2016.
  12. Link, S. W.; Heath, R. A. (1975). "A sequential theory of psychological discrimination". Psychometrika. 40 (1): 77–105. doi:10.1007/BF02291481.
  13. Link, S. W. (1978). "The Relative Judgment Theory of the Psychometric Function". Attention and Performance VII. Taylor & Francis. pp. 619–630. ISBN   9781003310228.
  14. S. W. Link, The wave theory of difference and similarity (book), Taylor and Francis, 1992
  15. A. G. McKendricka; M. Kesava Paia1 (January 1912). "XLV.—The Rate of Multiplication of Micro-organisms: A Mathematical Study". Proceedings of the Royal Society of Edinburgh. 31: 649–653. doi:10.1017/S0370164600025426.{{cite journal}}: CS1 maint: numeric names: authors list (link)
  16. Raymond Pearl & Lowell Reed (June 1920). "On the Rate of Growth of the Population of the United States" (PDF). Proceedings of the National Academy of Sciences of the United States of America . Vol. 6, no. 6. p. 275.
  17. Griffiths, Graham; Schiesser, William (2009). "Linear and nonlinear waves". Scholarpedia. 4 (7): 4308. Bibcode:2009SchpJ...4.4308G. doi: 10.4249/scholarpedia.4308 . ISSN   1941-6016.
  18. Yukalov, V. I.; Yukalova, E. P.; Sornette, D. (2009). "Punctuated evolution due to delayed carrying capacity". Physica D: Nonlinear Phenomena. 238 (17): 1752–1767. arXiv: 0901.4714 . Bibcode:2009PhyD..238.1752Y. doi:10.1016/j.physd.2009.05.011. S2CID   14456352.
  19. Gershenfeld 1999, p. 150.
  20. LeCun, Y.; Bottou, L.; Orr, G.; Muller, K. (1998). Orr, G.; Muller, K. (eds.). Efficient BackProp (PDF). Springer. ISBN   3-540-65311-2.{{cite book}}: |work= ignored (help)
  21. Worldometer: COVID-19 CORONAVIRUS PANDEMIC
  22. Villalobos-Arias, Mario (2020). "Using generalized logistics regression to forecast population infected by Covid-19". arXiv: 2004.02406 [q-bio.PE].
  23. Postnikov, Eugene B. (June 2020). "Estimation of COVID-19 dynamics "on a back-of-envelope": Does the simplest SIR model provide quantitative parameters and predictions?". Chaos, Solitons & Fractals. 135: 109841. Bibcode:2020CSF...13509841P. doi:10.1016/j.chaos.2020.109841. PMC   7252058 . PMID   32501369.
  24. Saito, Takesi (June 2020). "A Logistic Curve in the SIR Model and Its Application to Deaths by COVID-19 in Japan". medRxiv   10.1101/2020.06.25.20139865v2 .
  25. Reiser, Paul A. (2020). "Modified SIR Model Yielding a Logistic Solution". arXiv: 2006.01550 [q-bio.PE].
  26. Lee, Se Yoon; Lei, Bowen; Mallick, Bani (2020). "Estimation of COVID-19 spread curves integrating global data and borrowing information". PLOS ONE. 15 (7): e0236860. arXiv: 2005.00662 . Bibcode:2020PLoSO..1536860L. doi: 10.1371/journal.pone.0236860 . PMC   7390340 . PMID   32726361.
  27. Yin, Xi; Zelenay, Piotr (13 July 2018). "Kinetic Models for the Degradation Mechanisms of PGM-Free ORR Catalysts". ECS Transactions. 85 (13): 1239–1250. doi:10.1149/08513.1239ecst. OSTI   1471365. S2CID   103125742.
  28. 1 2 Tanalikhit, Pattarapon; Worakitthamrong, Thanabodi; Chaidet, Nattanon; Kanchanapusakit, Wittaya (24–25 May 2021). "Measuring refractive index gradient of sugar solution". Journal of Physics: Conference Series. 2145: 012072. doi: 10.1088/1742-6596/2145/1/012072 . S2CID   245811843.
  29. López-Arias, T; Calzà, G; Gratton, L M; Oss, S (2009). "Mirages in a bottle". Physics Education. 44 (6): 582. doi:10.1088/0031-9120/44/6/002. S2CID   59380632.
  30. Bod, Hay, Jennedy (eds.) 2003, pp. 147–156
  31. Collection of data on crop production and depth of the water table in the soil of various authors. On line:
  32. Collection of data on crop production and soil salinity of various authors. On line:
  33. Rocha, Leno S.; Rocha, Frederico S. A.; Souza, Thársis T. P. (5 October 2017). "Is the public sector of your country a diffusion borrower? Empirical evidence from Brazil". PLOS ONE. 12 (10): e0185257. arXiv: 1604.07782 . Bibcode:2017PLoSO..1285257R. doi: 10.1371/journal.pone.0185257 . ISSN   1932-6203. PMC   5628819 . PMID   28981532.
  34. Ayres, Robert (February 1989). "Technological Transformations and Long Waves" (PDF). International Institute for Applied Systems Analysis. Archived from the original (PDF) on 1 March 2012. Retrieved 6 November 2010.
  35. Marchetti, Cesare (1996). "Pervasive Long Waves: Is Society Cyclotymic" (PDF). Aspen Global Change INstitute. Archived from the original (PDF) on 5 March 2012.
  36. Marchetti, Cesare (1988). "Kondratiev Revisited-After One Cycle" (PDF). Cesare Marchetti. Archived from the original (PDF) on 9 March 2012. Retrieved 6 November 2010.
  37. Grübler, Arnulf (1990). The Rise and Fall of Infrastructures: Dynamics of Evolution and Technological Change in Transport (PDF). Heidelberg and New York: Physica-Verlag.
  38. Perez, Carlota (2002). Technological Revolutions and Financial Capital: The Dynamics of Bubbles and Golden Ages . UK: Edward Elgar Publishing Limited. ISBN   1-84376-331-1.