Network calculus

Last updated

Network calculus is "a set of mathematical results which give insights into man-made systems such as concurrent programs, digital circuits and communication networks." [1] Network calculus gives a theoretical framework for analysing performance guarantees in computer networks. As traffic flows through a network it is subject to constraints imposed by the system components, for example:

Contents

These constraints can be expressed and analysed with network calculus methods. Constraint curves can be combined using convolution under min-plus algebra. Network calculus can also be used to express traffic arrival and departure functions as well as service curves.

The calculus uses "alternate algebras ... to transform complex non-linear network systems into analytically tractable linear systems." [2]

Currently, there exists two branches in network calculus: one handling deterministic bounded, and one handling stochastic bounds. [3]

System modelling

Modelling flow and server

In network calculus, a flow is modelled as cumulative functions A, where A(t) represents the amount of data (number of bits for example) sent by the flow in the interval [0,t). Such functions are non-negative and non-decreasing. The time domain is often the set of non negative reals.

Arrival and departure curve at ingress and egress of a server. Network Calculus -- Single server.svg
Arrival and departure curve at ingress and egress of a server.

A server can be a link, a scheduler, a traffic shaper, or a whole network. It is simply modelled as a relation between some arrival cumulative curve A and some departure cumulative curve D. It is required that A ≥ D, to model the fact that the departure of some data can not occur before its arrival.

Modelling backlog and delay

Given some arrival and departure curve A and D, the backlog at any instant t, denoted b(A,D,t) can be defined as the difference between A and D. The delay at t, d(A,D,t) is defined as the minimal amount of time such that the departure function reached the arrival function. When considering the whole flows, the supremum of these values is used.

Horizontal and vertical deviation between arrival and departure cumulative curves Horizontal and vertical deviation.svg
Horizontal and vertical deviation between arrival and departure cumulative curves

In general, the flows are not exactly known, and only some constraints on flows and servers are known (like the maximal number of packet sent on some period, the maximal size of packets, the minimal link bandwidth). The aim of network calculus is to compute upper bounds on delay and backlog, based on these constraints. To do so, network calculus uses the min-plus algebra.

Min-plus Semiring

Network calculus makes an intensive use on the min-plus semiring (sometimes called min-plus algebra).

In filter theory and linear systems theory the convolution of two functions and is defined as

In min-plus semiring the sum is replaced by the minimum respectively infimum operator and the product is replaced by the sum. So the min-plus convolution of two functions and becomes

e.g. see the definition of service curves. Convolution and min-plus convolution share many algebraic properties. In particular both are commutative and associative.

A so-called min-plus de-convolution operation is defined as

e.g. as used in the definition of traffic envelopes.

The vertical and horizontal deviations can be expressed in terms of min-plus operators.

Traffic envelopes

Cumulative curves are real behaviours, unknown at design time. What is known is some constraint. Network calculus uses the notion of traffic envelope, also known as arrival curves.

A cumulative function A is said to conform to an envelope E (also called arrival curve and denoted α) , if for all t it holds that

Two equivalent definitions can be given

Thus, E places an upper constraint on flow A. Such function E can be seen as an envelope that specifies an upper bound on the number of bits of flow seen in any interval of length d starting at an arbitrary t, cf. eq. ( 1 ).

Service curves

In order to provide performance guarantees to traffic flows it is necessary to specify some minimal performance of the server (depending on reservations in the network, or scheduling policy, etc.). Service curves provide a means of expressing resource availability. Several kinds of service curves exists, like weakly strict, variable capacity node, etc. See [4] [5] for an overview.

Minimal service

Let A be an arrival flow, arriving at the ingress of a server, and D be the flow departing at the egress. The system is said to provide a simple minimal service curveS to the pair (A,B), if for all t it holds that

Strict minimal service

Let A be an arrival flow, arriving at the ingress of a server, and D be the flow departing at the egress. A backlog period is an interval I such that, on any t I, A(t)>D(t).

The system is said to provide a strict minimal service curveS to the pair (A,B) iff, , such that , if is a backlog period, then .

If a server offers a strict minimal service of curve S, it also offers a simple minimal service of curve S.

Notations

Depending on the authors, on the purpose of the paper, different notations or even names are used for the same notion.

Main notations in network calculus
Notions name(s)NotationsComments
Cumulative curveThe first papers were using , [1] but is used for Flow, and for Arrival.
Input/output pair of curves, , The input/output curve pair was initially denoted . The naming stands for Arrival and Departure. Then naming names input and output flows.
Envelope, Arrival curveAuthors using the term 'Envelope' also use , and conversely with 'Arrival curve' and .
Service curveAuthors in general use either both or both
Delay, Horizontal deviationThe term 'horizontal deviation' emphasizes on the mathematical definition, whereas 'delay' emphasizes on the semantics.
Backlog, vertical deviationThe term 'vertical deviation' emphasizes on the mathematical definition, whereas 'backlog' emphasizes on the semantics.
Convolution
Deconvolution

Basic results: Performance bounds and envelope propagation

From traffic envelope and service curves, some bounds on the delay and backlog, and an envelope on the departure flow can be computed.

Let A be an arrival flow, arriving at the ingress of a server, and D be the flow departing at the egress. If the flow as a traffic envelope E, and the server provides a minimal service of curve S, then the backlog and delay can be bounded:

Moreover, the departure curve has envelope .

Moreover, these bounds are tight i.e. given some E, and S, one may build an arrival and departure such that b(A,D) = b(E,S) and v(A,D)=v(E,S).

Concatenation / PBOO

Consider a sequence of two servers, when the output of the first one is the input of the second one. This sequence can be seen as a new server, built as the concatenation of the two other ones.

Then, if the first (resp. second) server offers a simple minimal service (resp. ), then, the concatenation of both offers a simple minimal service .

Sequence of two servers Network Calculus -- Sequence of servers.svg
Sequence of two servers

The proof does iterative application of the definition of service curves , and some properties of convolution, isotonicity (), and associativity ().

The interest of this result is that the end-to-end delay bound is not greater than the sum of local delays: .

This result is known as Pay burst only once (PBOO).

Tools

There are several tools based on network calculus. A comparison can be found in. [6]

Min-plus computation

There exist several tools and library devoted to the min-plus algebra.

All these tools and library are based on the algorithms presented in. [9]

Network analysis tools

Events

WoNeCa workshop is a Workshop on Network Calculus. It is organized every two years to bring together researchers with an interest in the theory of network calculus as well as those who want to apply existing results to new applications. The workshop also serves to promote the network calculus theory to researchers with an interest in applied queueing models.

In 2018, International Workshop on Network Calculus and Applications (NetCal 2018) was held in Vienna, Austria as a part of the 30th International Teletraffic Congress (ITC 30).

In 2024, the network calculus Dagstuhl seminar (24141) was held from 1st April to 4th April in Dagstuhl, Germany.

Related Research Articles

<span class="mw-page-title-main">Mathematical optimization</span> Study of mathematical algorithms for optimization problems

Mathematical optimization or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfields: discrete optimization and continuous optimization. Optimization problems arise in all quantitative disciplines from computer science and engineering to operations research and economics, and the development of solution methods has been of interest in mathematics for centuries.

In the field of mathematical optimization, stochastic programming is a framework for modeling optimization problems that involve uncertainty. A stochastic program is an optimization problem in which some or all problem parameters are uncertain, but follow known probability distributions. This framework contrasts with deterministic optimization, in which all problem parameters are assumed to be known exactly. The goal of stochastic programming is to find a decision which both optimizes some criteria chosen by the decision maker, and appropriately accounts for the uncertainty of the problem parameters. Because many real-world decisions involve uncertainty, stochastic programming has found applications in a broad range of areas ranging from finance to transportation to energy optimization.

In probability theory and related fields, Malliavin calculus is a set of mathematical techniques and ideas that extend the mathematical field of calculus of variations from deterministic functions to stochastic processes. In particular, it allows the computation of derivatives of random variables. Malliavin calculus is also called the stochastic calculus of variations. P. Malliavin first initiated the calculus on infinite dimensional space. Then, the significant contributors such as S. Kusuoka, D. Stroock, J-M. Bismut, Shinzo Watanabe, I. Shigekawa, and so on finally completed the foundations.

Stochastic gradient descent is an iterative method for optimizing an objective function with suitable smoothness properties. It can be regarded as a stochastic approximation of gradient descent optimization, since it replaces the actual gradient by an estimate thereof. Especially in high-dimensional optimization problems this reduces the very high computational burden, achieving faster iterations in exchange for a lower convergence rate.

A stochastic differential equation (SDE) is a differential equation in which one or more of the terms is a stochastic process, resulting in a solution which is also a stochastic process. SDEs have many applications throughout pure mathematics and are used to model various behaviours of stochastic models such as stock prices, random growth models or physical systems that are subjected to thermal fluctuations.

A cyclostationary process is a signal having statistical properties that vary cyclically with time. A cyclostationary process can be viewed as multiple interleaved stationary processes. For example, the maximum daily temperature in New York City can be modeled as a cyclostationary process: the maximum temperature on July 21 is statistically different from the temperature on December 20; however, it is a reasonable approximation that the temperature on December 20 of different years has identical statistics. Thus, we can view the random process composed of daily maximum temperatures as 365 interleaved stationary processes, each of which takes on a new value once per year.

In mathematics, delay differential equations (DDEs) are a type of differential equation in which the derivative of the unknown function at a certain time is given in terms of the values of the function at previous times. DDEs are also called time-delay systems, systems with aftereffect or dead-time, hereditary systems, equations with deviating argument, or differential-difference equations. They belong to the class of systems with the functional state, i.e. partial differential equations (PDEs) which are infinite dimensional, as opposed to ordinary differential equations (ODEs) having a finite dimensional state vector. Four points may give a possible explanation of the popularity of DDEs:

  1. Aftereffect is an applied problem: it is well known that, together with the increasing expectations of dynamic performances, engineers need their models to behave more like the real process. Many processes include aftereffect phenomena in their inner dynamics. In addition, actuators, sensors, and communication networks that are now involved in feedback control loops introduce such delays. Finally, besides actual delays, time lags are frequently used to simplify very high order models. Then, the interest for DDEs keeps on growing in all scientific areas and, especially, in control engineering.
  2. Delay systems are still resistant to many classical controllers: one could think that the simplest approach would consist in replacing them by some finite-dimensional approximations. Unfortunately, ignoring effects which are adequately represented by DDEs is not a general alternative: in the best situation, it leads to the same degree of complexity in the control design. In worst cases, it is potentially disastrous in terms of stability and oscillations.
  3. Voluntary introduction of delays can benefit the control system.
  4. In spite of their complexity, DDEs often appear as simple infinite-dimensional models in the very complex area of partial differential equations (PDEs).

In Itô calculus, the Euler–Maruyama method is a method for the approximate numerical solution of a stochastic differential equation (SDE). It is an extension of the Euler method for ordinary differential equations to stochastic differential equations. It is named after Leonhard Euler and Gisiro Maruyama. Unfortunately, the same generalization cannot be done for any arbitrary deterministic method.

A stochastic simulation is a simulation of a system that has variables that can change stochastically (randomly) with individual probabilities.

In mathematics, a local martingale is a type of stochastic process, satisfying the localized version of the martingale property. Every martingale is a local martingale; every bounded local martingale is a martingale; in particular, every local martingale that is bounded from below is a supermartingale, and every local martingale that is bounded from above is a submartingale; however, a local martingale is not in general a martingale, because its expectation can be distorted by large values of small probability. In particular, a driftless diffusion process is a local martingale, but not necessarily a martingale.

In mathematics, a stopped process is a stochastic process that is forced to assume the same value after a prescribed time.

Robust optimization is a field of mathematical optimization theory that deals with optimization problems in which a certain measure of robustness is sought against uncertainty that can be represented as deterministic variability in the value of the parameters of the problem itself and/or its solution. It is related to, but often distinguished from, probabilistic optimization methods such as chance-constrained optimization.

In stochastic analysis, a rough path is a generalization of the notion of smooth path allowing to construct a robust solution theory for controlled differential equations driven by classically irregular signals, for example a Wiener process. The theory was developed in the 1990s by Terry Lyons. Several accounts of the theory are available.

In the mathematical theory of probability, the drift-plus-penalty method is used for optimization of queueing networks and other stochastic systems.

The min-entropy, in information theory, is the smallest of the Rényi family of entropies, corresponding to the most conservative way of measuring the unpredictability of a set of outcomes, as the negative logarithm of the probability of the most likely outcome. The various Rényi entropies are all equal for a uniform distribution, but measure the unpredictability of a nonuniform distribution in different ways. The min-entropy is never greater than the ordinary or Shannon entropy and that in turn is never greater than the Hartley or max-entropy, defined as the logarithm of the number of outcomes with nonzero probability.

In statistics, the residence time is the average amount of time it takes for a random process to reach a certain boundary value, usually a boundary far from the mean.

Stochastic chains with memory of variable length are a family of stochastic chains of finite order in a finite alphabet, such as, for every time pass, only one finite suffix of the past, called context, is necessary to predict the next symbol. These models were introduced in the information theory literature by Jorma Rissanen in 1983, as a universal tool to data compression, but recently have been used to model data in different areas such as biology, linguistics and music.

The separation principle is one of the fundamental principles of stochastic control theory, which states that the problems of optimal control and state estimation can be decoupled under certain conditions. In its most basic formulation it deals with a linear stochastic system

Permutation codes are a family of error correction codes that were introduced first by Slepian in 1965. and have been widely studied both in Combinatorics and Information theory due to their applications related to Flash memory and Power-line communication.

In mathematics, stochastic analysis on manifolds or stochastic differential geometry is the study of stochastic analysis over smooth manifolds. It is therefore a synthesis of stochastic analysis and of differential geometry.

References

Books, Surveys, and Tutorials on Network Calculus
Related books on the max-plus algebra or on convex minimization
Deterministic network calculus
Network topologies, feed-forward networks
Measurement-based system identification
Stochastic network calculus
Wireless network calculus

Citations

  1. 1 2 Le Boudec, Jean-Yves; Thiran, Patrick (2001). Goos, Gerhard; Hartmanis, Juris; van Leeuwen, Jan (eds.). Network Calculus: A Theory of Deterministic Queuing Systems for the Internet. Lecture Notes in Computer Science. Vol. 2050. doi:10.1007/3-540-45318-0. ISBN   978-3-540-42184-9. S2CID   20610609.
  2. Jiang, Yuming; Liu, Yong (2009). Stochastic Network Calculus. Bibcode:2009snc..book.....L. CiteSeerX   10.1.1.725.5561 . doi:10.1007/978-1-84800-127-5. ISBN   978-1-84800-126-8.
  3. Fidler, M. (2010). "Survey of deterministic and stochastic service curve models in the network calculus". IEEE Communications Surveys & Tutorials. 12: 59–86. doi:10.1109/SURV.2010.020110.00019. S2CID   10745931.
  4. 1 2 Bouillard, Anne; Jouhet, Laurent; Thierry, Eric (2009). Service curves in Network Calculus: dos and don'ts (Technical report). INRIA. RR-7094.
  5. Bouillard, Anne; Jouhet, Laurent; Thierry, Éric. Comparison of Different Classes of Service Curves in Network Calculus (PDF). 10th International Workshop on Discrete Event Systems (WODES 2010). Technische Universität Berlin.
  6. Zhou, Boyang; Howenstine, Isaac; Limprapaipong, Siraphob; Cheng, Liang (December 14, 2020). "A Survey on Network Calculus Tools for Network Infrastructure in Real-Time Systems". IEEE Access. 8. IEEE: 223588–223605. Bibcode:2020IEEEA...8v3588Z. doi: 10.1109/ACCESS.2020.3043600 .
  7. Zippo, Raffaele; Stea, Giovanni (June 2022). "Nancy: an efficient parallel Network Calculus library". SoftwareX. 19. Elsevier: 101178. arXiv: 2205.11449 . Bibcode:2022SoftX..1901178Z. doi: 10.1016/j.softx.2022.101178 .
  8. Rakotomalala, Lucien; Boyer, Marc; Roux, Pierre (2021). Verifying min-plus computations with coq. 13th NASA Formal Methods Symposium (NFM 2021). doi:10.1007/978-3-030-76384-8.
  9. Bouillard, Anne; Thierry, Eric (2008). "An Algorithmic Toolbox for Network Calculus". Discrete Event Dynamic Systems: Theory and Applications. 18: 3–49. doi:10.1007/s10626-007-0028-x. S2CID   14643542.
  10. Bondorf, Steffen; Schmitt, Jens B. (2014). The DiscoDNC v2 – A Comprehensive Tool for Deterministic Network Calculus (PDF). 8th International Conference on Performance Evaluation Methodologies and Tools (VALUETOOLS 2014).
  11. Thiele, Lothar; Chakraborty, Samarjit; Naedele, Martin. Real-Time Calculus for Scheduling Hard Real-Time Systems. IEEE International Symposium on Circuits and Systems (ISCAS) 2000. Geneva, Switzerland. doi:10.1109/ISCAS.2000.858698.
  12. Schioler, Henrik; Schwefel, Hans P.; Hansen, Martin B. (2007). CyNC: A MATLAB/SimuLink Toolbox for Network Calculus. 2nd International Conference on Performance Evaluation Methodologies and Tools (ValueTools '07).
  13. Boyer, Marc; Migge, Jörn; Fumey, Marc (2011). PEGASE, A Robust and Efficient Tool for Worst Case Network Traversal Time (PDF). SAE 2011 AeroTech Congress & Exhibition.
  14. Mifdaoui, Ahlem; Ayed, H. (2010). WOPANets: A tool for WOrst case Performance Analysis of embedded Networks. 15th IEEE International Workshop on Computer Aided Modeling, Analysis and Design of Communication Links and Networks (CAMAD). doi:10.1109/CAMAD.2010.5686958.
  15. Schmidt, Mark; Veith, Sebastian; Menth, Michael; Kehrer, Stephan (2014). DelayLyzer: A Tool for Analyzing Delay Bounds in Industrial Ethernet Networks. 17th Int. GI/ITG Conf. on Measurement, Modelling, and Evaluation of Computing Systems and Dependability and Fault Tolerance (MMB & DFT 2014). doi:10.1007/978-3-319-05359-2_19.
  16. Bisti, Luca; Lenzini, Luciano; Mingozzi, Enzo; Stea, Giovanni (2012). DEBORAH: A Tool for Worst-Case Analysis of FIFO Tandems. International Symposium On Leveraging Applications of Formal Methods, Verification and Validation. doi:10.1007/978-3-642-16558-0_15.
  17. Bouillard, Anne; Stea, Giovanni (October 2015). "Exact worst-case delay in FIFO-multiplexing feed-forward networks". IEEE/ACM Transactions on Networking. 23 (5): 1387–1400. doi:10.1109/TNET.2014.2332071. hdl: 11568/501671 . S2CID   14216975.
  18. Bouillard, Anne; Éric, Thierry (September 2016). "Tight performance bounds in the worst-case analysis of feed-forward networks" (PDF). Discrete Event Dynamic Systems. 26 (3): 383–411. doi:10.1007/s10626-015-0213-2. S2CID   40699209.
  19. Bouillard, Anne (2019). Stability and performance bounds in cyclic networks using network calculus. 17th International Conference on Formal Modeling and Analysis of Timed Systems.
  20. Kerschbaum, Sven; Hielscher, Kai-Steffen; German, Reinhard (2016). The need for shaping non-time-critical data in PROFINET networks. 14th IEEE International Conference on Industrial Informatics (INDIN). doi:10.1109/INDIN.2016.7819151.
  21. Thomas, Ludovic (September 2022). Analysis of the side-effects on latency bounds of combinations of scheduling, redundancy and synchronization mechanisms in time-sensitive networks (Doctorat de l'université de Toulouse).