Info-gap decision theory

Info-gap decision theory seeks to optimize robustness to failure under severe uncertainty, ^{[1] [2]} in particular applying sensitivity analysis of the stability radius type ^[3] to perturbations in the value of a given estimate of the parameter of interest. It has some connections with Wald's maximin model; some authors distinguish them, others consider them instances of the same principle.

It was developed by Yakov Ben-Haim, ^[4] and has found many applications and described as a theory for decision-making under "severe uncertainty". It has been criticized as unsuited for this purpose, and alternatives proposed, including such classical approaches as robust optimization.

Applications

Info-gap theory has generated a lot of literature. Info-gap theory has been studied or applied in a range of applications including engineering, ^{[5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] [18]} biological conservation, ^{[19] [20] [21] [22] [23] [24] [25] [26] [27] [28] [29] [30]} theoretical biology, ^[31] homeland security, ^[32] economics, ^{[33] [34] [35]} project management ^{[36] [37] [38]} and statistics. ^[39] Foundational issues related to info-gap theory have also been studied. ^{[40] [41] [42] [43] [44] [45]}

Engineering

A typical engineering application is the vibration analysis of a cracked beam, where the location, size, shape and orientation of the crack is unknown and greatly influence the vibration dynamics. ^[9] Very little is usually known about these spatial and geometrical uncertainties. The info-gap analysis allows one to model these uncertainties, and to determine the degree of robustness - to these uncertainties - of properties such as vibration amplitude, natural frequencies, and natural modes of vibration. Another example is the structural design of a building subject to uncertain loads such as from wind or earthquakes. ^{[8] [10]} The response of the structure depends strongly on the spatial and temporal distribution of the loads. However, storms and earthquakes are highly idiosyncratic events, and the interaction between the event and the structure involves very site-specific mechanical properties which are rarely known. The info-gap analysis enables the design of the structure to enhance structural immunity against uncertain deviations from design-base or estimated worst-case loads.^{[ citation needed ]} Another engineering application involves the design of a neural net for detecting faults in a mechanical system, based on real-time measurements. A major difficulty is that faults are highly idiosyncratic, so that training data for the neural net will tend to differ substantially from data obtained from real-time faults after the net has been trained. The info-gap robustness strategy enables one to design the neural net to be robust to the disparity between training data and future real events. ^{[11] [13]}

Biology

The conservation biologist faces info-gaps in using biological models. They use info-gap robustness curves to select among management options for spruce-budworm populations in Eastern Canada. Burgman ^[46] uses the fact that the robustness curves of different alternatives can intersect.

Project management

Project management is another area where info-gap uncertainty is common. The project manager often has very limited information about the duration and cost of some of the tasks in the project, and info-gap robustness can assist in project planning and integration. ^[37] Financial economics is another area where the future is unpredictable, which may be either pernicious or propitious. Info-gap robustness and opportuneness analyses can assist in portfolio design, credit rationing, and other applications. ^[33]

Criticism

A general criticism of non-probabilistic decision rules, discussed in detail at decision theory: alternatives to probability theory, is that optimal decision rules (formally, admissible decision rules) can always be derived by probabilistic methods, with a suitable utility function and prior distribution (this is the statement of the complete class theorems), and thus that non-probabilistic methods such as info-gap are unnecessary and do not yield new or better decision rules.

A more general criticism of decision making under uncertainty is the impact of outsized, unexpected events, ones that are not captured by the model. This is discussed particularly in black swan theory, and info-gap, used in isolation, is vulnerable to this, as are a fortiori all decision theories that use a fixed universe of possibilities, notably probabilistic ones.

Sniedovich ^[47] raises two points to info-gap decision theory, one substantive, one scholarly:

1. the info-gap uncertainty model is flawed and oversold

One should consider the range of possibilities, not its subsets. Sniedovich argues that info-gap decision theory is therefore a "voodoo decision theory."

2. info-gap is maximin

Ben-Haim states (Ben-Haim 1999, pp. 271–2) that "robust reliability is emphatically not a [min-max] worst-case analysis". Note that Ben-Haim compares info-gap to minimax, while Sniedovich considers it a case of maximin.

Sniedovich has challenged the validity of info-gap theory for making decisions under severe uncertainty. Sniedovich notes that the info-gap robustness function is "local" to the region around ${\displaystyle \displaystyle {\tilde {u}}}$, where ${\displaystyle \displaystyle {\tilde {u}}}$ is likely to be substantially in error.

Maximin

Symbolically, max ${\displaystyle \alpha }$ assuming min (worst-case) outcome, or maximin.

In other words, while it is not a maximin analysis of outcome over the universe of uncertainty, it is a maximin analysis over a properly construed decision space.

Ben-Haim argues that info-gap's robustness model is not min-max/maximin analysis because it is not worst-case analysis of outcomes; it is a satisficing model, not an optimization model – a (straightforward) maximin analysis would consider worst-case outcomes over the entire space which, since uncertainty is often potentially unbounded, would yield an unbounded bad worst case.

Stability radius

Sniedovich ^[3] has shown that info-gap's robustness model is a simple stability radius model, namely a local stability model of the generic form

${\displaystyle {\hat {\rho }}({\tilde {p}}):=\max \ \{\rho \geq 0:p\in P(s),\forall p\in B(\rho ,{\tilde {p}})\}}$

where ${\displaystyle B(\rho ,{\tilde {p}})}$ denotes a ball of radius ${\displaystyle \rho }$ centered at ${\displaystyle {\tilde {p}}}$ and ${\displaystyle P(s)}$ denotes the set of values of ${\displaystyle p}$ that satisfy pre-determined stability conditions.

In other words, info-gap's robustness model is a stability radius model characterized by a stability requirement of the form ${\displaystyle r_{c}\leq R(q,p)}$. Since stability radius models are designed for the analysis of small perturbations in a given nominal value of a parameter, Sniedovich ^[3] argues that info-gap's robustness model is unsuitable for the treatment of severe uncertainty characterized by a poor estimate and a vast uncertainty space.

Discussion

Satisficing and bounded rationality

It is correct that the info-gap robustness function is local, and has restricted quantitative value in some cases. However, a major purpose of decision analysis is to provide focus for subjective judgments. That is, regardless of the formal analysis, a framework for discussion is provided. Without entering into any particular framework, or characteristics of frameworks in general, discussion follows about proposals for such frameworks.

Simon ^[48] introduced the idea of bounded rationality. Limitations on knowledge, understanding, and computational capability constrain the ability of decision makers to identify optimal choices. Simon advocated satisficing rather than optimizing: seeking adequate (rather than optimal) outcomes given available resources. Schwartz, ^[49] Conlisk ^[50] and others discuss extensive evidence for the phenomenon of bounded rationality among human decision makers, as well as for the advantages of satisficing when knowledge and understanding are deficient. The info-gap robustness function provides a means of implementing a satisficing strategy under bounded rationality. For instance, in discussing bounded rationality and satisficing in conservation and environmental management, Burgman notes that "Info-gap theory ... can function sensibly when there are 'severe' knowledge gaps." The info-gap robustness and opportuneness functions provide "a formal framework to explore the kinds of speculations that occur intuitively when examining decision options." ^[51] Burgman then proceeds to develop an info-gap robust-satisficing strategy for protecting the endangered orange-bellied parrot. Similarly, Vinot, Cogan and Cipolla ^[52] discuss engineering design and note that "the downside of a model-based analysis lies in the knowledge that the model behavior is only an approximation to the real system behavior. Hence the question of the honest designer: how sensitive is my measure of design success to uncertainties in my system representation? ... It is evident that if model-based analysis is to be used with any level of confidence then ... [one must] attempt to satisfy an acceptable sub-optimal level of performance while remaining maximally robust to the system uncertainties." ^[52] They proceed to develop an info-gap robust-satisficing design procedure for an aerospace application.

Alternatives

Of course, decision in the face of uncertainty is nothing new, and attempts to deal with it have a long history. A number of authors have noted and discussed similarities and differences between info-gap robustness and minimax or worst-case methods ^{[7] [16] [35] [37] [53]} . ^[54] Sniedovich ^[47] has demonstrated formally that the info-gap robustness function can be represented as a maximin optimization, and is thus related to Wald's minimax theory. Sniedovich ^[47] has claimed that info-gap's robustness analysis is conducted in the neighborhood of an estimate that is likely to be substantially wrong, concluding that the resulting robustness function is equally likely to be substantially wrong.

On the other hand, the estimate is the best one has, so it is useful to know if it can err greatly and still yield an acceptable outcome. This critical question clearly raises the issue of whether robustness (as defined by info-gap theory) is qualified to judge whether confidence is warranted, ^{[5] [55] [56]} and how it compares to methods used to inform decisions under uncertainty using considerations not limited to the neighborhood of a bad initial guess. Answers to these questions vary with the particular problem at hand. Some general comments follow.

Sensitivity analysis

Main article: Sensitivity analysis

Sensitivity analysis – how sensitive conclusions are to input assumptions – can be performed independently of a model of uncertainty: most simply, one may take two different assumed values for an input and compares the conclusions. From this perspective, info-gap can be seen as a technique of sensitivity analysis, though by no means the only.

Robust optimization

Main article: Robust optimization

The robust optimization literature ^{[57] [58] [59] [60] [61] [62]} provides methods and techniques that take a global approach to robustness analysis. These methods directly address decision under severe uncertainty, and have been used for this purpose for more than thirty years now. Wald's Maximin model is the main instrument used by these methods.

The principal difference between the Maximin model employed by info-gap and the various Maximin models employed by robust optimization methods is in the manner in which the total region of uncertainty is incorporated in the robustness model. Info-gap takes a local approach that concentrates on the immediate neighborhood of the estimate. In sharp contrast, robust optimization methods set out to incorporate in the analysis the entire region of uncertainty, or at least an adequate representation thereof. In fact, some of these methods do not even use an estimate.

Comparative analysis

Classical decision theory, ^{[63] [64]} offers two approaches to decision-making under severe uncertainty, namely maximin and Laplaces' principle of insufficient reason (assume all outcomes equally likely); these may be considered alternative solutions to the problem info-gap addresses.

Further, as discussed at decision theory: alternatives to probability theory, probabilists, particularly Bayesians probabilists, argue that optimal decision rules (formally, admissible decision rules) can always be derived by probabilistic methods (this is the statement of the complete class theorems), and thus that non-probabilistic methods such as info-gap are unnecessary and do not yield new or better decision rules.

Maximin

As attested by the rich literature on robust optimization, maximin provides a wide range of methods for decision making in the face of severe uncertainty.

Indeed, as discussed in criticism of info-gap decision theory, info-gap's robustness model can be interpreted as an instance of the general maximin model.

Bayesian analysis

As for Laplaces' principle of insufficient reason, in this context it is convenient to view it as an instance of Bayesian analysis.

The essence of the Bayesian analysis is applying probabilities for different possible realizations of the uncertain parameters. In the case of Knightian (non-probabilistic) uncertainty, these probabilities represent the decision maker's "degree of belief" in a specific realization.

In our example, suppose there are only five possible realizations of the uncertain revenue to allocation function. The decision maker believes that the estimated function is the most likely, and that the likelihood decreases as the difference from the estimate increases. Figure 11 exemplifies such a probability distribution.

Figure 11 – Probability distribution of the revenue function realizations

Now, for any allocation, one can construct a probability distribution of the revenue, based on his prior beliefs. The decision maker can then choose the allocation with the highest expected revenue, with the lowest probability for an unacceptable revenue, etc.

The most problematic step of this analysis is the choice of the realizations probabilities. When there is an extensive and relevant past experience, an expert may use this experience to construct a probability distribution. But even with extensive past experience, when some parameters change, the expert may only be able to estimate that ${\displaystyle A}$ is more likely than ${\displaystyle B}$, but will not be able to reliably quantify this difference. Furthermore, when conditions change drastically, or when there is no past experience at all, it may prove to be difficult even estimating whether ${\displaystyle A}$ is more likely than ${\displaystyle B}$.

Nevertheless, methodologically speaking, this difficulty is not as problematic as basing the analysis of a problem subject to severe uncertainty on a single point estimate and its immediate neighborhood, as done by info-gap. And what is more, contrary to info-gap, this approach is global, rather than local.

Still, it must be stressed that Bayesian analysis does not expressly concern itself with the question of robustness.

Bayesian analysis raises the issue of learning from experience and adjusting probabilities accordingly. In other words, decision is not a one-stop process, but profits from a sequence of decisions and observations.

See also

• Decision analysis
• Decision theory

References

1. Yakov Ben-Haim, Information-Gap Theory: Decisions Under Severe Uncertainty, Academic Press, London, 2001.
2. Yakov Ben-Haim, Info-Gap Theory: Decisions Under Severe Uncertainty, 2nd edition, Academic Press, London, 2006.
3. Sniedovich, M. (2010). "A bird's view of info-gap decision theory". Journal of Risk Finance. 11 (3): 268–283. doi:10.1108/15265941011043648.
4. "How Did Info-Gap Theory Start? How Does it Grow?". Archived from the original on 2009-11-28. Retrieved 2009-03-18.
5. Yakov Ben-Haim, Robust Reliability in the Mechanical Science, Springer, Berlin ,1996.
6. Hipel, Keith W.; Ben-Haim, Yakov (1999). "Decision making in an uncertain world: Information-gap modelling in water resources management". IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews. 29 (4): 506–517. doi:10.1109/5326.798765. S2CID   14135581.
7. Yakov Ben-Haim, 2005, Info-gap Decision Theory For Engineering Design. Or: Why `Good' is Preferable to `Best', appearing as chapter 11 in Engineering Design Reliability Handbook, Edited by Efstratios Nikolaidis, Dan M.Ghiocel and Surendra Singhal, CRC Press, Boca Raton.
8. Kanno, Y.; Takewaki, I. (2006). "Robustness analysis of trusses with separable load and structural uncertainties". International Journal of Solids and Structures. 43 (9): 2646–2669. doi:10.1016/j.ijsolstr.2005.06.088.
9. Kaihong Wang, 2005, Vibration Analysis of Cracked Composite Bending-torsion Beams for Damage Diagnosis, PhD thesis, Virginia Politechnic Institute, Blacksburg, Virginia.
10. Kanno, Y.; Takewaki, I. (2006). "Sequential semidefinite program for maximum robustness design of structures under load uncertainty". Journal of Optimization Theory and Applications. 130 (2): 265–287. doi:10.1007/s10957-006-9102-z. S2CID   16514524.
11. Pierce, S.G.; Worden, K.; Manson, G. (2006). "A novel information-gap technique to assess reliability of neural network-based damage detection". Journal of Sound and Vibration. 293 (1–2): 96–111. Bibcode:2006JSV...293...96P. doi:10.1016/j.jsv.2005.09.029.
12. Pierce, Gareth; Ben-Haim, Yakov; Worden, Keith; Manson, Graeme (2006). "Evaluation of neural network robust reliability using information-gap theory". IEEE Transactions on Neural Networks. 17 (6): 1349–1361. doi:10.1109/TNN.2006.880363. PMID   17131652. S2CID   13019088.
13. Chetwynd, D.; Worden, K.; Manson, G. (2006). "An application of interval-valued neural networks to a regression problem". Proceedings of the Royal Society A . 462 (2074): 3097–3114. Bibcode:2006RSPSA.462.3097C. doi:10.1098/rspa.2006.1717. S2CID   122820264.
14. Lim, D.; Ong, Y. S.; Jin, Y.; Sendhoff, B.; Lee, B. S. (2006). "Inverse Multi-objective Robust Evolutionary Design" (PDF). Genetic Programming and Evolvable Machines. 7 (4): 383–404. doi:10.1007/s10710-006-9013-7. S2CID   9244713.
15. Vinot, P.; Cogan, S.; Cipolla, V. (2005). "A robust model-based test planning procedure" (PDF). Journal of Sound and Vibration. 288 (3): 571–585. Bibcode:2005JSV...288..571V. doi:10.1016/j.jsv.2005.07.007. S2CID   122895551.
16. Takewaki, Izuru; Ben-Haim, Yakov (2005). "Info-gap robust design with load and model uncertainties". Journal of Sound and Vibration. 288 (3): 551–570. Bibcode:2005JSV...288..551T. doi:10.1016/j.jsv.2005.07.005. S2CID   53466062.
17. Izuru Takewaki and Yakov Ben-Haim, 2007, Info-gap robust design of passively controlled structures with load and model uncertainties, Structural Design Optimization Considering Uncertainties, Yiannis Tsompanakis, Nikkos D. Lagaros and Manolis Papadrakakis, editors, Taylor and Francis Publishers.
18. Hemez, Francois M.; Ben-Haim, Yakov (2004). "Info-gap robustness for the correlation of tests and simulations of a nonlinear transient". Mechanical Systems and Signal Processing. 18 (6): 1443–1467. Bibcode:2004MSSP...18.1443H. doi:10.1016/j.ymssp.2004.03.001.
19. Levy, Jason K.; Hipel, Keith W.; Kilgour, Marc (2000). "Using environmental indicators to quantify the robustness of policy alternatives to uncertainty". Ecological Modelling. 130 (1–3): 79–86. doi:10.1016/S0304-3800(00)00226-X.
20. Moilanen, A.; Wintle, B.A. (2006). "Uncertainty analysis favours selection of spatially aggregated reserve structures". Biological Conservation. 129 (3): 427–434. doi:10.1016/j.biocon.2005.11.006.
21. Halpern, Benjamin S.; Regan, Helen M.; Possingham, Hugh P.; McCarthy, Michael A. (2006). "Accounting for uncertainty in marine reserve design". Ecology Letters. 9 (1): 2–11. Bibcode:2006EcolL...9....2H. doi:10.1111/j.1461-0248.2005.00827.x. PMID   16958861.
22. Regan, Helen M.; Ben-Haim, Yakov; Langford, Bill; Wilson, Will G.; Lundberg, Per; Andelman, Sandy J.; Burgman, Mark A. (2005). "Robust decision making under severe uncertainty for conservation management". Ecological Applications. 15 (4): 1471–1477. Bibcode:2005EcoAp..15.1471R. doi:10.1890/03-5419.
23. McCarthy, M.A.; Lindenmayer, D.B. (2007). "Info-gap decision theory for assessing the management of catchments for timber production and urban water supply". Environmental Management. 39 (4): 553–562. Bibcode:2007EnMan..39..553M. doi:10.1007/s00267-006-0022-3. hdl: 1885/28692 . PMID   17318697. S2CID   45674554.
24. Crone, Elizabeth E.; Pickering, Debbie; Schultz, Cheryl B. (2007). "Can captive rearing promote recovery of endangered butterflies? An assessment in the face of uncertainty". Biological Conservation. 139 (1–2): 103–112. Bibcode:2007BCons.139..103C. doi:10.1016/j.biocon.2007.06.007.
25. L. Joe Moffitt, John K. Stranlund and Craig D. Osteen, 2007, Robust detection protocols for uncertain introductions of invasive species, Journal of Environmental Management, In Press, Corrected Proof, Available online 27 August 2007.
26. Burgman, M. A.; Lindenmayer, D.B.; Elith, J. (2005). "Managing landscapes for conservation under uncertainty" (PDF). Ecology. 86 (8): 2007–2017. Bibcode:2005Ecol...86.2007B. CiteSeerX   10.1.1.477.4238 . doi:10.1890/04-0906.
27. Moilanen, A.; Elith, J.; Burgman, M.; Burgman, M (2006). "Uncertainty analysis for regional-scale reserve selection". Conservation Biology. 20 (6): 1688–1697. Bibcode:2006ConBi..20.1688M. doi:10.1111/j.1523-1739.2006.00560.x. PMID   17181804. S2CID   28613050.
28. Moilanen, Atte; Runge, Michael C.; Elith, Jane; Tyre, Andrew; Carmel, Yohay; Fegraus, Eric; Wintle, Brendan; Burgman, Mark; Benhaim, Y (2006). "Planning for robust reserve networks using uncertainty analysis". Ecological Modelling. 199 (1): 115–124. doi:10.1016/j.ecolmodel.2006.07.004. S2CID   2406867.
29. Nicholson, Emily; Possingham, Hugh P. (2007). "Making conservation decisions under uncertainty for the persistence of multiple species" (PDF). Ecological Applications. 17 (1): 251–265. doi:10.1890/1051-0761(2007)017[0251:MCDUUF]2.0.CO;2. PMID   17479849.
30. Burgman, Mark, 2005, Risks and Decisions for Conservation and Environmental Management, Cambridge University Press, Cambridge.
31. Carmel, Yohay; Ben-Haim, Yakov (2005). "Info-gap robust-satisficing model of foraging behavior: Do foragers optimize or satisfice?". American Naturalist. 166 (5): 633–641. doi:10.1086/491691. PMID   16224728. S2CID   20509139.
32. Moffitt, Joe; Stranlund, John K.; Field, Barry C. (2005). "Inspections to Avert Terrorism: Robustness Under Severe Uncertainty". Journal of Homeland Security and Emergency Management. 2 (3): 3. doi:10.2202/1547-7355.1134. S2CID   55708128. Archived from the original on 2006-03-23. Retrieved 2006-04-21.
33. Beresford-Smith, Bryan; Thompson, Colin J. (2007). "Managing credit risk with info-gap uncertainty". The Journal of Risk Finance. 8 (1): 24–34. doi:10.1108/15265940710721055.
34. John K. Stranlund and Yakov Ben-Haim, (2007), Price-based vs. quantity-based environmental regulation under Knightian uncertainty: An info-gap robust satisficing perspective, Journal of Environmental Management, In Press, Corrected Proof, Available online 28 March 2007.
35. Ben-Haim, Yakov (2005). "Value at risk with Info-gap uncertainty". Journal of Risk Finance. 6 (5): 388–403. doi:10.1108/15265940510633460. S2CID   154808813.
36. Ben-Haim, Yakov; Laufer, Alexander (1998). "Robust reliability of projects with activity-duration uncertainty". Journal of Construction Engineering and Management. 124 (2): 125–132. doi:10.1061/(ASCE)0733-9364(1998)124:2(125).
37. Tahan, Meir; Ben-Asher, Joseph Z. (2005). "Modeling and analysis of integration processes for engineering systems". Systems Engineering. 8 (1): 62–77. doi:10.1002/sys.20021. S2CID   3178866.
38. Regev, Sary; Shtub, Avraham; Ben-Haim, Yakov (2006). "Managing project risks as knowledge gaps". Project Management Journal. 37 (5): 17–25. doi:10.1177/875697280603700503. S2CID   110857106.
39. Fox, D.R.; Ben-Haim, Y.; Hayes, K.R.; McCarthy, M.; Wintle, B.; Dunstan, P. (2007). "An Info-Gap Approach to Power and Sample-size calculations". Environmetrics. 18 (2): 189–203. Bibcode:2007Envir..18..189F. doi:10.1002/env.811. S2CID   53609269.
40. Ben-Haim, Yakov (1994). "Convex models of uncertainty: Applications and Implications". Erkenntnis. 41 (2): 139–156. doi:10.1007/BF01128824. S2CID   121067986.
41. Ben-Haim, Yakov (1999). "Set-models of information-gap uncertainty: Axioms and an inference scheme". Journal of the Franklin Institute. 336 (7): 1093–1117. doi:10.1016/S0016-0032(99)00024-1.
42. Ben-Haim, Yakov (2000). "Robust rationality and decisions under severe uncertainty". Journal of the Franklin Institute. 337 (2–3): 171–199. doi:10.1016/S0016-0032(00)00016-8.
43. Ben-Haim, Yakov (2004). "Uncertainty, probability and information-gaps". Reliability Engineering and System Safety. 85 (1–3): 249–266. doi:10.1016/j.ress.2004.03.015.
44. George J. Klir, 2006, Uncertainty and Information: Foundations of Generalized Information Theory, Wiley Publishers.
45. Yakov Ben-Haim, 2007, Peirce, Haack and Info-gaps, in Susan Haack, A Lady of Distinctions: The Philosopher Responds to Her Critics, edited by Cornelis de Waal, Prometheus Books.
46. Burgman, Mark, 2005, Risks and Decisions for Conservation and Environmental Management, Cambridge University Press, Cambridge, pp.399.
47. Sniedovich, M. (2007). "The art and science of modeling decision-making under severe uncertainty" (PDF). Decision Making in Manufacturing and Services. 1 (1–2): 109–134. doi: 10.7494/dmms.2007.1.2.111 .
48. Simon, Herbert A. (1959). "Theories of decision making in economics and behavioral science". American Economic Review. 49: 253–283.
49. Schwartz, Barry, 2004, Paradox of Choice: Why More Is Less, Harper Perennial.
50. Conlisk, John (1996). "Why bounded rationality?". Journal of Economic Literature. XXXIV: 669–700.
51. Burgman, Mark, 2005, Risks and Decisions for Conservation and Environmental Management, Cambridge University Press, Cambridge, pp.391, 394.
52. Vinot, P.; Cogan, S.; Cipolla, V. (2005). "A robust model-based test planning procedure" (PDF). Journal of Sound and Vibration. 288 (3): 572. Bibcode:2005JSV...288..571V. doi:10.1016/j.jsv.2005.07.007. S2CID   122895551.
53. Z. Ben-Haim and Y. C. Eldar, Maximum set estimators with bounded estimation error, IEEE Trans. Signal Process., vol. 53, no. 8, August 2005, pp. 3172-3182.
54. Babuška, I., F. Nobile and R. Tempone, 2005, Worst case scenario analysis for elliptic problems with uncertainty, Numerische Mathematik (in English) vol.101 pp.185–219.
55. Ben-Haim, Yakov; Cogan, Scott; Sanseigne, Laetitia (1998). "Usability of Mathematical Models in Mechanical Decision Processes". Mechanical Systems and Signal Processing. 12 (1): 121–134. Bibcode:1998MSSP...12..121B. doi:10.1006/mssp.1996.0137.
56. (See also chapter 4 in Yakov Ben-Haim, Ref. 2.)
57. Rosenhead, M.J.; Elton, M.; Gupta, S.K. (1972). "Robustness and Optimality as Criteria for Strategic Decisions". Operational Research Quarterly. 23 (4): 413–430. doi:10.1057/jors.1972.72.
58. Rosenblatt, M.J.; Lee, H.L. (1987). "A robustness approach to facilities design". International Journal of Production Research. 25 (4): 479–486. doi:10.1080/00207548708919855.
59. P. Kouvelis and G. Yu, 1997, Robust Discrete Optimization and Its Applications, Kluwer.
60. B. Rustem and M. Howe, 2002, Algorithms for Worst-case Design and Applications to Risk Management, Princeton University Press.
61. R.J. Lempert, S.W. Popper, and S.C. Bankes, 2003, Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis, The Rand Corporation.
62. A. Ben-Tal, L. El Ghaoui, and A. Nemirovski, 2006, Mathematical Programming, Special issue on Robust Optimization, Volume 107(1-2).
63. Resnik, M.D., Choices: an Introduction to Decision Theory, University of Minnesota Press, Minneapolis, MN, 1987.
64. French, S.D., Decision Theory, Ellis Horwood, 1988.

External links

• Info-Gap Theory and Its Applications, further information on info-gap theory

  What is Info-Gap Theory? informal introduction

  Making Responsible Decisions (When it Seems that You Can't): Engineering Design and Strategic Planning Under Severe Uncertainty

  How Did Info-Gap Theory Start? How Does it Grow?

  Frequently Asked Questions about info-gap theory

• Info-Gap Campaign Archived 2011-07-14 at the Wayback Machine , further analysis and critique of info-gap

  Frequently Asked Questions about Info-Gap Decision Theory (PDF)