Info-gap decision theory

Last updated

Info-gap decision theory seeks to optimize robustness to failure under severe uncertainty, [1] [2] in particular applying sensitivity analysis of the stability radius type [3] to perturbations in the value of a given estimate of the parameter of interest. It has some connections with Wald's maximin model; some authors distinguish them, others consider them instances of the same principle.

Contents

It was developed by Yakov Ben-Haim, [4] and has found many applications and described as a theory for decision-making under "severe uncertainty". It has been criticized as unsuited for this purpose, and alternatives proposed, including such classical approaches as robust optimization.

Applications

Info-gap theory has generated a lot of literature. Info-gap theory has been studied or applied in a range of applications including engineering, [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] [18] biological conservation, [19] [20] [21] [22] [23] [24] [25] [26] [27] [28] [29] [30] theoretical biology, [31] homeland security, [32] economics, [33] [34] [35] project management [36] [37] [38] and statistics. [39] Foundational issues related to info-gap theory have also been studied. [40] [41] [42] [43] [44] [45]

Engineering

A typical engineering application is the vibration analysis of a cracked beam, where the location, size, shape and orientation of the crack is unknown and greatly influence the vibration dynamics. [9] Very little is usually known about these spatial and geometrical uncertainties. The info-gap analysis allows one to model these uncertainties, and to determine the degree of robustness - to these uncertainties - of properties such as vibration amplitude, natural frequencies, and natural modes of vibration. Another example is the structural design of a building subject to uncertain loads such as from wind or earthquakes. [8] [10] The response of the structure depends strongly on the spatial and temporal distribution of the loads. However, storms and earthquakes are highly idiosyncratic events, and the interaction between the event and the structure involves very site-specific mechanical properties which are rarely known. The info-gap analysis enables the design of the structure to enhance structural immunity against uncertain deviations from design-base or estimated worst-case loads.[ citation needed ] Another engineering application involves the design of a neural net for detecting faults in a mechanical system, based on real-time measurements. A major difficulty is that faults are highly idiosyncratic, so that training data for the neural net will tend to differ substantially from data obtained from real-time faults after the net has been trained. The info-gap robustness strategy enables one to design the neural net to be robust to the disparity between training data and future real events. [11] [13]

Biology

The conservation biologist faces info-gaps in using biological models. They use info-gap robustness curves to select among management options for spruce-budworm populations in Eastern Canada. Burgman [46] uses the fact that the robustness curves of different alternatives can intersect.

Project management

Project management is another area where info-gap uncertainty is common. The project manager often has very limited information about the duration and cost of some of the tasks in the project, and info-gap robustness can assist in project planning and integration. [37] Financial economics is another area where the future is unpredictable, which may be either pernicious or propitious. Info-gap robustness and opportuneness analyses can assist in portfolio design, credit rationing, and other applications. [33]

Criticism

A general criticism of non-probabilistic decision rules, discussed in detail at decision theory: alternatives to probability theory, is that optimal decision rules (formally, admissible decision rules) can always be derived by probabilistic methods, with a suitable utility function and prior distribution (this is the statement of the complete class theorems), and thus that non-probabilistic methods such as info-gap are unnecessary and do not yield new or better decision rules.

A more general criticism of decision making under uncertainty is the impact of outsized, unexpected events, ones that are not captured by the model. This is discussed particularly in black swan theory, and info-gap, used in isolation, is vulnerable to this, as are a fortiori all decision theories that use a fixed universe of possibilities, notably probabilistic ones.

Sniedovich [47] raises two points to info-gap decision theory, one substantive, one scholarly:

1. the info-gap uncertainty model is flawed and oversold
One should consider the range of possibilities, not its subsets. Sniedovich argues that info-gap decision theory is therefore a "voodoo decision theory."
2. info-gap is maximin
Ben-Haim states (Ben-Haim 1999, pp. 271–2) that "robust reliability is emphatically not a [min-max] worst-case analysis". Note that Ben-Haim compares info-gap to minimax, while Sniedovich considers it a case of maximin.

Sniedovich has challenged the validity of info-gap theory for making decisions under severe uncertainty. Sniedovich notes that the info-gap robustness function is "local" to the region around , where is likely to be substantially in error.

Maximin

Symbolically, max assuming min (worst-case) outcome, or maximin.

In other words, while it is not a maximin analysis of outcome over the universe of uncertainty, it is a maximin analysis over a properly construed decision space.

Ben-Haim argues that info-gap's robustness model is not min-max/maximin analysis because it is not worst-case analysis of outcomes; it is a satisficing model, not an optimization model – a (straightforward) maximin analysis would consider worst-case outcomes over the entire space which, since uncertainty is often potentially unbounded, would yield an unbounded bad worst case.

Stability radius

Sniedovich [3] has shown that info-gap's robustness model is a simple stability radius model, namely a local stability model of the generic form

where denotes a ball of radius centered at and denotes the set of values of that satisfy pre-determined stability conditions.

In other words, info-gap's robustness model is a stability radius model characterized by a stability requirement of the form . Since stability radius models are designed for the analysis of small perturbations in a given nominal value of a parameter, Sniedovich [3] argues that info-gap's robustness model is unsuitable for the treatment of severe uncertainty characterized by a poor estimate and a vast uncertainty space.

Discussion

Satisficing and bounded rationality

It is correct that the info-gap robustness function is local, and has restricted quantitative value in some cases. However, a major purpose of decision analysis is to provide focus for subjective judgments. That is, regardless of the formal analysis, a framework for discussion is provided. Without entering into any particular framework, or characteristics of frameworks in general, discussion follows about proposals for such frameworks.

Simon [48] introduced the idea of bounded rationality. Limitations on knowledge, understanding, and computational capability constrain the ability of decision makers to identify optimal choices. Simon advocated satisficing rather than optimizing: seeking adequate (rather than optimal) outcomes given available resources. Schwartz, [49] Conlisk [50] and others discuss extensive evidence for the phenomenon of bounded rationality among human decision makers, as well as for the advantages of satisficing when knowledge and understanding are deficient. The info-gap robustness function provides a means of implementing a satisficing strategy under bounded rationality. For instance, in discussing bounded rationality and satisficing in conservation and environmental management, Burgman notes that "Info-gap theory ... can function sensibly when there are 'severe' knowledge gaps." The info-gap robustness and opportuneness functions provide "a formal framework to explore the kinds of speculations that occur intuitively when examining decision options." [51] Burgman then proceeds to develop an info-gap robust-satisficing strategy for protecting the endangered orange-bellied parrot. Similarly, Vinot, Cogan and Cipolla [52] discuss engineering design and note that "the downside of a model-based analysis lies in the knowledge that the model behavior is only an approximation to the real system behavior. Hence the question of the honest designer: how sensitive is my measure of design success to uncertainties in my system representation? ... It is evident that if model-based analysis is to be used with any level of confidence then ... [one must] attempt to satisfy an acceptable sub-optimal level of performance while remaining maximally robust to the system uncertainties." [52] They proceed to develop an info-gap robust-satisficing design procedure for an aerospace application.

Alternatives

Of course, decision in the face of uncertainty is nothing new, and attempts to deal with it have a long history. A number of authors have noted and discussed similarities and differences between info-gap robustness and minimax or worst-case methods [7] [16] [35] [37] [53] . [54] Sniedovich [47] has demonstrated formally that the info-gap robustness function can be represented as a maximin optimization, and is thus related to Wald's minimax theory. Sniedovich [47] has claimed that info-gap's robustness analysis is conducted in the neighborhood of an estimate that is likely to be substantially wrong, concluding that the resulting robustness function is equally likely to be substantially wrong.

On the other hand, the estimate is the best one has, so it is useful to know if it can err greatly and still yield an acceptable outcome. This critical question clearly raises the issue of whether robustness (as defined by info-gap theory) is qualified to judge whether confidence is warranted, [5] [55] [56] and how it compares to methods used to inform decisions under uncertainty using considerations not limited to the neighborhood of a bad initial guess. Answers to these questions vary with the particular problem at hand. Some general comments follow.

Sensitivity analysis

Sensitivity analysis – how sensitive conclusions are to input assumptions – can be performed independently of a model of uncertainty: most simply, one may take two different assumed values for an input and compares the conclusions. From this perspective, info-gap can be seen as a technique of sensitivity analysis, though by no means the only.

Robust optimization

The robust optimization literature [57] [58] [59] [60] [61] [62] provides methods and techniques that take a global approach to robustness analysis. These methods directly address decision under severe uncertainty, and have been used for this purpose for more than thirty years now. Wald's Maximin model is the main instrument used by these methods.

The principal difference between the Maximin model employed by info-gap and the various Maximin models employed by robust optimization methods is in the manner in which the total region of uncertainty is incorporated in the robustness model. Info-gap takes a local approach that concentrates on the immediate neighborhood of the estimate. In sharp contrast, robust optimization methods set out to incorporate in the analysis the entire region of uncertainty, or at least an adequate representation thereof. In fact, some of these methods do not even use an estimate.

Comparative analysis

Classical decision theory, [63] [64] offers two approaches to decision-making under severe uncertainty, namely maximin and Laplaces' principle of insufficient reason (assume all outcomes equally likely); these may be considered alternative solutions to the problem info-gap addresses.

Further, as discussed at decision theory: alternatives to probability theory, probabilists, particularly Bayesians probabilists, argue that optimal decision rules (formally, admissible decision rules) can always be derived by probabilistic methods (this is the statement of the complete class theorems), and thus that non-probabilistic methods such as info-gap are unnecessary and do not yield new or better decision rules.

Maximin

As attested by the rich literature on robust optimization, maximin provides a wide range of methods for decision making in the face of severe uncertainty.

Indeed, as discussed in criticism of info-gap decision theory, info-gap's robustness model can be interpreted as an instance of the general maximin model.

Bayesian analysis

As for Laplaces' principle of insufficient reason, in this context it is convenient to view it as an instance of Bayesian analysis.

The essence of the Bayesian analysis is applying probabilities for different possible realizations of the uncertain parameters. In the case of Knightian (non-probabilistic) uncertainty, these probabilities represent the decision maker's "degree of belief" in a specific realization.

In our example, suppose there are only five possible realizations of the uncertain revenue to allocation function. The decision maker believes that the estimated function is the most likely, and that the likelihood decreases as the difference from the estimate increases. Figure 11 exemplifies such a probability distribution.

Figure 11 - Probability distribution of the revenue function realizations IGT-example11.png
Figure 11 – Probability distribution of the revenue function realizations

Now, for any allocation, one can construct a probability distribution of the revenue, based on his prior beliefs. The decision maker can then choose the allocation with the highest expected revenue, with the lowest probability for an unacceptable revenue, etc.

The most problematic step of this analysis is the choice of the realizations probabilities. When there is an extensive and relevant past experience, an expert may use this experience to construct a probability distribution. But even with extensive past experience, when some parameters change, the expert may only be able to estimate that is more likely than , but will not be able to reliably quantify this difference. Furthermore, when conditions change drastically, or when there is no past experience at all, it may prove to be difficult even estimating whether is more likely than .

Nevertheless, methodologically speaking, this difficulty is not as problematic as basing the analysis of a problem subject to severe uncertainty on a single point estimate and its immediate neighborhood, as done by info-gap. And what is more, contrary to info-gap, this approach is global, rather than local.

Still, it must be stressed that Bayesian analysis does not expressly concern itself with the question of robustness.

Bayesian analysis raises the issue of learning from experience and adjusting probabilities accordingly. In other words, decision is not a one-stop process, but profits from a sequence of decisions and observations.

See also

Notes

    Related Research Articles

    Satisficing is a decision-making strategy or cognitive heuristic that entails searching through the available alternatives until an acceptability threshold is met. The term satisficing, a portmanteau of satisfy and suffice, was introduced by Herbert A. Simon in 1956, although the concept was first posited in his 1947 book Administrative Behavior. Simon used satisficing to explain the behavior of decision makers under circumstances in which an optimal solution cannot be determined. He maintained that many natural problems are characterized by computational intractability or a lack of information, both of which preclude the use of mathematical optimization procedures. He observed in his Nobel Prize in Economics speech that "decision makers can satisfice either by finding optimum solutions for a simplified world, or by finding satisfactory solutions for a more realistic world. Neither approach, in general, dominates the other, and both have continued to co-exist in the world of management science".

    Global optimization is a branch of applied mathematics and numerical analysis that attempts to find the global minima or maxima of a function or a set of functions on a given set. It is usually described as a minimization problem because the maximization of the real-valued function is equivalent to the minimization of the function .

    Sensitivity analysis is the study of how the uncertainty in the output of a mathematical model or system can be divided and allocated to different sources of uncertainty in its inputs. This involves estimating sensitivity indices that quantify the influence of an input or group of inputs on the output. A related practice is uncertainty analysis, which has a greater focus on uncertainty quantification and propagation of uncertainty; ideally, uncertainty and sensitivity analysis should be run in tandem.

    Model predictive control (MPC) is an advanced method of process control that is used to control a process while satisfying a set of constraints. It has been in use in the process industries in chemical plants and oil refineries since the 1980s. In recent years it has also been used in power system balancing models and in power electronics. Model predictive controllers rely on dynamic models of the process, most often linear empirical models obtained by system identification. The main advantage of MPC is the fact that it allows the current timeslot to be optimized, while keeping future timeslots in account. This is achieved by optimizing a finite time-horizon, but only implementing the current timeslot and then optimizing again, repeatedly, thus differing from a linear–quadratic regulator (LQR). Also MPC has the ability to anticipate future events and can take control actions accordingly. PID controllers do not have this predictive ability. MPC is nearly universally implemented as a digital control, although there is research into achieving faster response times with specially designed analog circuitry.

    Bayesian experimental design provides a general probability-theoretical framework from which other theories on experimental design can be derived. It is based on Bayesian inference to interpret the observations/data acquired during the experiment. This allows accounting for both any prior knowledge on the parameters to be determined as well as uncertainties in observations.

    In decision theory, the Ellsberg paradox is a paradox in which people's decisions are inconsistent with subjective expected utility theory. John Maynard Keynes published a version of the paradox in 1921. Daniel Ellsberg popularized the paradox in his 1961 paper, "Risk, Ambiguity, and the Savage Axioms". It is generally taken to be evidence of ambiguity aversion, in which a person tends to prefer choices with quantifiable risks over those with unknown, incalculable risks.

    <span class="mw-page-title-main">Stability radius</span> Concept in mathematics

    In mathematics, the stability radius of an object at a given nominal point is the radius of the largest ball, centered at the nominal point, all of whose elements satisfy pre-determined stability conditions. The picture of this intuitive notion is this:

    Imprecise probability generalizes probability theory to allow for partial probability specifications, and is applicable when information is scarce, vague, or conflicting, in which case a unique probability distribution may be hard to identify. Thereby, the theory aims to represent the available knowledge more accurately. Imprecision is useful for dealing with expert elicitation, because:

    Uncertainty quantification (UQ) is the science of quantitative characterization and estimation of uncertainties in both computational and real world applications. It tries to determine how likely certain outcomes are if some aspects of the system are not exactly known. An example would be to predict the acceleration of a human body in a head-on crash with another car: even if the speed was exactly known, small differences in the manufacturing of individual cars, how tightly every bolt has been tightened, etc., will lead to different results that can only be predicted in a statistical sense.

    Robust optimization is a field of mathematical optimization theory that deals with optimization problems in which a certain measure of robustness is sought against uncertainty that can be represented as deterministic variability in the value of the parameters of the problem itself and/or its solution. It is related to, but often distinguished from, probabilistic optimization methods such as chance-constrained optimization.

    <span class="mw-page-title-main">Probabilistic design</span> Discipline within engineering design

    Probabilistic design is a discipline within engineering design. It deals primarily with the consideration and minimization of the effects of random variability upon the performance of an engineering system during the design phase. Typically, these effects studied and optimized are related to quality and reliability. It differs from the classical approach to design by assuming a small probability of failure instead of using the safety factor. Probabilistic design is used in a variety of different applications to assess the likelihood of failure. Disciplines which extensively use probabilistic design principles include product design, quality control, systems engineering, machine design, civil engineering and manufacturing.

    In decision theory, on making decisions under uncertainty—should information about the best course of action arrive after taking a fixed decision—the human emotional response of regret is often experienced, and can be measured as the value of difference between a made decision and the optimal decision.

    The scenario approach or scenario optimization approach is a technique for obtaining solutions to robust optimization and chance-constrained optimization problems based on a sample of the constraints. It also relates to inductive reasoning in modeling and decision-making. The technique has existed for decades as a heuristic approach and has more recently been given a systematic theoretical foundation.

    Robust decision-making (RDM) is an iterative decision analytics framework that aims to help identify potential robust strategies, characterize the vulnerabilities of such strategies, and evaluate the tradeoffs among them. RDM focuses on informing decisions under conditions of what is called "deep uncertainty", that is, conditions where the parties to a decision do not know or do not agree on the system models relating actions to consequences or the prior probability distributions for the key input parameters to those models.

    In decision theory and game theory, Wald's maximin model is a non-probabilistic decision-making model according to which decisions are ranked on the basis of their worst-case outcomes – the optimal decision is one with the least bad worst outcome. It is one of the most important models in robust decision making in general and robust optimization in particular.

    <span class="mw-page-title-main">Probability box</span> Characterization of uncertain numbers consisting of both aleatoric and epistemic uncertainties

    A probability box is a characterization of uncertain numbers consisting of both aleatoric and epistemic uncertainties that is often used in risk analysis or quantitative uncertainty modeling where numerical calculations must be performed. Probability bounds analysis is used to make arithmetic and logical calculations with p-boxes.

    Probability bounds analysis (PBA) is a collection of methods of uncertainty propagation for making qualitative and quantitative calculations in the face of uncertainties of various kinds. It is used to project partial information about random variables and other quantities through mathematical expressions. For instance, it computes sure bounds on the distribution of a sum, product, or more complex function, given only sure bounds on the distributions of the inputs. Such bounds are called probability boxes, and constrain cumulative probability distributions.

    P-boxes and probability bounds analysis have been used in many applications spanning many disciplines in engineering and environmental science, including:

    In regression analysis, an interval predictor model (IPM) is an approach to regression where bounds on the function to be approximated are obtained. This differs from other techniques in machine learning, where usually one wishes to estimate point values or an entire probability distribution. Interval Predictor Models are sometimes referred to as a nonparametric regression technique, because a potentially infinite set of functions are contained by the IPM, and no specific distribution is implied for the regressed variables.

    Probabilistic numerics is an active field of study at the intersection of applied mathematics, statistics, and machine learning centering on the concept of uncertainty in computation. In probabilistic numerics, tasks in numerical analysis such as finding numerical solutions for integration, linear algebra, optimization and simulation and differential equations are seen as problems of statistical, probabilistic, or Bayesian inference.

    References

    1. Yakov Ben-Haim, Information-Gap Theory: Decisions Under Severe Uncertainty, Academic Press, London, 2001.
    2. Yakov Ben-Haim, Info-Gap Theory: Decisions Under Severe Uncertainty, 2nd edition, Academic Press, London, 2006.
    3. 1 2 3 Sniedovich, M. (2010). "A bird's view of info-gap decision theory". Journal of Risk Finance. 11 (3): 268–283. doi:10.1108/15265941011043648.
    4. "How Did Info-Gap Theory Start? How Does it Grow?". Archived from the original on 2009-11-28. Retrieved 2009-03-18.
    5. 1 2 Yakov Ben-Haim, Robust Reliability in the Mechanical Science, Springer, Berlin ,1996.
    6. Hipel, Keith W.; Ben-Haim, Yakov (1999). "Decision making in an uncertain world: Information-gap modelling in water resources management". IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews. 29 (4): 506–517. doi:10.1109/5326.798765. S2CID   14135581.
    7. 1 2 Yakov Ben-Haim, 2005, Info-gap Decision Theory For Engineering Design. Or: Why `Good' is Preferable to `Best', appearing as chapter 11 in Engineering Design Reliability Handbook, Edited by Efstratios Nikolaidis, Dan M.Ghiocel and Surendra Singhal, CRC Press, Boca Raton.
    8. 1 2 Kanno, Y.; Takewaki, I. (2006). "Robustness analysis of trusses with separable load and structural uncertainties". International Journal of Solids and Structures. 43 (9): 2646–2669. doi:10.1016/j.ijsolstr.2005.06.088.
    9. 1 2 Kaihong Wang, 2005, Vibration Analysis of Cracked Composite Bending-torsion Beams for Damage Diagnosis, PhD thesis, Virginia Politechnic Institute, Blacksburg, Virginia.
    10. 1 2 Kanno, Y.; Takewaki, I. (2006). "Sequential semidefinite program for maximum robustness design of structures under load uncertainty". Journal of Optimization Theory and Applications. 130 (2): 265–287. doi:10.1007/s10957-006-9102-z. S2CID   16514524.
    11. 1 2 Pierce, S.G.; Worden, K.; Manson, G. (2006). "A novel information-gap technique to assess reliability of neural network-based damage detection". Journal of Sound and Vibration. 293 (1–2): 96–111. Bibcode:2006JSV...293...96P. doi:10.1016/j.jsv.2005.09.029.
    12. Pierce, Gareth; Ben-Haim, Yakov; Worden, Keith; Manson, Graeme (2006). "Evaluation of neural network robust reliability using information-gap theory". IEEE Transactions on Neural Networks. 17 (6): 1349–1361. doi:10.1109/TNN.2006.880363. PMID   17131652. S2CID   13019088.
    13. 1 2 Chetwynd, D.; Worden, K.; Manson, G. (2006). "An application of interval-valued neural networks to a regression problem". Proceedings of the Royal Society A . 462 (2074): 3097–3114. Bibcode:2006RSPSA.462.3097C. doi:10.1098/rspa.2006.1717. S2CID   122820264.
    14. Lim, D.; Ong, Y. S.; Jin, Y.; Sendhoff, B.; Lee, B. S. (2006). "Inverse Multi-objective Robust Evolutionary Design" (PDF). Genetic Programming and Evolvable Machines. 7 (4): 383–404. doi:10.1007/s10710-006-9013-7. S2CID   9244713.
    15. Vinot, P.; Cogan, S.; Cipolla, V. (2005). "A robust model-based test planning procedure" (PDF). Journal of Sound and Vibration. 288 (3): 571–585. Bibcode:2005JSV...288..571V. doi:10.1016/j.jsv.2005.07.007. S2CID   122895551.
    16. 1 2 Takewaki, Izuru; Ben-Haim, Yakov (2005). "Info-gap robust design with load and model uncertainties". Journal of Sound and Vibration. 288 (3): 551–570. Bibcode:2005JSV...288..551T. doi:10.1016/j.jsv.2005.07.005. S2CID   53466062.
    17. Izuru Takewaki and Yakov Ben-Haim, 2007, Info-gap robust design of passively controlled structures with load and model uncertainties, Structural Design Optimization Considering Uncertainties, Yiannis Tsompanakis, Nikkos D. Lagaros and Manolis Papadrakakis, editors, Taylor and Francis Publishers.
    18. Hemez, Francois M.; Ben-Haim, Yakov (2004). "Info-gap robustness for the correlation of tests and simulations of a nonlinear transient". Mechanical Systems and Signal Processing. 18 (6): 1443–1467. Bibcode:2004MSSP...18.1443H. doi:10.1016/j.ymssp.2004.03.001.
    19. Levy, Jason K.; Hipel, Keith W.; Kilgour, Marc (2000). "Using environmental indicators to quantify the robustness of policy alternatives to uncertainty". Ecological Modelling. 130 (1–3): 79–86. doi:10.1016/S0304-3800(00)00226-X.
    20. Moilanen, A.; Wintle, B.A. (2006). "Uncertainty analysis favours selection of spatially aggregated reserve structures". Biological Conservation. 129 (3): 427–434. doi:10.1016/j.biocon.2005.11.006.
    21. Halpern, Benjamin S.; Regan, Helen M.; Possingham, Hugh P.; McCarthy, Michael A. (2006). "Accounting for uncertainty in marine reserve design". Ecology Letters. 9 (1): 2–11. Bibcode:2006EcolL...9....2H. doi:10.1111/j.1461-0248.2005.00827.x. PMID   16958861.
    22. Regan, Helen M.; Ben-Haim, Yakov; Langford, Bill; Wilson, Will G.; Lundberg, Per; Andelman, Sandy J.; Burgman, Mark A. (2005). "Robust decision making under severe uncertainty for conservation management". Ecological Applications. 15 (4): 1471–1477. Bibcode:2005EcoAp..15.1471R. doi:10.1890/03-5419.
    23. McCarthy, M.A.; Lindenmayer, D.B. (2007). "Info-gap decision theory for assessing the management of catchments for timber production and urban water supply". Environmental Management. 39 (4): 553–562. Bibcode:2007EnMan..39..553M. doi:10.1007/s00267-006-0022-3. hdl: 1885/28692 . PMID   17318697. S2CID   45674554.
    24. Crone, Elizabeth E.; Pickering, Debbie; Schultz, Cheryl B. (2007). "Can captive rearing promote recovery of endangered butterflies? An assessment in the face of uncertainty". Biological Conservation. 139 (1–2): 103–112. Bibcode:2007BCons.139..103C. doi:10.1016/j.biocon.2007.06.007.
    25. L. Joe Moffitt, John K. Stranlund and Craig D. Osteen, 2007, Robust detection protocols for uncertain introductions of invasive species, Journal of Environmental Management, In Press, Corrected Proof, Available online 27 August 2007.
    26. Burgman, M. A.; Lindenmayer, D.B.; Elith, J. (2005). "Managing landscapes for conservation under uncertainty" (PDF). Ecology. 86 (8): 2007–2017. Bibcode:2005Ecol...86.2007B. CiteSeerX   10.1.1.477.4238 . doi:10.1890/04-0906.
    27. Moilanen, A.; Elith, J.; Burgman, M.; Burgman, M (2006). "Uncertainty analysis for regional-scale reserve selection". Conservation Biology. 20 (6): 1688–1697. Bibcode:2006ConBi..20.1688M. doi:10.1111/j.1523-1739.2006.00560.x. PMID   17181804. S2CID   28613050.
    28. Moilanen, Atte; Runge, Michael C.; Elith, Jane; Tyre, Andrew; Carmel, Yohay; Fegraus, Eric; Wintle, Brendan; Burgman, Mark; Benhaim, Y (2006). "Planning for robust reserve networks using uncertainty analysis". Ecological Modelling. 199 (1): 115–124. doi:10.1016/j.ecolmodel.2006.07.004. S2CID   2406867.
    29. Nicholson, Emily; Possingham, Hugh P. (2007). "Making conservation decisions under uncertainty for the persistence of multiple species" (PDF). Ecological Applications. 17 (1): 251–265. doi:10.1890/1051-0761(2007)017[0251:MCDUUF]2.0.CO;2. PMID   17479849.
    30. Burgman, Mark, 2005, Risks and Decisions for Conservation and Environmental Management, Cambridge University Press, Cambridge.
    31. Carmel, Yohay; Ben-Haim, Yakov (2005). "Info-gap robust-satisficing model of foraging behavior: Do foragers optimize or satisfice?". American Naturalist. 166 (5): 633–641. doi:10.1086/491691. PMID   16224728. S2CID   20509139.
    32. Moffitt, Joe; Stranlund, John K.; Field, Barry C. (2005). "Inspections to Avert Terrorism: Robustness Under Severe Uncertainty". Journal of Homeland Security and Emergency Management. 2 (3): 3. doi:10.2202/1547-7355.1134. S2CID   55708128. Archived from the original on 2006-03-23. Retrieved 2006-04-21.
    33. 1 2 Beresford-Smith, Bryan; Thompson, Colin J. (2007). "Managing credit risk with info-gap uncertainty". The Journal of Risk Finance. 8 (1): 24–34. doi:10.1108/15265940710721055.
    34. John K. Stranlund and Yakov Ben-Haim, (2007), Price-based vs. quantity-based environmental regulation under Knightian uncertainty: An info-gap robust satisficing perspective, Journal of Environmental Management, In Press, Corrected Proof, Available online 28 March 2007.
    35. 1 2 Ben-Haim, Yakov (2005). "Value at risk with Info-gap uncertainty". Journal of Risk Finance. 6 (5): 388–403. doi:10.1108/15265940510633460. S2CID   154808813.
    36. Ben-Haim, Yakov; Laufer, Alexander (1998). "Robust reliability of projects with activity-duration uncertainty". Journal of Construction Engineering and Management. 124 (2): 125–132. doi:10.1061/(ASCE)0733-9364(1998)124:2(125).
    37. 1 2 3 Tahan, Meir; Ben-Asher, Joseph Z. (2005). "Modeling and analysis of integration processes for engineering systems". Systems Engineering. 8 (1): 62–77. doi:10.1002/sys.20021. S2CID   3178866.
    38. Regev, Sary; Shtub, Avraham; Ben-Haim, Yakov (2006). "Managing project risks as knowledge gaps". Project Management Journal. 37 (5): 17–25. doi:10.1177/875697280603700503. S2CID   110857106.
    39. Fox, D.R.; Ben-Haim, Y.; Hayes, K.R.; McCarthy, M.; Wintle, B.; Dunstan, P. (2007). "An Info-Gap Approach to Power and Sample-size calculations". Environmetrics. 18 (2): 189–203. Bibcode:2007Envir..18..189F. doi:10.1002/env.811. S2CID   53609269.
    40. Ben-Haim, Yakov (1994). "Convex models of uncertainty: Applications and Implications". Erkenntnis. 41 (2): 139–156. doi:10.1007/BF01128824. S2CID   121067986.
    41. Ben-Haim, Yakov (1999). "Set-models of information-gap uncertainty: Axioms and an inference scheme". Journal of the Franklin Institute. 336 (7): 1093–1117. doi:10.1016/S0016-0032(99)00024-1.
    42. Ben-Haim, Yakov (2000). "Robust rationality and decisions under severe uncertainty". Journal of the Franklin Institute. 337 (2–3): 171–199. doi:10.1016/S0016-0032(00)00016-8.
    43. Ben-Haim, Yakov (2004). "Uncertainty, probability and information-gaps". Reliability Engineering and System Safety. 85 (1–3): 249–266. doi:10.1016/j.ress.2004.03.015.
    44. George J. Klir, 2006, Uncertainty and Information: Foundations of Generalized Information Theory, Wiley Publishers.
    45. Yakov Ben-Haim, 2007, Peirce, Haack and Info-gaps, in Susan Haack, A Lady of Distinctions: The Philosopher Responds to Her Critics, edited by Cornelis de Waal, Prometheus Books.
    46. Burgman, Mark, 2005, Risks and Decisions for Conservation and Environmental Management, Cambridge University Press, Cambridge, pp.399.
    47. 1 2 3 Sniedovich, M. (2007). "The art and science of modeling decision-making under severe uncertainty" (PDF). Decision Making in Manufacturing and Services. 1 (1–2): 109–134. doi: 10.7494/dmms.2007.1.2.111 .
    48. Simon, Herbert A. (1959). "Theories of decision making in economics and behavioral science". American Economic Review. 49: 253–283.
    49. Schwartz, Barry, 2004, Paradox of Choice: Why More Is Less, Harper Perennial.
    50. Conlisk, John (1996). "Why bounded rationality?". Journal of Economic Literature. XXXIV: 669–700.
    51. Burgman, Mark, 2005, Risks and Decisions for Conservation and Environmental Management, Cambridge University Press, Cambridge, pp.391, 394.
    52. 1 2 Vinot, P.; Cogan, S.; Cipolla, V. (2005). "A robust model-based test planning procedure" (PDF). Journal of Sound and Vibration. 288 (3): 572. Bibcode:2005JSV...288..571V. doi:10.1016/j.jsv.2005.07.007. S2CID   122895551.
    53. Z. Ben-Haim and Y. C. Eldar, Maximum set estimators with bounded estimation error, IEEE Trans. Signal Process., vol. 53, no. 8, August 2005, pp. 3172-3182.
    54. Babuška, I., F. Nobile and R. Tempone, 2005, Worst case scenario analysis for elliptic problems with uncertainty, Numerische Mathematik (in English) vol.101 pp.185–219.
    55. Ben-Haim, Yakov; Cogan, Scott; Sanseigne, Laetitia (1998). "Usability of Mathematical Models in Mechanical Decision Processes". Mechanical Systems and Signal Processing. 12 (1): 121–134. Bibcode:1998MSSP...12..121B. doi:10.1006/mssp.1996.0137.
    56. (See also chapter 4 in Yakov Ben-Haim, Ref. 2.)
    57. Rosenhead, M.J.; Elton, M.; Gupta, S.K. (1972). "Robustness and Optimality as Criteria for Strategic Decisions". Operational Research Quarterly. 23 (4): 413–430. doi:10.1057/jors.1972.72.
    58. Rosenblatt, M.J.; Lee, H.L. (1987). "A robustness approach to facilities design". International Journal of Production Research. 25 (4): 479–486. doi:10.1080/00207548708919855.
    59. P. Kouvelis and G. Yu, 1997, Robust Discrete Optimization and Its Applications, Kluwer.
    60. B. Rustem and M. Howe, 2002, Algorithms for Worst-case Design and Applications to Risk Management, Princeton University Press.
    61. R.J. Lempert, S.W. Popper, and S.C. Bankes, 2003, Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis, The Rand Corporation.
    62. A. Ben-Tal, L. El Ghaoui, and A. Nemirovski, 2006, Mathematical Programming, Special issue on Robust Optimization, Volume 107(1-2).
    63. Resnik, M.D., Choices: an Introduction to Decision Theory, University of Minnesota Press, Minneapolis, MN, 1987.
    64. French, S.D., Decision Theory, Ellis Horwood, 1988.