Design optimization

Last updated December 30, 2023

Design optimization is an engineering design methodology using a mathematical formulation of a design problem to support selection of the optimal design among many alternatives. Design optimization involves the following stages: ^[1]^[2]

Variables: Describe the design alternatives
Objective: Elected functional combination of variables (to be maximized or minimized)
Constraints: Combination of Variables expressed as equalities or inequalities that must be satisfied for any acceptable design alternative
Feasibility: Values for set of variables that satisfies all constraints and minimizes/maximizes Objective.

Design optimization problem

The formal mathematical (standard form) statement of the design optimization problem is ^[3]

${\begin{aligned}&{\operatorname {minimize} }&&f(x)\\&\operatorname {subject\;to} &&h_{i}(x)=0,\quad i=1,\dots ,m_{1}\\&&&g_{j}(x)\leq 0,\quad j=1,\dots ,m_{2}\\&\operatorname {and} &&x\in X\subseteq R^{n}\end{aligned}}$

where

$x$ is a vector of n real-valued design variables $x_{1},x_{2},...,x_{n}$
$f(x)$ is the objective function
$h_{i}(x)$ are $m_{1}$ equality constraints
$g_{j}(x)$ are $m_{2}$ inequality constraints
$X$ is a set constraint that includes additional restrictions on $x$ besides those implied by the equality and inequality constraints.

The problem formulation stated above is a convention called the negative null form, since all constraint function are expressed as equalities and negative inequalities with zero on the right-hand side. This convention is used so that numerical algorithms developed to solve design optimization problems can assume a standard expression of the mathematical problem.

We can introduce the vector-valued functions

${\begin{aligned}&&&{h=(h_{1},h_{2},\dots ,h_{m1})}\\\operatorname {and} \\&&&{g=(g_{1},g_{2},\dots ,g_{m2})}\end{aligned}}$

to rewrite the above statement in the compact expression

${\begin{aligned}&{\operatorname {minimize} }&&f(x)\\&\operatorname {subject\;to} &&h(x)=0,\quad g(x)\leq 0,\quad x\in X\subseteq R^{n}\\\end{aligned}}$

We call $h,g$ the set or system of (functional) constraints and $X$ the set constraint.

Application

Design optimization applies the methods of mathematical optimization to design problem formulations and it is sometimes used interchangeably with the term engineering optimization. When the objective function f is a vector rather than a scalar, the problem becomes a multi-objective optimization one. If the design optimization problem has more than one mathematical solutions the methods of global optimization are used to identified the global optimum.

Optimization Checklist^[2]

Problem Identification
Initial Problem Statement
Analysis Models
Optimal Design Model
Model Transformation
Local Iterative Techniques
Global Verification
Final Review

A detailed and rigorous description of the stages and practical applications with examples can be found in the book Principles of Optimal Design.

Practical design optimization problems are typically solved numerically and many optimization software exist in academic and commercial forms.^[4] There are several domain-specific applications of design optimization posing their own specific challenges in formulating and solving the resulting problems; these include, shape optimization, wing-shape optimization, topology optimization, architectural design optimization, power optimization. Several books, articles and journal publications are listed below for reference.

One modern application of design optimization is structural design optimization (SDO) is in building and construction sector. SDO emphasizes automating and optimizing structural designs and dimensions to satisfy a variety of performance objectives. These advancements aim to optimize the configuration and dimensions of structures to optimize augmenting strength, minimize material usage, reduce costs, enhance energy efficiency, improve sustainability, and optimize several other performance criteria. Concurrently, structural design automation endeavors to streamline the design process, mitigate human errors, and enhance productivity through computer-based tools and optimization algorithms. Prominent practices and technologies in this domain include the parametric design, generative design, building information modelling (BIM) technology, machine learning (ML), and artificial intelligence (AI), as well as integrating finite element analysis (FEA) with simulation tools.^[5]

Journals

Related Research Articles

Mathematical optimization or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfields: discrete optimization and continuous optimization. Optimization problems arise in all quantitative disciplines from computer science and engineering to operations research and economics, and the development of solution methods has been of interest in mathematics for centuries.

In mathematical optimization, the method of Lagrange multipliers is a strategy for finding the local maxima and minima of a function subject to equation constraints. It is named after the mathematician Joseph-Louis Lagrange.

Optimal control theory is a branch of control theory that deals with finding a control for a dynamical system over a period of time such that an objective function is optimized. It has numerous applications in science, engineering and operations research. For example, the dynamical system might be a spacecraft with controls corresponding to rocket thrusters, and the objective might be to reach the Moon with minimum fuel expenditure. Or the dynamical system could be a nation's economy, with the objective to minimize unemployment; the controls in this case could be fiscal and monetary policy. A dynamical system may also be introduced to embed operations research problems within the framework of optimal control theory.

An integer programming problem is a mathematical optimization or feasibility program in which some or all of the variables are restricted to be integers. In many settings the term refers to integer linear programming (ILP), in which the objective function and the constraints are linear.

In mathematical optimization and decision theory, a loss function or cost function is a function that maps an event or values of one or more variables onto a real number intuitively representing some "cost" associated with the event. An optimization problem seeks to minimize a loss function. An objective function is either a loss function or its opposite, in which case it is to be maximized. The loss function could include terms from several levels of the hierarchy.

Multi-disciplinary design optimization (MDO) is a field of engineering that uses optimization methods to solve design problems incorporating a number of disciplines. It is also known as multidisciplinary system design optimization (MSDO), and multidisciplinary design analysis and optimization (MDAO).

In mathematics, nonlinear programming (NLP) is the process of solving an optimization problem where some of the constraints or the objective function are nonlinear. An optimization problem is one of calculation of the extrema of an objective function over a set of unknown real variables and conditional to the satisfaction of a system of equalities and inequalities, collectively termed constraints. It is the sub-field of mathematical optimization that deals with problems that are not linear.

Topology optimization is a mathematical method that optimizes material layout within a given design space, for a given set of loads, boundary conditions and constraints with the goal of maximizing the performance of the system. Topology optimization is different from shape optimization and sizing optimization in the sense that the design can attain any shape within the design space, instead of dealing with predefined configurations.

In mathematics, engineering, computer science and economics, an optimization problem is the problem of finding the best solution from all feasible solutions.

Shape optimization is part of the field of optimal control theory. The typical problem is to find the shape which is optimal in that it minimizes a certain cost functional while satisfying given constraints. In many cases, the functional being solved depends on the solution of a given partial differential equation defined on the variable domain.

<span class="mw-page-title-main">Interior-point method</span> Algorithms for solving convex optimization problems

Interior-point methods are algorithms for solving linear and non-linear convex optimization problems. IPMs combine two advantages of previously-known algorithms:

Convex optimization is a subfield of mathematical optimization that studies the problem of minimizing convex functions over convex sets. Many classes of convex optimization problems admit polynomial-time algorithms, whereas mathematical optimization is in general NP-hard. With recent advancements in computing and optimization algorithms, convex programming is nearly as straightforward as linear programming.

In mathematical optimization, the Karush–Kuhn–Tucker (KKT) conditions, also known as the Kuhn–Tucker conditions, are first derivative tests for a solution in nonlinear programming to be optimal, provided that some regularity conditions are satisfied.

In mathematical optimization theory, duality or the duality principle is the principle that optimization problems may be viewed from either of two perspectives, the primal problem or the dual problem. If the primal is a minimization problem then the dual is a maximization problem. Any feasible solution to the primal (minimization) problem is at least as large as any feasible solution to the dual (maximization) problem. Therefore, the solution to the primal is an upper bound to the solution of the dual, and the solution of the dual is a lower bound to the solution of the primal. This fact is called weak duality.

In mathematical optimization and related fields, relaxation is a modeling strategy. A relaxation is an approximation of a difficult problem by a nearby problem that is easier to solve. A solution of the relaxed problem provides information about the original problem.

Multi-objective optimization or Pareto optimization is an area of multiple-criteria decision making that is concerned with mathematical optimization problems involving more than one objective function to be optimized simultaneously. Multi-objective is a type of vector optimization that has been applied in many fields of science, including engineering, economics and logistics where optimal decisions need to be taken in the presence of trade-offs between two or more conflicting objectives. Minimizing cost while maximizing comfort while buying a car, and maximizing performance whilst minimizing fuel consumption and emission of pollutants of a vehicle are examples of multi-objective optimization problems involving two and three objectives, respectively. In practical problems, there can be more than three objectives.

Bilevel optimization is a special kind of optimization where one problem is embedded (nested) within another. The outer optimization task is commonly referred to as the upper-level optimization task, and the inner optimization task is commonly referred to as the lower-level optimization task. These problems involve two kinds of variables, referred to as the upper-level variables and the lower-level variables.

In mathematical optimization, Wolfe duality, named after Philip Wolfe, is type of dual problem in which the objective function and constraints are all differentiable functions. Using this concept a lower bound for a minimization problem can be found because of the weak duality principle.

Lexicographic max-min optimization is a kind of multi-objective optimization. In general, multi-objective optimization deals with optimization problems with two or more objective functions to be optimized simultaneously. Lexmaxmin optimization presumes that the decision-maker would like the smallest objective value to be as high as possible; subject to this, the second-smallest objective should be as high as possible; and so on. In other words, the decision-maker ranks the possible solutions according to a leximin order of their objective function values.

The Method of Moving Asymptotes (MMA) is an optimization algorithm developed by Krister Svanberg in the 1980s. It's primarily used for solving non-linear programming problems, particularly those related to structural design and topology optimization.

References

↑ Martins, Joaquim R. R. A.; Ning, Andrew (2021-10-01). Engineering Design Optimization (PDF). Cambridge University Press. ISBN 978-1108833417.
1 2 Papalambros, Panos Y.; Wilde, Douglass J. (2017-01-31). Principles of Optimal Design: Modeling and Computation. Cambridge University Press. ISBN 9781316867457.
↑ Boyd, Stephen; Boyd, Stephen P.; California), Stephen (Stanford University Boyd; Vandenberghe, Lieven; Angeles), Lieven (University of California Vandenberghe, Los (2004-03-08). Convex Optimization (PDF). Cambridge University Press. ISBN 9780521833783.{{cite book}}: CS1 maint: multiple names: authors list (link)
↑ Messac, Achille (2015-03-19). Optimization in Practice with MATLAB®: For Engineering Students and Professionals. Cambridge University Press. ISBN 9781316381373.
↑ Towards BIM-Based Sustainable Structural Design Optimization: A Systematic Review and Industry Perspective. Sustainability 2023, 15, 15117. https://doi.org/10.3390/su152015117

Rutherford., Aris, ([2016], ©1961). The optimal design of chemical reactors : a study in dynamic programming. Saint Louis: Academic Press/Elsevier Science. ISBN 9781483221434. OCLC 952932441
Jerome., Bracken, ([1968]). Selected applications of nonlinear programming. McCormick, Garth P.,. New York,: Wiley. ISBN 0471094404. OCLC 174465
L., Fox, Richard ([1971]). Optimization methods for engineering design. Reading, Mass.,: Addison-Wesley Pub. Co. ISBN 0201020785. OCLC 150744
Johnson, Ray C. Mechanical Design Synthesis With Optimization Applications. New York: Van Nostrand Reinhold Co, 1971.
1905-, Zener, Clarence, ([1971]). Engineering design by geometric programming. New York,: Wiley-Interscience. ISBN 0471982008. OCLC 197022
H., Mickle, Marlin ([1972]). Optimization in systems engineering. Sze, T. W., 1921-2017,. Scranton,: Intext Educational Publishers. ISBN 0700224076. OCLC 340906.
Optimization and design; [papers]. Avriel, M.,, Rijckaert, M. J.,, Wilde, Douglass J.,, NATO Science Committee., Katholieke Universiteit te Leuven (1970- ). Englewood Cliffs, N.J.,: Prentice-Hall. [1973]. ISBN 0136380158. OCLC 618414.
J., Wilde, Douglass (1978). Globally optimal design. New York: Wiley. ISBN 0471038989. OCLC 3707693.
J., Haug, Edward (1979). Applied optimal design : mechanical and structural systems. Arora, Jasbir S.,. New York: Wiley. ISBN 047104170X. OCLC 4775674.
Uri., Kirsch, (1981). Optimum structural design : concepts, methods, and applications. New York: McGraw-Hill. ISBN 0070348448. OCLC 6735289.
Uri., Kirsch, (1993). Structural optimization : fundamentals and applications. Berlin: Springer-Verlag. ISBN 3540559191. OCLC 27676129.
Structural optimization : recent developments and applications. Lev, Ovadia E., American Society of Civil Engineers. Structural Division., American Society of Civil Engineers. Structural Division. Committee on Electronic Computation. Committee on Optimization. New York, N.Y.: ASCE. 1981. ISBN 0872622819. OCLC 8182361.
Foundations of structural optimization : a unified approach. Morris, A. J. Chichester [West Sussex]: Wiley. 1982. ISBN 0471102008. OCLC 8031383.
N., Siddall, James (1982). Optimal engineering design : principles and applications. New York: M. Dekker. ISBN 0824716337. OCLC 8389250.
1944-, Ravindran, A., (2006). Engineering optimization : methods and applications. Reklaitis, G. V., 1942-, Ragsdell, K. M. (2nd ed.). Hoboken, N.J.: John Wiley & Sons. ISBN 0471558141. OCLC 61463772.
N.,, Vanderplaats, Garret (1984). Numerical optimization techniques for engineering design : with applications. New York: McGraw-Hill. ISBN 0070669643. OCLC 9785595.
T., Haftka, Raphael (1990). Elements of Structural Optimization. Gürdal, Zafer., Kamat, Manohar P. (Second rev. edition ed.). Dordrecht: Springer Netherlands. ISBN 9789401578622. OCLC 851381183.
S., Arora, Jasbir (2011). Introduction to optimum design (3rd ed.). Boston, MA: Academic Press. ISBN 9780123813756. OCLC 760173076.
S.,, Janna, William. Design of fluid thermal systems (SI edition ; fourth edition ed.). Stamford, Connecticut. ISBN 9781285859651. OCLC 881509017.
Structural optimization : status and promise. Kamat, Manohar P. Washington, DC: American Institute of Aeronautics and Astronautics. 1993. ISBN 156347056X. OCLC 27918651.
Mathematical programming for industrial engineers. Avriel, M., Golany, B. New York: Marcel Dekker. 1996. ISBN 0824796209. OCLC 34474279.
Hans., Eschenauer, (1997). Applied structural mechanics : fundamentals of elasticity, load-bearing structures, structural optimization : including exercises. Olhoff, Niels., Schnell, W. Berlin: Springer. ISBN 3540612327. OCLC 35184040.
1956-, Belegundu, Ashok D., (2011). Optimization concepts and applications in engineering. Chandrupatla, Tirupathi R., 1944- (2nd ed.). New York: Cambridge University Press. ISBN 9781139037808. OCLC 746750296.
Okechi., Onwubiko, Chinyere (2000). Introduction to engineering design optimization. Upper Saddle River, NJ: Prentice-Hall. ISBN 0201476738. OCLC 41368373.
Optimization in action : proceedings of the Conference on Optimization in Action held at the University of Bristol in January 1975. Dixon, L. C. W. (Laurence Charles Ward), 1935-, Institute of Mathematics and Its Applications. London: Academic Press. 1976. ISBN 0122185501. OCLC 2715969.
P., Williams, H. (2013). Model building in mathematical programming (5th ed.). Chichester, West Sussex: Wiley. ISBN 9781118506189. OCLC 810039791.
Integrated design of multiscale, multifunctional materials and products. McDowell, David L., 1956-. Oxford: Butterworth-Heinemann. 2010. ISBN 9781856176620. OCLC 610001448.
M.,, Dede, Ercan. Multiphysics simulation : electromechanical system applications and optimization. Lee, Jaewook,, Nomura, Tsuyoshi,. London. ISBN 9781447156406. OCLC 881071474.
1962-, Liu, G. P. (Guo Ping), (2001). Multiobjective optimisation and control. Yang, Jian-Bo, 1961-, Whidborne, J. F. (James Ferris), 1960-. Baldock, Hertfordshire: Research Studies Press. ISBN 0585491941. OCLC 54380075.

Structural Topology Optimization

Bendsøe, Martin Philip; Kikuchi, Noboru (1988-11-01). "Generating optimal topologies in structural design using a homogenization method". Computer Methods in Applied Mechanics and Engineering. 71 (2): 197–224. doi:10.1016/0045-7825(88)90086-2. hdl: 2027.42/27079 . ISSN 0045-7825.
Bendsøe, Martin P. (1995). Optimization of structural topology, shape, and material. Springer. ISBN 3540590579.
Behrooz, Hassani (1999). Homogenization and Structural Topology Optimization : Theory, Practice and Software. Springer. ISBN 9781447108917. OCLC 853262659.
Bendsøe, Martin P.; Sigmund, O. (2013). Topology optimization : theory, methods, and applications (2nd ed.). Springer. ISBN 9783662050866. OCLC 50448149.
Rozvany, G.I.N.; Lewiński, T., eds. (2014). Topology optimization in structural and continuum mechanics. Springer. ISBN 9783709116432. OCLC 859524179.

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[edo2021-1] Martins, Joaquim R. R. A.; Ning, Andrew (2021-10-01). Engineering Design Optimization (PDF). Cambridge University Press. ISBN 978-1108833417.

[pyp2017-2] 1 2 Papalambros, Panos Y.; Wilde, Douglass J. (2017-01-31). Principles of Optimal Design: Modeling and Computation. Cambridge University Press. ISBN 9781316867457.

[3] Boyd, Stephen; Boyd, Stephen P.; California), Stephen (Stanford University Boyd; Vandenberghe, Lieven; Angeles), Lieven (University of California Vandenberghe, Los (2004-03-08). Convex Optimization (PDF). Cambridge University Press. ISBN 9780521833783.{{cite book}}: CS1 maint: multiple names: authors list (link)

[4] Messac, Achille (2015-03-19). Optimization in Practice with MATLAB®: For Engineering Students and Professionals. Cambridge University Press. ISBN 9781316381373.

[5] Towards BIM-Based Sustainable Structural Design Optimization: A Systematic Review and Industry Perspective. Sustainability 2023, 15, 15117. https://doi.org/10.3390/su152015117

[1]

[2]

[3]

[4]

[5]

Design optimization

Contents