Research Papers: Design Automation

Trust Region Based Mode Pursuing Sampling Method for Global Optimization of High Dimensional Design Problems

[+] Author and Article Information
George H. Cheng, Adel Younis, Kambiz Haji Hajikolaei

Product Design and Optimization Lab (PDOL),
School of Mechatronic Systems Engineering,
Simon Fraser University,
250-13450 102 Avenue,
Surrey, BC V3T0A3, Canada

G. Gary Wang

Product Design and Optimization Lab (PDOL),
School of Mechatronic Systems Engineering,
Simon Fraser University,
250-13450 102 Avenue,
Surrey, BC V3T0A3, Canada
e-mail: gary_wang@sfu.ca

1Corresponding author.

Contributed by the Design Automation Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received January 16, 2014; final manuscript received November 17, 2014; published online December 17, 2014. Assoc. Editor: Christopher Mattson.

J. Mech. Des 137(2), 021407 (Feb 01, 2015) (9 pages) Paper No: MD-14-1054; doi: 10.1115/1.4029219 History: Received January 16, 2014; Revised November 17, 2014; Online December 17, 2014

Mode pursuing sampling (MPS) was developed as a global optimization algorithm for design optimization problems involving expensive black box functions. MPS has been found to be effective and efficient for design problems of low dimensionality, i.e., the number of design variables is less than 10. This work integrates the concept of trust regions into the MPS framework to create a new algorithm, trust region based mode pursuing sampling (TRMPS2), with the aim of dramatically improving performance and efficiency for high dimensional problems. TRMPS2 is benchmarked against genetic algorithm (GA), dividing rectangles (DIRECT), efficient global optimization (EGO), and MPS using a suite of standard test problems and an engineering design problem. The results show that TRMPS2 performs better on average than GA, DIRECT, EGO, and MPS for high dimensional, expensive, and black box (HEB) problems.

Copyright © 2015 by ASME
Your Session has timed out. Please sign back in to continue.


Haftka, R., Scott, E., and Cruz, J., 1998, “Optimization and Experiments: A Survey,” ASME Appl. Mech. Rev., 51(7), pp. 435–448. [CrossRef]
Gu, L., 2001, “A Comparison of Polynomial Based Regression Models in Vehicle Safety Analysis,” ASME Paper No. DAC-21063.
Duddeck, F., 2008, “Multidisciplinary Optimization of Car Bodies,” Struct. Multidiscip. Optim., 35(4), pp. 375–389. [CrossRef]
Mitchell, M., 1996, An Introduction to Genetic Algorithms, MIT, Cambridge, MA.
Bertsimas, D., and Tsitsiklis, J., 1993, “Simulated Annealing,” Stat. Sci., 8(1), pp. 10–15. [CrossRef]
Poli, R., Kennedy, J., and Blackwell, T., 2007, “Particle Swarm Optimization: An Overview,” Swarm Intell., 1(1), pp. 33–57. [CrossRef]
Jones, D. R., Schonlau, M., and Welch, W. J., 1998, “Efficient Global Optimization of Expensive Black-Box Functions,” J. Global Optim., 13(4), pp. 455–492. [CrossRef]
Jones, D., Perttunen, C., and Stuckman, B., 1993, “Lipschitzian Optimization Without the Lipschitz Constant,” J. Optim. Theory Appl., 79(1), pp. 157–181. [CrossRef]
Shan, S., and Wang, G. G., 2010, “Metamodeling for High Dimensional Simulation-Based Design Problems,” ASME J. Mech. Des., 132(5), pp. 1–11. [CrossRef]
Zhan, Z., Zhang, J., Li, Y., and Chung, H., 2009, “Adaptive Particle Swarm Optimization,” IEEE Trans. Syst., Man, Cybern., Part B, 39(6), pp. 1362–1381. [CrossRef]
Wang, L., Shan, S., and Wang, G., 2004, “Mode-Pursuing Sampling Method for Global Optimization on Expensive Black-Box Functions,” J. Eng. Optim., 36(4), pp. 419–438. [CrossRef]
Sharif, B., Wang, G. G., and ElMekkawy, T. Y., 2008, “Mode Pursuing Sampling Method for Discrete Variable Optimization on Expensive Black-Box Functions,” ASME J. Mech. Des., 130(2), p. 021402. [CrossRef]
Duan, X., Wang, G., Kang, X., Niu, Q., Naterer, G., and Peng, Q., 2009, “Performance Study of Mode-Pursuing Sampling Method,” J. Eng. Optim., 41(1), pp. 1–21. [CrossRef]
Conn, A. R., Gould, N. I. M., and Toint, P. L., 2000, Trust Region Methods, J. E.Dennis, ed., MPS-SIAM, Philadelphia, PA. [CrossRef]
Addis, B., and Leyffer, S., 2006, “A Trust Region Algorithm for Global Optimization,” Comput. Optim. Appl., 35(3), pp. 287–304. [CrossRef]
Alexandrov, N., Dennis, J., Lewis, R., and Torczon, V., 1997, “A Trust Region Framework for Managing the Use of Approximation Models in Optimization,” Struct. Optim., 15(1), pp. 16–23. [CrossRef]
Rodríguez, J., Watson, L., and Renaud, J. E., 1998, “Trust Region Augmented Lagrangian Methods for Sequential Response Surface Approximation and Optimization,” ASME Design Engineering Technical Conferences, Vol. 120(1), pp. 58–66.
Cheng, G., and Wang, G., 2012, “Trust Region Based MPS Method for Global Optimization of High Dimensional Problems,” AIAA Paper No. 2012-1590. [CrossRef]
Fu, J., and Wang, L., 2002, “A Random-Discretization Based Monte Carlo Sampling Method and Its Applications,” Methodol. Comput. Appl. Probab., 4(1), pp. 5–25. [CrossRef]
SIMULIA, 2009, “ Isight: Automate Design Exploration and Optimization.” Available at: http://www.simulia.com/download/products/Isight_Brochure_FINAL.pdf, Accessed 2014.
Red Cedar Technology, 2014, “ SHERPA—An Efficient and Robust Optimization/Search Algorithm.” Available at: http://www.redcedartech.com/pdfs/SHERPA.pdf, Accessed 2014.
Houck, C., Joines, J., and Kay, M., 1995, “A Genetic Algorithm for Function Optimization: A Matlab Implementation,” ACM Trans. Math. Software.
Viana, F., 2013, “SURROGATES Toolbox,” https://sites.google.com/site/felipeacviana/surrogatestoolbox, Accessed 2013.
Jones, D., 2001, “The Direct Global Optimization Algorithm,” Encycl. Optim., 1, pp. 431–440. [CrossRef]
Finkel, D., 2004, “Research and Codes.” Available at: http://www4.ncsu.edu/∼ctk/Finkel_Direct/, Accessed 2013.
Schittkowski, K., 1987, More Test Examples for Nonlinear Programming Codes ( Lecture Notes in Economics and Mathematical Systems), Springer-Verlag, New York. [CrossRef]
Hsu, Y., Wang, S., and Yu, C., 2003, “A Sequential Approximation Method Using Neural Networks for Engineering Design Optimization Problems,” Eng. Optim., 35(5), pp. 489–511. [CrossRef]
Thanedar, P., 1995, “Survey of Discrete Variable Optimization for Structural Design,” J. Struct. Eng., 121(3), pp. 301–306. [CrossRef]
Haji Hajikolaei, K., Pirmoradi, Z., and Wang, G., “Decomposition for Large-Scale Global Optimization Based on Quantified Variable Correlations Uncovered by Metamodeling,” J. Eng. Optim. (in press). [CrossRef]
Schutte, J., and Haftka, R., 2010, “Global Structural Optimization of a Stepped Cantilever Beam Using Quasi-Separable Decomposition,” Eng. Optim., 42(4), pp. 347–367. [CrossRef]


Grahic Jump Location
Fig. 2

(a) 30D cantilever with 5000 points and (b) 30D cantilever problem with equivalent nfe

Grahic Jump Location
Fig. 1

Stepped cantilever beam with d steps



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In