Research Papers: Design Automation

Model Discrepancy Quantification in Simulation-Based Design of Dynamical Systems

[+] Author and Article Information
Zhen Hu

Department of Industrial and Manufacturing
Systems Engineering,
University of Michigan-Dearborn,
2340 Heinz Prechter Engineering Complex
Dearborn, MI 48128
e-mail: zhennhu@umich.edu

Chao Hu

Assistant Professor
Department of Mechanical Engineering,
Iowa State University,
2026 Black Engineering,
Ames, IA 50011;
Department of Electrical and Computer Engineering,
Iowa State University,
2026 Black Engineering,
Ames, IA 50011
e-mail: chaohu@iastate.edu

Zissimos P. Mourelatos

Mechanical Engineering Department,
Oakland University,
Engineering Center,
Room 402D, 115 Library Drive,
Rochester, MI 48309
e-mail: mourelat@oakland.edu

Sankaran Mahadevan

John R. Murray Sr. Professor of Engineering,
Department of Civil and Environmental
Vanderbilt University,
2201 West End Avenue, Box 1831, Station B,
Nashville, TN 37235
e-mail: sankaran.mahadevan@vanderbilt.edu

1Corresponding author.

Contributed by the Design Automation Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received February 26, 2018; final manuscript received September 9, 2018; published online October 8, 2018. Assoc. Editor: Xiaoping Du.

J. Mech. Des 141(1), 011401 (Oct 08, 2018) (13 pages) Paper No: MD-18-1148; doi: 10.1115/1.4041483 History: Received February 26, 2018; Revised September 09, 2018

Discrete-time state-space models have been extensively used in simulation-based design of dynamical systems. These prediction models may not accurately represent the true physics of a dynamical system due to potentially flawed understanding of the system, missing physics, and/or numerical approximations. To improve the validity of these models at new design locations, this paper proposes a novel dynamic model discrepancy quantification (DMDQ) framework. Time-instantaneous prediction models are constructed for the model discrepancies of “hidden” state variables, and are used to correct the discrete-time prediction models at each time-step. For discrete-time models, the hidden state variables and their discrepancies are coupled over two adjacent time steps. Also, the state variables cannot be directly measured. These factors complicate the construction of the model discrepancy prediction models. The proposed DMDQ framework overcomes these challenges by proposing two discrepancy modeling approaches: an estimation-modeling approach and a modeling-estimation approach. The former first estimates the model discrepancy and then builds a nonparametric prediction model of the model discrepancy; the latter builds a parametric prediction model of the model discrepancy first and then estimates the parameters of the prediction model. A subsampling method is developed to reduce the computational effort in building the two types of prediction models. A mathematical example and an electrical circuit dynamical system demonstrate the effectiveness of the proposed DMDQ framework and highlight the advantages and disadvantages of the proposed approaches.

Copyright © 2019 by ASME
Your Session has timed out. Please sign back in to continue.


Hu, Z. , and Mahadevan, S. , 2018, “ Adaptive Surrogate Modeling for Time-Dependent Multidisciplinary Reliability Analysis,” ASME J. Mech. Des., 140(2), p. 021401. [CrossRef]
Hou, Z. , and Jin, S. , 2011, “ Data-Driven Model-Free Adaptive Control for a Class of MIMO Nonlinear Discrete-Time Systems,” IEEE Trans. Neural Networks, 22(12), pp. 2173–2188. [CrossRef]
Apley, D. W. , Liu, J. , and Chen, W. , 2006, “ Understanding the Effects of Model Uncertainty in Robust Design With Computer Experiments,” ASME J. Mech. Des., 128(4), pp. 945–958. [CrossRef]
Kennedy, M. C. , and O'Hagan, A. , 2001, “ Bayesian Calibration of Computer Models,” J. R. Stat. Soc.: Ser. B, 63(3), pp. 425–464. [CrossRef]
Bayarri, M. J. , Berger, J. O. , Paulo, R. , Sacks, J. , Cafeo, J. A. , Cavendish, J. , Lin, C.-H. , and Tu, J. , 2007, “ A Framework for Validation of Computer Models,” Technometrics, 49(2), pp. 138–154. [CrossRef]
Higdon, D. , Gattiker, J. , Williams, B. , and Rightley, M. , 2008, “ Computer Model Calibration Using High-Dimensional Output,” J. Am. Stat. Assoc., 103(482), pp. 570–583. [CrossRef]
Borsuk, M. E. , Stow, C. A. , and Reckhow, K. H. , 2004, “ A Bayesian Network of Eutrophication Models for Synthesis, Prediction, and Uncertainty Analysis,” Ecol. Modell., 173(2–3), pp. 219–239. [CrossRef]
Arendt, P. D. , Apley, D. W. , and Chen, W. , 2012, “ Quantification of Model Uncertainty: Calibration, Model Discrepancy, and Identifiability,” ASME J. Mech. Des., 134(10), p. 100908. [CrossRef]
Arendt, P. D. , Apley, D. W. , Chen, W. , Lamb, D. , and Gorsich, D. , 2012, “ Improving Identifiability in Model Calibration Using Multiple Responses,” ASME J. Mech. Des., 134(10), p. 100909. [CrossRef]
Higdon, D. , Kennedy, M. , Cavendish, J. C. , Cafeo, J. A. , and Ryne, R. D. , 2004, “ Combining Field Data and Computer Simulations for Calibration and Prediction,” SIAM J. Sci. Comput., 26(2), pp. 448–466. [CrossRef]
Ling, Y. , Mullins, J. , and Mahadevan, S. , 2014, “ Selection of Model Discrepancy Priors in Bayesian Calibration,” J. Comput. Phys., 276, pp. 665–680. [CrossRef]
Jiang, Z. , Chen, W. , Fu, Y. , and Yang, R.-J. , 2013, “ Reliability-Based Design Optimization With Model Bias and Data Uncertainty,” SAE Int. J. Mater. Manuf., 6(3), pp. 502–516. [CrossRef]
Jiang, Z. , Li, W. , Apley, D. W. , and Chen, W. , 2015, “ A Spatial-Random-Process Based Multidisciplinary System Uncertainty Propagation Approach With Model Uncertainty,” ASME J. Mech. Des., 137(10), p. 101402. [CrossRef]
Pan, H. , Xi, Z. , and Yang, R.-J. , 2016, “ Model Uncertainty Approximation Using a Copula-Based Approach for Reliability Based Design Optimization,” Struct. Multidiscip. Optim., 54(6), pp. 1543–1556. [CrossRef]
Nannapaneni, S. , Hu, Z. , and Mahadevan, S. , 2016, “ Uncertainty Quantification in Reliability Estimation With Limit State Surrogates,” Struct. Multidiscip. Optim., 54(6), pp. 1509–1526. [CrossRef]
Moon, M.-Y. , Cho, H. , Choi, K. , Gaul, N. , Lamb, D. , and Gorsich, D. , 2018, “ Confidence-Based Reliability Assessment Considering Limited Numbers of Both Input and Output Test Data,” Struct. Multidiscip. Optim., 57(5), pp. 2027–2043.
Xi, Z. , Pan, H. , and Yang, R.-J. , 2017, “ Time Dependent Model Bias Correction for Model Based Reliability Analysis,” Struct. Saf., 66, pp. 74–83. [CrossRef]
Lu, X. , and Li, H.-X. , 2009, “ Perturbation Theory Based Robust Design Under Model Uncertainty,” ASME J. Mech. Des., 131(11), p. 111006. [CrossRef]
Xi, Z. , Pan, H. , and Yang, R.-J. , 2015, “ Stochastic Model Bias Correction of Dynamic System Responses for Simulation-Based Reliability Analysis,” ASME Paper No. DETC2015-46938.
Conti, S. , and O’Hagan, A. , 2010, “ Bayesian Emulation of Complex Multi-Output and Dynamic Computer Models,” J. Stat. Plann. Inference, 140(3), pp. 640–651. [CrossRef]
Burns, J. A. , Cliff, E. M. , and Herdman, T. L. , 2018, “ Identification of Dynamical Systems With Structured Uncertainty,” Inverse Probl. Sci. Eng., 26(2), pp. 280–321. [CrossRef]
Jolliffe, I. T. , 1986, “ Principal Component Analysis and Factor Analysis,” Principal Component Analysis, Springer, Berlin, pp. 115–128.
Hu, Z. , and Mahadevan, S. , 2017, “ A Surrogate Modeling Approach for Reliability Analysis of a Multidisciplinary System With Spatio-Temporal Output,” Struct. Multidiscip. Optim., 56(3), pp. 553–569. [CrossRef]
Hu, C. , Youn, B. D. , and Chung, J. , 2012, “ A Multiscale Framework With Extended Kalman Filter for Lithium-Ion Battery SOC and Capacity Estimation,” Appl. Energy, 92, pp. 694–704. [CrossRef]
Hu, C. , Jain, G. , Tamirisa, P. , and Gorka, T. , 2014, “ Method for Estimating Capacity and Predicting Remaining Useful Life of Lithium-Ion Battery,” Appl. Energy, 126, pp. 182–189. [CrossRef]
Hu, C. , Jain, G. , Zhang, P. , Schmidt, C. , Gomadam, P. , and Gorka, T. , 2014, “ Data-Driven Method Based on Particle Swarm Optimization and k-Nearest Neighbor Regression for Estimating Capacity of Lithium-Ion Battery,” Appl. Energy, 129, pp. 49–55. [CrossRef]
Geroulas, V. , Mourelatos, Z. P. , Tsianika, V. , and Baseski, I. , 2018, “ Reliability Analysis of Nonlinear Vibratory Systems Under Non-Gaussian Loads,” ASME J. Mech. Des., 140(2), p. 021404. [CrossRef]
Jing, R. , Xi, Z. , Yang, X. G. , and Decker, E. , 2014, “ A Systematic Framework for Battery Performance Estimation Considering Model and Parameter Uncertainties,” Int. J. Prognostics Health Manage., 5(2), pp. 1–10.
Orchard, M. E. , and Vachtsevanos, G. J. , 2009, “ A Particle-Filtering Approach for On-Line Fault Diagnosis and Failure Prognosis,” Trans. Inst. Meas. Control, 31(3–4), pp. 221–246. [CrossRef]
Barut, M. , Bogosyan, S. , and Gokasan, M. , 2007, “ Speed-Sensorless Estimation for Induction Motors Using Extended Kalman Filters,” IEEE Trans. Ind. Electron., 54(1), pp. 272–280. [CrossRef]
Houtekamer, P. L. , and Mitchell, H. L. , 2005, “ Ensemble Kalman Filtering,” Q. J. R. Meteorol. Soc., 131(613), pp. 3269–3289. [CrossRef]
Rasmussen, C. E. , 2004, “ Gaussian Processes in Machine Learning,” Advanced Lectures on Machine Learning, Springer, Berlin, pp. 63–71.
Xiu, D. , and Karniadakis, G. E. , 2002, “ The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations,” SIAM J. Sci. Comput., 24(2), pp. 619–644. [CrossRef]
Bennett, K. P. , and Bredensteiner, E. J. , 1997, “ A Parametric Optimization Method for Machine Learning,” INFORMS J. Comput., 9(3), pp. 311–318. [CrossRef]
Jones, D. R. , Schonlau, M. , and Welch, W. J. , 1998, “ Efficient Global Optimization of Expensive Black-Box Functions,” J. Global Optim., 13(4), pp. 455–492. [CrossRef]
Hu, Z. , and Du, X. , 2015, “ Mixed Efficient Global Optimization for Time-Dependent Reliability Analysis,” ASME J. Mech. Des., 137(5), p. 051401. [CrossRef]
Jin, R. , Chen, W. , and Sudjianto, A. , 2002, “ On Sequential Sampling for Global Metamodeling in Engineering Design,” ASME Paper No. DETC2002/DAC-34092.
Plett, G. L. , 2004, “ Extended Kalman Filtering for Battery Management Systems of LiPB-Based HEV Battery Packs—Part 3: State and Parameter Estimation,” J. Power Sources, 134(2), pp. 277–292. [CrossRef]


Grahic Jump Location
Fig. 1

Illustration of a discrete-time dynamical system in state-space form

Grahic Jump Location
Fig. 2

A DBN representation illustrating connections between different variables

Grahic Jump Location
Fig. 3

Bayesian network after arrow reversing at ti+1

Grahic Jump Location
Fig. 4

Time-dependent inputs of the five experiments

Grahic Jump Location
Fig. 5

Prediction and observation for experiments 1 and 2

Grahic Jump Location
Fig. 6

Prediction and observation for experiments 3–5

Grahic Jump Location
Fig. 7

Model discrepancy of state variable: (a) true model and (b) prediction model by approach one

Grahic Jump Location
Fig. 8

Approximated model discrepancy by approach two

Grahic Jump Location
Fig. 9

Prediction for a new input after correction using approach one

Grahic Jump Location
Fig. 10

Prediction for a new input after correction using approach two

Grahic Jump Location
Fig. 11

Absolute prediction errors of different methods

Grahic Jump Location
Fig. 12

An electrical circuit dynamical system

Grahic Jump Location
Fig. 13

Observations, prediction, and selected points of three experiments (electrical circuit)

Grahic Jump Location
Fig. 14

Model discrepancy of “hidden” state variable: (a) true model and (b) approach one

Grahic Jump Location
Fig. 15

Model discrepancy of “hidden” state variable: (a) approach one-linear and (b) approach two

Grahic Jump Location
Fig. 16

Model discrepancy of “hidden” state variable: (a) true model and (b) approach one

Grahic Jump Location
Fig. 17

Model discrepancy of “hidden” state variable: (a) approach one-linear and (b) approach two

Grahic Jump Location
Fig. 18

True versus predicted observations at a new input condition



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In