Technical Briefs

A Study of Student Design Team Behaviors in Complex System Design

[+] Author and Article Information
Jesse Austin-Breneman

e-mail: jlab@mit.edu

Tomonori Honda

e-mail: tomonori@mit.edu
Department of Mechanical Engineering,
Massachusetts Institute of Technology,
Cambridge, MA 02139

Maria C. Yang

Department of Mechanical Engineering and
Engineering Systems Division,
Massachusetts Institute of Technology,
Cambridge, MA 02139
e-mail: mcyang@mit.edu

Contributed by the Design Education Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received July 12, 2011; final manuscript received August 10, 2012; published online November 15, 2012. Assoc. Editor: Janis Terpenny.

J. Mech. Des 134(12), 124504 (Nov 15, 2012) (7 pages) doi:10.1115/1.4007840 History: Received July 12, 2011; Revised August 10, 2012

Large-scale engineering systems require design teams to balance complex sets of considerations using a wide range of design and decision-making skills. Formal, computational approaches for optimizing complex systems offer strategies for arriving at optimal solutions in situations where system integration and design optimization are well-formulated. However, observation of design practice suggests engineers may be poorly prepared for this type of design. Four graduate student teams completed a distributed, complex system design task. Analysis of the teams' design histories suggests three categories of suboptimal approaches: global rather than local searches, optimizing individual design parameters separately, and sequential rather than concurrent optimization strategies. Teams focused strongly on individual subsystems rather than system-level optimization, and did not use the provided system gradient indicator to understand how changes in individual subsystems impacted the overall system. This suggests the need for curriculum to teach engineering students how to appropriately integrate systems as a whole.

Copyright © 2012 by ASME
Your Session has timed out. Please sign back in to continue.


The National Academy of Engineering, 2005, Educating the Engineer of 2020: Adapting Engineering Education to the New Century, National Academies Press, Washington, DC.
Jain, V. K., and Sobek, D. K., 2006, “Linking Design Process to Customer Satisfaction Through Virtual Design of Experiments,” Res. Eng. Des., 17(2), pp. 59–71. [CrossRef]
Atman, C. J., Adams, R. S., Cardella, M. E., Turns, J., Mosborg, S., and Saleem, J., 2007, “Engineering Design Process: A Comparison of Students and Exper Practitioners,” J. Eng. Educ., 96(4), pp. 359–379. Available at http://jee.org/2007/october/9.pdf
Kilgore, D., Atman, C. J., Yasuhara, K., and Barker, T. J., 2007, “Considering Context: A Study of First-Year Engineering Students,” J. Eng. Educ., 96(4), pp. 321–334. Available at http://www.jee.org/2007/october/6.pdf
Dym, C., Agogino, A., Eris, O., Frey, D., and Leifer, L., 2005, “Engineering Design Thinking, Teaching, and Learning,” J. Eng. Educ., 95(1), pp. 103–120. Available at http://www.jee.org/2005/january/252.pdf
Linder, B. M., 1999, “Understanding Estimation and its Relation to Engineering Education,” Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA.
Mark, G., 2002, “Extreme Collaboration,” Commun. ACM, 45(6), pp. 89–93. [CrossRef]
Avnet, M. S., 2009, “Socio-Cognitive Analysis of Engineering Systems Design: Shared Knowledge, Process, and Product,” Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA.
Simon, H. A., 1997, Models of Bounded Rationality, MIT Press, Cambridge, MA.
Devendorf, E., and Lewis, K., 2008, “Planning on Mistakes: An Approach to Incorporate Error Checking Into the Design Process,” ASME Design Engineering Technical Conference Proceedings, ASME, 1, pp. 273–284, Paper No. DETC2008-50006.
Gurnani, A. P., and Lewis, K., 2008, “Using Bounded Rationality to Improve Decentralized Design,” AIAA J., 46(12), pp. 3049–3059. [CrossRef]
Nash, J. F., 1951, “Non-Cooperative Games,” Ann. Math., 54, pp. 286–295. [CrossRef]
Yang, M. C., and Jin, Y., 2008, “An Examination of Team Effectiveness in Distributed and Co-located Engineering Teams,” Int. J. Eng. Educ., 24(2), pp. 400–408.
Lewis, K., and Mistree, F., 1997, “Modeling Interactions in Interdisciplinary Design: A Game Theoretic Approach,” AIAA J., 35(8), pp. 1387–1392. [CrossRef]
BandecchiM., Melton, B., Gardini, B., and Ongaro, F., 2000, “The ESA/ESTEC Concurrent Design Facility,” Proceedings of the 2nd European Systems Engineering Conference, EuSec, Vol. 1, pp. 329–336.
Karpati, G., Martin, J., Steiner, M., and Reinhardt, K., 2003, “The Integrated Mission Design Center (IMDC) at NASA Goddard Space Flight Center,” Proceedings of the IEEE Aerospace Conference, IEEE Publications, Vol. 8, pp. 8_3657–8_3667.
Gough, K., Allen, B. D., and Amundsen, R. M., 2005, “Collaborative Mission Design at NASA Langley Research Center,” Proceedings of Space Systems Engineering Conference, Georgia Institute of Technology, Paper No. SSEC_SA3, see also http://smartech.gatech.edu/handle/1853/8020
Ancona, D., Bresman, H., and Kaeufer, K., 2002, “The Comparative Advantage of X-Teams,” Sloan Manage Rev., 43(3), pp. 33–39. Available at http://ehis.ebscohost.com/ehost/detail?sid=39e32ae0-b990-4475-8559-7b9a9732e2b3%40sessionmgr14&vid=1&hid=5&bdata=JnNpdGU9ZWhvc3QtbGl2ZQ%3d%3d#
Papalambros, P. Y., and Wilde, D. J., 2000, Principles of Optimal Design: Modeling and Computation, Cambridge University Press, New York, NY.
Simpson, T. W., Poplinski, J. D., Koch, P. N., and Allen, J. K., 2001, “Metamodels for Computer-Based Engineering Design: Survey and Recommendations,” Eng. Comput., 17(2), pp. 129–150. [CrossRef]
Sobieszczanski-Sobieski, J., and Haftka, R. T., 1997, “Multidisciplinary Aerospace Design Optimization: Survey of Recent Developments,” Struct. Multidiscip. Optim., 14(1), pp. 1–23. [CrossRef]
Vincent, T. L., 1983, “Game Theory as a Design Tool,” J. Mech., Transm., Autom. Des., 105, pp. 165–170. [CrossRef]
Lewis, K., 1996, “An Algorithm for Integrated Subsystem Embodiment and System Synthesis,” Ph.D. thesis, Georgia Institute of Technology, Atlanta, GA.
Whitfield, R. I., Duffy, A. H. B., Coates, G., and Hills, W., 2002, “Distributed Design Coordination,” Res. Eng. Des., 13, pp. 243–252. 10.1007/s00163-002-0021-1
Hazelrigg, G. A., 1998, “A Framework for Decision-Based Engineering Design,” J. Mech. Des., 120, pp. 653–658. [CrossRef]
Chanron, V., and Lewis, K., 2005, “A Study of Convergence in Decentralized Design Processes,” Res. Eng. Des., 16(3), pp. 133–145. [CrossRef]
Chanron, V., Singh, T., and Lewis, K., 2005, “Equilibrium Stability in Decentralized Design Systems,” Int. J. Syst. Sci., 36(10), pp. 651–662. [CrossRef]
Xiao, A., Zheng, S., Allen, J. K., Rosen, D. W., and Mistree, F., 2005, “Collaborative Multidisciplinary Decision Making Using Game Theory and Design Capability Indices,” Res. Eng. Des., 16(1-2), pp. 57–72. [CrossRef]
Gurnani, A. P., and Lewis, K., 2008, “Using Bounded Rationality to Improve Decentralized Design,” AIAA J., 46(12), pp. 3049–3059. [CrossRef]
Lewis, K. E., Chen, W., and Schmidt, L. C., 2006, Decision Making in Engineering Design, American Society of Mechanical Engineers Press, New York, NY.
Yi, S. I., Shin, J. K., and Park, G. J., 2008, “Comparison of MDO Methods With Mathematical Examples,” Struct. Multidiscip. Optim., 35(5), pp. 391–402. [CrossRef]
Honda, T., Ciucci, F., and Yang, M. C., 2012, “An Information Passing Strategy for Achieving Pareto Optimality in the Design of Complex Systems,” Res. Eng. Des., 23(1), pp. 71–83. [CrossRef]
Collopy, P., 2001, “Economic-Based Distributed Optimal Design,” Proceedings of AIAA SPACE 2001 Conference and Exposition, AIAA, Paper No. 2001-4675.
Gilboa, I., Maccheroni, F., Marinacci, M., and Schmeidler, D., 2010, “Objective and Subjective Rationality in A Multiple Prior Model,” Econometrica, 78(2), pp. 755–770. [CrossRef]
Hermann, J., 2010, “Progressive Design Processes and Bounded Rational Designers,” J. Mech. Des., 132, p. 0810051. [CrossRef]
Gigerenzer, G., and Goldstein, D. D., 1996, “Reasoning the Fast and Frugal Way: Models of Bounded Rationality,” Psychol. Rev., 103(4), pp. 650–669. [CrossRef] [PubMed]
Nardi, B., and Whittaker, S., 2002, “The Place of Face-to-Face Communication in Distributed Work,” Distributed Work, P.Hinds, and S.Keisler, eds., MIT Press, Cambridge, MA, pp. 83–109.
Kendon, A., 1990, Conducting Interaction: Patterns of Behavior in Focused Encounters, Cambridge University Press, New York, NY.
Cooke, N. J., and Gorman, J. C., 2006, “Assessment of Team Cognition,” International Encyclopedia of Ergonomics and Human Factors, P.Karwowski, ed., Taylor & Francis Ltd., UK, pp. 270–275.
Ericsoon, K. A., Krampe, R., and Tesch-Romer, C., 1993, “The Role of Deliberate Practice in the Acquisition of Expert Performance,” Psychol. Rev., 100, pp. 363–406. [CrossRef]
Adelson, B., and Solway, E., 1988, “A Model of Software Design,” The Nature of Expertise, Chi, M., R.Glaser, and M.Farr, eds., Erlbaum, Hillsdale, NJ.
Schenk, K. D., Vitalari, N., and Davis, K. S., 1998, “Differences Between Novice and Expert Systems Analysts: What Do We Know and What Do We Do,” J. Manage. Inf. Syst., 15, pp. 9–51. Available at http://www.jstor.org/stable/40398371
Cross, N., 2004, “Expertise in Design: An Overview,” Des. Stud., 25(5), pp. 427–441. [CrossRef]
Kruger, C., and Cross, N., 2006, “Solution Driven Versus Problem Driven Deisgn: Strategies and Outcomes,” Des. Stud., 27(5), pp. 527–548. [CrossRef]
Jin, Y., and Geslin, M., 2010, “A Study of Argumentation-Based Negotiation in Collaborative Design,” Artif. Intell. Eng. Des., Anal. Manuf., 24, pp. 35–48. [CrossRef]
Larson, W., and Wertz, J., 1999, Space Mission Analysis and Design, Microcosm Press and Kluwer Academic Publishers, El Segundo, CA.
Freiheit, T., and Rao, S., 1991, “A Modified Game Theory Approach to Multiobjective Optimization,” J. Mech. Des., 113, pp. 286–291. [CrossRef]
Shiau, C., and Michalek, J., 2008, “Should Designers Worry About Market Systems?,” J. Mech. Des., 131, pp. 1–9. 10.1115/1.3013848
Parkin, K. L. G., Sercel, J. C., Liu, N. J., and Thunnissen, D. P., 2003, “Icemaker: An Excel-Based Environment for Collaborative Design,” Proceedings of IEEE Aerospace Conference, IEEE Publications, Paper No. 1564.
Bhowmik, R., 2008, “Building Design Optimization Using Sequential Linear Programming,” J. Comput., 3(4), pp. 58–64. [CrossRef]
Miele, A., Huang.H. Y., and Heideman, J. C., 1969, “Sequential Gradient-Restoration Algorithm for the Minimization of Constrained Functions-Ordinary and Conjugate Gradient Versions,” J. Optim. Theory Appl., 4(4), pp. 213–243. [CrossRef]
Snyman, J., 2005, Practical Mathematical Optimization, Springer, New York, NY.
Forsyth, D., 1990, Group Dynamics, Brooks/Cole, Pacific Grove, CA.
Harvey, J., 1974, “The Abilene Paradox: The Management of Agreement,” Organizational Dyn., 3(1), pp. 63–80. [CrossRef]


Grahic Jump Location
Fig. 1

Input and output variables for satellite design example

Grahic Jump Location
Fig. 2

Modified game theoretic team structure for the design team and task. The three subsystems are allowed to confer and negotiate directly without a mediator.

Grahic Jump Location
Fig. 3

Comparison of four best design results selected by the teams. The Pareto frontier serves as a baseline. The percentage next to each point is the compatibility error of that solution.

Grahic Jump Location
Fig. 4

Design history for each team. Each path shows the design points explored by individual teams.

Grahic Jump Location
Fig. 5

Compatibility Error between subsystems as function of design iteration




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In