Research Papers: Design Theory and Methodology

Optimizing Design Teams Based on Problem Properties: Computational Team Simulations and an Applied Empirical Test

[+] Author and Article Information
Christopher McComb

Department of Mechanical Engineering,
Carnegie Mellon University,
Pittsburgh, PA 15213
e-mail: ccm@cmu.edu

Jonathan Cagan

Fellow ASME
Department of Mechanical Engineering,
Carnegie Mellon University,
Pittsburgh, PA 15213
e-mail: cagan@cmu.edu

Kenneth Kotovsky

Department of Psychology,
Carnegie Mellon University,
Pittsburgh, PA 15213
e-mail: kotovsky@cmu.edu

Contributed by the Design Theory and Methodology Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received July 9, 2016; final manuscript received January 10, 2017; published online February 6, 2017. Editor: Irem Tumer.

J. Mech. Des 139(4), 041101 (Feb 06, 2017) (12 pages) Paper No: MD-16-1497; doi: 10.1115/1.4035793 History: Received July 09, 2016; Revised January 10, 2017

The performance of a team with the right characteristics can exceed the mere sum of the constituent members' individual efforts. However, a team having the wrong characteristics may perform more poorly than the sum of its individuals. Therefore, it is vital that teams are assembled and managed properly in order to maximize performance. This work examines how the properties of configuration design problems can be leveraged to select the best values for team characteristics (specifically team size and interaction frequency). A computational model of design teams which has been shown to effectively emulate human team behavior is employed to pinpoint optimized team characteristics for solving a variety of configuration design problems. These configuration design problems are characterized with respect to the local and global structure of the design space, the alignment between objectives, and the resources allotted for solving the problem. Regression analysis is then used to create equations for predicting optimized values for team characteristics based on problem properties. These equations achieve moderate to high accuracy, making it possible to design teams based on those problem properties. Further analysis reveals hypotheses about how the problem properties can influence a team's search for solutions. This work also conducts a cognitive study on a different problem to test the predictive equations. For a configuration problem of moderate size, the model predicts that zero interaction between team members should lead to the best outcome. A cognitive study of human teams verifies this surprising prediction, offering partial validation of the predictive theory.

Copyright © 2017 by ASME
Topics: Design , Teams
Your Session has timed out. Please sign back in to continue.


Cannon-Bowers, J. A. , Salas, E. , and Converse, S. , 1993, “ Shared Mental Models in Expert Team Decision Making,” Individual and Group Decision Making: Current Issues, N. J. Castellan , ed., Lawrence Erlbaum Associates, Inc., Hillsdale, NJ, pp. 221–246.
Dyer, D. J. , 1984, “ Team Research and Team Training: A State-of-the-Art Review,” Human Factors Review: 1984, F. Muckler , ed., Human Factors Society, Santa Monica, CA, pp. 285–323.
Orasanu, J. M. , and Salas, E. , 1993, “ Team Decision Making in Complex Environments,” Decision Making in Action: Models and Methods, G. Klein , J. Orasanu , R. Calderwood , and C. Zsambok , eds., Ablex Publishers, Norwood, NJ, pp. 327–345.
Morgan, B. , Glickman, A. , Woodard, E. , Blaiwes, A. , and Salas, E. , 1986, “ Measurement of Team Behaviors in a Navy Environment,” Report No. ADA185237.
McComb, C. , Cagan, J. , and Kotovsky, K. , 2015, “ Rolling With the Punches: An Examination of Team Performance in a Design Task Subject to Drastic Changes,” Des. Stud., 36(1), pp. 99–121. [CrossRef]
Jansson, D. , and Smith, S. M. , 1991, “ Design Fixation,” Des. Stud., 12(1), pp. 3–11. [CrossRef]
Gooding, R. Z. , and Wagner, J. A. , 1985, “ A Meta-Analytic Review of the Relationship Between Size and Performance: The Productivity and Efficiency of Organizations and Their Subunits,” Administrative Sci. Q., 30(4), pp. 462–481. [CrossRef]
Markham, S. E. , Danserau, F. , and ALutto, J. A. , 1982, “ Group Size and Absenteeism Rates: A Longitudinal Analysis,” Acad. Manage. J., 25(4), pp. 921–927. [CrossRef]
Mullen, B. , Symons, C. , Hu, L.-T. , and Salas, E. , 1989, “ Group Size, Leadership Behavior, and Subordinate Satisfaction,” J. Gen. Psychol., 116(2), pp. 155–170. [CrossRef]
Amason, A. C. , and Sapienza, H. J. , 1997, “ The Effects of Top Management Team Size and Interaction Norms on Cognitive and Affective Conflict,” J. Manage., 23(4), pp. 495–516.
Magjuka, R. J. , and Baldwin, T. T. , 2006, “ Team-Based Employee Involvement Programs: Effects of Design and Administration,” Pers. Psychol., 44(4), pp. 793–812. [CrossRef]
Yetton, P. W. , and Bottger, P. C. , 1982, “ Individual Versus Group Problem Solving: An Empirical Test of a Best-Member Strategy,” Organ. Behav. Hum. Perform., 29(3), pp. 307–321. [CrossRef]
Stewart, G. L. , 2006, “ A Meta-Analytic Review of Relationships Between Team Design Features and Team Performance,” J. Manage., 32(1), pp. 29–55.
Kozlowski, S. W. J. , and Klein, K. J. , 2000, “ A Multilevel Approach to Theory and Research in Organizations: Contextual, Temporal, and Emergent Processes,” Multilevel Theory, Research and Methods in Organizations: Foundations, Extensions, and New Directions, S. W. J. Kozlowski and K. J. Klein , eds., Jossey-Bass, San Francisco, CA, pp. 3–90.
Qurashi, M. M. , 1993, “ Dependence of Publication-Rate on Size of Some University Groups and Departments in U.K. and Greece in Comparison With N.C.I., USA,” Scientometrics, 27(1), pp. 19–38. [CrossRef]
Brooks, F. , 1995, The Mythical Man-Month, Addison-Wesley Longman Publishing, Boston, MA.
Di Penta, M. , Harman, M. , Antoniol, G. , and Qureshi, F. , 2007, “ The Effect of Communication Overhead on Software Maintenance Project Staffing: A Search-Based Approach,” 2007 IEEE International Conference on Software Maintainence, Oct. 2–5, pp. 315–324.
Blackburn, J. D. , Lapre, M. A. , and Van Wassenhove, L. N. , 2006, “ Brooks' Law Revisited: Improving Software Productivity by Managing Complexity,” SSRN Electron. J. (Online).
Heričko, M. , Živkovič, A. , and Rozman, I. , 2008, “ An Approach to Optimizing Software Development Team Size,” Inf. Process. Lett., 108(3), pp. 101–106. [CrossRef]
McComb, C. , Goucher-Lambert, K. , and Cagan, J. , 2015, “ Fairness and Manipulation: An Empirical Study of Arrow's Impossibility Theorem,” International Conference on Engineering Design, Milan, Italy, July 27–30, pp. 267–276.
McComb, C. , Cagan, J. , and Kotovsky, K. , 2016, “ Drawing Inspiration From Human Design Teams for Better Search and Optimization: The Heterogeneous Simulated Annealing Teams Algorithm,” ASME J. Mech. Des., 138(4), p. 44501. [CrossRef]
He, J. , Butler, B. , and King, W. , 2007, “ Team Cognition: Development and Evolution in Software Project Teams,” J. Manage. Inf. Syst., 24(2), pp. 261–292. [CrossRef]
Pinto, M. , 1990, “ Project Team Communication and Cross-Functional Cooperation in New Program Development,” J. Prod. Innovation Manage., 7(3), pp. 200–212. [CrossRef]
Smith, K. G. , Smith, K. A. , Olian, J. D. , Sims, H. P. , O'Bannon, D. P. , and Scully, J. A. , 1994, “ Top Management Team Demography and Process: The Role of Social Integration and Communication,” Administrative Sci. Q., 39(3), p. 412. [CrossRef]
Espinosa, J. A. , Nan, N. , and Carmel, E. , 2015, “ Temporal Distance, Communication Patterns, and Task Performance in Teams,” J. Manage. Inf. Syst., 32(1), pp. 151–191. [CrossRef]
Patrashkova-Volzdoska, R. R. , McComb, S. A. , Green, S. G. , and Compton, W. D. , 2003, “ Examining a Curvilinear Relationship Between Communication Frequency and Team Performance in Cross-Functional Project Teams,” IEEE Trans. Eng. Manage., 50(3), pp. 262–269. [CrossRef]
Patrashkova, R. R. , and McComb, S. A. , 2004, “ Exploring Why More Communication is Not Better: Insights From a Computational Model of Cross-Functional Teams,” J. Eng. Technol. Manage., 21(1–2), pp. 83–114. [CrossRef]
Kennedy, D. M. , McComb, S. A. , and Vozdolska, R. R. , 2011, “ An Investigation of Project Complexity's Influence on Team Communication Using Monte Carlo Simulation,” J. Eng. Technol. Manage., 28(3), pp. 109–127. [CrossRef]
Fu, K. , Cagan, J. , and Kotovsky, K. , 2010, “ Design Team Convergence: The Influence of Example Solution Quality,” ASME J. Mech. Des., 132(11), p. 111005. [CrossRef]
McComb, C. , Cagan, J. , and Kotovsky, K. , 2015, “ Lifting the Veil: Drawing Insights About Design Teams From a Cognitively-Inspired Computational Model,” Des. Stud., 40(C), pp. 119–142. [CrossRef]
Jones, P. E. , and Roelofsma, P. , 2000, “ The Potential for Social Contextual and Group Biases in Team Decision-Making: Biases, Conditions and Psychological,” Ergonomics, 43(8), pp. 1129–1152. [CrossRef] [PubMed]
Granovetter, M. , 1983, “ The Strength of Weak Ties: A Network Theory Revisited,” Sociol. Theory, 1(1983), p. 201. [CrossRef]
Sio, U. N. , Kotovsky, K. , and Cagan, J. , 2014, “ Analyzing the Effect of Team Structure on Team Performance: An Experimental and Computational Approach,” 36th Annual Conference of the Cognitive Science Society, P. Bello , M. Guarini , M. McShane , and B. Scassellati , eds., Cognitive Science Society, Austin, TX, pp. 1437–1442.
Dinar, M. , Park, Y.-S. , Shah, J. J. , and Langley, P. , 2015, “ Patterns of Creative Design: Predicting Ideation From Problem Formulation,” ASME Paper No. DETC2015-46537.
Dinar, M. , Shah, J. , Hunt, G. , Campana, E. , and Langley, P. , 2011, “ Towards a Formal Representation Model of Problem Formulation in Design,” ASME Paper No. DETC2011-48396.
Shah, J. J. , Smith, S. M. , and Vargas-Hernandez, N. , 2003, “ Metrics for Measuring Ideation Effectiveness,” Des. Stud., 24(2), pp. 111–134. [CrossRef]
Kirkpatrick, S. , Gelatt, C. D. , and Vecchi, M. P. , 1983, “ Optimization by Simulated Annealing,” Science, 220(4598), pp. 671–680. [CrossRef] [PubMed]
Cagan, J. , and Kotovsky, K. , 1997, “ Simulated Annealing and the Generation of the Objective Function: A Model of Learning During Problem Solving,” Comput. Intell., 13(4), pp. 534–581. [CrossRef]
Yu, B. Y. , Honda, T. , Sharqawy, M. , and Yang, M. , 2016, “ Human Behavior and Domain Knowledge in Parameter Design of Complex Systems,” Des. Stud., 45(Part B), pp. 1–26.
Ball, L. J. , and Ormerod, T. C. , 1995, “ Structured and Opportunistic Processing in Design: A Critical Discussion,” Int. J. Hum. Comput. Stud., 43(1), pp. 131–151. [CrossRef]
Langley, P. , 1985, “ Learning to Search: From Weak Methods to Domain-Specific Heuristics,” Cognit. Sci., 9(2), pp. 217–260. [CrossRef]
Simon, H. A. , 1956, “ Rational Choice and the Structure of the Environment,” Psychol. Rev., 63(2), pp. 129–138. [CrossRef] [PubMed]
Nikander, J. B. , Liikkanen, L. A. , and Laakso, M. , 2014, “ The Preference Effect in Design Concept Evaluation,” Des. Stud., 35(5), pp. 473–499. [CrossRef]
Toh, C. A. , Patel, A. H. , Strohmetz, A. A. , and Miller, S. R. , 2015, “ My Idea Is Best! Ownership Bias and Its Influence on Engineering Concept Selection,” ASME Paper No. DETC2015-46478.
McComb, C. , Cagan, J. , and Kotovsky, K. , 2017, “ Utilizing Markov Chains to Understand Operation Sequencing in Design Tasks,” Design Computing and Cognition’16, J. S. Gero , ed., Springer International Publishing, Cham, Switzerland, pp. 401–418.
Sen, P. , and Yang, J.-B. , 2012, Multiple Criteria Decision Support in Engineering Design, Springer Sciences and Business Media, London.
Myers, J. L. , Well, A. , and Lorch, R. F. , 2010, Research Design and Statistical Analysis, Routledge, London.
Cagan, J. , Shimada, K. , and Yin, S. , 2002, “ A Survey of Computational Approaches to Three-Dimensional Layout Problems,” Comput. Des., 34(8), pp. 597–611.
Sorkin, G. , 1991, “ Efficient Simulated Annealing on Fractal Energy Landscapes,” Algorithmica, 6(37), pp. 367–418. [CrossRef]
Mandelbrot, B. B. , 1983, The Fractal Geometry of Nature, W. H. Freeman, New York.
Gneiting, T. , and Schlather, M. , 2001, “ Stochastic Models Which Separate Fractal Dimension and Hurst Effect,” SIAM Rev., 46(2), pp. 269–282. [CrossRef]
Hurst, H. E. , 1957, “ A Suggested Statistical Model of Some Time Series Which Occur in Nature,” Nature, 180(4584), pp. 494–494. [CrossRef]
Mandelbrot, B. B. , and Wallis, J. R. , 1968, “ Noah, Joseph, and Operational Hydrology,” Water Resour. Res., 4(5), pp. 909–918. [CrossRef]
Lingo, E. L. , and O'Mahony, S. , 2010, “ Nexus Work: Brokerage on Creative Projects.,” Administrative Sci. Q., 55(1), pp. 47–81. [CrossRef]
Nosek, J. T. , 1998, “ The Case for Collaborative Programming,” Commun. ACM, 41(3), pp. 105–108. [CrossRef]
Secomb, J. , 2008, “ A Systematic Review of Peer Teaching and Learning in Clinical Education,” J. Clin. Nurs., 17(6), pp. 703–716. [CrossRef] [PubMed]
Yumer, M. E. , Chaudhuri, S. , Hodgins, J. K. , and Kara, L. B. , 2015, “ Semantic Shape Editing Using Deformation Handles,” ACM Trans. Graph., 34(4), pp. 86:1–86:12. [CrossRef]
Dennis, A. R. , and Gallupe, B. R. , 1992, “ A History of Group Support Systems Empirical Research: Lessons Learned and Future Directions,” Group Support Systems: New Perspectives, MacMillan, New York.
Valacich, J. S. , Dennis, A. R. , and Connolly, T. , 1994, “ Idea Generation in Computer-Based Groups: A New Ending to an Old Story,” Organ. Behav. Hum. Decis. Process., 57(3), pp. 448–467. [CrossRef]
Mumford, M. D. , Feldman, J. M. , Hein, M. B. , and Nagao, D. J. , 2001, “ Tradeoffs Between Ideas and Structure: Individual Versus Group Performance in Creative Problem Solving,” J. Creat. Behav., 35(1), pp. 1–23. [CrossRef]
Katzenbach, J. R. , and Smith, D. K. , 1993, The Wisdom of Teams: Creating the High-Performance Organization, Harvard Business Review Press, Boston, MA.
Wright, D. B. , 2007, “ Calculating Nominal Group Statistics in Collaboration Studies,” Behav. Res. Methods, 39(3), pp. 460–70. [CrossRef] [PubMed]
Zajonc, R. B. , and Sales, S. M. , 1966, “ Social Facilitation of Dominant and Subordinate Responses,” J. Exp. Soc. Psychol., 2(2), pp. 160–168. [CrossRef]
Salomon, G. , and Globerson, T. , 1989, “ When Teams Do Not Function the Way They Ought To,” Int. J. Educ. Res., 13(1), pp. 89–99. [CrossRef]
McComb, C. , Cagan, J. , and Kotovsky, K. , 2016, “ Linking Properties of Design Problems to Optimal Team Characteristics,” ASME Paper No. DETC2016-59333.


Grahic Jump Location
Fig. 1

Example solutions to structural design problems, showing required loads and supports: (a) narrow-base tower layout, (b) wide-base tower layout, (c) single-span bridge layout, and (d) double-span bridge layout

Grahic Jump Location
Fig. 2

Example solutions to fluid channel design problems, showing pressures at required inlets and outlets: (a) concentric water distribution network, (b) eccentric water distribution network, (c) concentric oil distribution network, and (d) eccentric oil distribution network

Grahic Jump Location
Fig. 3

Random walk example

Grahic Jump Location
Fig. 4

Determining the optimal team characteristics for (a) case A and (b) case B

Grahic Jump Location
Fig. 5

Contribution to final model for case A, main effects only

Grahic Jump Location
Fig. 6

Contribution to final model for case A, main effects + interactions

Grahic Jump Location
Fig. 7

Contribution to final model for case B, main effects only

Grahic Jump Location
Fig. 8

Contribution to final model for case B, main effects + interactions

Grahic Jump Location
Fig. 9

Quality of best solutions with respect to total cost. Error bars indicate ±1 standard error.




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In