Research Papers: Design Theory and Methodology

Computer-Based “Mental Set” Tasks: An Alternative Approach to Studying Design Fixation

[+] Author and Article Information
Maria Adriana Neroni

Department of Engineering,
University of Cambridge,
Trumpington Street,
Cambridge CB2 1PZ, UK
e-mail: man52@cam.ac.uk

Luis A. Vasconcelos

Department of Engineering,
University of Cambridge,
Trumpington Street,
Cambridge CB2 1PZ, UK
e-mail: lal40@cam.ac.uk

Nathan Crilly

Department of Engineering,
University of Cambridge,
Trumpington Street,
Cambridge CB2 1PZ, UK
e-mail: nc266@cam.ac.uk

Contributed by the Design Theory and Methodology Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received November 24, 2016; final manuscript received April 6, 2017; published online May 12, 2017. Assoc. Editor: Katja Holtta-Otto.

J. Mech. Des 139(7), 071102 (May 12, 2017) (10 pages) Paper No: MD-16-1789; doi: 10.1115/1.4036562 History: Received November 24, 2016; Revised April 06, 2017

The term “design fixation” refers to a phenomenon where designers unknowingly limit the space within which they search for solutions. In an attempt to study this phenomenon experimentally, researchers typically set participants open-ended design problems, prime them with an example solution, and measure their performance through a variety of subjective metrics. This approach gives rise to various problems, including limited data capture and highly subjective evaluation of design behavior. To address these problems, we studied design fixation with a computer-based task inspired by psychological paradigms used to study “mental set” (also known as the “Einstellung effect”). The task consisted of a gamelike activity requiring participants to design a bridge within a specified budget. The use of a digital environment facilitated continuous data capture during the design activities. The constrained task (and direct quantitative measures) permitted a more objective analysis of design performance, including the occurrence of fixation. The results showed that participants who developed a mental set during the task failed to find alternative, more efficient solutions in trials admitting multiple solutions, compared to the participants who did not fall victim to this mental block. In addition, during the process of designing, the occurrence of mental set resulted in participants adopting a less efficient design behavior and reporting a different subjective experience of the task. The method used and the results obtained show an exciting alternative for studying design fixation experimentally and promote a wider exploration of the variety of design activities in which fixation might occur.

Copyright © 2017 by ASME
Your Session has timed out. Please sign back in to continue.


Youmans, R. J. , and Arciszewski, T. , 2014, “ Design Fixation: A Cloak of Many Colors,” Design Computing and Cognition’12, Springer, Dordrecht, The Netherlands, pp. 115–129.
Youmans, R. J. , and Arciszewski, T. , 2014, “ Design Fixation: Classifications and Modern Methods of Prevention,” Artif. Intell. Eng. Des. Anal. Manuf., 28(2), pp. 129–137. [CrossRef]
Perttula, M. , and Sipilä, P. , 2007, “ The Idea Exposure Paradigm in Design Idea Generation,” J. Eng. Des., 18(1), pp. 93–102. [CrossRef]
Agogue, M. , Poirel, N. , Pineau, A. , Houde, O. , and Cassotti, M. , 2014, “ The Impact of Age and Training on Creativity: A Design-Theory Approach to Study Fixation Effects,” Thinking Skills Creativity, 11, pp. 33–41. [CrossRef]
Crilly, N. , 2015, “ Fixation and Creativity in Concept Development: The Attitudes and Practices of Expert Designers,” Des. Stud., 38, pp. 54–91. [CrossRef]
Robertson, B. F. , and Radcliffe, D. F. , 2009, “ Impact of CAD Tools on Creative Problem Solving in Engineering Design,” Comput.-Aided Des., 41(3), pp. 136–146. [CrossRef]
Jansson, D. G. , and Smith, S. M. , 1991, “ Design Fixation,” Des. Stud., 12(1), pp. 3–11. [CrossRef]
Linsey, J. S. , Tseng, I. , Fu, K. , Cagan, J. , Wood, K. L. , and Schunn, C. , 2010, “ A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty,” ASME J. Mech. Des., 132(4), p. 041003. [CrossRef]
Viswanathan, V. , and Linsey, J. , 2011, “ Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost,” ASME Paper No. DETC2011-47862.
Vasconcelos, L. A. , and Crilly, N. , 2016, “ Inspiration and Fixation: Questions, Methods, Findings, and Challenges,” Des. Stud., 42, pp. 1–32. [CrossRef]
Sio, U. N. , Kotovsky, K. , and Cagan, J. , 2015, “ Fixation or Inspiration? A Meta-Analytic Review of the Role of Examples on Design Processes,” Des. Stud., 39, pp. 70–99. [CrossRef]
Greene, J. C. , Caracelli, V. J. , and Graham, W. F. , 1989, “ Toward a Conceptual Framework for Mixed-Method Evaluation Designs,” Educ. Eval. Policy Anal., 11(3), pp. 255–274. [CrossRef]
Bilalić, M. , McLeod, P. , and Gobet, F. , 2008, “ Why Good Thoughts Block Better Ones: The Mechanism of the Pernicious Einstellung (Set) Effect,” Cognition, 108(3), pp. 652–661. [CrossRef] [PubMed]
Luchins, A. S. , 1942, “ Mechanization in Problem Solving: The Effect of Einstellung,” Psychol. Monogr., 54(6), pp. 1–95. [CrossRef]
Simon, H. A. , and Gilmartin, K. , 1973, “ A Simulation of Memory for Chess Positions,” Cognit. Psychol., 5(1), pp. 29–46. [CrossRef]
La Rocca, G. , and van Tooren, M. J. , 2010, “ Knowledge-Based Engineering to Support Aircraft Multidisciplinary Design and Optimization,” Proc. Inst. Mech. Eng., Part G, 224(9), pp. 1041–1055. [CrossRef]
Snider, C. M. , Culley, S. J. , and Dekoninck, E. A. , 2013, “ Analysing Creative Behaviour in the Later Stage Design Process,” Des. Stud., 34(5), pp. 543–574. [CrossRef]
Snider, C. , Dekoninck, E. , and Culley, S. , 2016, “ Beyond the Concept: Characterisations of Later-Stage Creative Behaviour in Design,” Res. Eng. Des., 27(3), pp. 265–289. [CrossRef]
Maier, N. R. F. , 1931, “ Reasoning and Learning,” Psychol. Rev., 38(4), pp. 332–346. [CrossRef]
Duncker, K. , and Lees, L. S. , 1945, “ On Problem-Solving,” Psychol. Monogr., 58(5), pp. 1–113. [CrossRef]
Luchins, A. S. , 1951, “ On Recent Usage of the Einstellung-Effect as a Test of Rigidity,” J. Consult. Psychol., 15(2), pp. 89–94. [CrossRef] [PubMed]
Luchins, A. S. , and Luchins, E. H. , 1950, “ New Experimental Attempts at Preventing Mechanization in Problem Solving,” J. Gen. Psychol., 42(2), pp. 279–297. [CrossRef]
Luchins, A. S. , and Luchins, E. H. , 1959, Rigidity of Behavior: A Variational Approach to the Effect of Einstellung, University of Oregon Books, Eugene, OR.
Chen, Z. , and Mo, L. , 2004, “ Schema Induction in Problem Solving: A Multidimensional Analysis,” J. Exp. Psychol., 30, pp. 583–600.
Ellis, J. J. , and Reingold, E. M. , 2014, “ The Einstellung Effect in Anagram Problem Solving: Evidence From Eye Movements,” Front. Psychol., 5(679), pp. 1–7. [PubMed]
Lovett, M. C. , and Anderson, J. R. , 1996, “ History of Success and Current Context in Problem Solving: Combined Influences on Operator Selection,” Cognit. Psychol., 31(2), pp. 168–217. [CrossRef]
Atwood, M. E. , and Polson, P. G. , 1976, “ A Process Model for Water Jug Problems,” Cognit. Psychol., 8(2), pp. 191–216. [CrossRef]
Delaney, P. F. , Ericsson, K. A. , and Knowles, M. E. , 2004, “ Immediate and Sustained Effects of Planning in a Problem-Solving Task,” J. Exp. Psychol., 30, pp. 1219–1234.
Tresselt, M. E. , and Leeds, D. S. , 1953, “ The Einstellung Effect in Immediate and Delayed Problem-Solving,” J. Gen. Psychol., 49(1), pp. 87–95. [CrossRef]
Bilalić, M. , McLeod, P. , and Gobet, F. , 2010, “ The Mechanism of the Einstellung (Set) Effect: A Pervasive Source of Cognitive Bias,” Curr. Dir. Psychol. Sci., 19(2), pp. 111–115. [CrossRef]
Bilalić, M. , and McLeod, P. , 2014, “ Why Good Thoughts Block Better Ones,” Sci. Am., 310(3), pp. 74–79. [CrossRef] [PubMed]
Saariluoma, P. , 1992, “ Error in Chess: The Apperception-Restructuring View,” Psychol. Res., 54(1), pp. 17–26. [CrossRef] [PubMed]
Chronic Logic, 2001, “ Pontifex,” Chronic Logic, Santa Cruz, CA, accessed Apr. 21, 2016, http://www.chroniclogic.com/pontifex.htm
Beepa, 2013, “ Fraps,” Beepa Pty Ltd, Albert Park, Melbourne, Australia, accessed Apr. 21, 2016, http://www.fraps.com/
Guindon, R. , 1990, “ Designing the Design Process: Exploiting Opportunistic Thoughts,” Hum.-Comput. Interact., 5(2), pp. 305–344. [CrossRef]
Eckert, C. M. , Stacey, M. , and Earl, C. , 2005, “ References to Past Designs,” Studying Designers '05, J. S. Gero and N. Bonnardel , eds., University of Provence, Aix-en-Provence, France, pp. 3–21.
Busby, J. A. , and Lloyd, P. A. , 1999, “ Influences on Solution Search Processes in Design Organisations,” Res. Eng. Des., 11(3), pp. 158–171. [CrossRef]
French, M. J. , 1998, Conceptual Design for Engineers, 3rd ed., Springer, London. (Originally published in 1971 as Engineering Design: The Conceptual Stage, Educational Books, London).
Frensch, P. A. , and Sternberg, R. J. , 1989, “ Expertise and Intelligent Thinking: When Is It Worse to Know Better?,” Advances in the Psychology of Human Intelligence, Vol. 5, R. J. Sternberg , ed., Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 157–188.
Rowe, P. G. , 1987, Design Thinking, MIT Press, Cambridge, MA.
Ullman, D. G. , Dietterich, T. G. , and Stauffer, L. A. , 1988, “ A Model of the Mechanical Design Process Based on Empirical Data,” Artif. Intell. Eng. Des. Anal. Manuf., 2(1), pp. 33–52. [CrossRef]
Ball, L. J. , Evans, J. S. B. , and Dennis, I. , 1994, “ Cognitive Processes in Engineering Design: A Longitudinal Study,” Ergonomics, 37(11), pp. 1753–1786. [CrossRef]
Bender, B. , and Blessing, L. , 2004, “ On the Superiority of Opportunistic Design Strategies During Early Embodiment Design,” DS 32: Proceedings of DESIGN 2004, the 8th International Design Conference, Dubrovnik, Croatia, May 18–21, pp. 117–122.
Cross, N. , 2004, “ Expertise in Design: An Overview,” Des. Stud., 25(5), pp. 427–441. [CrossRef]
Fricke, G. , 1999, “ Successful Approaches in Dealing With Differently Precise Design Problems,” Des. Stud., 20(5), pp. 417–429. [CrossRef]
Bronowski, J. , 1985, “ The Creative Process,” Leonardo, 18(4), pp. 245–248. [CrossRef]
Crilly, N. , 2010, “ The Roles That Artefacts Play: Technical, Social and Aesthetic Functions,” Des. Stud., 31(4), pp. 311–344. [CrossRef]
Kuhn, T. S. , 1962, The Structure of Scientific Revolutions, University of Chicago Press, Chicago, IL.
Lankoski, P. , and Björk, S. , 2015, Game Research Methods: An Overview, ETC Press, Carnegie Mellon University, Pittsburgh, PA.
Amabile, T. M. , 1983, “ The Social Psychology of Creativity: A Componential Conceptualization,” J. Pers. Soc. Psychol., 45(2), pp. 357–376. [CrossRef]
Howard-Jones, P. , Taylor, J. , and Sutton, L. , 2002, “ The Effect of Play on the Creativity of Young Children During Subsequent Activity,” Early Child Dev. Care, 172(4), pp. 323–328. [CrossRef]
Youmans, R. J. , 2011, “ The Effects of Physical Prototyping and Group Work on the Reduction of Design Fixation,” Des. Stud., 32(2), pp. 115–138. [CrossRef]
Welch, M. , Barlex, D. , and Lim, H. S. , 2000, “ Sketching: Friend or Foe to the Novice Designer?,” Int. J. Technol. Des. Edu., 10(2), pp. 125–148. [CrossRef]
Michael, D. , and Chen, S. , 2006, Serious Games: Games That Educate, Train, and Inform, Thomson Course Technology, Boston, MA.
Croskerry, P. , 2003, “ The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them,” Acad. Med., 78(8), pp. 775–780. [CrossRef] [PubMed]
Kassirer, J. P. , and Kopelman, R. I. , 1989, “ Cognitive Errors in Diagnosis: Instantiation, Classification, and Consequences,” Am. J. Med., 86(4), pp. 433–441. [CrossRef] [PubMed]
Morewedge, C. K. , Yoon, H. , Scopelliti, I. , Symborski, C. W. , Korris, J. H. , and Kassam, K. S. , 2015, “ Debiasing Decisions: Improved Decision Making With a Single Training Intervention,” Policy Insights Behav. Brain Sci., 2(1), pp. 129–140. [CrossRef]
Beilock, S. L. , and DeCaro, M. S. , 2007, “ From Poor Performance to Success Under Stress: Working Memory, Strategy Selection, and Mathematical Problem Solving Under Pressure,” J. Exp. Psychol., 33(6), pp. 983–998.
Henderson, K. , 1999, On Line and on Paper: Visual Representations, Visual Culture, and Computer Graphics in Design Engineering, MIT Press, Cambridge, MA.
Goldschmidt, G. , 2014, “ Modeling the Role of Sketching in Design Idea Generation,” An Anthology of Theories and Models of Design, A. Chakrabarti and L. T. M. Blessing , eds., Springer, London, pp. 433–450.
Chandrasegaran, S. K. , Ramani, K. , Sriram, R. D. , Horváth, I. , Bernard, A. , Harik, R. F. , and Gao, W. , 2013, “ The Evolution, Challenges, and Future of Knowledge Representation in Product Design Systems,” Comput.-Aided Des., 45(2), pp. 204–228. [CrossRef]


Grahic Jump Location
Fig. 1

Screen images of the game platform used for the trials (Reprinted with permission from Chronic Logic [33]), showing th design mode (left) and the test mode (right)

Grahic Jump Location
Fig. 2

Mean additional cost (and standard error) of the last design tested compared to the first design tested. In each case, the additional cost is relative to the cost of the least expensive possible functional solution.

Grahic Jump Location
Fig. 3

Proportion of trials in which the participants exhibited the stop if it works behavior, the strong then cheap behavior, and the cheap then strong behavior. “Others” refer to all the cases in which the behavior could not be classified in one of previous categories or resulted from a combination of them.




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In