Research Papers: Design Theory and Methodology

Comparing Ideation Techniques for Beginning Designers

[+] Author and Article Information
Shanna R. Daly

Assistant Professor
Mechanical Engineering,
University of Michigan,
2350 Hayward Avenue,
Ann Arbor, MI 48109
e-mail: srdaly@umich.edu

Colleen M. Seifert

Department of Psychology,
University of Michigan,
530 Church Street,
Ann Arbor, MI 48109
e-mail: seifert@umich.edu

Seda Yilmaz

Associate Professor
Department of Industrial Design,
Iowa State University,
146 College of Design,
Ames, IA 50011
e-mail: seda@iastate.edu

Richard Gonzalez

Department of Psychology,
University of Michigan,
530 Church Street,
Ann Arbor, MI 48109
e-mail: gonzo@umich.edu

Contributed by the Design Theory and Methodology Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received January 25, 2016; final manuscript received June 1, 2016; published online August 30, 2016. Assoc. Editor: Julie Linsey.

J. Mech. Des 138(10), 101108 (Aug 30, 2016) (12 pages) Paper No: MD-16-1073; doi: 10.1115/1.4034087 History: Received January 25, 2016; Revised June 01, 2016

Concept generation techniques can help to support designers in generating multiple ideas during design tasks. However, differences in the ways these techniques guide idea generation are not well understood. This study investigated the qualities of concepts generated by beginning engineering designers using one of three different idea generation techniques. Working individually on an open-ended engineering design problem, 102 first year engineering students learned and applied one of three different ideation techniques—design heuristics, morphological analysis, or individual brainstorming (using brainstorming rules to generate ideas working alone)—to a given design problem. Using the consensual assessment technique, all concepts were rated for creativity, elaboration, and practicality, and all participants' concept sets were rated for quantity and diversity. The simplest technique, individual brainstorming, led to the most concepts within the short (25 minute) ideation session. All three techniques produced creative concepts averaging near the scale midpoint. The elaboration of the concepts was significantly higher with design heuristics and morphological analysis techniques, and the practicality was significantly higher using design heuristics. Controlling for number of concepts generated, there were no significant differences in diversity of solution sets across groups. These results demonstrate that the use of design heuristics does not limit the creativity of ideation outcomes, and helps students to develop more elaborate and practical ideas. Design heuristics show advantages in the initial idea generation phase for beginning engineering students. These findings point to specific strengths in different ideation techniques, and the value of exposing beginning designers to multiple techniques for idea generation.

Copyright © 2016 by ASME
Topics: Creativity , Design , Students
Your Session has timed out. Please sign back in to continue.


Cross, N. , 2000, Engineering Design Methods: Strategies for Product Design, 3rd ed., Wiley, Chichester, UK.
Pahl, G. , and Beitz, W. , 1996, Engineering Design: A Systematic Approach, Springer-Verlag, Berlin.
Higgins, J. S. , Maitland, G. C. , Perkins, J. D. , Richardson, S. M. , and Piper, D. W. , 1989, “ Identifying and Solving Problems in Engineering Design,” Stud. Higher Educ., 14(2), pp. 169–181. [CrossRef]
Horowitz, R. , 1999, “ Creative Problem Solving in Engineering Design,” Ph.D. dissertation, Tel-Aviv University, Tel Aviv-Yafo, Israel.
Osborn, A. , 1957, Applied Imagination: Principles and Procedures of Creative Thinking, Charles Scribner's Sons, New York.
Ulrich, K. , and Eppinger, S. , 1995, Product Design and Development, McGraw-Hill, New York.
Dym, C. L. , 1994, Engineering Design: A Synthesis of Views, Cambridge University Press, New York.
Daly, S. R. , Yilmaz, S. , Christian, C. , Seifert, C. , and Gonzalez, R. , 2012, “ Design Heuristics in Engineering Concept Generation,” J. Eng. Educ., 101(4), pp. 601–629. [CrossRef]
Newell, A. , and Simon, H. A. , 1972, Human Problem Solving, Prentice-Hall, Englewood, NJ.
Dorst, K. H. , and Cross, N. , 2001, “ Creativity in the Design Process: Co-Evolution of Problem-Solution,” Des. Stud., 22(5), pp. 425–437. [CrossRef]
Chrysikou, E. G. , and Weisberg, R. W. , 2005, “ Following the Wrong Footsteps: Fixation Effects of Pictorial Examples in a Design Problem-Solving Task,” J. Exp. Psychol., 31(5), pp. 1134–1148.
Linsey, J. S. , Tseng, I. , Fu, K. , Cagan, J. , Wood, K. L. , and Schunn, C. , 2010, “ A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty,” ASME J. Mech. Des., 132(4), pp. 1–12. [CrossRef]
Purcell, A. T. , and Gero, J. S. , 1996, “ Design and Other Types of Fixation,” Des. Stud., 17(4), pp. 363–383. [CrossRef]
Sio, U. N. , Kotovsky, K. , and Cagan, J. , 2015, “ Fixation or Inspiration? A Meta-Analytic Review of the Role of Examples on Design Processes,” Des. Stud., 39(C), pp. 70–99. [CrossRef]
Smith, S. M. , 1995, “ Getting Into and Out of Mental Ruts: A Theory of Fixation, Incubation, and Insight,” The Nature of Insight, R. J. Sternberg , and J. E. Davidson , eds., MIT Press, Cambridge.
Viswanathan, V. K. , and Linsey, J. S. , 2013, “ Design Fixation and Its Mitigation,” ASME J. Mech Des., 135(5), p. 051008. [CrossRef]
Youmans, R. J. , and Arciszewski, T. , 2014, “ Design Fixation: Classifications and Modern Methods of Prevention,” Artif. Intell. Eng. Des., Anal. Manuf., 28(02), pp. 129–137. [CrossRef]
Chrysikou, E. G. , and Weisberg, R. W. , 2005, “ Following the Wrong Footsteps: Fixation Effects of Pictorial Examples in a Design Problem-solving Task,” J. Exp. Psychol., 31(5), pp. 1134–1148.
Crilly, N. , 2015, “ Fixation and Creativity in Concept Development: The Attitudes and Practices of Expert Designers,” Des. Stud., 38, pp. 54–91. [CrossRef]
Vasconcelos, L. A. , and Crilly, N. , 2016, “ Inspiration and Fixation: Questions, Methods, Findings, and Challenges,” Des. Stud., 42, pp. 1–32. [CrossRef]
Eberle, B. , 1995, Scamper, Prufrock, Waco, TX.
Chulvi, V. , González-Cruz, M. C. , Mulet, E. , and Aguilar-Zambrano, J. , 2013, “ Influence of the Type of Idea Generation Method on the Creativity of Solutions,” Res. Eng. Des., 24(1), pp. 33–41. [CrossRef]
Dahl, D. , and Moreau, P. , 2002, “ The Influence and Value of Analogical Thinking During New Product Ideation,” J. Mark. Res., 39(1), pp. 47–60. [CrossRef]
Dunbar, K. , and Blanchette, I. , 2001, “ The In vivo/In Vitro Approach to Cognition: The Case of Analogy,” Trends Cognit. Sci., 5(8), pp. 334–339. [CrossRef]
Goel, A. K. , and Bhatta, S. R. , 2004, “ Use of Design Patterns in Analogy-Based Design,” Adv. Eng. Inf., 18(2), pp. 85–94. [CrossRef]
Linsey, J. S. , 2007, “ Design-by-Analogy and Representation in Innovative Engineering Concept Generation,” Ph.D. dissertation, University of Texas, Austin, TX.
Perkins, D. , 1997, “ Creativity's Camel: The Role of Analogy in Invention,” Creative Thought, T. Ward , S. Smith , and J. Vaid , eds., American Psychological Association, Washington, DC, pp. 523–528.
Hannan, D. , 2000, “ Value Methodology, Creative Problem Solving Strategies and TRIZ,” SAVE International Conference, pp. 70–79.
Hernandez, N. V. , Schmidt, L. C. , and Okudan, G. E. , 2013, “ Systematic Ideation Effectiveness Study of TRIZ,” ASME J. Mech. Des., 135(10), p.101009. [CrossRef]
Orloff, M. A. , 2003, Inventive Thinking Through TRIZ: A Practical Guide, Springer, Berlin, Germany.
Terninko, J. , Zussman, A. , and Zlotin, B. , 1998, Systematic Innovation: An Introduction to TRIZ. CRC Press, LLC, Boca Raton, FL.
Altshuller, G. , 2005, 40 Principles: TRIZ Keys to Technical Innovation, Extended Edition, Technical Innovation Center, Worchester, MA.
Altshuller, G. , and Rodman, S. , 1999, The Innovation Algorithm: TRIZ, Systematic Innovation and Technical Creativity, Technical Innovation Center, Worchester, MA.
Dym, C. L. , and Little, P. , 2004, Engineering Design: A Project-Based Introduction, Wiley, Hoboken, NJ.
Otto, K. , and Wood, K. , 2001, Product Design: Techniques in Reverse Engineering and New Product Development, Prentice-Hall, Upper Saddle River, NJ.
Ullman, D. , 1992, The Mechanical Design Process, McGraw-Hill, New York.
Allen, M. , 1962, Morphological Creativity, Prentice-Hall, Upper Saddle River, New Jersey.
Zwicky, F. , 1969, Discovery, Invention, Reserach Through the Morphological Approach, Macmillan, New York.
Yilmaz, S. , and Seifert, C. M. , 2011, “ Creativity Through Design Heuristics: A Case Study of Expert Product Design,” Des. Stud., 32(4), pp. 384–415. [CrossRef]
Yilmaz, S. , Seifert, C. M. , and Gonzalez, R. , 2010, “ Cognitive Heuristics in Design: Instructional Strategies to Increase Creativity in Idea Generation,” J. Artif. Intell. Eng. Des., Anal. Manuf., 24(3), pp. 335–355. [CrossRef]
Design Heuristics, LLC, 2012, “ Design Heuristics, Strategies to Inspire Ideas,” www.designheuristics.com, Design Heuristics, LLC.
Reich, Y. , Hatchuel, A. , Shai, O. , and Subrahmanian, E. , 2012, “ A Theoretical Analysis of Creativity Methods in Engineering Design: Casting an Improving ASIT Within C-K Theory,” J. Eng. Des., 23(2), pp. 137–158. [CrossRef]
Daly, S. R. , Christian, J. , Yilmaz, S. , Seifert, C. , and Gonzalez, R. , 2012, “ Assessing Design Heuristics for Idea Generation in an Introductory Engineering Course,” Int. J. Eng. Educ., 28(2), pp. 1–11.
Yilmaz, S. , Daly, S. R. , Christian, J. L. , Seifert, C. M. , and Gonzalez, R. , 2013, “ Can Experienced Designers Learn From New Tools? A Case Study of Idea Generation in a Professional Engineering Team,” Int. J. Des. Creativity Innovation, 2(2), pp. 82–96. [CrossRef]
Kotys-Schwartz, D. , Daly, S. R. , Yilmaz, S. , Knight, D. , and Polmear, M. , 2014, “ Evaluating the Implementation of Design Heuristic Cards in an Industry-Sponsored Capstone Design Course,” 121st Annual Conference of American Society of Engineering Education, Indianapolis, IN, June 15–18, Industrial Design Conference Presentations, Posters and Proceedings. Paper No. 6.
Leahy, K. , Yilmaz, S. , Seifert, C. , and Daly, S. , 2016, “ Integrating Design Heuristics Into Your Classroom,” Annual Conference of American Society of Engineering Education, New Orleans, LA, July 26–Aug. 29, p. 25796.
Dym, C. L. , Agogino, A. M. , Eris, O. , Frey, D. D. , and Leifer, L. J. , 2005, “ Engineering Design Thinking, Teaching, and Learning,” J. Eng. Educ., 94(1), pp. 103–120. [CrossRef]
Sheppard, S. D. , 2003, “ A Description of Engineering: An Essential Backdrop for Interpreting Engineering Education,” Mudd Design Workshop IV, Claremont, CA, July 10–12.
Liu, Y. C. , Bligh, T. , and Chakrabarti, A. , 2003, “ Towards an ‘Ideal’ Approach for Concept Generation,” Des. Stud., 24(4), pp. 341–355. [CrossRef]
Brophy, D. R. , 2001, “ Comparing the Attributes, Activities, and Performance of Divergent, Convergent, and Combination Thinkers,” Creativity Res. J., 13(3–4), pp. 439–455. [CrossRef]
Sangelkar, S. , de Vries, C. , Ashour, O. , and Lasher, W. , 2015, “ Teaching Idea Generation to Undergraduate Students Within the Time Constraints of a Capstone Course,” Annual Conference of American Society of Engineering Education, Seattle, WA, June 14–17, Paper No. 13352.
Coates, N. , Cook, I. , and Robinson, H. , 1996, “ Idea Generation Techniques in an Industrial Market,” J. Mark. Pract., 3(2), pp. 107–118. [CrossRef]
Fogler, H. S. , Rojek, C. , Jackson, N. A. , and Brigham, E. F. , 2014, Strategies for Creative Problem Solving, Prentice Hall, Upper Saddle River, NJ.
White, C. , Wood, K. , and Jensen, D. , 2012, “ From Brainstorming to C-Sketch to Principles of Historical Innovators: Ideation Techniques to Enhance Student Creativity,” J. STEM Educ., 13(5), pp. 12–25.
Warren, T. F. , and Davis, G. A. , 1969, “ Techniques for Creative Thinking: An Empirical Comparison of Three Methods,” Psychol. Rep., 25(1), pp. 207–214. [CrossRef] [PubMed]
Davis, G. A. , and Roweton, W. E. , 1968, “ Using Idea Checklists With College Students: Overcoming Resistance,” J. Psychol., 70(2), pp. 221–226. [CrossRef]
Shah, J. J. , Vargas-Hernandez, N. , Summers, J. D. , and Kulkarni, S. , 2001, “ Collaborative Sketching (c-Sketch): An Idea Generation Technique for Engineering Design,” J. Creative Behav., 35(3), pp. 168–198. [CrossRef]
Butler, D. L. , and Kline, M. A. , 1998, “ Good Versus Creative Solutions: A Comparison of Brainstorming, Hierarchical, and Perspective-Changing Heuristics,” Creativity Res. J., 11(4), pp. 325–331. [CrossRef]
Linsey, J. S. , Clauss, E. F. , Kurtoglu, T. , Murphy, J. T. , Wood, K. L. , and Markman, A. B. , 2011, “ An Experimental Study of Group Idea Generation Techniques: Understanding the Roles of Idea Representation and Viewing Methods,” ASME J. Mech. Des., 133(3), p. 031008. [CrossRef]
Kramer, J. , Daly, S. R. , Yilmaz, S. , and Seifert, C. M. , 2014, “ A Case Study Analysis of Design Heuristics in an Upper-level Cross-disciplinary Design Course,” Annual Conference of American Society of Engineering Education, Paper No. 8452.
Kramer, J. , Daly, S. R. , Yilmaz, S. , Seifert, C. M. , and Gonzalez, R. , 2015, “ Investigating the Impact of Design Heuristics on Idea Initiation and Development,” Adv. Eng. Educ., 4(4), pp.1–26.
Altshuller, G. , 1997, 40 Principles: TRIZ Keys to Technical Innovation, Technical Innovation Center, Worcester, MA.
Ilevbare, I. M. , Probert, D. , and Phaal, R. , 2013, “ A Review of TRIZ, and Its Benefits and Challenges in Practice,” Technovation, 33(2), pp. 30–37. [CrossRef]
Stein, M. I. , 1975, Stimulating Creativity: Group Procedures, Academic Press, New York.
Leclef, F. , 1994, “ 132 Managers Talk About Creativity Consultancy,” Creativity and Innovation: The Power of Synergy, H. Geschka , S. Moger , and T. Rickards , eds., Geschka & Partner Unternhmensberatung, Darmstadt, Germany, pp. 45–49.
Wallas, G. , 1926, The Art of Thought, Butler & Tanner, Ltd., London.
Kelley, T. , 2001, “ The Art of Innovation: Lessons in Creativity From IDEO,” America's Leading Design Dirm, Double Day, New York.
Wilson, C. , 2006, “ Brainstorming Pitfalls and Best Practices,” Interactions, 13(5), pp. 50–63. [CrossRef]
Kinlaw, D. C. , 1996, Facilitation Skills: Create Your Own Training Program, McGraw-Hill, New York.
Isaksen, S. G. , 1998, “ A Review of Brainstorming Research: Six Critical Issues for Inquiry,” Monograph #302, Creative Research Unit, Creative Problem Solving Group, Buffalo, NY.
Hargadon, A. , and Sutton, R. I. , 1997, “ Technology Brokering and Innovation in a Product Development Firm,” Adm. Sci. Q., 42(4), pp. 716–749. [CrossRef]
Sutton, R. I. , and Hargadon, A. , 1996, “ Brainstorming Groups in Context: Effectiveness in a Product,” Adm. Sci. Q., 41(4), pp. 685–718. [CrossRef]
Firestien, R. L. , and Treffinger, D. J. , 1983, “ Creative Problem Solving: Guidelines and Resources for Effective Facilitation,” Gifted Child Today, 6(1), pp. 2–10. [CrossRef]
Isaksen, S. G. , 1983, “ Toward a Model for the Facilitation of Creative Problem Solving,” J. Creative Behav., 17(1), pp. 18–30. [CrossRef]
Isaksen, S. G. , and Gaulin, J. P. , 2005, “ A Reexamination of Brainstorming Research: Implications for Research and Practice,” Gifted Child Q., 49(4), pp. 315–329. [CrossRef]
Offner, A. K. , Kramer, T. J. , and Winter, J. P. , 1996, “ The Effects of Facilitation, Recording, and Pauses on Group Brainstorming,” Small Group Res., 27(2), pp. 283–298. [CrossRef]
Bennis, W. , and Biederman, P. W. , 1997, Organizing Genius: The Secrets of Creative Collaboration, Addison-Wesley Publishing, New York.
Galegher, J. , Kraut, R. E. , and Egido, C. , 1990, Intellectual Teamwork: Social and Technological Foundations of Cooperative Work, Lawrence Erlbaum Associates, Hillsdale, NJ.
Laughlin, P. , 2002, “ Groups Perform Better Than the Best Individuals on Letters-to-Numbers Problems,” Organ. Behav. Hum. Decis. Processes, 88(2), pp. 605–620. [CrossRef]
Collins, B. , and Guetzkow, H. , 1964, A Social Psychology of Group Problem Solving, Wiley, New York.
Paulus, P. B. , Pauhus, P. B. , Dzindolet, M. T. , Poletes, G. , and Camacho, L. M. , 1993, “ Perception of Performance in Group Brainstorming: The Illusion of Group Productivity,” Pers. Soc. Psychol. Bull., 19(1), pp. 78–89. [CrossRef]
Diehl, M. , and Stroebe, W. , 1987, “ Productivity Loss in Brainstorming Groups: Toward the Solution of a Riddle,” J. Pers. Soc. Psychol., 53(3), pp. 497–509. [CrossRef]
Diehl, M. , and Stroebe, W. , 1991, “ Productivity Loss in Idea Generation Groups: Tracking Down the Blocking Effect,” J. Pers. Soc. Psychol., 61(3), pp. 392–403. [CrossRef]
Mullen, B. , Johnson, C. , and Salas, E. , 1991, “ Productivity Loss in Brainstorming Groups: A Meta-Analytic Integration,” Basic Appl. Soc. Psychol., 12(1), pp. 3–23. [CrossRef]
Paulus, P. B. , 2000, “ Groups, Teams, and Creativity: The Creative Potential of Idea-Generating Groups,” Appl. Psychol.: Int. Rev., 49(2), pp. 237–262. [CrossRef]
Rietzschel, E. F. , Nijstad, B. A. , and Stroebe, W. , 2006, “ Productivity is Not Enough: A Comparison of Interactive and Nominal Brainstorming Groups on Idea Generation and Selection,” J. Exp. Soc. Psychol., 42(2), pp. 244–251. [CrossRef]
Taylor, D. W. , Berry, P. C. , and Block, C. H. , 1958, “ Does Group Participation When Using Brainstorming Facilitate or Inhibit Creative Thinking?,” Adm. Sci. Q., 6, pp. 22–47.
Harari, O. , and Graham, W. K. , 1975, “ Tasks and Task Consequences as Factors in Individual and Group Brainstorming,” J. Soc. Psychol., 95(1), pp. 61–65. [CrossRef]
Steiner, I. D. , 1972, Group Process and Productivity, Academic Press, San Diego, CA.
Lewis, A. C. , Sadosky, T. L. , and Connolly, T. , 1975, “ Effectiveness of Group Brainstorming in Engineering Problem Solving,” IEEE Trans. Eng. Manage., 22(3), pp. 119–124. [CrossRef]
Devine, D. J. , Clayton, L. D. , Philips, J. L. , Dunford, B. B. , and Melner, S. B. , 1999, “ Teams in Organizations Prevalence, Characteristics, and Effectiveness,” Small Group Res., 30(6), pp. 678–711. [CrossRef]
Sheppard, S. D. , and Jenison, R. , 1997, “ Examples of Freshman Design Education,” Int. J. Eng. Educ., 13(4), pp. 248–261.
Kowaltowski, D. C. C. K. , Bianchi, G. , and de Paiva, V . T. , 2010, “ Methods That May Stimulate Creativity and Their Use in Architectural Design Education,” Int. J. Technol. Des. Educ., 20(4), pp. 453–476. [CrossRef]
Cross, N. , 1994, Engineering Design Methods: Strategies for Product Design, Wiley, Chichester, UK.
Rozenburg, N. F. M. , and Eekels, J. , 1995, Product Design: Fundamentals and Method, Wiley, New York.
Suh, N. , 2001, Axiomatic Design: Advances and Applications, Oxford University Press, New York.
Smith, G. F. , Richardson, J. , Summers, J. D. , and Mocko, G. M. , 2012, “ Concept Exploration Through Morphological Charts: An Experimental Study,” ASME J. Mech. Des., 134(5), p. 051004. [CrossRef]
Roozenburg, N. F. M. , and Eekels, J. , 1995, Product Design: Fundamentals and Methods, Vol. 2, Wiley, Chichester, UK.
Huang, G. , and Mak, K. , 1999, “ Web-Based Morphological Charts for Concept Design in Collaborative Product Development,” J. Intell. Manuf., 10(3–4), pp. 267–278. [CrossRef]
George, D. , 2012, “ Concept Generation Using Morphological and Options Matrices,” Ph.D. dissertation, Clemson University, Clemson, SC.
Majaro, S. , 1998, “ Morphological Analysis,” Mark. Intell. Plann., 6(2), pp. 4–11. [CrossRef]
Ritchey, T. , 1998, “ General Morphological Analysis: A General Method for Non-Quantified Modeling,” 16th EURO Conference on Operational Analysis, Brussels, Belgium.
Nisbett, R. E. , and Ross, L. , 1980, Human Inference: Strategies, and Shortcomings of Social Judgment, Prentice-Hall, Englewood Cliffs, NJ.
Klein, G. , 1998, Sources of Power: How People Make Decisions, The MIT Press, Cambridge, MA.
Daly, S. R. , Yilmaz, S. , Seifert, C. , and Gonzalez, R. , 2010, “ Cognitive Heuristic Use in Engineering Design Ideation,” Annual Conference of American Society for Engineering Education, Louisville, KY, June 20–23, pp. 15.282.1–15.282.25.
Seifert, C. M. , Gonzalez, R. , Yilmaz, S. , and Daly, S. , 2016, “ Boosting Creativity in Idea Generation Using Design Heuristics,” Design and Design Thinking (Essentials in the PDMA's New Product Development Series), Product Development and Management Association, eds., Wiley, New York, pp. 71–86.
Yilmaz, S. , “ Design Heuristics,” Ph.D. dissertation, University of Michigan, Ann Arbor, MI.
Yilmaz, S. , Daly, S. , Seifert, C. , and Gonzalez, R. , 2015, “ How do Designers Generate New Ideas? Design Heuristics Across Two Disciplines,” Des. Sci., epub.
Yilmaz, S. , Daly, S. R. , Seifert, C. M. , and Gonzalez, R. , 2016, “ Evidence-based Design Heuristics for Idea Generation,” Design Studies (in press).
Yilmaz, S. , Seifert, C. M. , Daly, S. R. , and Gonzalez, R. , 2016, “ Design Strategies in Innovative Products,” Design, 138(7), p. 071102.
Christian, J. , Daly, S. , Yilmaz, S. , Seifert, C. , and Gonzalez, R. , 2012, “ Design Heuristics Support Two Modes of Idea Generation: Initiating Ideas and Transitioning Among Concepts,” Annual Conference of American Society of Engineering Education, San Antonio, TX, June.
Yilmaz, S. , Daly, S. , Seifert, C. M. , and Gonzalez, R. , 2015, “ Cultivating Innovation in Your STEM Classroom With Design Heuristics,” C2GEN: A Chautauqua Program for the 21st Century, C2GEN Chautauqua Project.
Daly, S. , Christian, J. , Yilmaz, S. , Seifert, C. , and Gonzalez, R. , 2011, “ Teaching Design Ideation,” Annual Conference of American Society for Engineering Education, Vancouver, BC, Canada, June 26–29, Industrial Design Conference Presentations, Posters and Proceedings, Paper No. 4.
Gray, C. , Seifert, C. , Yilmaz, S. , Daly, S. , and Gonzalez, R. , 2016, “ What is the Content of ‘Design Thinking’? Design Heuristics as Conceptual Repertoire,” Int. J. Eng. Educ., 32(3B), pp. 1349–1355.
Jensen, D. D. , Wood, J. J. , Knodel, P. , Wood, K. L. , Crawford, R. H. , and Vincent, R. , 2012, “ Evaluating Ideation Using the Publications Popular Science, Popular Mechanics and Make in Coordination With a New Patent Search Tool and the 6-3-5 Method,” Annual Conference of American Society of Engineering Education, San Antonio, TX, June 10–13, pp. 25.586.1–25.586.23.
Jensen, D. J. , Weaver, J. , Wood, K. , Linsey, J. , and Wood, J. , 2009, “ Techniques to Enhance Concept Generation and Develop Creativity,” Annual Conference of American Society of Engineering Education, pp. 14.1167.1–14.1167.23.
Ogot, M. , and Okudan, G. E. , 2007, “ Systematic Creativity Methods in Engineering Education: A Learning Styles Perspective,” Int. J. Eng. Educ., 22(3), pp. 566–576.
Amabile, T. , 1982, “ Social Psychology of Creativity: A Consensual Assessment Technique,” J. Pers. Soc. Psychol., 43(5), pp. 997–1013. [CrossRef]
Guilford, J. P. , 1966, “ Measurement and Creativity,” TheoryPract., 5(4), pp. 185–189.
Torrance, E. P. , 2008, Torrance Tests of Creative Thinking: Norms-Technical Manual, Verbal Forms A and B, Scholastic Testing Service, Bensenville, IL.
Shah, J. J. , Vargas-Hernandez, N. , and Smith, S. M. , 2003, “ Metrics for Measuring Ideation Effectiveness,” Des. Stud., 24(2), pp. 111–134. [CrossRef]
Amabile, T. M. , 1983, The Social Psychology of Creativity, Springer-Verlag, New York.
George, D. , and Mallery, P. , 2003, SPSS for Windows Step by Step: A Simple Guide and Reference, 11.0 Update, 4th ed., Allyn & Bacon, Boston.
Hennessey, B. A. , Amabile, T. , and Mueller, J. M. , 1999, “ Consensual Assessment,” Encyclopedia of Creativity, Vol. 2, M. Runco , and S. Pritzker , eds., Academic Press, San Diego, CA.
Ruscio, J. , Whitney, D. M. , and Amabile, T. M. , 1998, “ Looking Inside the Fishbowl of Creativity: Verbal and Behavioral Predictors of Creative Performance,” Creativity Res. J., 11(3), pp. 243–263. [CrossRef]
Stemler, S. E. , 2004, “ A Comparison of Consensus, Consistency, and Measurement Approaches to Estimating Interrater Reliability,” Pract. Assess., Res. Eval., 9(4), pp. 1–19.
Stemler, S. E. , and Tsai, J. , 2008, “ 3 Best Practices in Interrater Reliability Three Common Approaches,” Best Practices in Quantitative Methods, J. Osborne , ed., SAGE Publications, Thousand Oaks, CA, pp. 29–50.
Nelson, B. A. , Wilson, J. O. , Rosen, D. , and Yen, J. , 2009, “ Refined Metrics for Measuring Ideation Effectiveness,” Des. Stud., 30(6), pp. 737–743. [CrossRef]
Peeters, J. , Verhaegen, P. A. , Vandevenne, D. , and Duflou, J. R. , 2010, “ Refined Metrics for Measuring Novelty in Ideation,” IDMME Virtual Concept Research in Interaction Design, Oct. 20–22, Bordeaux, France.
Shah, J. , Smith, S. M. , and Vargas-Hernandez, N. , 2000, “ Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments,” J. Mech. Des., 122(4), pp. 377–384. [CrossRef]
Basadur, M. , and Hausdorf, P. A. , 1996, “ Measuring Divergent Thinking Attitudes Related to Creative Problem Solving and Innovation Management,” Creativity Res. J., 9(1), pp. 21–32. [CrossRef]
Basadur, M. , Graen, G. B. , and Scandura, T. A. , 1986, “ Training Effects on Attitudes toward Divergent Thinking Among Manufacturing Engineers,” J. Appl. Psychol., 71(4), pp. 612–617. [CrossRef]
Cooperrider, B. , 2008, “ The Importance of Divergent Thinking in Engineering Design,” Proceedings of the American Society for Engineering Education Pacific Southwest Annual Conference.
Silvia, P. J. , Winterstein, B. P. , Willse, J. T. , Barona, C. M. , Cram, J. T. , Hess, K. I. , Martinez, J. L. , and Richard, C. A. , 2008, “ Assessing Creativity With Divergent Thinking Tasks: Exploring the Reliability and Validity of New Subjective Scoring Methods,” Psychol. Aesth., Creativity, Arts, 2(2), pp. 68–85. [CrossRef]
Jansson, D. G. , and Smith, S. M. , 1991, “ Design Fixation,” Des. Stud., 12(1), pp. 3–11. [CrossRef]
Gray, C. M. , Yilmaz, S. , Seifert, C. M. , Daly, S. , and Gonzalez, R. , 2015, “ What Happens When Creativity is Exhausted? Design Tools as an Aid for Ideation,” American Education Research Association Annual Meeting (AERA), Chicago, IL, April 16–20.
Chen, C. , Kasof, J. , Himsel, A. J. , Greenberger, E. , Dong, Q. , and Xue, G. , 2002, “ Creativity in Drawings of Geometric Shapes: A Cross-Cultural Examination With the Consensual Assessment Technique,” J. Cross-Cultural Psychol., 33(2), pp. 171–187. [CrossRef]


Grahic Jump Location
Fig. 1

Heuristic card example: attach independent functional components

Grahic Jump Location
Fig. 2

Heuristic card list

Grahic Jump Location
Fig. 3

Students' work shown on transcribed and adjusted concept sheets

Grahic Jump Location
Fig. 4

Examples of low and high scoring concepts

Grahic Jump Location
Fig. 5

Example solutions using each ideation technique

Grahic Jump Location
Fig. 6

Average CAT scores for concepts generated with each ideation technique

Grahic Jump Location
Fig. 7

Average number of concepts generated and CAT scores for diversity of concept

Grahic Jump Location
Fig. 8

Correlation analysis of number of ideas and diversity score




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In