Research Papers

An Investigation on the Implications of Design Process Phases on Artifact Novelty

[+] Author and Article Information
Nur Ozge Ozaltin

Department of Industrial Engineering,
University of Pittsburgh,
Pittsburgh, PA 15260
e-mail: noo7@pitt.edu

Mary Besterfield-Sacre

Department of Industrial Engineering,
University of Pittsburgh,
Pittsburgh, PA 15260
e-mail: mbsacre@pitt.edu

Gül E. Okudan Kremer

Department of Industrial and Manufacturing,
The Pennsylvania State University,
University Park,
State College, PA 16801
e-mail: gkremer@psu.edu

Larry J. Shuman

Department of Industrial Engineering,
University of Pittsburgh,
Pittsburgh, PA 15260
e-mail: shuman@pitt.edu

Manuscript received April 7, 2013; final manuscript received August 5, 2014; published online February 18, 2015. Assoc. Editor: Janis Terpenny.

J. Mech. Des 137(5), 051001 (May 01, 2015) (12 pages) Paper No: MD-13-1154; doi: 10.1115/1.4028530 History: Received April 07, 2013; Revised August 05, 2014; Online February 18, 2015

Innovation, including engineering innovation, is essential for economic growth. Currently, while most design practices in engineering education focus on aspects of “good” technical design, elements of innovation may be neglected. This research investigates design process activities that yield innovative artifacts. Specifically, we examine the types of design activities, their timing, and the associations among each other. Specifically, two research questions are explored. First, what design activities do teams engage in that relate to the innovativeness of the resultant design artifact? Second, how do these design activities impact the succeeding activities across the design process (from problem definition to working prototype (WP))? To explore these questions, 16 senior capstone bioengineering design teams are followed as they advance from initial conceptualization to WP over an average 23 week period. Several significant measures suggest that innovative teams differ from their noninnovative counterparts in terms of what activities they engage in, how much they engage in the particular activities, and in what phase they conduct the activities. Specifically, certain activities utilized in the early phase (e.g., marketing) are essential for innovation. Moreover, in terms of iterations through activities, spending significant time and effort while developing a design, as well as having smooth, rich iterations throughout the process contribute to the innovativeness of the artifact.

Copyright © 2015 by ASME
Topics: Design , Teams , Innovation
Your Session has timed out. Please sign back in to continue.


Naim, A. M., and Lewis, K. E., 2011, “Rethinking Design: The Formal Integration of Engineering Innovation into a Design Process,” ASME Paper No. CP002011054860000465000001. [CrossRef]
Olson, S., 2010, “Rebuilding a Real Economy: Unleashing Engineering Innovation: Summary of a Forum 2010,” National Academy of Engineering, Washington, DC. Available at: http://www.nap.edu/openbook.php?record_id=12851
Katehi, L., Pearson, G., and Feder, M., 2009, “Engineering in the K-12 Classroom. Understanding the Status and Improving the Prospects Committee on K-12 Engineering Education,” National Academy of Engineering and National Research Council, Washington, DC.
Technical Report, 2009, “A Strategy for American Innovation: Driving Towards Sustainable Growth and Quality Jobs,” National Economic Council Office of Science and Technology Policy, Executive Office of the President. Available at: http://www.whitehouse.gov/innovation/strategy
Atman, C. J., Chimka, J. R., Bursic, K. M., and Nachtmann, H. L., 1999, “A Comparison of Freshman and Senior Engineering Design Processes,” Des. Studies, 20(2), pp. 131–152. [CrossRef]
Costa, R., and Sobek, D. K., II, 2004, “How Process Affects Performance: An Analysis of Student Design Productivity,” Proceedings of DETC’04.
Atman, C. J., Yasuhara, K., Adams, R. S., Barker, T., Turns, J., and Rhone, E., 2007, “Breadth in Problem Scoping: A Comparison of Freshman and Senior Engineering Students,” International Journal of Engineering Education, Special Issue on the Harvey Mudd VI Design Education Workshop, 24(2), pp. 234–245.
Atman, C. J., Cardella, M. E., Turns, J., and Adams., 2005, “Comparing Freshman and Senior Engineering Design Processes: An In-Depth Follow-Up Study,” Des. Studies, 26(4), pp. 324–357. [CrossRef]
Crismond, D., 2001, “Learning and Using Science Ideas When Doing Investigate-and-Redesign Tasks: A Study of Naive, Novice, and Expert Designers Doing Constrained and Scaffolded Design Work,” J. Res. Sci. Teach., 38(7), pp. 791–820. [CrossRef]
Smith, R. P., and Tjandra, P., 1998, “Experimental Observation of Iteration in Engineering Design,” Res. Eng. Des., 10(2), pp. 107–117. [CrossRef]
Schunn, C. D., Paulus, P. B., Cagan, J., and Wood, K., 2006, “The Scientific Basis of Individual and Team Innovation and Discovery,” Final Report from the NSF Innovation and Discovery Workshop.
Özaltin, N. O., Clark, R., and Besterfield-Sacre, M. E., 2014, “A Mixed Methods Analysis of Engineering Design Team Processes that Contribute to Innovative Outcomes,” J. Eng. Educ., 103(2), pp. 193–219. [CrossRef]
Shai, O., Reich, Y., and Rubin, D., 2009, “Creative Conceptual Design: Extending the Scope by Infused Design,” Comput.-Aided Des., 41(3), pp. 117–135. [CrossRef]
Schumpeter, J. A., 1934, The Theory of Economic Development: An Inquiry into Profits, Capital, Credit, Interest, and the Business Cycle, Transaction Publishers, New Brunswick, New Jersey.
Simon, H. A., 1996, The Sciences of the Artificial, MIT Press, Cambridge, MA.
Okudan, G., and Mohammed, S., 2006, “Task Gender Orientation Perceptions by Novice Designers: Implications for Engineering Design Research, Teaching and Practice,” Des. Studies, 27(6), pp. 723–740. [CrossRef]
Dym, C. I., and Little, P., 2004, Engineering Design: A Project Based Introduction, 2nd ed., Wiley, New York, New York.
Stempfle, J., and Badke-Schaub, P., 2002, “Thinking in Design Teams—An Analysis of Team Communication,” Des. Studies, 23(5), pp. 473–496. [CrossRef]
Ha, A. Y., and Porteus, E. L., 1995, “Optimal Timing of Reviews in Concurrent Design for Manufacturability,” Manage. Sci., 41(9), pp. 1431–1447. [CrossRef]
Krishnan, V., Eppinger, S. D., and Whitney, D. E., 1997, “A Predictive Model of Sequential Iteration in Engineering Design,” Manage. Sci., 43(4), pp. 1104–1120. [CrossRef]
Golish, B., Besterfield-Sacre, M., and Shuman, L., 2008, “Comparing the Innovation Processes in Academic and Corporate Settings,” J. Prod. Innovation Manage., 25(1), pp. 47–62. [CrossRef]
Hattori, R. A., and Wycoff, J., 2002, “Innovation DNA: A Good Idea Is Not Enough. It Has To Create Value,” Train. Dev., 56(2), pp. 25–39.
Johannessen, J., Olsen, B., and Lumpkin, G. T., 2001, “Innovation as Newness: What is New, How New, and New to Whom?,” Eur. J. Innovation Manage., 4(1), pp. 20–31. [CrossRef]
Damanpour, F., 1996, “Organizational Complexity and Innovation: Developing and Testing Multiple Contingency Models,” Manage. Sci., 42(5), pp. 693–716. [CrossRef]
Weyrich, C., 1998, “The Meaning of Innovation,” Electron. News, 44(2206), pp. 8–9.
Radnor, Z., and Robinson, J., 2000, “Benchmarking Innovation: A Short Report,” Creativity Innovation Manage., 9(1), pp. 3–13. [CrossRef]
Wycoff, J., 2005, “The Ten Big Innovation Killers and How to Keep Your Innovation System Alive and Well,” accessed July 1, 2014, http://knooppuntinnovatie.nl/documenten/TheBigTenInnovationKillers.pdf
Xu, Q. R., Liang, X. R., and Zhu, L., 2004, “The Evolution of Three Generations Innovation Management—From Event View, Process View to Capability View,” IEEE Transactions, International Engineering Management Conference, pp. 586–590. [CrossRef]
Xu, Q. R., Zhu, L., and Zhen, G., 2004, “The Measurement of Total Innovation Capacity—Case Study of Several Chinese Firms,” IEEE Transactions, International Engineering Management Conference, pp. 622–625. [CrossRef]
Xu, Q. R., Zhu, L., and Xie, Z., 2003, “Building up Innovative Culture for Total Innovation Management,” IEEE Transactions, International Engineering Management Conference, pp. 186–189. [CrossRef]
Paulson Gjerde, K. A., Slotnick, S. A., and Sobel, M. J., 2002, “New Product Innovation With Multiple Features and Technology Constraints,” Manage. Sci., 48(10), pp. 1268–1284. [CrossRef]
Montalvo, C., 2006, “What Triggers Change and Innovation?,” Technovation, 26(3), pp. 312–323.
Aghion, P., Bloom, N., Blundell, R., Griffith, R., and Howitt, P., 2005, “Competition and Innovation: An Inverted -U Relationship,” Q. J. Econ., 120(2), pp. 701–728.
Cooper, R. G., and Kleinschmidt, E. J., 1987, “Success Factors in Product Innovation,” Ind. Mark. Manage., 16(3), pp. 215–223. [CrossRef]
Johne, F. A., and Snelson, P. A., 1988, “Success Factors in Product Innovation: A Selective Review of the Literature,” Prod. Innovation Manage., 5(2), pp. 114–128. [CrossRef]
Hauser, J., Tellis, G., and Griffin, A., 2006, “Research on Innovation: A Review and Agenda for Marketing Science,” Mark. Sci., 25(6), pp. 687–717. [CrossRef]
Gatignon, H., Tushman, M. L., Smith, W., and Anderson, P., 2002, “A Structural Approach to Assessing Innovation: Construct Development of Innovation Locus, Type, and Characteristics,” Manage. Sci., 48(9), pp. 1103–1122. [CrossRef]
The Institution of Professional Engineers New Zealand (IPENZ), 2002, “The Drive for Innovators and Entrepreneurs: School Governance and Technology Education,” IPENZ Informatory Note Seven, August.
Ford, G., Koutsky, T., and Spiwak, L., 2007, “A Valley of Death in the Innovation Sequence: An Economic Investigation,” Available at SSRN 1093006.
Carlsson, B., Jacobsson, S., Magnus, H., and Rickne, A., 2002, “Innovation Systems: Analytical and Methodological Issues,” Res. Policy, 31(2), pp. 233–245. [CrossRef]
Cagan, J., and Vogel, C. M., 2002, Creating Breakthrough Products: Innovation From Product Planning to Program Approval, Financial Times, Prentice Hall, Upper Saddle River, New Jersey.
Ohtomi, K., and Ozawa, M., 2002, “Innovative Design Process and Information Technology for Electromechanical Product Development,” Concurr. Eng.: Res. Appl., 10(4), pp. 335–340. [CrossRef]
Salter, A., and Gann, D., 2003, “Sources of Ideas for Innovation in Engineering Design,” Res. Policy, 32(8), pp. 1309–1324. [CrossRef]
Yannou, B., Jankovic, M., Leroy, Y., and Okudan Kremer, G. E., 2013, “Observation From Radical Innovation Projects Considering the Company Context,” ASME J. Mech. Des., 135(2), p. 021005. [CrossRef]
Accessed July 1, 2014, http://www.abet.org
McDonald, D., Devaprasad, J., Duesing, P., Mahajan, A., Qatu, M., and Walworth, M., 1996, “Reengineering the Senior Design Experience With Industry-Sponsored Multidisciplinary Team Projects,” FIE'96 Proceedings, pp. 1313–1316.
Atman, C. J., Rhone, E., Adams, R. S., Turns, J., Barker, T., and Yasuhara, K., 2007, “Breadth in Problem-Scoping: A Comparison Freshman and Senior Engineering Students,” Proceedings of the Harvey Mudd Design Conference, Claremont.
Adams, R., and Atman, C. J., 1999, “Cognitive Processes in Iterative Design Behavior,” Proceedings of the Annual Frontiers in Education Conference, San Juan, Puerto Rico, November.
Adams, R. S., Mann, L., Jordan, S., and Daly, S., 2007, “Exploring the Boundaries: Language, Roles, and Structures in Cross-Disciplinary Design Teams,” Proceedings of the 7th Annual Design Thinking Research Symposium, London.
Kavakli, M., and Gero, J., 2002, “The Structure of Concurrent Cognitive Actions: A Case Study on Novice and Expert Diagnosis,” Des. Studies, 23(1), pp. 25–40. [CrossRef]
Diaz, A., 1987, “Interactive Solution to multi-objective Optimization Problems,” Int. J. Numer. Methods Eng., 24(12), pp. 1865–1877. [CrossRef]
Georgiopoulos, P., 2003, “Enterprise-Wide Product Design: Linking Optimal Design Decisions to the Theory of the Firm,” D. Eng. thesis, University of Michigan, Ann Arbor, MI.
Wagner, K. W., and Durr, W., 2005, “Design Failure Cost as a Measure of a Process Measurement System (A Method for Building the System and Evaluating the Measure),” Software Engineering and Advanced Applications 31st Euro-micro Conference, Portugal, pp. 214–221.
Linsey, J., Tseng, I., Fu, K., Cagan, J., Wood, K., and Schunn, C., 2010, “A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty,” ASME J. Mech. Des., 132(4), p. 041003. [CrossRef]
Purcell, T., Gero, J., Edwards, H., and Matka, E., 1994, “Design Fixation and Intelligent Design Aids,” Artif. Intell. Des., 94, pp. 483–495.
Toh, C., Miller, S., and Kremer, G. E., 2012, “The Role of Personality and Team-based Product Dissection on Fixation Effects,” Adv. Eng. Educ., 3(4), pp. 1–23.
Roberts, C., Yaşar, Ş., Morrell, D., Henderson, M., Danielson, S., and Cooke, N., 2007, “A Pilot Study Of Engineering Design Teams Using Protocol Analysis,” Proceedings of the American Society for Engineering Education Conference, Honolulu, HI.
Elizondo, L. A., Kisselburgh, L. G., Hirleman, E. D., Cipra, R. J., Ramani, K., Yang, M., and Carleton, T., 2010, “Understanding Innovation in Student Design Projects,” Proceedings of ASME 2010 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Montreal, QC, Canada.
Stavridou, A., and Furnham, A., 1996, “The Relationship between Psychoticism, Trait-Creativity the Attentional Mechanism of Cognitive Inhibition,” Pers. Individ. Differ., 21(1), pp. 143–153. [CrossRef]
Treffinger, D. J., Young, G. C., Selby, E. C., and Shepardson, C. A., 2002, “Assessing Creativity: A Guide for Educators,” National Research Center on the Gifted and Talented.
Torrance, E. P., 1998, “The Torrance Tests of Creative Thinking Norms—Technical Manual Figural (Streamlined) Forms A and B,” Scholastic Testing Service, Inc., Bensenville, IL.
Urban, K. K., and Jellen, H. G., 1996, “Test for Creative Thinking—Drawing Production (TCT-DP),” Swets Test Services.
Ragusa, G., “Transforming Engineering Education: Development of Creativity, Innovation and Entrepreneurship in Engineering Students,” Int. J. Eng. Educ (to be published).
Amabile, T. M., Conti, R., Coon, H., Lazenby, J., and Herron, M., 1996, “Assessing the Work Environment for Creativity,” Acad. Manage. J., 39(5), pp. 1154–1184. [CrossRef]
Shah, J. J., Vargas-Hernandez, N., and Smith, S. M., 2003, “Metrics for Measuring Ideation Effectiveness,” Des. Studies, 24(2), pp. 111–134. [CrossRef]
Grenier, A. L., and Schmidt, L. C., 2007, “Analysis of Engineering Design Journal Sketches and Notations,” ASME DETC/CIE, Las Vegas, NV, ASME Paper No. DETC2007-35360. [CrossRef]
Özaltin, N. Ö., Besterfield-Sacre, M., and Shuman, L. J., 2010, “A Conceptual Model to Understand Innovation in the Design Process,” Proceedings of the 2010 Industrial Engineering Research Conference, Cancun, Mexico.
Özaltin, N. Ö., Besterfield-Sacre, M., and Shuman, L. J., 2010, “Bioengineering Design Process: Patterns That Lead to Quality Outcomes,” ASEE Annual Conference, Louisville, KY.
Stiggins, R. J., 1999, “Evaluating Classroom Assessment Training in Teacher Education Programs,” Educ. Meas.: Issues Pract., 18(1), pp. 23–27. [CrossRef]
Moskal, B. M., and Leydens, J. A., 2000, “Scoring Rubric Development: Validity and Reliability,” Pract. Assess., Res. Eval., 7(10), pp. 71–81.
Callahan, C. A., Erdmann, J. B., Hojat, M., Jon Veloski, J., Rattner, S., Nasca, T. J., and Gonnella, J. S., 2000, “Validity of Faculty Ratings of Students' Clinical Competence in Core Clerkships in Relation to Scores on Licensing Examinations and Supervisors' Ratings in Residency,” Acad. Med., 75(10), pp. S71–S73. [CrossRef] [PubMed]
Tan, P., Steinbach, M., and Kumar, V., 2006, Introduction to Data Mining, Addison-Wesley, Boston.
Picard, R., and Cook, D., 1984, “Cross-Validation of Regression Models,” J. Am. Stat. Assoc., 79(387), pp. 575–583. [CrossRef]
Viswanathan, V. K., and Linsey, J. S., 2010, “Work in Progress—Understanding Design Fixation: A Sunk Cost Perspective on Innovation,” Proceedings of the 40th ASEE/IEEE Frontiers in Education Conference.
Hacker, W., 1997, “Improving Engineering Design-Contributions of Cognitive Ergonomics,” Ergonomics, 40(10), pp. 1088–1096. [CrossRef]
Davila, T., Epstein, M., and Shelton, R., 2005, Making Innovation Work: How to Manage it, Measure it, and Profit From it, 1st ed., Pearson, Prentice-Hall, Upper Saddle River, New Jersey.
Luo, L., Kannan, P. K., Besharati, B., and Azarm, S., 2005, “Design of Robust New Products Under Variability: Marketing Meets Design,” J. Prod. Innovation Manage., 22(2), pp. 177–192. [CrossRef]
Kolodner, J. L., and Wills, L. M., 1996, “Powers of Observation in Creative Design,” Des. Studies, 17(4), pp. 385–416. [CrossRef]
Cross, N., 2003, “The Expertise of Exceptional Designers,” Expertise in Design, Creativity and Cognition Press, N.Cross, and E.Edmonds, eds., University of Technology, Sydney, Australia.
Sturges, R. H., O'Shaughnessy, K., and Reed, R. G., 1993, “A Systematic Approach to Conceptual Design,” Concurr. Eng.: Res. Appl., 1(2), pp. 93–105. [CrossRef]
Lloyd, P., and Scott, P., 1994, “Discovering the Design Problem,” Des. Studies, 15(2), pp. 125–140. [CrossRef]
Dorst, K., and Cross, N., 2001, “Creativity in the Design Process: Co-evolution of Problem-Solution,” Des. Studies, 22(5), pp. 425–437. [CrossRef]
Özaltin, N. Ö., 2012, “The Analysis and Modeling of the Engineering Design Process: Factors Leading to Innovative Outcomes,” Published doctoral dissertation, University of Pittsburgh, Pittsburgh, PA.
Condoor, S., and LaVoie, D., 2007, “Design Fixation: A Cognitive Model,” International Conference on Engineering Design, Paris, France, Aug. 28–31.
Purcell, A. T., Williams, P., Gero, J. S., and Colbron, B., 1993, “Fixation Effects: Do They Exist in Design Problem Solving?,” Environ. Plann. B: Plann. Des., 20(3), pp. 333–345. [CrossRef]
Ullman, D. G., Dietterich, T. G., and Stauffer, T., 1988, “A Model of the Mechanical Design Process Based on Empirical Data,” Artif. Intell. Eng. Des. Manuf., 2(1), pp. 33–52. [CrossRef]
Ball, L., Evans, J., and Dennis, I., 1994, “Cognitive Processes in Engineering Design: A Longitudinal Study,” Ergonomics, 37(11), pp. 1753–1786. [CrossRef]
Linsey, J. S., Tseng, I., Fu, K., Cagan, J., Wood, K. L., and Schunn, C., 2010, “A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty,” ASME J. Mech. Des., 132(4), p. 041003. [CrossRef]
Daly, S. R., Yilmaz, S., Christian, J. L., Seifert, C. M., and Gonzalez, R., 2012, “Design Heuristics in Engineering Concept Generation,” J. Eng. Educ., 101(4), pp. 601–629. [CrossRef]
Casakin, H., and Goldschmidt, G., 1999, “Expertise and the Use of Analogy and Visual Displays: Implications for Design Education,” Des. Studies, 20(2), pp. 153–175. [CrossRef]
Casakin, H., and Goldschmidt, G., 2000, “Reasoning by Visual Analogy in Design Problem-Solving: The Role of Guidance,” Environ. Plann. B: Plann. Des., 27(1), pp. 105–119. [CrossRef]


Grahic Jump Location
Fig. 1

Feedback and iteration in the Dym's design process (see Ref. [18])

Grahic Jump Location
Fig. 2

Timeline of a design process

Grahic Jump Location
Fig. 3

An example of counted design categories

Grahic Jump Location
Fig. 4

An example of calculated support and confidence probabilities

Grahic Jump Location
Fig. 5

An association map example

Grahic Jump Location
Fig. 6

Association maps in the early phase

Grahic Jump Location
Fig. 7

Association maps in the middle phase

Grahic Jump Location
Fig. 8

Association maps in the late phase




Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In