Past studies have identified the following cognitive skills relevant to conceptual design: divergent thinking, spatial reasoning, visual thinking, abstract reasoning, and problem formulation (PF). Standardized tests are being developed to assess these skills. The tests on divergent thinking and visual thinking are fully developed and validated; this paper focuses on the development of a test of abstract reasoning in the context of engineering design. Similar to the two previous papers, this paper reports on the theoretical and empirical basis for skill identification and test development. Cognitive studies of human problem solving and design thinking revealed four indicators of abstract reasoning: qualitative deductive reasoning (DR), qualitative inductive reasoning (IR), analogical reasoning (AnR), and abductive reasoning (AbR). Each of these is characterized in terms of measurable indicators. The paper presents test construction procedures, trial runs, data collection, norming studies, and test refinement. Initial versions of the test were given to approximately 250 subjects to determine the clarity of the test problems, time allocation and to gauge the difficulty level. A protocol study was also conducted to assess test content validity. The beta version was given to approximately 100 students and the data collected was used for norming studies and test validation. Analysis of test results suggested high internal consistency; factor analysis revealed four eigenvalues above 1.0, indicating assessment of four different subskills by the test (as initially proposed by four indicators). The composite Cronbach’s alpha for all of the factors together was found to be 0.579. Future research will be conducted on criterion validity.
Skip Nav Destination
Article navigation
October 2014
Research-Article
Applied Tests of Design Skills—Part III: Abstract Reasoning
Maryam Khorshidi,
Maryam Khorshidi
Mechanical & Aerospace Engineering,
Arizona State University
,Tempe, AZ
85287
Search for other works by this author on:
Jami J. Shah,
Jami J. Shah
Mechanical & Aerospace Engineering,
Arizona State University
,Tempe, AZ
85287
Search for other works by this author on:
Jay Woodward
Jay Woodward
Department of Educational Psychology,
Texas A&M University
,College Station, TX
77843
Search for other works by this author on:
Maryam Khorshidi
Mechanical & Aerospace Engineering,
Arizona State University
,Tempe, AZ
85287
Jami J. Shah
Mechanical & Aerospace Engineering,
Arizona State University
,Tempe, AZ
85287
Jay Woodward
Department of Educational Psychology,
Texas A&M University
,College Station, TX
77843Part I of this paper was published in J. Mech. Des.134(2), 021005 (Feb. 03, 2012).
Part II of this paper was published in J. Mech. Des.135(7), 071004 (May 24, 2013).
Contributed by the Design Theory and Methodology Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received October 23, 2013; final manuscript received June 24, 2014; published online July 31, 2014. Assoc. Editor: Janis Terpenny.
J. Mech. Des. Oct 2014, 136(10): 101101 (11 pages)
Published Online: July 31, 2014
Article history
Received:
October 23, 2013
Revision Received:
June 24, 2014
Citation
Khorshidi, M., Shah, J. J., and Woodward, J. (July 31, 2014). "Applied Tests of Design Skills—Part III: Abstract Reasoning." ASME. J. Mech. Des. October 2014; 136(10): 101101. https://doi.org/10.1115/1.4027986
Download citation file:
Get Email Alerts
Large Language Models for Predicting Empathic Accuracy Between a Designer and a User
J. Mech. Des (April 2025)
Repurposing as a Decommissioning Strategy for Complex Systems: A Systematic Review
J. Mech. Des (May 2025)
A Dataset Generation Framework for Symmetry-Induced Mechanical Metamaterials
J. Mech. Des (April 2025)
Related Articles
The Effects of Language and Pruning on Function Structure Interpretability
J. Mech. Des (June,2012)
An Analysis of Sketching Skill and Its Role in Early Stage Engineering Design
J. Mech. Des (May,2007)
Semantic Networks for Engineering Design: State of the Art and Future Directions
J. Mech. Des (February,2022)
Learning-Based Preference Modeling in Engineering Design Decision-Making
J. Mech. Des (June,2001)
Related Proceedings Papers
Related Chapters
Knowledge-Based Engineering
Computer Aided Design and Manufacturing
Platform Technologies
Computer Aided Design and Manufacturing
Utility Function Fundamentals
Decision Making in Engineering Design