Research Papers: Design Education

Efficacy Investigation of Virtual Reality Teaching Module in Manufacturing System Design Course

[+] Author and Article Information
Junfeng Ma

Department of Industrial and
Systems Engineering,
Mississippi State University,
Mississippi State, MS 39762
e-mail: ma@ise.msstate.edu

Raed Jaradat

Department of Industrial and
Systems Engineering,
Mississippi State University,
Mississippi State, MS 39762
e-mail: jaradat@ise.msstate.edu

Omar Ashour

Department of Industrial Engineering,
Penn State University-Behrend,
Erie, PA 16563
e-mail: oma110@psu.edu

Michael Hamilton

Institute for Systems Engineering Research,
Mississippi State University,
Vicksburg, MS 39180
e-mail: michaelh@iser.msstate.edu

Parker Jones

Institute for Systems Engineering Research,
Mississippi State University,
Vicksburg, MS 39180
e-mail: parkerj@iser.msstate.edu

Vidanelage L. Dayarathna

Industrial and Systems Engineering Department,
Mississippi State University,
Mississippi State, MS 39762
e-mail: vld66@msstate.edu

1Corresponding author.

Contributed by the Design Education Committee of ASME for publication in the JOURNAL OF MECHANICAL DESIGN. Manuscript received January 18, 2018; final manuscript received September 3, 2018; published online October 17, 2018. Assoc. Editor: Gul E. Okudan Kremer.

J. Mech. Des 141(1), 012002 (Oct 17, 2018) (13 pages) Paper No: MD-18-1053; doi: 10.1115/1.4041428 History: Received January 18, 2018; Revised September 03, 2018

Manufacturing system design is a complex engineering field that requires cooperated and aggregated multiple-disciplinary theoretical and practical support. Thereby, the concepts and topics in manufacturing system design courses are not easy to grasp by students. Advances in virtual reality (VR) technology present a new opportunity that can provide the implementation of complex engineering theory from industrial real-life practice in a virtual 3D model. The authors developed a unique queuing theory VR teaching module that can be used in a manufacturing system design course. The module uses Oculus Rift headset, Oculus Touch, and unity 3D software package. The efficacy of this VR teaching module is measured through simulation sickness, system usability, and user experience tools. The statistical analysis shows that VR teaching module is a user-friendly and efficient tool for delivering queueing theory. Approximately 91.7% of the participants experienced below moderate level simulation sickness and none of them withdrew from the study; 91.67% had “above average” satisfaction in terms of system usability. The average user experience was found to be 3.625 out 6. The results also show that the system usability has impact on students' knowledge gain but not motivation, while user experience can affect student's knowledge gain and motivation. VR teaching module outperforms the traditional teaching module in terms of knowledge gain and motivation. Overall, the findings of the study confirm the efficacy of VR technology in teaching queuing theory.

Copyright © 2019 by ASME
Your Session has timed out. Please sign back in to continue.


Gershwin, S. , 1993, Manufacturing Systems Analysis, Prentice Hall, Upper Saddle River, NJ.
Prinard-Welyczko, K. M., Garrison, A. C. S., Ramos, R. L., and Cater, B. S., 2017, “ Characterizing the Undergraduate Neuroscience Major in the U.S.: An Examination of Course Requirements and Institution-Program Associations,” J. Undergrad. Neurosci. Educ., 16(1), pp. A60–A67. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5777840/
Educating Engineers, 2018, “Industrial Engineering,” Starkville, MS, accessed Sept.17, 2018, http://educatingengineers.com/degrees/industrial-engineering
Gershwin, S. , 2010, “ Manufacturing Systems Overview,” Georgia Tech, Atlanta, GA, accessed Dec. 22, 2017, https://ocw.mit.edu/courses/mechanical-engineering/2-854-introduction-to-manufacturing-systems-fall-2016/lecture-notes/MIT2_854F16_Introduction.pdf
Mostafa, S. , Dumrak, J. , and Soltan, H. , 2013, “ A Framework for Lean Manufacturing Implementation,” Prod. Manuf. Res., 1(1), pp. 44–64.
Wreen, J. , and Wreen, B. , 2009, “ Enhancing Learning by Integrating Theory and Practice,” Int. J. Teach. Learn. Higher Educ., 21(2), pp. 258–265. https://files.eric.ed.gov/fulltext/EJ899313.pdf
Verma, A. , 2007, “ Enhancing Student Learning in Engineering Technology Programs? A Case for Physical Simulation,” ASEE Annual Conference, Honolulu, HI, June 24–27, p. 12.672. https://peer.asee.org/1551
Schaefer, M. , 2016, “ Use of Casting Simulation and Rapid Prototyping in an Undergraduate Course in Manufacturing Processes,” ASEE Annual Conference, New Orleans, LA, June 26–29.
Paudel, A. M. , and Kalla, D. K. , 2016, “ Direct Digital Manufacturing Course Into Mechanical Engineering Technology Curriculum,” ASEE Annual Conference, New Orleans, LA, June 26–29.
Ma, J. , Conrad, T. , Kremer, G. , and Jackson, K. , 2016, “ Exposure to Digital and Hands-on Delivery Modes in Engineering Design Education and Their Impact on Task Completion Efficiency,” J. Integr. Des. Process Sci., 21(2), pp. 61–78. [CrossRef]
Zhou, Z. , and Donaldson, A. , 2010, “ Work in Progress-Project Based Learning in Manufacturing Process,” Frontiers in Education Conference (FIE 2010), Washington, DC, pp. T1J-1–T1J-2.
Serdar, T. , 2015, “ Project Based Learning in Manufacturing Processes Course,” ASEE Annual Conference, Seattle, Washington, DC.
Pantelidis, V. S. , 1997, “ Virtual Reality and Engineering Education,” Comput. Appl. Eng. Educ., 5(1), pp. 3–12. [CrossRef]
Ramasundaram, V. , Grunwald, S. , Mangeot, A. , Comerford, N. B. , and Bliss, C. M. , 2005, “ Development of an Environmental Virtual Field Laboratory,” Comput. Educ., 45(1), pp. 21–34. [CrossRef]
Çaliskan, O. , 2011, “ Virtual Field Trips in Education of Earth and Environmental Sciences,” Procedia-Soc. Behav. Sci., 15, pp. 3239–3243. [CrossRef]
Barata, P. N. A. , Filho, M. R. , and Nunes, M. V. A. , 2015, “ Consolidating Learning in Power Systems: Virtual Reality Applied to the Study of the Operation of Electric Power Transformers,” IEEE Trans. Educ., 58(4), pp. 255–261. [CrossRef]
Mikropoulos, T. A. , and Bellou, J. , 2006, “ The Unique Features of Educational Virtual Environments,” Proc. E-Soc., 2006, pp. 122–128. https://link.springer.com/article/10.1007/s10055-006-0039-1
Molnar, A. , 1997, “ Computers in Education: A Brief History,” THE J., 24(11), pp. 63–68. https://thejournal.com/articles/1997/06/01/computers-in-education-a-brief-history.aspx
Dawley, L. , and Dede, C. , 2014, “ Situated Learning in Virtual Worlds and Immersive Simulations,” Handbook of Research on Educational Communications and Technology, J. M. Spector , M. D. Merrill , J. Elen , and M. J. Bishop , eds., Springer, New York, pp. 723–734.
Winn, W. , 1993, “ A Conceptual Basis for Educational Applications of Virtual Reality,” Human Interface Technology Laboratory, Washington Technology Center, University of Washington, accessed Dec. 15, 2017, http://www.hitl.washington.edu/research/education/winn/winn-paper.html~
Dickey, M. D. , 2007, “ Brave New (Interactive) Worlds: A Review of the Design Affordances and Constraints of Two 3D Virtual Worlds as Interactive Learning Environments,” J. Interact. Learn. Environ., 13(1–2), pp. 121–137.
Lee, E. A. L. , Wong, K. W. , and Fung, C. C. , 2010, “ How Does Desktop Virtual Reality Enhance Learning Outcomes? A Structural Equation Modeling Approach,” Comput. Educ., 55(4), pp. 1424–1442. [CrossRef]
Jonassen, D. H. , Peck, K. L. , and Wilson, B. G. , 1999, Learning With Technology: A Constructivist Perspective, Prentice Hall, Upper Saddle River, NJ.
Crosier, J. K. , Cobb, S. V. G. , and Wilson, J. R. , 2000, “ Experimental Comparison of Virtual Reality With Traditional Teaching Methods for Teaching Radioactivity,” Educ. Inf. Technol., 5(4), pp. 329–343. [CrossRef]
Triantafyllou, K. , Lazaridis, L. D. , and Dimitriadis, G. D. , 2014, “ Virtual Reality Simulators for Gastrointestinal Endoscopy Training,” World J. Gastrointest. Endoscopy, 6(1), pp. 6–12. [CrossRef]
Wexner, S. D. , Eisen, G. M. , and Simmang, C. , 2002, “ Principles of Privileging and Credentialing for Endoscopy and Colonoscopy,” Surg. Endosc., 16(2), pp. 367–369. [CrossRef] [PubMed]
Ende, A. , Zopf, Y. , Konturek, P. , Naegel, A. , Hahn, E. G. , Matthes, K. , and Maiss, J. , 2012, “ Strategies for Training in Diagnostic Upper Endoscopy: A Prospective, Randomized Trial,” Gastrointest. Endosc., 75(2), pp. 254–260. [CrossRef] [PubMed]
Ferlitsch, A. , Schoefl, R. , Puespoek, A. , Miehsler, W. , SchoenigerHekele, M. , Hofer, H. , Gangl, A. , and Homoncik, M. , 2010, “ Effect of Virtual Endoscopy Simulator Training on Performance of Upper Gastrointestinal Endoscopy in Patients: A Randomized Controlled Trial,” Endoscopy, 42(12), pp. 1049–1056. [CrossRef] [PubMed]
Ahlberg, G. , Hultcrantz, R. , Jaramillo, E. , Lindblom, A. , and Arvidsson, D. , 2005, “ Virtual Reality Colonoscopy Simulation: A Compulsory Practice for the Future Colonoscopist?,” Endoscopy, 37(12), pp. 1198–1204. [CrossRef] [PubMed]
Deb, S. , Carruth, D. W. , Sween, R. , and Strawderman, L. , 2017, “ Efficacy of Virtual Reality in Pedestrian Safety Research,” Appl. Ergon., 65, pp. 449–460. [CrossRef] [PubMed]
Evans, P. T. , Vance, J. M. , and Dark, V. J. , 1999, “ Assessing the Effectiveness of Traditional and Virtual Reality Interfaces in Spherical Mechanism Design,” ASME J. Mech. Des., 121(4), pp. 507–514. [CrossRef]
Kennedy, R. S. , Lane, N. E. , Berbaum, K. S. , and Lilienthal, M. G. , 1993, “ Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness,” Int. J. Aviat. Psychol., 3(3), pp. 203–220. [CrossRef]
Brooke, J. , 1996, “ SUS-A Quick and Dirty Usability Scale,” Usability Eval. Ind., 189(194), pp. 4–7.
Witmer, B. G. , and Singer, M. J. , 1998, “ Measuring Presence in Virtual Environments: A Presence Questionnaire,” Presence., 7(3), pp. 225–240. [CrossRef]
Young, S. D. , Adelstein, B. D. , and Ellis, S. R. , 2007, “ Demand Characteristics in Assessing Motion Sickness in a Virtual Environment: Or Does Taking a Motion Sickness Questionnaire Make You Sick?,” IEEE Trans. Visualization Comput. Graphics, 13(3), pp. 422–428. [CrossRef]
Kraft, C. , 2012, User Experience Innovation: User Centered Design That Works, Apress, New York.
Steuer, J. , 1992, “ Defining Virtual Reality: Dimensions Determining Telepresence,” J. Commun., 42(4), pp. 73–93. [CrossRef]
Hart, S. G. , 2006, “ NASA-Task Load Index (NASA-TLX); 20 Years Later,” Human Factors and Ergonomics Society 50th Annual Meeting, Oct., pp. 904–908.
Hamilton, M. , Jaradat, R. , Jones, P. , Wall, E. , Dayarathna, V. , Ray, D. , and Hsu, G. , 2018, “ Immersive Virtual Training Environment for Teaching Single and Multi-Queuing Theory: Industrial Engineering Queuing Theory Concepts,” ASEE Annual Conference and Exposition, June 24–27, Salt City, UT. https://peer.asee.org/30597
Pintrich, P. R. , and DeGroot, E. , 1990, “ Motivational and Self-Regulated Learning Components of Classroom Academic Performance,” J. Educ. Psychol., 82(1), pp. 33–40. [CrossRef]
Sauro, J. , 2011, “ Measuring Usability With the System Usability Scale (SUS),” MeasuringU, Denver, CO, accessed Dec. 15, 2017, https://measuringu.com/sus/
Beede, D. , Julian, T. , Langdon, D. , McKittrick, G. , Khan, B. , and Doms, M. , 2011, “ Women in STEM: A Gender Gap to Innovation, ESA Issue Brief #04-11,” U.S. Department of Commerce, Washington, DC, accessed Feb. 10, 2017, http://eric.ed.gov/?id=ED523766
Gunderson, E. A. , Ramirez, G. , Levine, S. C. , and Beilock, S. L. , 2011, “ The Role of Parents and Teachers in the Development of Gender-Related Math Attitudes,” Sex Roles, 66(3–4), pp. 153–166.
Pronin, E. , Steele, C. M. , and Ross, L. , 2004, “ Identity Bifurcation in Response to Stereotype Threat: Women and Mathematics,” J. Exp. Soc. Psychol., 40(2), pp. 152–168. [CrossRef]
Glass, J. L. , Sassler, S. , Levitte, Y. , and Michelmore, K. M. , 2013, “ What's so Special About STEM? A Comparison of Women's Retention in STEM and Professional Occupations,” Soc. Forces, 92(2), pp. 723–756. [CrossRef] [PubMed]
Moss-Racusin, C. A. , Dovidio, J. F. , Brescoll, V. L. , Graham, M. J. , and Handelsman, J. , 2012, “ Science Faculty's Subtle Gender Biases Favor Male Students,” Proc. Natl. Acad. Sci., 109(41), pp. 16474–16479. [CrossRef]
Wimer, J. W. , Ridenour, C. S. , Thomas, K. , and Place, A. W. , 2001, “ Higher Order Teacher Questioning of Boys and Girls in Elementary Mathematics Classrooms,” J. Educ. Res., 95(2), pp. 84–92. [CrossRef]
Preston, A. E. , 2004, Leaving Science, Russell Sage Foundation, New York.


Grahic Jump Location
Fig. 1

Virtual reality module development iteration

Grahic Jump Location
Fig. 3

NASA TLX aspects of performance

Grahic Jump Location
Fig. 4

A service management VR system

Grahic Jump Location
Fig. 5

Data collection process flow

Grahic Jump Location
Fig. 6

Virtual reality data collection photos

Grahic Jump Location
Fig. 7

Simulation sickness questionnaire symptom frequency distribution

Grahic Jump Location
Fig. 8

The distribution of pre and postknowledge exercises scores

Grahic Jump Location
Fig. 9

Interval plot of motivation differences



Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In