Hostname: page-component-7479d7b7d-68ccn Total loading time: 0 Render date: 2024-07-11T02:21:51.505Z Has data issue: false hasContentIssue false
  • English
  • Français

STUDENT PARTICIPANTS IN EMPIRICAL STUDIES IN ENGINEERING DESIGN - A COLLECTION OF REFLECTIONS TO IMPROVE YOUR STUDY QUALITY

Published online by Cambridge University Press:  27 July 2021

Selin Üreten ,
Olga Sankowski  and
Dieter Krause
Selin Üreten*
Affiliation:
TUHH
Olga Sankowski
Affiliation:
TUHH
Dieter Krause
Affiliation:
TUHH
*
Üreten, Selin, TUHH, Germany, selin.uereten@tuhh.de

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Engineering design has a broad variety of approaches, methods and methodologies to conduct, evaluate and validate research. This contribution focuses on empirical studies and divides existing approaches and classifies them according to a scheme with criteria and boundary conditions, such as participants (students, researchers), the length of the study, the incorporation of the study into the curriculum etc. There are certain ideas, challenges and recommended practices associated with each environment and scenario. Knowing them will help design method developers in engineering design who want to conduct empirical studies but have little or no experience with student participants. Therefore, conducted studies from the research institute are mapped onto the classification scheme and synthesized challenges and recommended practices associated with laboratory conditions and student participants will be presented.

Keywords

Design methodologyHuman behaviour in designDesign educationEmpirical studiesEngineering design
Type
Article
Information
Proceedings of the Design Society , Volume 1: ICED21 , August 2021 , pp. 2741 - 2750
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2021. Published by Cambridge University Press

References

Barth, A.; Caillaud, E.; Rose, B. (2011), “How to validate research in engineering design?” International Conference on Engineering Design, ICED11, Denmark.Google Scholar
Blessing, L. T. M.; Chakrabarti, A. (2009), DRM, a Design Research Methodology, Springer, London.10.1007/978-1-84882-587-1CrossRefGoogle Scholar
Cantamessa, M. (2003), “An empirical perspective upon design research”, Journal of Engineering Design, Vol. 14, No. 1, pp. 1–15, Taylor& Francis. https://doi.org/10.1080/0954482031000078126CrossRefGoogle Scholar
Carver, J.; Jaccheri, L.; Morasca, S.; Shull, F. (2006), “Issues in Empirical Studies with Students”, Technical Report MSU-060714.Google Scholar
Carver, J.C.; Jaccheri, L.; Morasca, S.; Shull, F. (2010), “A checklist for integrating student empirical studies with research and teaching goals”, Empirical Software Engineering, Vol. 15, pp. 35–59, https://doi.org/10.1007/s10664-009-9109-9CrossRefGoogle Scholar
Cash, P.; Elias, E.; Dekoninck, E.; Culley, S.J. (2012), Methodological insights from a rigorous small scale design experiment, In: Design Studies, Volume 33, Issue 2, pp. 208–235. https://doi.org/10.1016/j.destud.2011.07.008CrossRefGoogle Scholar
Cash, P.; Stanković, T. and Štorga, M. (Eds.) (2016), Experimental Design Research. Approaches, Perspectives, Applications, Springer, Cham. https://doi.org/10.1007/978-3-319-33781-4_1Google Scholar
Jansson, D. G.; Smith, S. M. (1991): “Design fixation”, Design Studies, Vol. 12, Issue 1, pp. 3–11, https://doi.org/10.1016/0142-694X(91)90003-F.CrossRefGoogle Scholar
Eckert, C. M.; Clarkson, P. J.; Stacey, M. K. (2003), “The spiral of applied research: A methodological view on integrated design research”, Proceedings of the 14th International Conference on Engineering Design (ICED'03), Stockholm, Sweden.Google Scholar
Frey, D. D. & Dym, C. L. (2006), “Validation of design methods: lessons from medicine”, Research in Engineering Design 17, 45–57.10.1007/s00163-006-0016-4CrossRefGoogle Scholar
Fu, K., Murphy, J., Yang, M., Otto, K.; Jensen, D.; Wood, K. (2015), “Design-by-analogy: experimental evaluation of a functional analogy search methodology for concept generation improvement”, Research in Engineering Design, 26, pp. 77–95. https://doi.org/10.1007/s00163-014-0186-4CrossRefGoogle Scholar
Hussy, W.; Schreier, M.; Echterhoff, G. (2013), “Forschungsmethoden in Psychologie und Sozialwissenschaften für Bachelor”, 2nd edition, Springer, Berlin, Heidelberg. 10.1007/978-3-642-34362-9 10.1007/978-3-642-34362-9CrossRefGoogle Scholar
Ko, A.J., LaToza, T.D. & Burnett, M.M. (2015), “A practical guide to controlled experiments of software engineering tools with human participants”, Empirical Software Engineering 20, pp. 110–141, https://doi.org/10.1007/s10664-013-9279-3CrossRefGoogle Scholar
Razzaghi, M.; Ramirez, M.; Zehner, R. (2009), “Cultural patterns in product design ideas: comparisons between Australian and Iranian student concepts”, Design Studies, Vol. 30, Issue 4, pp. 438–461, https://doi.org/10.1016/j.destud.2008.11.006.CrossRefGoogle Scholar
Ruckpaul, A., Fürstenhöfer, T., Matthiesen, S. (2015), “Combination of Eye Tracking and Think-Aloud Methods in Engineering Design Research”. In: Gero, J., Hanna, S. (eds) Design Computing and Cognition '14. Springer, Cham. https://doi.org/10.1007/978-3-319-14956-1_5Google Scholar
Reich, Y. (2010), “My method is better!”, Research in Engineering Design 21, pp. 137–142.10.1007/s00163-010-0092-3CrossRefGoogle Scholar
Svahnberg, M.; Aurum, A.; Wohlin, C. (2008): “Using Students as Subjects – An Empirical Evaluation”, Proceedings of the Second International Symposium on Empirical Software Engineering and Measurement, ESEM 2008, Kaiserslautern, Germany. 10.1145/1414004.1414055Google Scholar
Seepersad, C. C.; Pedersen, K.; Emblemsvåg, J.; Bailey, R.; Allen, J. K.; Mistree, F. (2006), “The validation square: How does one verify and validate a design method?”, Decision Making in Engineering Design (ed. Lewis, K. E.; Chen, W.; Schmidt, L. C.), pp. 303–314. ASME, DOI: https://doi.org/10.1115/1.802469.ch25Google Scholar
Üreten, S.; Eisenmann, M.; Nelius, T.; Garrelts, E.; Krause, D.; Matthiesen, S. (2020a), “Current Challenges and Solution Approaches in Empirical Engineering Design Research - A Workshop for Empirical Research”, Proceedings of the Design Society: DESIGN Conference, 1, Dubrovnik, Croatia, 2020, pp. 61–70, https://doi.org/10.1017/dsd.2020.280CrossRefGoogle Scholar
Üreten, S.; Spallek, J.; Üreten, E.; Krause, D. (2020b), “Validation of the Design for Mass Adaptation Method - A Case for Higher Medical Treatment Quality”, Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, vol. 9, 1, pp.88–100, https://doi.org/10.1177/2327857920091059CrossRefGoogle Scholar
Üreten, S.; Eisenmann, M.; Nelius, T.; Cao, S.; Matthiesen, S.; Krause, D. (2019), “A Concept Map for Design Method Experiments in Product Development - A Guideline for Method Developers”, Proceedings of the 30th Symposium Design for X (DFX 2019), Jesteburg, Germany, pp. 147–158, https://doi.org/10.35199/dfx2019.13CrossRefGoogle Scholar
Üreten, S.; Krause, D. (2018), “A Deeper Understanding of Students' Method Acceptance through Focus Group Interviews”, Proceedings of the 29th Symposium Design for X (DfX 2018), Tutzing, Germany, pp. 37–48Google Scholar
Üreten, S.; Krause, D. (2017), “Discursive vs. intuitive - An experimental study to facilitate the use of design catalogues”, Proceedings of the 21st International Conference on Engineering Design (ICED 17), Vol. 9, Design Education, Vancouver, Canada, pp. 99–108.Google Scholar
Üreten, S.; Beckmann, G.; Schwenke, E.; Krause, D.; Cao, S. (2017), “Continuing Education and Personalization of Design Methods to Improve their Acceptance in Practice – An Explorative Study”, Procedia CIRP, Vol. 60, 27th CIRP Design Conference, pp. 524–529, https://doi.org/10.1016/j.procir.2017.01.012CrossRefGoogle Scholar
Vermaas, P. (2016), “A logical critique of the expert position in design research: Beyond expert justification of design methods and towards empirical validation”, Design Science, Vol. 2, No. e7, https://doi.org/10.1017/dsj.2016.6.CrossRefGoogle Scholar