Hostname: page-component-7479d7b7d-767nl Total loading time: 0 Render date: 2024-07-08T12:09:21.891Z Has data issue: false hasContentIssue false
  • English
  • Français

OVERCOMING AUGMENTED REALITY ADOPTION BARRIERS IN DESIGN: A MIXED PROTOTYPING CONTENT AUTHORING TOOL SUPPORTED BY COMPUTER VISION

Published online by Cambridge University Press:  27 July 2021

Eduardo Piñones ,
Gaetano Cascini ,
Giandomenico Caruso  and
Federico Morosi
Eduardo Piñones*
Affiliation:
Politecnico di Milano
Gaetano Cascini
Affiliation:
Politecnico di Milano
Giandomenico Caruso
Affiliation:
Politecnico di Milano
Federico Morosi
Affiliation:
Politecnico di Milano
*
Piñones Zuleta, Eduardo Andrés, Politecnico di Milano, Mechanical engineering, Italy, eduardo.pinones@polimi.it

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Enhancing the appearance of physical prototypes with digital elements, also known as mixed prototyping, has demonstrated to be a valuable approach in the product development process. However, the adoption is limited also due to the high time and competence required for authoring the digital contents. This paper presents a content authoring tool that aims to improve the user acceptance by reducing the specific competence required, which is needed for segmentation and UV mapping of the 3D model used to implement a mixed prototype. Part of the tasks related to 3D modelling software, in fact, has been transferred to simpler manual tasks applied onto the physical prototype. Moreover, the proposed tool can recognise these manual inputs thanks to a computer-vision algorithm and automatically manage the segmentation and UV mapping tasks, freeing time for the user in a task that otherwise would require complete engagement. To preliminarily evaluate effectiveness and potential of the tool, it has been used in a case study to build up the mixed prototype of a coffee machine. The result demonstrated that the tool can correctly segment the 3D model of a physical prototype in its relevant parts and generate their corresponding UV maps.

Keywords

New product developmentComputational design methodsIndustrial designMixed prototypingAugmented reality
Type
Article
Information
Proceedings of the Design Society , Volume 1: ICED21 , August 2021 , pp. 2359 - 2368
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2021. Published by Cambridge University Press

References

Bhattacharya, B. and Winer, E.H. (2019), “Augmented reality via expert demonstration authoring (AREDA)”, Computers in Industry, Vol. 105, pp. 61–79. https://doi.org/10.1016/j.compind.2018.04.021CrossRefGoogle Scholar
Cascini, G., O'Hare, J., Dekoninck, E., Becattini, N., Boujut, J.-F., Ben Guefrache, F., Carli, I., et al. . (2020), “Exploring the use of AR technology for co-creative product and packaging design”, Computers in Industry, Vol. 123, p. 103308. https://doi.org/10.1016/j.compind.2020.103308CrossRefGoogle Scholar
Davila, J.M., Oyedele, L., Demian, P. and Beach, T. (2020), “A research agenda for augmented and virtual reality in architecture, engineering and construction”, Advanced Engineering Informatics, Vol. 45, p. 101122. https://doi.org/10.1016/j.aei.2020.101122CrossRefGoogle Scholar
Egger, J. and Masood, T. (2020), “Augmented reality in support of intelligent manufacturing – A systematic literature review”, Computers & Industrial Engineering, Vol. 140, pp. 106–195. https://doi.org/10.1016/j.cie.2019.106195CrossRefGoogle Scholar
Gimeno, J., Morillo, P., Orduña, J.M. and Fernández, M. (2013), “A new AR authoring tool using depth maps for industrial procedures”, Computers in Industry, Vol. 64 No. 9, pp. 1263–1271. https://doi.org/10.1016/j.compind.2013.06.012CrossRefGoogle Scholar
Giunta, L., Guefrache, F.B., Dekoninck, E., Gopsill, J., O'Hare, J. and Morosi, F. (2019), “Investigating the Impact of Spatial Augmented Reality on Communication between Design Session Participants - A Pilot Study”, Proceedings of the Design Society: International Conference on Engineering Design, Cambridge University Press, Vol. 1 No. 1, pp. 1973–1982. https://doi.org/10.1017/dsi.2019.203CrossRefGoogle Scholar
Katz, S. and Tal, A. (2003), “Hierarchical mesh decomposition using fuzzy clustering and cuts”, ACM Transactions on Graphics (TOG), ACM. https://dl.acm.org/doi/abs/10.1145/882262.882369Google Scholar
Lévy, B., Petitjean, S., Ray, N. and Maillot, J. (2002), “Least squares conformal maps for automatic texture atlas generation”, ACM Transactions on Graphics, Vol. 21 No. 3, pp. 362–371. https://doi.org/10.1145/566654.566590CrossRefGoogle Scholar
van Lopik, K., Sinclair, M., Sharpe, R., Conway, P. and West, A. (2020), “Developing augmented reality capabilities for industry 4.0 small enterprises: Lessons learnt from a content authoring case study”, Computers in Industry, Vol. 117, p. 103–208. https://doi.org/10.1016/j.compind.2020.103208CrossRefGoogle Scholar
Marner, M.R., Smith, R.T., Porter, S.R., Broecker, M.M., Close, B. and Thomas, B.H. (2011), “Large Scale Spatial Augmented Reality for Design and Prototyping”, in Furht, B. (Ed.), Handbook of Augmented Reality, Springer New York, New York, NY, pp. 231–254. https://doi.org/10.1007/978-1-4614-0064-6_10CrossRefGoogle Scholar
Masood, T. and Egger, J. (2019), “Augmented reality in support of Industry 4.0—Implementation challenges and success factors”, Robotics and Computer-Integrated Manufacturing, Vol. 58, pp. 181–195. https://doi.org/10.1016/j.rcim.2019.02.003CrossRefGoogle Scholar
Masood, T. and Egger, J. (2020), “Adopting augmented reality in the age of industrial digitalisation”, Computers in Industry, Vol. 115, pp. 103–112. https://doi.org/10.1016/j.compind.2019.07.002CrossRefGoogle Scholar
Misal Khan, I.M., Babar, M. and Mudassir, M.U. (2019), “Implementation of 3D Scanning Technique for Object Model Replication and Customization Using Rapid Prototyping”, 2019 International Conference on Engineering and Emerging Technologies (ICEET), pp. 1–6. https://doi.org/10.1109/CEET1.2019.8711836CrossRefGoogle Scholar
Mohr, P., Kerbl, B., Donoser, M., Schmalstieg, D. and Kalkofen, D. (2015), “Retargeting Technical Documentation to Augmented Reality”, Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Association for Computing Machinery, New York, NY, USA, pp. 3337–3346. https://doi.org/10.1145/2702123.2702490CrossRefGoogle Scholar
O'Hare, J., Dekoninck, E., Giunta, L., Masclet, C. and Cascini, G. (2018), “Exploring the performance of augmented reality technologies in co-creative sessions: Initial results from controlled experiments”, presented at the 5th International Conference on Design Creativity. https://doi.org/10.21278/idc.2018.0391CrossRefGoogle Scholar
Poranne, R., Tarini, M., Huber, S., Panozzo, D. and Sorkine-Hornung, O. (2017), “Autocuts: simultaneous distortion and cut optimization for UV mapping”, ACM Transactions on Graphics, Vol. 36 No. 6. https://doi.org/10.1145/3130800.3130845CrossRefGoogle Scholar
de Souza Cardoso, L.F., Mariano, F.C.M.Q. and Zorzal, E.R. (2020), “A survey of industrial augmented reality”, Computers & Industrial Engineering, Vol. 139, p. 106–159. https://doi.org/10.1016/j.cie.2019.106159CrossRefGoogle Scholar
Takezawa, T., Iwai, D., Sato, K., Hara, T., Takeda, Y. and Murase, K. (2019), “Material Surface Reproduction and Perceptual Deformation with Projection Mapping for Car Interior Design”, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 251–258. https://doi.org/10.1109/VR.2019.8797923.CrossRefGoogle Scholar
Tarini, M., Yuksei, C. and Lefebvre, S. (2017), “Rethinking Texture Mapping”, presented at the SIGGRAPH, Los Angeles. https://doi.org/10.1145/3084873.3084911CrossRefGoogle Scholar
Zhou, X. and Rau, P.-L.P. (2019), “Determining fidelity of mixed prototypes: Effect of media and physical interaction”, Applied Ergonomics, Vol. 80, pp. 111–118. https://doi.org/10.1016/j.apergo.2019.05.007CrossRefGoogle Scholar