Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-26T19:45:42.679Z Has data issue: false hasContentIssue false
  • English
  • Français

ACTIVE ENGAGEMENT IN COLLABORATIVE ENGINEERING DESIGN: HOW TO MEASURE AND USE IT IN A FEEDBACK SYSTEM?

Published online by Cambridge University Press:  19 June 2023

Sabah Farshad  and
Clement Fortin
Sabah Farshad*
Affiliation:
Skolkovo Institute of Science and Technology (Skoltech)
Clement Fortin
Affiliation:
Skolkovo Institute of Science and Technology (Skoltech)
*
Farshad, Sabah, Skolkovo Institute of Science and Technology, Russian Federation, sabah.farshad@skoltech.ru

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Engineering design is typically a collaborative process, and in the era of digital engineering, online collaboration platforms are increasingly being used to perform the work. Despite the development of e-collaboration technologies, there is a significant gap between actual collaboration and what is really needed. However, improving collaboration requires a proper measurement system. Yet, the common methods to measure and improve collaboration are challenging, usually not compatible with digitalized collaboration, and have limited scalability. This paper presents a new data-driven method for measuring, visualizing, and monitoring Active Engagement (AE) in web-based teamwork, which is a key element of effective collaboration. We applied the method in a case study of four engineering teams during a Technology Planning and Road-mapping course. The results suggest that measuring AE in web-based teams, with an available history log, is technically feasible and can meaningfully represent the team's collaboration. The presented approach can be used to upgrade e-collaboration platforms as a toolkit or for further investigation on improving web-based collaborative design and learning through monitoring dashboards and feedback systems.

Keywords

Collaborative designTeamworkCase studyDigital engineeringE-collaboration
Type
Article
Information
Proceedings of the Design Society , Volume 3: ICED23 , July 2023 , pp. 455 - 464
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2023. Published by Cambridge University Press

References

Agarwal, A., U. (2014), “Examining the impact of social exchange relationships on innovative work behaviour”, Team Performance Management, Vol. 20 No. 3/4, pp. 102–120.CrossRefGoogle Scholar
Arias, J., Ramírez, M.C., Duarte, D.M., Flórez, M.P. and Sanabria, J.P. (2016), “PoCDIO: a methodological proposal for promoting active participation in social engineering projects”, Systemic Practice and Action Research, Springer, Vol. 29 No. 4, pp. 379–403.Google Scholar
Benz, M.R., Johnson, D.K., Mikkelsen, K.S. and Lindstrom, L.E. (1995), “Improving collaboration between schools and vocational rehabilitation: Stakeholder identified barriers and strategies”, Career Development for Exceptional Individuals, Sage Publications Sage CA: Thousand Oaks, CA, Vol. 18 No. 2, pp. 133–144.Google Scholar
Berthoud, L. and Gliddon, J. (2018), “Using wikis to investigate communication, collaboration and engagement in Capstone engineering design projects”, European Journal of Engineering Education, Vol. 43 No. 2, pp. 247–263.CrossRefGoogle Scholar
Boughzala, I. and de Vreede, G.-J. (2015), “Evaluating Team Collaboration Quality: The Development and Field Application of a Collaboration Maturity Model”, Journal of Management Information Systems, Vol. 32 No. 3, pp. 129–157. https://doi.org/10.1080/07421222.2015.1095042CrossRefGoogle Scholar
Briggs, R.O. and Murphy, J.D. (2011), “Discovering and Evaluating Collaboration Engineering Opportunities: An Interview Protocol Based on the Value Frequency Model”, Group Decision and Negotiation, Vol. 20 No. 3, pp. 315–346.CrossRefGoogle Scholar
Brisco, R., Whitfield, R.I. and Grierson, H. (2018), “Modelling the Relationship between Design Activity and Computer-supported Collaborative Design Factors”, DS 92: Proceedings of the DESIGN 2018 15th International Design Conference, pp. 193–204.CrossRefGoogle Scholar
Cowan, R.J., Swearer Napolitano, S.M. and Sheridan, S.M. (2004), “Home-school collaboration”.CrossRefGoogle Scholar
DeFranco, J.F., Neill, C.J. and Clariana, R.B. (2011), “A cognitive collaborative model to improve performance in engineering teams—A study of team outcomes and mental model sharing”, Systems Engineering, Wiley Online Library, Vol. 14 No. 3, pp. 267–278.Google Scholar
Driskell, J.E., Salas, E. and Hughes, S. (2010), “Collective Orientation and Team Performance: Development of an Individual Differences Measure”, Human Factors: The Journal of the Human Factors and Ergonomics Society, Vol. 52 No. 2, pp. 316–328. https://doi.org/10.1177/0018720809359522CrossRefGoogle ScholarPubMed
Dubberly, H., Pangaro, P. and Haque, U. (2009), “On Modeling, What is interaction?: are there different types?”, Interactions, Vol. 16 No. 1, pp. 69–75. https://doi.org/10.1145/1456202.1456220CrossRefGoogle Scholar
Duehr, K., Efremov, P., Heimicke, J., Teitz, E.M., Ort, F., Weissenberger-Eibl, M. and Albers, A. (2021), “The positive impact of agile retrospectives on the collaboration of distributed development teams–a practical approach on the example of Bosch engineering GMBH”, Proceedings of the Design Society, Cambridge University Press, Vol. 1, pp. 3071–3080.CrossRefGoogle Scholar
Farshad, S. and Fortin, C. (2021), “Distributed Cognition Transformation in Complete Online System Engineering Design Teaching”, Proceedings of the Design Society, 1, 1313–1322. https://doi.org/10.1017/pds.2021.131.CrossRefGoogle Scholar
Farshad, S. and Fortin, C. (2023), “A Novel Method for Measuring, Visualizing, and Monitoring E-Collaboration”, International Journal of E-Collaboration, 19(1), 1–21. https://doi.org/10.4018/IJeC.317223CrossRefGoogle Scholar
FBI. (2022), “The Global Team Collaboration Software Market Size”, available at: https://www.fortunebusinessinsights.com/industry-reports/team-collaboration-software-market-101327.Google Scholar
Ferme, L., Zuo, J. and Rameezdeen, R. (2018), “Improving collaboration among stakeholders in green building projects: role of early contractor involvement”, Journal of Legal Affairs and Dispute Resolution in Engineering and Construction, American Society of Civil Engineers, Vol. 10 No. 4, p. 4518020.Google Scholar
Fernandes, J., Duarte, D., Ribeiro, C., Farinha, C., Pereira, J.M. and da Silva, M.M. (2012), “iThink: A game-based approach towards improving collaboration and participation in requirement elicitation”, Procedia Computer Science, Elsevier, Vol. 15, pp. 66–77.Google Scholar
Fischer, G. (2004), “Social creativity”, Proceedings of the Eighth Conference on Participatory Design Artful Integration: Interweaving Media, Materials and Practices - PDC 04, Vol. 1, ACM Press, New York, New York, USA, p. 152.Google Scholar
Graesser, A.C., Fiore, S.M., Greiff, S., Andrews-Todd, J., Foltz, P.W. and Hesse, F.W. (2018), “Advancing the Science of Collaborative Problem Solving”, Psychological Science in the Public Interest, Vol. 19 No. 2, pp. 59–92.CrossRefGoogle ScholarPubMed
Griffiths, A.-J., Alsip, J., Hart, S.R., Round, R.L. and Brady, J. (2020), “Together we can do so much: A systematic review and conceptual framework of collaboration in schools”, Canadian Journal of School Psychology, SAGE Publications Sage CA: Los Angeles, CA, p. 0829573520915368.Google Scholar
Hallam, P.R., Smith, H.R., Hite, J.M., Hite, S.J. and Wilcox, B.R. (2015), “Trust and collaboration in PLC teams: Teacher relationships, principal support, and collaborative benefits”, NASSP Bulletin, SAGE Publications Sage CA: Los Angeles, CA, Vol. 99 No. 3, pp. 193–216.CrossRefGoogle Scholar
Hamalainen, R. (2008), “Designing and evaluating collaboration in a virtual game environment for vocational learning”, Computers & Education, Vol. 50 No. 1, pp. 98–109.CrossRefGoogle Scholar
Hihn, J., Chattopadhyay, D., Karpati, G., McGuire, M., Borden, C., Panek, J. and Warfield, K. (2011), “Aerospace concurrent engineering design teams: Current state, next steps and a vision for the future”, AIAA SPACE Conference and Exposition 2011, American Institute of Aeronautics and Astronautics Inc., available at:https://doi.org/10.2514/6.2011-7238.CrossRefGoogle Scholar
Ho, D., Kumar, A. and Shiwakoti, N. (2019), “A Literature Review of Supply Chain Collaboration Mechanisms and Their Impact on Performance”, Engineering Management Journal, Vol. 31 No. 1, pp. 47–68.CrossRefGoogle Scholar
Jeffares, S. and Dickinson, H. (2016), “Evaluating collaboration: The creation of an online tool employing Q methodology”, Evaluation, Vol. 22 No. 1, pp. 91–107.CrossRefGoogle Scholar
Kihlstrom, G. (2021), “Focusing On The Most Meaningful Metrics”, Forbes, available at: https://www.forbes.com/sites/forbesagencycouncil/2021/04/22/focusing-on-the-most-meaningful-metrics/?sh=1612bcb29f26.Google Scholar
Lang, V. (2021), Digital Fluency, Springer.CrossRefGoogle Scholar
Lazareva, A. and Munkvold, B.E. (2017), “Facilitating collaboration: Potential synergies between collaboration engineering and computer-supported collaborative learning”, International Journal of E-Collaboration, Vol. 13 No. 3, pp. 22–38.CrossRefGoogle Scholar
Marek, L.I., Brock, D.-J.P. and Savla, J. (2015), “Evaluating Collaboration for Effectiveness”, American Journal of Evaluation, Vol. 36 No. 1, pp. 67–85.CrossRefGoogle Scholar
Markopoulos, P. and Mackay, W. (2009), Awareness Systems: Advances in Theory, Methodology and Design, Springer Science & Business Media.CrossRefGoogle Scholar
Martinez-maldonado, R., Ga, D., Echeverria, V., Nieto, G.F., Swiecki, Z. and Shum, S.B. (2022), “What Do You Mean by Collaboration Analytics? A Conceptual Model”, Vol. 8 No. 1, pp. 126–153.Google Scholar
Pirkis, J., Livingston, J., Herrman, H., Schweitzer, I., Gill, L., Morley, B., Grigg, M., et al. (2004), “Improving collaboration between private psychiatrists, the public mental health sector and general practitioners: evaluation of the Partnership Project”, Australian & New Zealand Journal of Psychiatry, Sage Publications Sage UK: London, England, Vol. 38 No. 3, pp. 125–134.Google Scholar
Prochaska, J.D., Croisant, S., Sommer, L.C., Treble, N., Bohn, K., Wiseman, L., Singleton, C., et al. (2021), “82003 Network Evaluation of a Community-Campus Partnership: Applying a Systems Science Lens to Evaluating Collaboration and Translation”, Journal of Clinical and Translational Science, Vol. 5 No. s1, pp. 81–82.CrossRefGoogle Scholar
Rometty, V.G. (2006), “Expanding the innovation horizon: The global CEO study 2006”, IBM Business Consulting Services.Google Scholar
Schwind, M. and Wegmann, C. (2008), “SVNNAT: Measuring Collaboration in Software Development Networks”, 2008 10th IEEE Conference on E-Commerce Technology and the Fifth IEEE Conference on Enterprise Computing, E-Commerce and E-Services, pp. 97–104.CrossRefGoogle Scholar
Spyra, G., Buchanan, W.J., Cruickshank, P. and Ekonomou, E. (2016), “Cloud-Based Identity and Identity Meta-Data”, Psychology and Mental Health, IGI Global, pp. 1756–1773. 10.4018/978-1-5225-0159-6.ch076Google Scholar
Tausch, S. (2016), “The influence of computer-mediated feedback on collaboration”, lmu, available at: https://doi.org/https://doi.org/10.5282/edoc.19975.CrossRefGoogle Scholar
Thomson, A.M., Perry, J.L. and Miller, T.K. (2007), “Conceptualizing and Measuring Collaboration”, Journal of Public Administration Research and Theory, Oxford University Press, Vol. 19 No. 1, pp. 23–56.Google Scholar
Tucker, V. and Schwartz, I. (2013), “Parents’ perspectives of collaboration with school professionals: Barriers and facilitators to successful partnerships in planning for students with ASD”, School Mental Health, Springer, Vol. 5 No. 1, pp. 3–14.Google Scholar
Zumbach, J., Reimann, P. and Koch, S.C. (2006), “Monitoring Students’ Collaboration in Computer-Mediated Collaborative Problem-Solving: Applied Feedback Approaches”, Journal of Educational Computing Research, SAGE Publications Sage CA: Los Angeles, CA, Vol. 35 No. 4, pp. 399–424.CrossRefGoogle Scholar