COMET: A ML-Based Tool for Evaluating the Effectiveness of Software Design Communication
2023 (English)In: 2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), IEEE conference proceedings, 2023, p. 729-736Conference paper, Published paper (Refereed)
Abstract [en]
Communication is one of the most demanding activities in software development. The effectiveness of communication can be measured by analyzing three interpersonal communication dimensions: Active Discussion, Creative Conflict, and Conversation Management. Previous work relied on manually labeling the communication dimensions to analyze the effectiveness of software design discussions, a process that is time-consuming and not applicable to real-time use. In this study, natural language processing and supervised machine learning are used to create COMET, a tool for automatic classification and assessment of the effectiveness of interpersonal communication during software design meetings. To determine the optimal classification approach, nine different classifiers are examined. The classifier model that performed the best is Random Forest which managed to achieve 93.66% accuracy, 93.76% precision, and 93.63% recall when trained and tested with a stratified 10-fold cross-validation technique.
Place, publisher, year, edition, pages
IEEE conference proceedings, 2023. p. 729-736
Keywords [en]
Software Engineering, Software Design, Machine Learning, Natural Language Processing, Communication
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:miun:diva-50183DOI: 10.1109/MODELS-C59198.2023.00119ISI: 001137051500098Scopus ID: 2-s2.0-85182394547OAI: oai:DiVA.org:miun-50183DiVA, id: diva2:1823074
Conference
2023 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)
2023-12-292023-12-292024-02-09Bibliographically approved