Automated Assessment of Use–Case Diagrams (AAUC), a feedback‐centric framework and tool for the automated assessment of UML use‐case diagrams, designed to support assessment practices in engineering education, is presented.
Abstract
Assessing diagrammatic artifacts such as UML use‐case diagrams is a core yet challenging task in engineering and software engineering education. In large classes, manually evaluating such diagrams is time‐consuming, subjective, and difficult to scale, particularly when student solutions exhibit structural variations and diverse labeling choices. These challenges limit the consistency of grading and the timeliness of feedback provided to students. This article presents Automated Assessment of Use–Case Diagrams (AAUC), a feedback‐centric framework and tool for the automated assessment of UML use‐case diagrams, designed to support assessment practices in engineering education. The proposed approach integrates label and structure matching, along with instructor‐configurable marking rules, within a level‐aware assessment model that supports partial credit and differentiated evaluation. Unlike approaches that focus solely on correctness detection, AAUC emphasizes the generation of meaningful formative feedback by identifying specific modeling issues, such as missing actors, incorrect relationships, and inconsistent or incomplete labeling. The framework has been evaluated using a dataset of 445 student‐generated use‐case diagrams collected over multiple academic years from undergraduate software engineering and systems analysis courses. The evaluation demonstrates that the system can robustly assess diverse student submissions, apply consistent marking policies, and generate both quantitative scores and qualitative feedback aligned with instructor expectations. By combining automated assessment with explicit feedback generation, AAUC addresses scalability challenges while supporting iterative improvement in student modeling work. The framework provides a practical, extensible solution for instructors seeking to integrate automated support into engineering education contexts involving diagrammatic design tasks.
This paper investigates the reliability of LLMs in evaluating UML diagrams generated through reverse engineering processes (source code) and asks: do LLM assessments align with those of human experts?
Olena Chebanyuk, Carles Sierra· International Conference on...· 0 citations
UML class diagrams are a crucial tool for defining the structure of software systems, but designing accurate and comprehensive class diagrams is a challenging task. Traditionally, creating UML models relies on the expertise and experience of professionals. However, with the development of AI technologies, particularly...
The results demonstrate that the integration of Retrieval-Augmented Generation, rubric-based evaluation, and Human-in-the-Loop validation constitutes an effective approach for AI-supported assessment of engineering laboratory reports, maintaining instructor oversight and educational integrity.
Amina Abbi, M. Skouri, M. Raoufi· International Journal of Adv...· 0 citations
The system attained a System Usability Scale (SUS) score of 88.5 and cut grading time by 87.5 percent, facilitating focused instructor review in LLM-supported programming assessments, facilitating focused instructor review in LLM-supported programming assessments.
A. Ibrahim, Runal Rezkiawan· EDUMATIC: Jurnal Pendidikan...· 0 citations
UML (Unified Modeling Language) is a foundational tool needed for teaching software engineering. Despite this, when taught with the traditional approach, students typically find it difficult to grasp the syntax, semantics, and diagramming techniques used in UML. This paper proposes a new approach to teaching UML throug...
Wajiha Mughal, Iqra Shahzad, Muhammad Muzzamil et al.· Pakistan journal of engineer...· 0 citations
Developing the skills required for requirements engineering students to conduct effective requirements elicitation interviews is critical yet challenging, as it requires the development of soft skills in addition to technical knowledge. Role-playing is widely adopted in requirements engineering education to support the...
Manal Binkhonain, O. Alharbi· Requirements Engineering· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.