On the consistency of state machines, use cases and block diagrams using dependency graphs and Large Language Models

Abstract

Model-Driven Engineering aims to support rigorous reasoning about system analysis and design by relying on multiple interconnected modeling views to represent complex systems. However, maintaining consistency across these heterogeneous views remains a major challenge, especially when capturing the subtle semantic and logical dependencies inherent to such systems. Traditional approaches to consistency rely on formal rule-based methods, sometimes complemented by ontologies. Yet, these techniques often fall short when dealing with deeper semantic issues that cannot be explicitly expressed as rules. This paper introduces a combined approach for the automated detection and correction of inconsistencies in multi-view SysML models. The proposed framework articulates three complementary techniques: (1) a Large Language Model (LLM)-based technique for inconsistency detection, (2) a dependency graph-based technique for detecting inconsistencies in a class of logical relationships between model elements and (3) a correction method relying on LLMs constrained by formal rules to enforce consistency constraints. The graph-based technique relies on transforming SysML design models into dependency graphs: The paper first proves that these graphs are in bijective correspondence with the original design models. It then formalizes consistency rules for three diagram types, presents the integrated framework and evaluates its implementation on representative SysML analysis and design diagrams. Overall, the practical illustration shows that the approach is effective for identifying and correcting inconsistencies, although the LLM-based component produces both false positives and false negatives. It also suggests that the dependency graph-based technique is a relevant complement to the LLM-based one for identifying inconsistencies in logical dependencies between model elements.