TMCAS: Efficient Large Language Model-Assisted Topic Modeling for Civil Aviation Safety Reports
TL;DR
This paper proposes TMCAS, an efficient large language model-assisted topic modeling framework for civil aviation safety reports that achieves superior clustering and interpretability while substantially reducing inference cost compared with document-wise LLM baselines.
Abstract
Voluntary safety reports provide valuable information for identifying potential risks and improving safety management in civil aviation. However, these reports are often large in volume, unstructured in format, and rich in domain-specific terminology, making manual analysis costly, inefficient, and difficult to scale. To address these challenges, this paper proposes TMCAS, an efficient large language model-assisted topic modeling framework for civil aviation safety reports. The proposed framework combines domain-adapted text embeddings, density-based clustering, representative sampling, noise repair, and large language model-based topic generation. Specifically, a contrastive learning-based fine-tuning strategy is introduced to enhance the semantic representation of aviation safety texts. An HDBSCAN-based clustering and sampling mechanism is then designed to select representative reports and reduce the computational cost of large language model inference, while a noise-repair strategy is used to improve topic coverage. Finally, large language models are employed to generate interpretable sentence-level topic labels and descriptions. Experiments demonstrate that TMCAS achieves superior clustering and interpretability while substantially reducing inference cost compared with document-wise LLM baselines.