Direct LLM-based projection enables high-quality multilingual clinical annotation transfer and provides a practical approach for extending clinical NLP resources to languages with fewer annotated datasets and language-specific tools.
Abstract
Background: To determine whether cross-lingual clinical annotation projection can be formulated as a text-preserving, document-level generative task that produces verifiable character-level annotations for multilingual clinical corpus construction, and to characterize its robustness and computational trade-offs relative to candidate-based projection pipelines. Methods: We developed a constrained LLM projection workflow that inserts entity tags directly into immutable target-language text, followed by deterministic validation and character-offset reconstruction. We evaluated it alongside supervised candidate-span projection and hybrid ML-LLM refinement for transferring Spanish Disease, Symptom, and Procedure annotations into six languages. Evaluation used MultiClinAI gold standard with strict span matching and character-overlap F1 Results: Direct LLM projection achieved the strongest and most consistent performance. GLM 5.2 obtained a mean Strict F1 of 0.9201 across 18 language-entity combinations, while locally deployable Gemma4:31B achieved 0.9133. The best LLM configuration improved Strict F1 over the previous state of the art in all 18 settings, by 0.0564-0.1512, yielding 55,416 grounded mentions with reconstructed offsets. Conclusions: Direct LLM-based projection enables high-quality multilingual clinical annotation transfer and provides a practical approach for extending clinical NLP resources to languages with fewer annotated datasets and language-specific tools. Combined with local inference and deterministic validation, it can substantially reduce expert time and cost for multilingual clinical corpus construction.
The findings suggest that conventional readability metrics should be extended with domain-specific measures to more accurately assess comprehensibility in medical texts and that large Language Models show strong potential to enhance the accessibility of clinical documentation for patients.
M. Teichmann, Pelin Özkara Menekseoglu, Julian Schwarz et al.· Studies in Health Technology...· 0 citations
Patient privacy and compliance with regulations such as the General Data Protection Regulation (GDPR) necessitate the robust de-identification of clinical texts. This study investigates the feasibility, computational cost, and limitations of de-identifying Spanish medical records using training-free Large Language Mo...
J. A. Alzate-Grisales, Joshua Bernal-Salcedo, J. M. Saborit-Torres et al.· Journal of Healthcare Inform...· 1 citation
Large language models (LLMs) are increasingly proposed for clinical summarization, yet evaluations relying on textual similarity overlook clinically consequential failure modes such as fabrication, omission, contradiction, and negation inversion. We treat medical summarization as controlled clinical compression, operat...
Luis Vera, Olga Craveiro, Ricardo Malheiro et al.· Machine Learning and Knowled...· 0 citations
Combining domain-specific embedding-based retrieval with LLM-based reranking substantially improves MCN performance compared to a standalone LLM approach, and supports robust semantic matching between German clinical expressions and standardized terminology concepts, facilitating structured representation and enabling...
Helena Adam, Akhila Abdulnazar, Roland Roller et al.· Studies in Health Technology...· 0 citations
A benchmark-guided, scalable framework for automated medical terminology standardization that accepts heterogeneous short medical expressions without manual input pre-processing and automatically performs text refinement, semantic retrieval and terminology mapping to standardized concepts and vocabulary codes is establ...
Anshul Verma, Abhijay, Manan Vangani et al.· bioRxiv· 0 citations
This work introduces Meddies-PII-Dataset, a corpus of one million synthetic clinical documents spanning seventeen languages and nine PII labels, and trains Meddies-PII-Model, a BIOES token classifier, and compares it with existing PII extraction systems using exact-match entity-level F1.
Linh Le, Ho Dinh Tri, Christian Hoang et al.· 0 citations