Skip to content
Preprint

Air Traffic Control Using Large Language Models: Prompt Engineering, Architecture, and Evaluation

Aug 2026 · 1 citation · 24 references
Computer Science

TL;DR

This article experimentally evaluates whether large language models (LLMs) can generate operationally realistic ATC transmissions and outlines a concrete path and its current limits toward LLM-assisted ATC.

Abstract

Air traffic control (ATC) communication is a safety-critical dialogue that remains largely human-driven even as other parts of air traffic management have been semi-automated. In this article, we experimentally evaluate whether large language models (LLMs) can generate operationally realistic ATC transmissions. An experimental general-aviation flight flying over the San Francisco"Bay Tour"route is hand-transcribed and used as ground truth (P0). Through a pilot-in-the-loop process we design five prompt structures (P1-P5) of increasing constraint and embed them in a stateful multi-turn pipeline, where the model plays ATC to a fixed pilot transcript while conditioning on the accumulating dialogue history. Across nine open- and closed-source LLMs we vary the prompt, the presence of a worked transcript from a different experimental flight as an in-context example, and whether the model conditions on its own prior replies or on injected ground-truth history. Turns are scored with lexical, structural, and semantic similarity metrics and by an LLM-as-judge (GPT-5.5) validated against human expert annotation. Supplying a worked example improves similarity, but tightening the prompt does not: the lightest prompts perform best and the most heavily scripted one collapses as its own errors accumulate through the dialogue, which injecting correct history repairs. These results outline a concrete path and its current limits toward LLM-assisted ATC.

View source

Similar papers

Open access Jul 2026

Explainable Recognition of Complex Flight Maneuvers via Retrieval-Augmented Large Language Models

TableManeuver is proposed, an explainable LLM-based FMR method that reformulates multivariate flight parameter time series as table-understanding inputs and combines recognition accuracy, cross-aircraft robustness, and readable step-by-step reasoning evidence, offering a practical route for applying LLMs to aviation time series analysis.

Liqiang Ren, Haipeng Wang, Xinlong Pan et al. · 0 citations
Preprint Aug 2026

ARENA: Automated Red-Teaming for Large Audio Language Models

Large audio-language models (LALMs) make it possible to interact with language models through speech, music, and environmental sound, but they also introduce a safety surface that is difficult to expose with text-only red-teaming. We study automated audio-grounded red-teaming, where a text query must remain safe in isolation while the joint text-audio input induces harmful target behavior. We propose ARENA, a closed-loop framework that trains a controller on an independent 2,000case text-audio dataset. MD-Judge supplies training rewards and adaptive search feedback, while a separate, non-adaptive Llama Guard 3 evaluator alone labels final outcomes. On 520 held-out AdvBench objectives, ARENA achieves FDR/PSR of 87.9/100.0%, 71.5/96.3%, 68.1/100.0%, and 75.4/98.5% on Audio Flamingo 3, Qwen2-Audio, MiMo-Audio, and GPTAudio, respectively. Ablations show that feedback-based refinement and audio-variant search substantially improve attack discovery.

Jiaming He, Zhicong Huang, Tian Jin et al. · 0 citations
Jul 2026

Toward Anthropomorphic Dialogue: A Closed-Loop Framework for Human-Like Chat Generation, Evaluation, and Preference Alignment

AnthroDial is presented, a closed-loop framework that formulates anthropomorphic dialogue as a joint problem of system architecture, executable evaluation, and diagnostic alignment and shows that anthropomorphic dialogue benefits when generation, evaluation, and reward shaping share the same behavioral dimensions.

Wentao Liu, Si-Yu Song, Xi Chen et al. · 0 citations
Conference Jul 2026

Towards Proactive Air Traffic Safety with Speech LLMs: Transcription, Attribute Tagging, and Readback Detection

Air traffic communication (ATC) is a highly specialized domain where noisy acoustic conditions, rapid speech rates, and domain-specific terminology pose significant challenges for automatic speech recognition. We investigate the use of Speech Large Language Models (Speech LLMs) to address these challenges by combining accurate transcription with structured information extraction. We leverage publicly available ATC datasets and apply data augmentation together with metadata-enriched training, which improves multi-turn dialogue handling and reduces transcription errors. On the test set, our model achieved a word error rate of 16.70% and a role classification accuracy of 96.60%. Furthermore, we propose a system for extracting callsigns, commands, and values, enabling automated readback detection. Case studies show that the system can determine whether pilots correctly repeat critical instructions, thereby supporting safety monitoring. Taken together, these results demonstrate the potential of Speech LLMs to deliver reproducible transcription accuracy, reliable role attribution, and proactive safety monitoring in air traffic communication.

Raymond Chung · 0 citations
Review Open access Aug 2026

Multimodal Large Language Models for Autonomous Driving: A Comprehensive Survey of Perception, Reasoning, Planning, and Safety Assurance

This 2026 survey synthesises 39 primary sources selected from an initial corpus of 274 candidate records screened over 2020-2026, organises the field around a five-role pipeline taxonomy (perception, prediction, planning, control, and human-machine interaction), and compares six representative driving MLLMs on accuracy, latency, and parameter footprint.

A. O. Ogar, Joshua Abah, Ali Muhammad et al. · 0 citations
Jul 2026

ABISS: Evaluating Text-to-SQL Systems Through Agent Interaction

A unified taxonomy of 8 categories covering ambiguous and unanswerable questions is addressed, a multi-agent generation pipeline with a two-stage process (NLQ generation followed by SQL grounding) and an explicit Category Conformance validation stage are addressed.

Giovanni Sullutrone, Luca Sala, Sania Aftar et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.