Skip to content
Open access

Evaluating Artificial Intelligence Tools In Identifying Translation Techniques In Literary Texts

Jul 2026 · Tarling Journal of Language Education · 0 citations

TL;DR

This study concludes that while all AI tools can transfer denotative meaning, generative models (LLMs) are superior in applying high-level translation techniques necessary for maintaining emotional nuance, discourse cohesion, and literary appeal.

Abstract

Backround - The rapid advancement of Artificial Intelligence (AI) in translation studies has transformed how literary texts are processed, shifting from literal word-for-word transfer to more contextually nuanced approaches. Literary fables demand particular sensitivity to personification, onomatopoeia, and moral messaging. Urgency of Research - Despite the proliferation of AI translation tools, previous studies have predominantly focused on macro-level quality evaluation (e.g., fluency and accuracy) rather than examining the micro-linguistic strategies AI employs. There remains a significant gap in understanding how different AI models identify and apply established translation techniques within Molina and Albir's comprehensive framework of 18 translation techniques. Research Objectives - This study aims to evaluate and compare the performance of four AI tools—ChatGPT, Gemini, Claude, and DeepL—in identifying and applying translation techniques in the literary fable "The Clever Rabbit," specifically examining how each model utilizes Molina and Albir's 18 translation techniques to achieve dynamic equivalence. Research Method - Adopting a qualitative descriptive approach, this study employs purposive sampling to select translation units demonstrating specific techniques. Data were collected through comparative textual analysis of one English source text and four Indonesian target texts, validated through theoretical triangulation and source triangulation. Research Findings - The findings reveal a clear strategic polarization: generative AI models (ChatGPT, Gemini, Claude) demonstrate dominance in complex transformation techniques such as Modulation (20-23%), Equivalence (12-13%), and Explicitation, reflecting deeper contextual understanding. In contrast, DeepL shows extreme reliance on Literal Translation (>65%) with minimal cultural or stylistic adaptation. ChatGPT excels in local adaptation through generalization and particularization; Gemini stands out in narrative vitality through expressive lexical variation; and Claude offers structural efficiency through precise grammatical reduction. Research Conclusion & Novelty - This study concludes that while all AI tools can transfer denotative meaning, generative models (LLMs) are superior in applying high-level translation techniques necessary for maintaining emotional nuance, discourse cohesion, and literary appeal. The novelty lies in its micro-linguistic analysis using Molina and Albir's comprehensive taxonomy across four distinct AI platforms, providing unprecedented insight into the "black box" of AI translation strategies. The findings offer practical guidance for educators, researchers, and translators in selecting appropriate AI tools, emphasizing that critical human post-editing remains indispensable for achieving true literary equivalence.

Read PDF

Similar papers

Review Open access Aug 2026

Evaluating Terminological Consistency in AI-Generated English–Arabic Political Translation

The study concludes that terminological consistency should be considered as a separate dimension of translation quality and emphasizes the importance of terminology control and human post-editing in AI-assisted political translation.

Osama Bala · 0 citations
Review Open access Aug 2026

Human and Artificial Intelligence in Literary Translation Evaluating Meaning, Style, and Cultural Representation

The development of artificial intelligence in translation raises questions about its ability to maintain meaning, style, and cultural representation in English literature. This study aims to compare human and AI translations in parts of texts that contain metaphors, idioms, narrative styles, and cultural elements. The study used a comparative qualitative approach by involving three human translators, one AI model, and two translation experts as validators. Data was collected through translation documentation and expert review, then analyzed using comparative textual analysis and thematic coding. The results show that human translators more consistently retain figurative nuances, narrative voices, and cultural distinctiveness, while AI tends to produce more explicit and standardized translations. The findings confirm the importance of human interpretation in AI-assisted literary translation

Gunawan Tambunsaribu · 0 citations
Open access Jul 2026

Evaluating the limits of machine translation for poetry: a multidimensional framework

The results show that LLMs and Google Translate consistently outperform specialized MT systems in terms of fluency, meaning preservation, and lexical-thematic alignment.

Beatriz Ribeiro Borges, P. H. R. Gabriel, E. Faria · 0 citations
Open access Jul 2026

Comparative Analysis of Digital Tools for Urdu-English Literary Text Translation: A BLEU Metric Evaluation

This research conducted a comparative analysis of three digital translation tools, Google Translate, Lingvanex, and MateCat, evaluating their performance in translating Saadat Hasan Manto's Urdu short story "Khol Do" into English, indicating that Google Translate is the most successful tool in terms of both quantitative measures and qualitative aspects.

Khadija Mushtaq, Rafia Bilal · 0 citations
Open access Sep 2026

Genre-Based Variation in AI-Assisted Students’ English-Indonesian Translation Quality: A Comparative Assessment across Academic Texts, News Texts, and Poetry

Artificial Intelligence (AI) performance in translation varies across genres due to the unique features of each genre. This study aims to explore the quality of students’ AI-aided translations of English academic texts, news articles, and poetry, and to determine whether translation quality varies by genre. A descriptive comparative research design was used in the study, involving a sample of 35 students from the English Departments of four universities in Indonesia. The participants translated an English academic text, a news article, and a poem using an Artificial Intelligence-assisted translation tool. The total number of translations was 105. Six translation experts evaluated all the translation samples using Nababan and Nuraeni’s model. They assessed translation quality in terms of accuracy, acceptability, readability, and a new dimension proposed by the researchers, i.e., poeticness, specifically for the translation of poetry. The study found that translations produced by students using AI ranged from moderate to high in quality. For the dimension of translation quality, the highest number of maximal scores (54.55%) was awarded for readability, followed by accuracy (51.56%) and acceptability (50.31%). Poeticness had the lowest score of 17.95%. It proved that AI’s ability to translate poetry is limited, as AI-generated translation cannot preserve literary devices such as figurative language, imagery, and rhyme, as well as the emotional and aesthetic elements of poetry.

Unknown authors · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.