A semantic distance augmentation (SDA) method that integrates syntactic information from constituency parse trees into the NMT encoder to optimize self-attention and achieves statistically significant improvements in translation quality over the strong baseline, without requiring additional training data or increasing model complexity.
Abstract
Neural machine translation (NMT) has witnessed substantial advancements, leveraging its learning capability to deliver highly accurate translations. Nevertheless, the efficacy of NMT models is contingent upon the accessibility of extensive-scale, high-quality training data, and its performance suffers notably in the absence of such datasets. To tackle this challenge, we propose a semantic distance augmentation (SDA) method that integrates syntactic information from constituency parse trees into the NMT encoder to optimize self-attention. Specifically, the source language sentences in the training set are analyzed by constituency parse analysis and the semantic distance attention matrix is constructed. Then, a fusion strategy is designed to integrate this matrix into the self-attention weight, enhancing the representation of the source sentences. In addition, a SDA length-aware strategy is proposed to adaptively control the contribution of semantic distance in the attention computation. Empirical evaluations across multiple low-resource language pairs reveal that the SDA method achieves statistically significant improvements in translation quality over the strong baseline, without requiring additional training data or increasing model complexity.
The research offers a Lotus Effect-Attention-based Bi-directional Gated Recurrent Unit (LE-Att-Bi-GRU) deep learning model for automatic translation quality assessment that improves semantic representation by incorporating a lotus-inspired division method that decreases noise and focuses essential semantic cues.
The effectiveness of multilingual transfer learning in low-resource settings is demonstrated by the fine-tuned Multilingual Bidirectional and Auto-Regressive Transformer-50 model, significantly outperforming the pretrained baseline.
G. Harshitha, Vasudeva, Nisha P. Poojary et al.· Engineering, Technology &...· 0 citations
The findings show that a hybrid combination of TL and DA with a self-supervised objective is the most effective solution for extremely low-resource scenarios, capable of producing the highest translation quality and outperforming baseline models and traditional methods such as Statistical Machine Translation (SMT).
Nur Fikri Khuluq, Muhammad Naufal Muzhaffar, Shofwatul Uyun· Jurnal Sains, Nalar, dan Apl...· 0 citations
A zero-shot translation enhancement algorithm based on dual semantic decoupling and explicit path regularization that improves the robustness and controllability of zero-shot translation in low-resource and cross-linguistic scenarios.
This paper proposes an alignment-aware multi-granularity tagging framework. First, this method uses a cross-lingual pre-trained model to encode source and target language contexts jointly while explicitly modeling-level bilingual correspondences via a learnable soft alignment layer. Second, a gated local enhancement module is introduced to dynamically fuse n-gram-level surface features on top of the Transformer high-level representation, preserving fine-grained error signals that are easily smoothed by attention mechanisms. Finally, a label-aware focus loss function is designed to alleviate the extreme imbalance between positive and negative samples. This function supports joint prediction of four types of fine-grained error labels. Results showed that on the large-scale benchmark of WMT QE Shared Task 2023, covering six language pairs, alignment-aware multi-granularity tagging achieved 78.6% in Micro-F1, 72.3% in Macro-F1, and improved Recall@Rare to 62.3%, especially excelling in low-frequency error types and significantly outperforming the baseline model.
Bijuan Wang, Lingli Zhu, Hongli Wen· International Journal of Inf...· 0 citations
An Efficient Dual-BERT Adversarial Network (DBAN) is proposed to improve the translation of noisy UGC by integrating contextual representation learning with adversarial training and significantly improves contextual understanding and cross-lingual semantic alignment while maintaining computational efficiency.
A. A. Aliero, Nasiru Muhammad Dankolo· International Journal Of Eng...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
