TransBERT: A Framework for Synthetic Translation in Domain-Specific Language Modeling
TransBERT, a novel framework for pre-training language models using exclusively synthetically translated text, is presented, and TransCorpus, a scalable translation toolkit is introduced, a scalable translation toolkit for building high-quality NLP resources in low-resource language/domain pairs.
Julien Knafou, L. Mottin, Anaïs Mottaz et al.
· Conference on Empirical Meth... · 2 citations
· ⚡1