International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 6 Issue 5 September-October 2024 Submit your research before last 3 days of October to publish your research paper in the issue of September-October.

Machine Translation with Neural Networks Based on a Transformer

Author(s) Chaali Kaoutar, Lachhab Yasser, Sefiani Maha
Country Morocco
Abstract Over the same period, thanks to deep neural networks, particularly in machine translation tasks that fall under natural language process (NLP), there have been major advances. Context is not something that lies well with traditional systems based on statistical models or tranlation memory and they also struggle with the level of fluency in translation. Through the invention of their Transformer models, Vaswani et al. This has also made great strides in improving both precision and performance [28] from 2017.
In this paper, we explore how to adapt pre-trained Transformer models into low-resource languages. For lower-engaged languages, we want to introduce hybrid methods in machine translation systems using multi-task learning and also transfer-learning with different metrics. To address this, we exploit the high-resource languages for training and introduce representation reduction techniques to be able to better handle some low-resourced cases.
Our results show that multi-task training improves BLEU scores by a large margin, especially for more scarce languages such as Swahili and Amharic. Our results exemplify the power of combining effective multi-task training with transfer learning in low-resource language translation.
Keywords Natural Language Processing (NLP), Machine Translation , Transformer Models ,Low-Resource Languages ,Multi-Task Learning , Transfer Learning, Vocabulary Reduction , Neural Networks , BLEU Score , Language Models .
Field Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In Volume 6, Issue 5, September-October 2024
Published On 2024-09-04
Cite This Machine Translation with Neural Networks Based on a Transformer - Chaali Kaoutar, Lachhab Yasser, Sefiani Maha - IJFMR Volume 6, Issue 5, September-October 2024. DOI 10.36948/ijfmr.2024.v06i05.26674
DOI https://doi.org/10.36948/ijfmr.2024.v06i05.26674
Short DOI https://doi.org/gt9kvb

Share this