Machine Translation for Low Resource Language using NLP Attention Mechanism

Vindya B J; Harish T A

doi:10.36948/ijfmr.2024.v06i04.24908

Machine Translation for Low Resource Language using NLP Attention Mechanism

Author(s)	Vindya B J, Harish T A
Country	India
Abstract	Machine translation (MT) systems play a major role in overcoming language barriers, particularly for underutilized language pairs like Bangla-English. This research compares the relative effectiveness of Neural Machine Translation (NMT) against Statistical Machine Translation (SMT) for translating between Bangla and English. It does this by employing a thorough methodology that involves model training, validation, and inference utilizing publicly available corpora. We developed and trained an NMT system using encoder-decoder architecture and attention methods. The system was trained using a Tatoeba Project dataset that was split into training and validation sets. The models were evaluated and modified using standard metrics, and the trained model checkpoints were saved and recovered for inference. Our experiments demonstrate that when translating between Bangla and English, NMT outperforms SMT by a wide margin in terms of BLEU scores.
Keywords	Machine Translation, Bangla-to-English, English-to-Bangla, Statistical Machine Translation, Neural Machine Translation, Sub word Segmentation, Byte Pair Encoding, Tatoeba Dataset
Field	Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In	Volume 6, Issue 4, July-August 2024
Published On	2024-07-25
Cite This	Machine Translation for Low Resource Language using NLP Attention Mechanism - Vindya B J, Harish T A - IJFMR Volume 6, Issue 4, July-August 2024. DOI 10.36948/ijfmr.2024.v06i04.24908
DOI	https://doi.org/10.36948/ijfmr.2024.v06i04.24908
Short DOI	https://doi.org/gt5hm4

View / Download PDF File

E-ISSN 2582-2160

doi

CrossRef DOI is assigned to each research paper published in our journal.

IJFMR DOI prefix is
10.36948/ijfmr

Downloads

Research Paper Format Copyright Permission Form and Undertaking Form Cover Page Vol 6 Isu 6 Cover Page Vol 6 Isu 5 Cover Page Vol 6 Isu 4

All research papers published on this website are licensed under Creative Commons Attribution-ShareAlike 4.0 International License, and all rights belong to their respective authors/researchers.

CC-BY-SA

About IJFMR Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us		+91-9898-5948-55	editor@ijfmr.com

International Journal For Multidisciplinary Research

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Machine Translation for Low Resource Language using NLP Attention Mechanism

Share this