International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 6 Issue 6 November-December 2024 Submit your research before last 3 days of December to publish your research paper in the issue of November-December.

Revolutionizing Content Digestion: Unleashing the Power of Bidirectional and Auto-Regressive Transformers in AI-Powered Automatic Text Summarization

Author(s) Ms. Vaishali V. Jikar, Dr.Gurudev B. Sawarkar, Ms. Rupali Dasarkar, Ms. Minakshi Dobale
Country India
Abstract Automatic text summarization has become increasingly essential in managing the overwhelming volume of textual information available across various domains. This paper explores the role of bidirectional and auto-regressive transformers, two prominent paradigms in natural language processing (NLP), in revolutionizing content digestion through AI-powered automatic text summarization. We discuss how bidirectional transformers, exemplified by models like BERT, and auto-regressive transformers, such as GPT, capture context and generate output tokens sequentially, respectively, contributing to the production of accurate and coherent summaries. By providing an overview of the challenges posed by the vast volume of textual data and the significance of automatic summarization, we delve into key advancements in NLP, emphasizing the development and applications of bidirectional and auto-regressive transformers in text summarization. Furthermore, we survey state-of-the-art models like BART and its derivatives, highlighting their convergence of bidirectional and auto-regressive techniques. Through a comprehensive analysis, we elucidate the transformative potential of bidirectional and auto-regressive transformers, offering valuable insights for researchers and practitioners in content digestion and NLP-driven knowledge extraction.
Keywords Automatic Text Summarization, Bidirectional Transformers, Auto-regressive Transformers, Natural Language Processing (NLP), BERT, GPT, BART, Content Digestion, Information Extraction, Knowledge Extraction
Field Engineering
Published In Volume 6, Issue 3, May-June 2024
Published On 2024-05-13
Cite This Revolutionizing Content Digestion: Unleashing the Power of Bidirectional and Auto-Regressive Transformers in AI-Powered Automatic Text Summarization - Ms. Vaishali V. Jikar, Dr.Gurudev B. Sawarkar, Ms. Rupali Dasarkar, Ms. Minakshi Dobale - IJFMR Volume 6, Issue 3, May-June 2024. DOI 10.36948/ijfmr.2024.v06i03.19417
DOI https://doi.org/10.36948/ijfmr.2024.v06i03.19417
Short DOI https://doi.org/gtt8w5

Share this