GHTM: A graph-based hybrid topic modeling approach for Bengali language
cs.CL
Submitted: 2025-08-01
Updated: 2026-10-12
Code: https://github.com/DULL-IIT/GHTM
License: http://creativecommons.org/licenses/by/4.0/
The gist: Topic modeling is a natural language processing technique used to discover latent themes and abstract topics from text corpora by grouping co-occurring keywords.
Terminology
Abstract
Topic modeling is a natural language processing technique used to discover latent themes and abstract topics from text corpora by grouping co-occurring keywords. Although widely researched in English, topic modeling remains understudied in Bengali due to a lack of adequate resources and initiatives. Existing Bengali topic modeling research lacks exploration of modern methodological approaches, reproducible implementations, diverse datasets, and systematic benchmarking. To bridge these gaps, this study presents Graph-based Hybrid Topic Model (GHTM), a novel architecture that synthesizes the distinct strengths of multiple paradigms by unifying statistical (TF-IDF), semantic (GloVe), and structural (GCN) modalities to construct semantically aligned document representations. GHTM later employs matrix factorization for topic extraction, offering a computationally lightweight alternative to resource-intensive neural and graph-based approaches. Through comprehensive benchmarking across three Bengali datasets of varying scales, GHTM consistently surpasses both traditional and contemporary topic modeling approaches, achieving improved topic coherence (NPMI: 0.27-0.28) and high topic diversity while maintaining computational efficiency. The model also outperformed established graph-based models on the English 20Newsgroups benchmark. Additionally, we introduce NCTBText, a diverse Bengali textbook-based dataset comprising 8,650 text documents, providing much-needed topical diversity beyond newspaper-centric Bengali corpora.
Sources
- Autoencoding Variational Inference For Topic Models
- Top2Vec: Distributed Representations of Topics
- BERTopic: Neural topic modeling with a class-based TF-IDF procedure
- Graph Contrastive Topic Model
- Potrika: Raw and Balanced Newspaper Datasets in the Bangla Language with Eight Topics and Five Attributes
- Mixing Dirichlet Topic Models and Word Embeddings to Make lda2vec
- Improving a tf-idf weighted document vector embedding
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering