Metadata-Version: 2.1
Name: bnltk
Version: 0.7.8
Summary: BNLTK(Bangla Natural Language Processing Toolkit)
Home-page: https://github.com/ashwoolford/bnltk
Author: Asraf Patoary
Author-email: asrafhossain197@gmail.com
License: UNKNOWN
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: black==24.10.0
Requires-Dist: keras==3.6.0
Requires-Dist: numpy==2.0.2
Requires-Dist: requests==2.32.3
Requires-Dist: scikit-learn==1.5.2
Requires-Dist: tensorflow==2.18.0

# BNLTK

[![License: MIT](https://img.shields.io/badge/License-MIT-brightgreen.svg)](https://opensource.org/licenses/MIT)
[![Downloads](https://static.pepy.tech/badge/bnltk)](https://pepy.tech/project/bnltk)



BNLTK(Bangla Natural Language Processing Toolkit) is an open-source python package for Natural Language Processing in Bangla. It offers functionalities to perform some basic NLP tasks such as Tokenization, Stemming and Parts of speech tagging. BNLTK requires Python version 3.6, 3.7, 3.8, 3.9 or 3.10.

Web documentation: [https://ashwoolford.github.io/bnltk/](https://ashwoolford.github.io/bnltk/)

## installation

```
pip install bnltk 
```

**Note**: If you are using version 0.7.6, please see the documentation [here](#version-076)


## Version 0.7.8 (latest)

### Tokenizer

```
from bnltk.tokenize import Tokenizers
t = Tokenizers()
print(t.bn_word_tokenizer('আজ আবহাওয়া খুব ভালো।'))
# ["আজ", "আবহাওয়া", "খুব", "ভালো", "।"]
```

### Stemmer

```
from bnltk.stemmer import BanglaStemmer
bn_stemmer = BanglaStemmer()
print(bn_stemmer.stem('হেসেছিলেন'))
# হাসা
```

### Parts of speech tagger

To use the Parts of Speech Tagger, please download the pretrained model's weights. Our trained model achieves an accuracy of 96%
```
from bnltk.bnltk_downloads import DataFiles
DataFiles.download()	
```
After successfully downloading the files, you can use this module as follows:

```
from bnltk.pos_tagger import PosTagger

p_tagger = PosTagger()
print(p_tagger.tagger('দুশ্চিন্তার কোন কারণই নাই'))  
# [('দুশ্চিন্তার', 'NC'), ('কোন', 'JQ'), ('কারণই', 'NC'), ('নাই', 'VM')]
```

## Version 0.7.6

### Tokenizer

```
from bnltk.tokenize import Tokenizers
t = Tokenizers()
print(t.bn_word_tokenizer('আজ আবহাওয়া খুব ভালো।'))
# ["আজ", "আবহাওয়া", "খুব", "ভালো"]
```

### Stemmer

```
from bnltk.stemmer import BanglaStemmer
bn_stemmer = BanglaStemmer()
print(bn_stemmer.stem('হেসেছিলেন'))
# হাসা
```

### Parts of speech tagger

To use the Parts of Speech Tagger, please download the pretrained model's weights. Our trained model achieves an accuracy of 96%
```
from bnltk.bnltk_downloads import DataFiles
DataFiles().download()	
```
After successfully downloading the files, you can use this module as follows:

```
from bnltk.pos_tagger import PosTagger

p_tagger = PosTagger()
p_tagger.loader()
print(p_tagger.tagger('দুশ্চিন্তার কোন কারণই নাই'))  
# [('দুশ্চিন্তার', 'NC'), ('কোন', 'JQ'), ('কারণই', 'NC'), ('নাই', 'VM')]
```

### Description of the POS tag set

| Categories            | Types                 |
|-----------------------|-----------------------|
| Noun (N)              | Common (NC)           |
|                       | Proper (NP)           |
|                       | Verbal (NV)           |
|                       | Spatio-temporal (NST) |
| Pronoun (P)           | Pronominal (PPR)      |
|                       | Reflexive (PRF)       |
|                       | Reciprocal (PRC)      |
|                       | Relative (PRL)        |
|                       | Wh (PWH)              |
|                       |                       |
| Nominal Modifier (J)  | Adjectives (JJ)       |
|                       | Quantifiers (JQ)      |
| Demonstratives (D)    | Absolutive (DAB)      |
|                       | Relative (DRL)        |
|                       | Wh (DWH)              |
| Adverb (A)            | Manner (AMN)          |
|                       | Location (ALC)        |
| Participle (L)        | Relative (LRL)        |
|                       | Verbal (LV)           |
| Postposition (PP)     |                       |
| Particles (C)         | Coordinating (CCD)    |
|                       | Subordinating (CSB)   |
|                       | Classifier (CCL)      |
|                       | Interjection (CIN)    |
|                       | Others (CX)           |
| Punctuations (PU)     |                       |
| Residual (RD)         | Foreign Word (RDF)    |
|                       | Symbol (RDS)          |
|                       | Other (RDX)           |




