Metadata-Version: 2.1
Name: biqwen
Version: 0.2.1
Summary: Tool for converting Qwen from uni-directional to bi-directional for tasks like classification and sentence embeddings.
Keywords: qwen,bidirectional,transformers,classification,sentence embeddings
Author-Email: clw200098 <clw200098@gmail.com>
License: MIT
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Project-URL: Homepage, https://github.com/clw8998/BiQwen
Requires-Python: >=3.8
Requires-Dist: transformers>=4.51.3
Requires-Dist: peft>=0.15.2
Requires-Dist: accelerate>=1.6.0
Requires-Dist: evaluate
Requires-Dist: seqeval
Description-Content-Type: text/markdown

# BiQwen

This module allows you to train a [Qwen model](https://huggingface.co/Qwen) with bidirectional attention.

## Installation

```bash
pip install biqwen
```

## Usage
### Qwen 3 Moe
See [examples/biqwen3_moe_ner.py](./examples/biqwen3_moe_ner.py) for usage examples.

### Qwen 3
See [examples/biqwen3_ner.py](./examples/biqwen3_ner.py) for usage examples.

### Qwen 2 (2.5)
See [examples/biqwen2_ner.py](./examples/biqwen2_ner.py) for usage examples.