Metadata-Version: 2.3
Name: langbench
Version: 0.0.2
Summary: A benchmarking tool for langchain based LLM pipelines.
License: MIT
Author: ameen-91
Author-email: mohammedameen9011@gmail.com
Requires-Python: >=3.10,<4.0
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Dist: ipykernel (>=6.29.5,<7.0.0)
Requires-Dist: ipywidgets (>=8.1.5,<9.0.0)
Requires-Dist: langchain (>=0.3.18,<0.4.0)
Requires-Dist: langchain-openai (>=0.3.6,<0.4.0)
Requires-Dist: numpy (>=1.26.4,<2)
Requires-Dist: pandas (>=2.2.3,<3.0.0)
Requires-Dist: plotly (>=6.0.0,<7.0.0)
Requires-Dist: pyyaml (>=6.0.2,<7.0.0)
Requires-Dist: torch (>=2.6.0,<3.0.0)
Requires-Dist: tqdm (>=4.67.1,<5.0.0)
Requires-Dist: transformers (>=4.48.3,<5.0.0)
Requires-Dist: typer (>=0.15.1,<0.16.0)
Description-Content-Type: text/markdown

# langbench

![PyPI - Version](https://img.shields.io/pypi/v/langbench)
![Python](https://img.shields.io/badge/python-3.11-blue.svg)
![PyPI - Downloads](https://img.shields.io/pypi/dw/langbench)
[![CI](https://github.com/micvitc/langbench/actions/workflows/ci.yaml/badge.svg)](https://github.com/micvitc/langbench/actions/workflows/ci.yaml)

`langbench` is an easy to use benchmarking library for langchain based LLM pipelines.

## Installation

```bash

pip install langbench

```

## Metrics

`langbench` provides the following metrics:

- `toxicity`: Toxicity of the generated text.
- `bias`: Bias of the generated text, including:
    - political
    - gender
    - racial
    - educational
    - nationality
    - religious
    - others
- `latency`: Latency of the generated text.

Reports are generated in the form of an html file.

## Documentation

The official documentation is available at [langbench](https://micvitc.github.io/langbench/).

## License

This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.




