Metadata-Version: 2.1
Name: autoarena
Version: 0.1.0b3
Summary: 
License: Apache-2.0
Author: Kolena Engineering
Author-email: eng@kolena.com
Requires-Python: >=3.10,<3.13
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Dist: anthropic (>=0.34.1,<0.35.0)
Requires-Dist: cohere (>=5.9.0,<6.0.0)
Requires-Dist: coolname (>=2.2.0,<3.0.0)
Requires-Dist: duckdb (>=1.0.0,<2.0.0)
Requires-Dist: fastapi (>=0.112.2,<0.113.0)
Requires-Dist: google-generativeai (>=0.7.2,<0.8.0)
Requires-Dist: loguru (>=0.7.2,<0.8.0)
Requires-Dist: ollama (>=0.3.2,<0.4.0)
Requires-Dist: openai (>=1.43.0,<2.0.0)
Requires-Dist: pandas (>=2.2.2,<3.0.0)
Requires-Dist: pyarrow (>=17.0.0,<18.0.0)
Requires-Dist: python-multipart (>=0.0.9,<0.0.10)
Requires-Dist: tenacity (>=9.0.0,<10.0.0)
Requires-Dist: torch (>=2.4.0,<3.0.0)
Requires-Dist: tqdm (>=4.66.5,<5.0.0)
Requires-Dist: transformers (>=4.44.2,<5.0.0)
Requires-Dist: uvicorn (>=0.30.6,<0.31.0)
Description-Content-Type: text/markdown

# AutoArena

AutoArena helps you stack rank LLM outputs against one another using automated judge evaluation. Run with:

```
python3 -m autoarena
```

Data is stored in an `autoarena.duckdb` file on your local machine.

## Development

To set up this repository for development, run:

```shell
poetry update && poetry install
poerty run pre-commit install
poetry run python3 -m autoarena
```

To run AutoArena for development, you will need to run both the backend and frontend service:

- Backend: `poetry run python3 -m autoarena --dev` (the `--dev`/`-d` flag enables automatic service reloading when
    source files change)
- Frontend: see [`ui/README.md`](./ui/README.md)

To build a release tarball in the `./dist` directory:

```
./scripts/build.sh
```

