Metadata-Version: 2.1
Name: briton
Version: 0.2.0.dev0
Summary: Python component of using Briton
License: MIT
Author: Pankaj Gupta
Author-email: pankaj@baseten.co
Requires-Python: >=3.10,<4.0
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Dist: fastapi (>=0.114.0,<0.115.0)
Requires-Dist: grpcio (>=1.62.3,<2.0.0)
Requires-Dist: grpcio-tools (>=1.62.3,<2.0.0)
Requires-Dist: hf-transfer (>=0.1.8,<0.2.0)
Requires-Dist: huggingface-hub (>=0.25.2,<0.26.0)
Requires-Dist: openai (>=1.51.2,<2.0.0)
Requires-Dist: outlines (==0.0.46)
Requires-Dist: pydantic (>=2.9.2,<3.0.0)
Requires-Dist: sentencepiece (>=0.2.0,<0.3.0)
Requires-Dist: torch (>=2.4.1,<3.0.0)
Requires-Dist: transformers (>=4.45.2,<5.0.0)
Description-Content-Type: text/markdown

# Briton

The python side of Briton. Briton server is written in C++ for high performance
and provides a grpc endpoint for interaction. A major function of this python
libarary is to provide easier interaction with the Briton Server. e.g. there's
logic to startup the Briton server and ensure it's healthy. It also provides
adapters for using Briton from Truss. For certain features, such as draft model
based speculative decoding, a subtantial chunk of the implementation is in this
library.

## Running tests

```
poetry run pytest
```

## Formatting code

```
poetry run ./format.sh
```

## Manually publishing to PyPi

Before running this, please increment the version appropriately in pyproject.toml.

Find the `basetenbot` credentials in 1Password, which can be used to sign into PyPi
and generate a token. This token can be saved in your `.pypirc` as follow:

```
[distutils]
  index-servers =
    pypi

[pypi]
  username = __token__
  password = # either a user-scoped token or a project-scoped token you want to set as the default
```

Or entered into the CLI when prompted by `twine upload` below:

```
rm -rf dist
poetry build
poetry run twine upload dist/*
```

