Metadata-Version: 2.4
Name: spillway
Version: 0.0.1
Summary: Congestion control for language model API traffic
Keywords: admission-control,concurrency,congestion-control,llm,rate-limiting
Author: Bharat Mehan
Author-email: Bharat Mehan <40287314+bharatmehan@users.noreply.github.com>
License-Expression: Apache-2.0
License-File: LICENSE
License-File: NOTICE
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Intended Audience :: Developers
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: System :: Networking
Classifier: Typing :: Typed
Requires-Python: >=3.10
Project-URL: Homepage, https://github.com/bharatmehan/spillway
Project-URL: Repository, https://github.com/bharatmehan/spillway
Project-URL: Changelog, https://github.com/bharatmehan/spillway/blob/main/CHANGELOG.md
Project-URL: Issues, https://github.com/bharatmehan/spillway/issues
Description-Content-Type: text/markdown

# Spillway

Congestion control for language model API traffic.

A Python library that decides whether a call to a language model API should proceed now, wait, or
be refused. It works on the resources that actually run out under load: request rate, concurrency,
and the amount of unfinished generation already committed. It is a library you import, not a
gateway you deploy.

## Status

Under development, and not yet usable. The version number is deliberately below 0.1 and there is
no public API yet. This release installs and reports its version. That is all it does.

Source and changelog: https://github.com/bharatmehan/spillway

## License

Apache 2.0.
