Metadata-Version: 2.1
Name: attention-kernels
Version: 0.2.0.post2
Summary: Attention kernels
Author-email: Daniël de Kok <me@danieldk.eu>
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Operating System :: OS Independent
Requires-Python: >=3.8
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: torch

## attention-kernels

`attention-kernels` is a standalone package with the paged attention and
cache reshape kernels from [vLLM](https://github.com/vllm-project/vllm), with modifications for TGI.
