Metadata-Version: 2.4
Name: bytoken
Version: 0.1.5
Summary: A fast C++ BPE tokenizer with Python bindings
Author: Vaibhav Sharma
License: MIT
Requires-Python: >=3.7
Dynamic: author
Dynamic: license
Dynamic: requires-python
Dynamic: summary
