accelerate<=1.5.1
datasets
py-cpuinfo
sentencepiece
numpy<2.0
tqdm
packaging
pillow
numba
tbb
transformers
threadpoolctl
