litellm
openai>=2.0
numpy
tqdm
pyrate-limiter>=4.4,<5