fastapi
uvicorn
typer
pydantic
nvidia-ml-py
pyngrok
requests
