torch
transformers
# vllm==0.6.2
tqdm