Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
requirements-rocm.txt 302 Bytes
Newer Older
TJian's avatar
Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)  
TJian committed
1
2
3
4 
ninja  # For faster builds.
typing-extensions>=4.8.0
starlette
psutil
zhuwenwen's avatar
update ray==2.9.3  
zhuwenwen committed
5 
ray == 2.9.3
TJian's avatar
Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)  
TJian committed
6
7
8 
sentencepiece  # Required for LLaMA tokenizer.
numpy
tokenizers>=0.15.0
Woosuk Kwon's avatar
[ROCm] Upgrade transformers to v4.38.0 (#2967)  
Woosuk Kwon committed
9 
transformers >= 4.38.0  # Required for Gemma.
TJian's avatar
Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)  
TJian committed
10
11 
fastapi
uvicorn[standard]
Jannis Schönleber's avatar
migrate pydantic from v1 to v2 (#2531)  
Jannis Schönleber committed
12 
pydantic >= 2.0  # Required for OpenAI server.
Allen.Dou's avatar
Restrict prometheus_client >= 0.18.0 to prevent errors when importing pkgs (#3070)  
Allen.Dou committed
13 
prometheus_client >= 0.18.0