Skip to content

GitLab

"llm/ggml.c" did not exist on "c5bcf32823ec9870ab4f65943cf611c42a88f1e9"
Switch branch/tag
Find file Normal viewHistoryPermalink
requirements-rocm.txt 300 Bytes
Newer Older
TJian's avatar
Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)  
TJian committed
1
2
3
4 
ninja  # For faster builds.
typing-extensions>=4.8.0
starlette
psutil
Simon Mo's avatar
Update Ray version requirements (#2636)  
Simon Mo committed
5 
ray >= 2.9
TJian's avatar
Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)  
TJian committed
6
7
8 
sentencepiece  # Required for LLaMA tokenizer.
numpy
tokenizers>=0.15.0
Woosuk Kwon's avatar
[ROCm] Upgrade transformers to v4.38.0 (#2967)  
Woosuk Kwon committed
9 
transformers >= 4.38.0  # Required for Gemma.
TJian's avatar
Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)  
TJian committed
10
11 
fastapi
uvicorn[standard]
Jannis Schönleber's avatar
migrate pydantic from v1 to v2 (#2531)  
Jannis Schönleber committed
12 
pydantic >= 2.0  # Required for OpenAI server.
Allen.Dou's avatar
Restrict prometheus_client >= 0.18.0 to prevent errors when importing pkgs (#3070)  
Allen.Dou committed
13 
prometheus_client >= 0.18.0