Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
requirements.txt 296 Bytes
Newer Older
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
1
2 
ninja  # For faster builds.
psutil
Antoni Baum's avatar
Ray placement group support (#397)  
Antoni Baum committed
3 
ray >= 2.5.1
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
4
5
6
7
8
9
10 
sentencepiece  # Required for LLaMA tokenizer.
numpy
torch >= 2.0.0
transformers >= 4.28.0  # Required for LLaMA.
xformers >= 0.0.19
fastapi
uvicorn
Keming's avatar
fix: freeze pydantic to v1 (#429)  
Keming committed
11 
pydantic < 2  # Required for OpenAI server.
Zhuohan Li's avatar
[Server] Add option to specify chat template for chat endpoint (#345)  
Zhuohan Li committed
12 
fschat  # Required for OpenAI ChatCompletion Endpoint.