Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
requirements.txt 318 Bytes
Newer Older
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
1
2 
ninja  # For faster builds.
psutil
Antoni Baum's avatar
Ray placement group support (#397)  
Antoni Baum committed
3 
ray >= 2.5.1
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
4
5 
sentencepiece  # Required for LLaMA tokenizer.
numpy
Woosuk Kwon's avatar
Pin PyTorch & xformers versions (#2155)  
Woosuk Kwon committed
6 
torch == 2.1.2
Woosuk Kwon's avatar
Upgrade transformers version to 4.36.0 (#2046)  
Woosuk Kwon committed
7 
transformers >= 4.36.0  # Required for Mixtral.
Woosuk Kwon's avatar
[Minor] Fix xformers version (#2158)  
Woosuk Kwon committed
8 
xformers == 0.0.23.post1  # Required for CUDA 12.1.
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
9 
fastapi
Danilo Peixoto's avatar
Use standard extras for uvicorn (#1166)  
Danilo Peixoto committed
10 
uvicorn[standard]
Thiago Salvatore's avatar
Pin pydantic dependency versions (#1429)  
Thiago Salvatore committed
11 
pydantic == 1.10.13  # Required for OpenAI server.
Simon Mo's avatar
Add Production Metrics in Prometheus format (#1890)  
Simon Mo committed
12 
aioprometheus[starlette]