Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
requirements.txt 379 Bytes
Newer Older
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
1
2 
ninja  # For faster builds.
psutil
Antoni Baum's avatar
Ray placement group support (#397)  
Antoni Baum committed
3 
ray >= 2.5.1
Woosuk Kwon's avatar
Add pandas to requirements.txt (#1047)  
Woosuk Kwon committed
4 
pandas  # Required for Ray data.
Woosuk Kwon's avatar
Add pyarrow to dependencies & Print warning on Ray import error (#1094)  
Woosuk Kwon committed
5 
pyarrow  # Required for Ray data.
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
6
7 
sentencepiece  # Required for LLaMA tokenizer.
numpy
Woosuk Kwon's avatar
Pin PyTorch & xformers versions (#2155)  
Woosuk Kwon committed
8 
torch == 2.1.2
Woosuk Kwon's avatar
Upgrade transformers version to 4.36.0 (#2046)  
Woosuk Kwon committed
9 
transformers >= 4.36.0  # Required for Mixtral.
Woosuk Kwon's avatar
Pin PyTorch & xformers versions (#2155)  
Woosuk Kwon committed
10 
xformers == 0.0.23  # Required for CUDA 12.1.
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
11 
fastapi
Danilo Peixoto's avatar
Use standard extras for uvicorn (#1166)  
Danilo Peixoto committed
12 
uvicorn[standard]
Thiago Salvatore's avatar
Pin pydantic dependency versions (#1429)  
Thiago Salvatore committed
13 
pydantic == 1.10.13  # Required for OpenAI server.
Simon Mo's avatar
Add Production Metrics in Prometheus format (#1890)  
Simon Mo committed
14 
aioprometheus[starlette]