Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
requirements.txt 325 Bytes
Newer Older
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
1
2 
ninja  # For faster builds.
psutil
Simon Mo's avatar
Update Ray version requirements (#2636)  
Simon Mo committed
3 
ray >= 2.9
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
4
5 
sentencepiece  # Required for LLaMA tokenizer.
numpy
Woosuk Kwon's avatar
Pin PyTorch & xformers versions (#2155)  
Woosuk Kwon committed
6 
torch == 2.1.2
Junyang Lin's avatar
Add qwen2 (#2495)  
Junyang Lin committed
7 
transformers >= 4.37.0 # Required for Qwen2
Woosuk Kwon's avatar
[Minor] Fix xformers version (#2158)  
Woosuk Kwon committed
8 
xformers == 0.0.23.post1  # Required for CUDA 12.1.
Woosuk Kwon's avatar
Specify python package dependencies in requirements.txt (#78)  
Woosuk Kwon committed
9 
fastapi
Danilo Peixoto's avatar
Use standard extras for uvicorn (#1166)  
Danilo Peixoto committed
10 
uvicorn[standard]
Jannis Schönleber's avatar
migrate pydantic from v1 to v2 (#2531)  
Jannis Schönleber committed
11 
pydantic >= 2.0  # Required for OpenAI server.
Simon Mo's avatar
Add Production Metrics in Prometheus format (#1890)  
Simon Mo committed
12 
aioprometheus[starlette]
Hanzhi Zhou's avatar
Implement custom all reduce kernels (#2192)  
Hanzhi Zhou committed
13 
pynvml == 11.5.0