Skip to content

GitLab

"vllm/entrypoints/openai/protocol.py" did not exist on "057daef778ec4e951841f44afda1cd0b1eb50ee4"
Commit c84c708a authored by Woosuk Kwon's avatar Woosuk Kwon
Browse files

Add README

parent fa16389a
Show whitespace changes
Inline Side-by-side
Showing with 13 additions and 0 deletions
README.md
View file @ c84c708a
# CacheFlow # CacheFlow
## Installation
```bash
pip install cmake torch transformers
pip install -e .
```
## Run
```bash
python server.py
```
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment