Commits · 2e0d3143844303136c8aefa4c7e7bac30fd26850 · norm / vllm

21 Jun, 2023 1 commit
- fix-ray (#193) · 2e0d3143
  Zhuohan Li authored Jun 22, 2023
  
  2e0d3143
20 Jun, 2023 9 commits
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
- Remove e.g. in README (#167) · 033f5c78
  Zhuohan Li authored Jun 20, 2023
  
  033f5c78
- [Minor] Fix URLs (#166) · 794e578d
  Woosuk Kwon authored Jun 19, 2023
  
  794e578d
- [Minor] Fix icons in doc (#165) · caddfc14
  Woosuk Kwon authored Jun 19, 2023
  
  caddfc14
- Change image urls (#164) · fc72e39d
  Zhuohan Li authored Jun 20, 2023
  
  fc72e39d
- Fix repo & documentation URLs (#163) · b7e62d34
  Woosuk Kwon authored Jun 19, 2023
  
  b7e62d34
- [Docs] Minor fix (#162) · 364536ac
  Woosuk Kwon authored Jun 19, 2023
  
  364536ac
- Add and list supported models in README (#161) · 0b32a987
  Zhuohan Li authored Jun 20, 2023
  
  0b32a987
- [PyPI] Fix package info in setup.py (#158) · 570fb2e9
  Woosuk Kwon authored Jun 19, 2023
  
  570fb2e9
19 Jun, 2023 4 commits
- Add logo and polish readme (#156) · a255885f
  Zhuohan Li authored Jun 19, 2023
  
  a255885f
- Add performance figures for dark mode (#160) · 5822ede6
  Woosuk Kwon authored Jun 18, 2023
  
  5822ede6
- Remove benchmark_async_llm_server.py (#155) · 0370afa2
  Zhuohan Li authored Jun 19, 2023
  
  0370afa2
- [Minor] Fix CompletionOutput.__repr__ (#157) · 7e2a913c
  Woosuk Kwon authored Jun 18, 2023
  
  7e2a913c
18 Jun, 2023 3 commits
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
- Write README and front page of doc (#147) · dcda03b4
  Woosuk Kwon authored Jun 18, 2023
  
  dcda03b4
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c
17 Jun, 2023 4 commits
- Add quickstart guide (#148) · bec7b2dc
  Zhuohan Li authored Jun 18, 2023
  
  bec7b2dc
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
- [Minor] Fix benchmark_throughput.py (#151) · bab8f3dd
  Woosuk Kwon authored Jun 16, 2023
  
  bab8f3dd
16 Jun, 2023 1 commit
- Rename servers and change port numbers to reduce confusion (#149) · eedb46bf
  Zhuohan Li authored Jun 17, 2023
  
  eedb46bf
15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
11 Jun, 2023 1 commit
- Remove redundant code in ColumnParallelLinear (#146) · da5ddcd5
  Woosuk Kwon authored Jun 10, 2023
  
  da5ddcd5
10 Jun, 2023 1 commit
- Non-streaming simple fastapi server (#144) · 5020e1e8
  Zhuohan Li authored Jun 11, 2023
  
  5020e1e8
07 Jun, 2023 2 commits
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
- Support FP32 (#141) · e38074b1
  Woosuk Kwon authored Jun 07, 2023
  
  e38074b1
06 Jun, 2023 2 commits
- [PyPI] Packaging for PyPI distribution (#140) · 376725ce
  Woosuk Kwon authored Jun 05, 2023
  
  376725ce
- [Docs] Write the `Adding a New Model` section (#138) · 456941cf
  Woosuk Kwon authored Jun 05, 2023
  
  456941cf
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
04 Jun, 2023 1 commit
- Add docstrings for LLM (#137) · 8274ca23
  Woosuk Kwon authored Jun 04, 2023
  
  8274ca23
03 Jun, 2023 2 commits
- Document supported models (#127) · 62ec38ea
  Woosuk Kwon authored Jun 02, 2023
  
  62ec38ea
- Add .readthedocs.yaml (#136) · 0eda2e09
  Woosuk Kwon authored Jun 02, 2023
  
  0eda2e09
28 May, 2023 2 commits
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4
- Enable LLaMA fast tokenizer (#132) · 337871c6
  Woosuk Kwon authored May 28, 2023
  
  337871c6
27 May, 2023 2 commits
- Add a doc for installation (#128) · 56b7f0ef
  Woosuk Kwon authored May 27, 2023
  
  56b7f0ef
- Improve setup script & Add a guard for bfloat16 kernels (#130) · d7211684
  Woosuk Kwon authored May 27, 2023
  
  d7211684
25 May, 2023 1 commit
- Add activation registry (#126) · 4a151dd4
  Woosuk Kwon authored May 25, 2023
  
  4a151dd4
24 May, 2023 2 commits
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
- Incrementally decode output tokens (#121) · e8671783
  Woosuk Kwon authored May 23, 2023
  
  e8671783