Commits · 0b7db411b5af4bf8a3a0cf989daa024ba5401ac1 · norm / vllm

26 Jun, 2023 2 commits
- [Bug] Fix the OOM condition for CPU cache (#260) · 0b7db411
  Zhuohan Li authored Jun 26, 2023
  
  0b7db411
- Compatible with Decapoda Research llama hf version (#251) · 471a7a45
  BasicCoder authored Jun 27, 2023
  
  471a7a45
25 Jun, 2023 2 commits
- Update README.md (#236) · 6214dd6c
  Lianmin Zheng authored Jun 25, 2023
  
  6214dd6c
- fix wrong using getattr to get dict value (#232) · 06033798
  metacryptom authored Jun 25, 2023
  
  06033798
22 Jun, 2023 5 commits
- [Docs] Add GPTBigCode to supported models (#213) · 665c4896
  Woosuk Kwon authored Jun 22, 2023
  
  665c4896
- GPTBigCode (StarCoder, SantaCoder Support) (#209) · 298695b7
  Michael Feil authored Jun 22, 2023
  
  298695b7
- Bump up version to 0.1.1 (#204) · 83658c8a
  Zhuohan Li authored Jun 22, 2023
  
  83658c8a
- [Fix] Better error message when there is OOM during cache initialization (#203) · 1d24ccb9
  Zhuohan Li authored Jun 22, 2023
  
  1d24ccb9
- [Bugfix] Fix a bug in RequestOutput.finished (#202) · 14f0b39c
  Woosuk Kwon authored Jun 22, 2023
  
  14f0b39c
21 Jun, 2023 1 commit
- fix-ray (#193) · 2e0d3143
  Zhuohan Li authored Jun 22, 2023
  
  2e0d3143
20 Jun, 2023 9 commits
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
- Remove e.g. in README (#167) · 033f5c78
  Zhuohan Li authored Jun 20, 2023
  
  033f5c78
- [Minor] Fix URLs (#166) · 794e578d
  Woosuk Kwon authored Jun 19, 2023
  
  794e578d
- [Minor] Fix icons in doc (#165) · caddfc14
  Woosuk Kwon authored Jun 19, 2023
  
  caddfc14
- Change image urls (#164) · fc72e39d
  Zhuohan Li authored Jun 20, 2023
  
  fc72e39d
- Fix repo & documentation URLs (#163) · b7e62d34
  Woosuk Kwon authored Jun 19, 2023
  
  b7e62d34
- [Docs] Minor fix (#162) · 364536ac
  Woosuk Kwon authored Jun 19, 2023
  
  364536ac
- Add and list supported models in README (#161) · 0b32a987
  Zhuohan Li authored Jun 20, 2023
  
  0b32a987
- [PyPI] Fix package info in setup.py (#158) · 570fb2e9
  Woosuk Kwon authored Jun 19, 2023
  
  570fb2e9
19 Jun, 2023 4 commits
- Add logo and polish readme (#156) · a255885f
  Zhuohan Li authored Jun 19, 2023
  
  a255885f
- Add performance figures for dark mode (#160) · 5822ede6
  Woosuk Kwon authored Jun 18, 2023
  
  5822ede6
- Remove benchmark_async_llm_server.py (#155) · 0370afa2
  Zhuohan Li authored Jun 19, 2023
  
  0370afa2
- [Minor] Fix CompletionOutput.__repr__ (#157) · 7e2a913c
  Woosuk Kwon authored Jun 18, 2023
  
  7e2a913c
18 Jun, 2023 3 commits
- Add comments on swap space (#154) · 3f92038b
  Woosuk Kwon authored Jun 18, 2023
  
  3f92038b
- Write README and front page of doc (#147) · dcda03b4
  Woosuk Kwon authored Jun 18, 2023
  
  dcda03b4
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c
17 Jun, 2023 4 commits
- Add quickstart guide (#148) · bec7b2dc
  Zhuohan Li authored Jun 18, 2023
  
  bec7b2dc
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
- [Minor] Fix benchmark_throughput.py (#151) · bab8f3dd
  Woosuk Kwon authored Jun 16, 2023
  
  bab8f3dd
16 Jun, 2023 1 commit
- Rename servers and change port numbers to reduce confusion (#149) · eedb46bf
  Zhuohan Li authored Jun 17, 2023
  
  eedb46bf
15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
11 Jun, 2023 1 commit
- Remove redundant code in ColumnParallelLinear (#146) · da5ddcd5
  Woosuk Kwon authored Jun 10, 2023
  
  da5ddcd5
10 Jun, 2023 1 commit
- Non-streaming simple fastapi server (#144) · 5020e1e8
  Zhuohan Li authored Jun 11, 2023
  
  5020e1e8
07 Jun, 2023 2 commits
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
- Support FP32 (#141) · e38074b1
  Woosuk Kwon authored Jun 07, 2023
  
  e38074b1
06 Jun, 2023 2 commits
- [PyPI] Packaging for PyPI distribution (#140) · 376725ce
  Woosuk Kwon authored Jun 05, 2023
  
  376725ce
- [Docs] Write the `Adding a New Model` section (#138) · 456941cf
  Woosuk Kwon authored Jun 05, 2023
  
  456941cf
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
04 Jun, 2023 1 commit
- Add docstrings for LLM (#137) · 8274ca23
  Woosuk Kwon authored Jun 04, 2023
  
  8274ca23