Commits · dcda03b4cb2c757682abe0faf14a6379dcde1cb2 · norm / vllm

18 Jun, 2023 2 commits
- Write README and front page of doc (#147) · dcda03b4
  Woosuk Kwon authored Jun 18, 2023
  
  dcda03b4
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c
17 Jun, 2023 4 commits
- Add quickstart guide (#148) · bec7b2dc
  Zhuohan Li authored Jun 18, 2023
  
  bec7b2dc
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
- [Minor] Fix benchmark_throughput.py (#151) · bab8f3dd
  Woosuk Kwon authored Jun 16, 2023
  
  bab8f3dd
16 Jun, 2023 1 commit
- Rename servers and change port numbers to reduce confusion (#149) · eedb46bf
  Zhuohan Li authored Jun 17, 2023
  
  eedb46bf
15 Jun, 2023 1 commit
- Add script for benchmarking serving throughput (#145) · 311490a7
  Woosuk Kwon authored Jun 14, 2023
  
  311490a7
11 Jun, 2023 1 commit
- Remove redundant code in ColumnParallelLinear (#146) · da5ddcd5
  Woosuk Kwon authored Jun 10, 2023
  
  da5ddcd5
10 Jun, 2023 1 commit
- Non-streaming simple fastapi server (#144) · 5020e1e8
  Zhuohan Li authored Jun 11, 2023
  
  5020e1e8
07 Jun, 2023 2 commits
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
- Support FP32 (#141) · e38074b1
  Woosuk Kwon authored Jun 07, 2023
  
  e38074b1
06 Jun, 2023 2 commits
- [PyPI] Packaging for PyPI distribution (#140) · 376725ce
  Woosuk Kwon authored Jun 05, 2023
  
  376725ce
- [Docs] Write the `Adding a New Model` section (#138) · 456941cf
  Woosuk Kwon authored Jun 05, 2023
  
  456941cf
05 Jun, 2023 1 commit
- Fix various issues of async servers (#135) · 1a956e13
  Zhuohan Li authored Jun 05, 2023
  
  1a956e13
04 Jun, 2023 1 commit
- Add docstrings for LLM (#137) · 8274ca23
  Woosuk Kwon authored Jun 04, 2023
  
  8274ca23
03 Jun, 2023 2 commits
- Document supported models (#127) · 62ec38ea
  Woosuk Kwon authored Jun 02, 2023
  
  62ec38ea
- Add .readthedocs.yaml (#136) · 0eda2e09
  Woosuk Kwon authored Jun 02, 2023
  
  0eda2e09
28 May, 2023 2 commits
- Add throughput benchmarking script (#133) · 211318d4
  Woosuk Kwon authored May 28, 2023
  
  211318d4
- Enable LLaMA fast tokenizer (#132) · 337871c6
  Woosuk Kwon authored May 28, 2023
  
  337871c6
27 May, 2023 2 commits
- Add a doc for installation (#128) · 56b7f0ef
  Woosuk Kwon authored May 27, 2023
  
  56b7f0ef
- Improve setup script & Add a guard for bfloat16 kernels (#130) · d7211684
  Woosuk Kwon authored May 27, 2023
  
  d7211684
25 May, 2023 1 commit
- Add activation registry (#126) · 4a151dd4
  Woosuk Kwon authored May 25, 2023
  
  4a151dd4
24 May, 2023 4 commits
- OpenAI Compatible Frontend (#116) · 057daef7
  Zhuohan Li authored May 23, 2023
  
  057daef7
- Incrementally decode output tokens (#121) · e8671783
  Woosuk Kwon authored May 23, 2023
  
  e8671783
- Print warnings/errors for large swap space (#123) · aedba6d5
  Woosuk Kwon authored May 23, 2023
  
  aedba6d5
- Add contributing guideline and mypy config (#122) · a283ec2e
  Woosuk Kwon authored May 23, 2023
  
  a283ec2e
23 May, 2023 2 commits
- Fix latency benchmark script (#118) · 3f942acf
  Woosuk Kwon authored May 22, 2023
  
  3f942acf
- Add initial sphinx docs (#120) · 19d28994
  Woosuk Kwon authored May 22, 2023
  
  19d28994
22 May, 2023 1 commit
- Introduce LLM class for offline inference (#115) · 655a5e48
  Woosuk Kwon authored May 21, 2023
  
  655a5e48
21 May, 2023 1 commit
- Implement stop strings and best_of (#114) · f746ced0
  Woosuk Kwon authored May 21, 2023
  
  f746ced0
20 May, 2023 2 commits
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f
- Remove unused parts in Megatron-LM code and add copyright notice (#110) · 7297fa6f
  Zhuohan Li authored May 20, 2023
  
  7297fa6f
19 May, 2023 2 commits
- Fix timeout error in the FastAPI frontend (#34) · b7955ef1
  Zhuohan Li authored May 19, 2023
  
  b7955ef1
- Use runtime profiling to replace manual memory analyzers (#81) · f756799b
  Zhuohan Li authored May 19, 2023
  
  f756799b
18 May, 2023 1 commit
- Use pytest format for unit tests (#107) · 825d8892
  Woosuk Kwon authored May 17, 2023
  
  825d8892
15 May, 2023 4 commits
- Add docstrings to some modules and classes (#100) · b322fd16
  Woosuk Kwon authored May 14, 2023
  
  b322fd16
- Add copyright headers to source files adapted from FT (#104) · 667ba399
  Woosuk Kwon authored May 14, 2023
  
  667ba399
- Add copyright headers for HF models (#103) · 707ec647
  Woosuk Kwon authored May 14, 2023
  
  707ec647
- Add Apache-2.0 license (#102) · 89988ec8
  Woosuk Kwon authored May 14, 2023
  
  89988ec8