Commits · 58a072be15a4e36bee006d1c9a962e527819cf18 · kecinstone / 2024pra-vllm

26 Jul, 2023 1 commit
- [Fix] Add model sequence length into model config (#575) · 58a072be
  Zhuohan Li authored Jul 25, 2023
  
  58a072be
20 Jul, 2023 3 commits
- Fix bad assert in initialize_cluster if PG already exists (#526) · c487a221
  Antoni Baum authored Jul 19, 2023
  
  c487a221
- Ray placement group support (#397) · 9925c179
  Antoni Baum authored Jul 19, 2023
  
  9925c179
- fix(ray_utils): ignore re-init error (#465) · 16c3e295
  Massimiliano Pronesti authored Jul 20, 2023
  
  16c3e295
18 Jul, 2023 1 commit
- fix max seq len (#489) · b4b195b3
  Lily Liu authored Jul 17, 2023
  
  b4b195b3
17 Jul, 2023 1 commit
- [Fix] Fix the condition of max_seq_len (#477) · 2bdea7ac
  Zhuohan Li authored Jul 17, 2023
  
  2bdea7ac
16 Jul, 2023 1 commit
- Offload port selection to OS (#467) · 6d7d95a7
  Zhangir Azerbayev authored Jul 16, 2023
  
  6d7d95a7
12 Jul, 2023 1 commit
- Fix handling of special tokens in decoding. (#418) · c6dfc3cd
  xcnick authored Jul 12, 2023
  
  c6dfc3cd
07 Jul, 2023 1 commit
- Add trust-remote-code flag to handle remote tokenizers (#364) · a945fcc2
  codethazine authored Jul 07, 2023
  
  a945fcc2
03 Jul, 2023 3 commits
- Fix an endless loop issue when engine_step throws a RuntimeError (#339) · 7717d083
  coolcloudcol authored Jul 04, 2023
  
  7717d083
- [Quality] Add CI for formatting (#343) · 42e0c1df
  Zhuohan Li authored Jul 03, 2023
  
  42e0c1df
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
01 Jul, 2023 1 commit
- Raise error for long prompt (#273) · dafd924c
  Lily Liu authored Jun 30, 2023
  
  dafd924c
28 Jun, 2023 2 commits
- [Tokenizer] Add tokenizer mode (#298) · 998d9d15
  Woosuk Kwon authored Jun 28, 2023
  
  998d9d15
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
26 Jun, 2023 1 commit
- [Bug] Fix the OOM condition for CPU cache (#260) · 0b7db411
  Zhuohan Li authored Jun 26, 2023
  
  0b7db411
25 Jun, 2023 1 commit
- fix wrong using getattr to get dict value (#232) · 06033798
  metacryptom authored Jun 25, 2023
  
  06033798
22 Jun, 2023 2 commits
- [Fix] Better error message when there is OOM during cache initialization (#203) · 1d24ccb9
  Zhuohan Li authored Jun 22, 2023
  
  1d24ccb9
- [Bugfix] Fix a bug in RequestOutput.finished (#202) · 14f0b39c
  Woosuk Kwon authored Jun 22, 2023
  
  14f0b39c
21 Jun, 2023 1 commit
- fix-ray (#193) · 2e0d3143
  Zhuohan Li authored Jun 22, 2023
  
  2e0d3143
20 Jun, 2023 1 commit
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
18 Jun, 2023 1 commit
- Reduce GPU memory utilization to make sure OOM doesn't happen (#153) · bf5f121c
  Zhuohan Li authored Jun 18, 2023
  
  bf5f121c
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15