Commits · fb96c1e98c05ffa35dd48416f68e88edb2f9eb34 · OpenDAS / vllm_cscc

15 Mar, 2024 1 commit
- Asynchronous tokenization (#2879) · fb96c1e9
  Antoni Baum authored Mar 15, 2024
  
  fb96c1e9
11 Mar, 2024 1 commit
- [BugFix] Fix get tokenizer when using ray (#3301) · 9e8744a5
  Roy authored Mar 11, 2024
  
  9e8744a5
23 Jan, 2024 1 commit

[Experimental] Add multi-LoRA support (#1804) · 9b945daa

Antoni Baum authored Jan 24, 2024


Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

9b945daa

17 Dec, 2023 1 commit
- [Minor] Delete Llama tokenizer warnings (#2146) · 3d1cfbfc
  Woosuk Kwon authored Dec 16, 2023
  
  3d1cfbfc
01 Dec, 2023 1 commit
- Fix Baichuan tokenizer error (#1874) · d06980df
  Woosuk Kwon authored Nov 30, 2023
  
  d06980df
30 Oct, 2023 1 commit
- Add support for `spaces_between_special_tokens` · 7013a801
  Dan Lord authored Oct 30, 2023
  
  7013a801
29 Oct, 2023 1 commit
- fix: don't skip first special token. (#1497) · beac8dd4
  Ricardo Lu authored Oct 29, 2023
  
  beac8dd4
13 Oct, 2023 1 commit
- Improve detokenization performance (#1338) · ec3b5ce9
  Antoni Baum authored Oct 13, 2023
  
  ec3b5ce9
03 Oct, 2023 1 commit
- add support for tokenizer revision (#1163) · 66d18a7f
  Federico Cassano authored Oct 02, 2023
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  66d18a7f
15 Sep, 2023 1 commit
- Fix warning message on LLaMA FastTokenizer (#1037) · 64ca424e
  Woosuk Kwon authored Sep 14, 2023
  
  64ca424e
14 Sep, 2023 1 commit
- Fix detokenization leaving special tokens (#1044) · dd54a4b0
  Antoni Baum authored Sep 14, 2023
```
Signed-off-by: Antoni Baum <antoni.baum@protonmail.com>
```
  dd54a4b0
13 Sep, 2023 1 commit
- Use TGI-like incremental detokenization (#984) · 9841d48a
  Antoni Baum authored Sep 13, 2023
  
  9841d48a
04 Sep, 2023 1 commit
- Only emit warning about internal tokenizer if it isn't being used (#939) · e15932bb
  Nelson Liu authored Sep 04, 2023
  
  e15932bb
15 Aug, 2023 1 commit
- Fix typo in tokenizer.py (#750) · 805de738
  Ikko Eltociear Ashimine authored Aug 15, 2023
```
conjuction -> conjunction
```
  805de738
12 Jul, 2023 1 commit
- Fix handling of special tokens in decoding. (#418) · c6dfc3cd
  xcnick authored Jul 12, 2023
  
  c6dfc3cd
08 Jul, 2023 1 commit
- Add trust_remote_code arg to get_config (#405) · ddfdf470
  Woosuk Kwon authored Jul 08, 2023
  
  ddfdf470
07 Jul, 2023 1 commit
- Add trust-remote-code flag to handle remote tokenizers (#364) · a945fcc2
  codethazine authored Jul 07, 2023
  
  a945fcc2
03 Jul, 2023 1 commit
- [Quality] Add code formatter and linter (#326) · d6fa1be3
  Zhuohan Li authored Jul 03, 2023
  
  d6fa1be3
28 Jun, 2023 2 commits
- [Tokenizer] Add tokenizer mode (#298) · 998d9d15
  Woosuk Kwon authored Jun 28, 2023
  
  998d9d15
- [Tokenizer] Add an option to specify tokenizer (#284) · 4338cc47
  Woosuk Kwon authored Jun 28, 2023
  
  4338cc47
25 Jun, 2023 1 commit
- fix wrong using getattr to get dict value (#232) · 06033798
  metacryptom authored Jun 25, 2023
  
  06033798
20 Jun, 2023 1 commit
- Use slow tokenizer for open llama models (#168) · 67d96c29
  Woosuk Kwon authored Jun 19, 2023
  
  67d96c29
17 Jun, 2023 2 commits
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
- Rename servers to engines (#152) · e5464ee4
  Zhuohan Li authored Jun 17, 2023
  
  e5464ee4
07 Jun, 2023 1 commit
- Add docstrings for LLMServer and related classes and examples (#142) · 42983742
  Zhuohan Li authored Jun 07, 2023
  
  42983742
28 May, 2023 1 commit
- Enable LLaMA fast tokenizer (#132) · 337871c6
  Woosuk Kwon authored May 28, 2023
  
  337871c6
24 May, 2023 1 commit
- Incrementally decode output tokens (#121) · e8671783
  Woosuk Kwon authored May 23, 2023
  
  e8671783
20 May, 2023 1 commit
- Refactor system architecture (#109) · c3442c1f
  Woosuk Kwon authored May 20, 2023
  
  c3442c1f
09 May, 2023 1 commit
- Use slow tokenizer for LLaMA (#84) · 85eb6318
  Woosuk Kwon authored May 09, 2023
  
  85eb6318