Commits · ff7ec82c4dd6170ea8fedbd4d974c0a670e84c97 · OpenDAS / vllm_cscc

19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
14 Aug, 2024 1 commit
- Fix empty output when temp is too low (#2937) · c134a464
  Chang Su authored Aug 13, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c134a464
07 Aug, 2024 1 commit
- [BUGFIX]: top_k is expected to be an integer. (#7227) · 7b261092
  Atilla Akkuş authored Aug 07, 2024
  
  7b261092
29 Jul, 2024 1 commit
- [Core] Reduce unnecessary compute when logprobs=None (#6532) · db9e5708
  Peng Guanwen authored Jul 30, 2024
  
  db9e5708
23 Jul, 2024 1 commit
- [Misc] Remove deprecation warning for beam search (#6659) · bdf5fd13
  Woosuk Kwon authored Jul 22, 2024
  
  bdf5fd13
15 Jul, 2024 1 commit
- Report usage for beam search (#6404) · 32c9d7f7
  Simon Mo authored Jul 14, 2024
  
  32c9d7f7
13 Jul, 2024 1 commit
- [Misc] Add deprecation warning for beam search (#6402) · eeceadae
  Woosuk Kwon authored Jul 13, 2024
  
  eeceadae
27 Jun, 2024 1 commit
- [BugFix] Fix `min_tokens` behaviour for multiple eos tokens (#5849) · 365791ff
  Nick Hill authored Jun 27, 2024
  
  365791ff
23 May, 2024 1 commit
- [Core]: Option To Use Prompt Token Ids Inside Logits Processor (#4985) · e3470f87
  Elisei Smirnov authored May 24, 2024
```
Co-authored-by: Elisei Smirnov <el.smirnov@innopolis.university>
```
  e3470f87
01 May, 2024 1 commit
- [Bugfix] Use random seed if seed is -1 (#4531) · 69909126
  sasha0552 authored May 01, 2024
  
  69909126
30 Apr, 2024 1 commit
- [Bugfix][Minor] Make ignore_eos effective (#4468) · dd1a50a8
  Li, Jiang authored May 01, 2024
  
  dd1a50a8
27 Apr, 2024 1 commit
- [BugFix] Fix `min_tokens` when `eos_token_id` is None (#4389) · 81661da7
  Nick Hill authored Apr 27, 2024
```
Co-authored-by: DefTruth <31974251+deftruth@users.noreply.github.com>
```
  81661da7
19 Apr, 2024 1 commit
- Support eos_token_id from generation_config.json (#4182) · a134ef6f
  Simon Mo authored Apr 18, 2024
  
  a134ef6f
12 Apr, 2024 1 commit
- [mypy] Add mypy type annotation part 1 (#4006) · 09473ee4
  SangBin Cho authored Apr 13, 2024
  
  09473ee4
11 Apr, 2024 1 commit
- [BugFix] Fix handling of stop strings and stop token ids (#3672) · e46a60aa
  Nick Hill authored Apr 11, 2024
  
  e46a60aa
05 Apr, 2024 1 commit
- Add option to completion API to truncate prompt tokens (#3144) · 1d7c940d
  Thomas Parnell authored Apr 05, 2024
  
  1d7c940d
04 Apr, 2024 1 commit
- [Core] [Frontend] Make detokenization optional (#3749) · aabe8f40
  Matthias Gerstgrasser authored Apr 03, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  aabe8f40
25 Mar, 2024 1 commit
- feat: implement the min_tokens sampling parameter (#3124) · c13ad1b7
  Travis Johnson authored Mar 25, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  c13ad1b7
11 Mar, 2024 1 commit
- Re-enable the 80 char line width limit (#3305) · 2f8844ba
  Zhuohan Li authored Mar 10, 2024
  
  2f8844ba
29 Feb, 2024 1 commit
- [Fix] Don't deep-copy LogitsProcessors when copying SamplingParams (#3099) · 29a8d6a5
  Nick Hill authored Feb 29, 2024
  
  29a8d6a5
21 Feb, 2024 1 commit
- Support per-request seed (#2514) · 7d2dcce1
  Nick Hill authored Feb 21, 2024
  
  7d2dcce1
24 Jan, 2024 1 commit
- [Bugfix] fix crash if max_tokens=None (#2570) · 3209b490
  Nikola Borisov authored Jan 23, 2024
  
  3209b490
03 Jan, 2024 1 commit
- [Minor] Fix typo and remove unused code (#2305) · 91405610
  Roy authored Jan 03, 2024
  
  91405610
15 Dec, 2023 1 commit
- Add a flag to include stop string in output text (#1976) · c06170cc
  Yunfeng Bai authored Dec 15, 2023
  
  c06170cc
03 Dec, 2023 1 commit
- add custom server params (#1868) · 60dc62dc
  Roy authored Dec 04, 2023
  
  60dc62dc
01 Dec, 2023 1 commit
- Fix the typo in SamplingParams' docstring (#1886) · f86bd619
  Jerry authored Dec 01, 2023
  
  f86bd619
22 Nov, 2023 3 commits
- Fix repetition penalty aligned with huggingface (#1577) · de23687d
  ljss authored Nov 23, 2023
  
  de23687d
- Set top_p=0 and top_k=-1 in greedy sampling (#1748) · 4cea74c7
  ljss authored Nov 23, 2023
  
  4cea74c7
- Add stop_token_ids in SamplingParams.__repr__ (#1745) · 094f716b
  陈序 authored Nov 22, 2023
  
  094f716b
18 Nov, 2023 1 commit
- Support Min P Sampler (#1642) · e87557b0
  Roy authored Nov 18, 2023
  
  e87557b0
03 Nov, 2023 1 commit
- Added logits processor API to sampling params (#1469) · 555bdcc5
  Noam Gat authored Nov 03, 2023
  
  555bdcc5
30 Oct, 2023 1 commit
- Add support for `spaces_between_special_tokens` · 7013a801
  Dan Lord authored Oct 30, 2023
  
  7013a801
29 Oct, 2023 1 commit
- Support repetition_penalty (#1424) · 69be658b
  ljss authored Oct 30, 2023
  
  69be658b
16 Oct, 2023 1 commit
- Implement prompt logprobs & Batched topk for computing logprobs (#1328) · 9d9072a0
  Zhuohan Li authored Oct 16, 2023
```
Co-authored-by: Yunmo Chen <16273544+wanmok@users.noreply.github.com>
```
  9d9072a0
02 Oct, 2023 1 commit
- [Minor] Fix type annotations (#1238) · 84e4e37d
  Woosuk Kwon authored Oct 02, 2023
  
  84e4e37d
28 Sep, 2023 1 commit
- Add `skip_special_tokens` sampling params (#1186) · 20f7cc4c
  Dan Lord authored Sep 27, 2023
  
  20f7cc4c
23 Sep, 2023 1 commit
- [Sampler] Vectorized sampling (simplified) (#1048) · 947b7941
  Zhuohan Li authored Sep 22, 2023
```
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>
```
  947b7941
21 Sep, 2023 1 commit
- feat: support stop_token_ids parameter. (#1097) · f98b745a
  Ricardo Lu authored Sep 22, 2023
  
  f98b745a
05 Sep, 2023 1 commit
- Align vLLM's beam search implementation with HF generate (#857) · 002800f0
  Zhuohan Li authored Sep 04, 2023
  
  002800f0
18 Aug, 2023 1 commit
- Fix typo in sampling_params.py (#788) · 0c04ce32
  wangcx18 authored Aug 18, 2023
  
  0c04ce32