Commits · 480b7f40cfa9a900e03ea4e825abc1a46b5d085b · OpenDAS / vllm_cscc

09 Oct, 2024 1 commit
- [Misc] Improve validation errors around best_of and n (#9167) · 480b7f40
  Travis Johnson authored Oct 08, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  480b7f40
07 Oct, 2024 1 commit
- [core] remove beam search from the core (#9105) · 18b296fd
  youkaichao authored Oct 06, 2024
  
  18b296fd
06 Oct, 2024 1 commit
- [Frontend] API support for beam search (#9087) · 168cab6b
  Brendan Wong authored Oct 05, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  168cab6b
01 Oct, 2024 1 commit
- [Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
  Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  062c89e7
24 Sep, 2024 1 commit
- [misc] soft drop beam search (#8763) · 1e7d5c01
  youkaichao authored Sep 24, 2024
  
  1e7d5c01
20 Sep, 2024 1 commit
- [Bugfix] Validate SamplingParam n is an int (#8548) · b28298f2
  saumya-saran authored Sep 20, 2024
  
  b28298f2
12 Sep, 2024 1 commit
- [Core] Add engine option to return only deltas or final output (#7381) · 551ce010
  Nick Hill authored Sep 12, 2024
  
  551ce010
21 Aug, 2024 1 commit
- [mypy] Enable following imports for entrypoints (#7248) · baaedfdb
  Cyrus Leung authored Aug 21, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Fei <dfdfcai4@gmail.com>
```
  baaedfdb
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
14 Aug, 2024 1 commit
- Fix empty output when temp is too low (#2937) · c134a464
  Chang Su authored Aug 13, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c134a464
07 Aug, 2024 1 commit
- [BUGFIX]: top_k is expected to be an integer. (#7227) · 7b261092
  Atilla Akkuş authored Aug 07, 2024
  
  7b261092
29 Jul, 2024 1 commit
- [Core] Reduce unnecessary compute when logprobs=None (#6532) · db9e5708
  Peng Guanwen authored Jul 30, 2024
  
  db9e5708
23 Jul, 2024 1 commit
- [Misc] Remove deprecation warning for beam search (#6659) · bdf5fd13
  Woosuk Kwon authored Jul 22, 2024
  
  bdf5fd13
15 Jul, 2024 1 commit
- Report usage for beam search (#6404) · 32c9d7f7
  Simon Mo authored Jul 14, 2024
  
  32c9d7f7
13 Jul, 2024 1 commit
- [Misc] Add deprecation warning for beam search (#6402) · eeceadae
  Woosuk Kwon authored Jul 13, 2024
  
  eeceadae
27 Jun, 2024 1 commit
- [BugFix] Fix `min_tokens` behaviour for multiple eos tokens (#5849) · 365791ff
  Nick Hill authored Jun 27, 2024
  
  365791ff
23 May, 2024 1 commit
- [Core]: Option To Use Prompt Token Ids Inside Logits Processor (#4985) · e3470f87
  Elisei Smirnov authored May 24, 2024
```
Co-authored-by: Elisei Smirnov <el.smirnov@innopolis.university>
```
  e3470f87
01 May, 2024 1 commit
- [Bugfix] Use random seed if seed is -1 (#4531) · 69909126
  sasha0552 authored May 01, 2024
  
  69909126
30 Apr, 2024 1 commit
- [Bugfix][Minor] Make ignore_eos effective (#4468) · dd1a50a8
  Li, Jiang authored May 01, 2024
  
  dd1a50a8
27 Apr, 2024 1 commit
- [BugFix] Fix `min_tokens` when `eos_token_id` is None (#4389) · 81661da7
  Nick Hill authored Apr 27, 2024
```
Co-authored-by: DefTruth <31974251+deftruth@users.noreply.github.com>
```
  81661da7
19 Apr, 2024 1 commit
- Support eos_token_id from generation_config.json (#4182) · a134ef6f
  Simon Mo authored Apr 18, 2024
  
  a134ef6f
12 Apr, 2024 1 commit
- [mypy] Add mypy type annotation part 1 (#4006) · 09473ee4
  SangBin Cho authored Apr 13, 2024
  
  09473ee4
11 Apr, 2024 1 commit
- [BugFix] Fix handling of stop strings and stop token ids (#3672) · e46a60aa
  Nick Hill authored Apr 11, 2024
  
  e46a60aa
05 Apr, 2024 1 commit
- Add option to completion API to truncate prompt tokens (#3144) · 1d7c940d
  Thomas Parnell authored Apr 05, 2024
  
  1d7c940d
04 Apr, 2024 1 commit
- [Core] [Frontend] Make detokenization optional (#3749) · aabe8f40
  Matthias Gerstgrasser authored Apr 03, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  aabe8f40
25 Mar, 2024 1 commit
- feat: implement the min_tokens sampling parameter (#3124) · c13ad1b7
  Travis Johnson authored Mar 25, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  c13ad1b7
11 Mar, 2024 1 commit
- Re-enable the 80 char line width limit (#3305) · 2f8844ba
  Zhuohan Li authored Mar 10, 2024
  
  2f8844ba
29 Feb, 2024 1 commit
- [Fix] Don't deep-copy LogitsProcessors when copying SamplingParams (#3099) · 29a8d6a5
  Nick Hill authored Feb 29, 2024
  
  29a8d6a5
21 Feb, 2024 1 commit
- Support per-request seed (#2514) · 7d2dcce1
  Nick Hill authored Feb 21, 2024
  
  7d2dcce1
24 Jan, 2024 1 commit
- [Bugfix] fix crash if max_tokens=None (#2570) · 3209b490
  Nikola Borisov authored Jan 23, 2024
  
  3209b490
03 Jan, 2024 1 commit
- [Minor] Fix typo and remove unused code (#2305) · 91405610
  Roy authored Jan 03, 2024
  
  91405610
15 Dec, 2023 1 commit
- Add a flag to include stop string in output text (#1976) · c06170cc
  Yunfeng Bai authored Dec 15, 2023
  
  c06170cc
03 Dec, 2023 1 commit
- add custom server params (#1868) · 60dc62dc
  Roy authored Dec 04, 2023
  
  60dc62dc
01 Dec, 2023 1 commit
- Fix the typo in SamplingParams' docstring (#1886) · f86bd619
  Jerry authored Dec 01, 2023
  
  f86bd619
22 Nov, 2023 3 commits
- Fix repetition penalty aligned with huggingface (#1577) · de23687d
  ljss authored Nov 23, 2023
  
  de23687d
- Set top_p=0 and top_k=-1 in greedy sampling (#1748) · 4cea74c7
  ljss authored Nov 23, 2023
  
  4cea74c7
- Add stop_token_ids in SamplingParams.__repr__ (#1745) · 094f716b
  陈序 authored Nov 22, 2023
  
  094f716b
18 Nov, 2023 1 commit
- Support Min P Sampler (#1642) · e87557b0
  Roy authored Nov 18, 2023
  
  e87557b0
03 Nov, 2023 1 commit
- Added logits processor API to sampling params (#1469) · 555bdcc5
  Noam Gat authored Nov 03, 2023
  
  555bdcc5
30 Oct, 2023 1 commit
- Add support for `spaces_between_special_tokens` · 7013a801
  Dan Lord authored Oct 30, 2023
  
  7013a801