Commits · a2a40bcd0d8275e19c46e9cc06ee994d8839b98d · OpenDAS / vllm_cscc · GitLab

04 Dec, 2024 1 commit
- [bugfix] fixed parameter “n” when set parameter “bestof” > 1 (#10854) · 8db957ee
  jianzheng authored Dec 04, 2024
```
Signed-off-by: jianzheng <57654625+o2363286@users.noreply.github.com>
```
  8db957ee
01 Nov, 2024 1 commit
- [Bugfix][Frontend] Reject guided decoding in multistep mode (#9892) · 031a7995
  Joe Runde authored Oct 31, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  031a7995
29 Oct, 2024 1 commit
- [Frontend] re-enable multi-modality input in the new beam search implementation (#9427) · ef7865b4
  Zhong Qishuai authored Oct 29, 2024
```
Signed-off-by: Qishuai Ferdinandzhong@gmail.com
```
  ef7865b4
26 Oct, 2024 1 commit
- [Frontend] Bad words sampling parameter (#9717) · 07e981fd
  Vasiliy Alekseev authored Oct 26, 2024
```
Signed-off-by: Vasily Alexeev <alvasian@yandex.ru>
```
  07e981fd
19 Oct, 2024 1 commit
- [Frontend] Avoid creating guided decoding LogitsProcessor unnecessarily (#9521) · 1325872e
  Nick Hill authored Oct 19, 2024
  
  1325872e
11 Oct, 2024 1 commit
- [misc] hide best_of from engine (#9261) · cbc2ef55
  youkaichao authored Oct 10, 2024
```
Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>
```
  cbc2ef55
09 Oct, 2024 1 commit
- [Misc] Improve validation errors around best_of and n (#9167) · 480b7f40
  Travis Johnson authored Oct 08, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  480b7f40
07 Oct, 2024 1 commit
- [core] remove beam search from the core (#9105) · 18b296fd
  youkaichao authored Oct 06, 2024
  
  18b296fd
06 Oct, 2024 1 commit
- [Frontend] API support for beam search (#9087) · 168cab6b
  Brendan Wong authored Oct 05, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  168cab6b
01 Oct, 2024 1 commit
- [Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
  Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  062c89e7
24 Sep, 2024 1 commit
- [misc] soft drop beam search (#8763) · 1e7d5c01
  youkaichao authored Sep 24, 2024
  
  1e7d5c01
20 Sep, 2024 1 commit
- [Bugfix] Validate SamplingParam n is an int (#8548) · b28298f2
  saumya-saran authored Sep 20, 2024
  
  b28298f2
12 Sep, 2024 1 commit
- [Core] Add engine option to return only deltas or final output (#7381) · 551ce010
  Nick Hill authored Sep 12, 2024
  
  551ce010
21 Aug, 2024 1 commit
- [mypy] Enable following imports for entrypoints (#7248) · baaedfdb
  Cyrus Leung authored Aug 21, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Fei <dfdfcai4@gmail.com>
```
  baaedfdb
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
14 Aug, 2024 1 commit
- Fix empty output when temp is too low (#2937) · c134a464
  Chang Su authored Aug 13, 2024
```
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c134a464
07 Aug, 2024 1 commit
- [BUGFIX]: top_k is expected to be an integer. (#7227) · 7b261092
  Atilla Akkuş authored Aug 07, 2024
  
  7b261092
29 Jul, 2024 1 commit
- [Core] Reduce unnecessary compute when logprobs=None (#6532) · db9e5708
  Peng Guanwen authored Jul 30, 2024
  
  db9e5708
23 Jul, 2024 1 commit
- [Misc] Remove deprecation warning for beam search (#6659) · bdf5fd13
  Woosuk Kwon authored Jul 22, 2024
  
  bdf5fd13
15 Jul, 2024 1 commit
- Report usage for beam search (#6404) · 32c9d7f7
  Simon Mo authored Jul 14, 2024
  
  32c9d7f7
13 Jul, 2024 1 commit
- [Misc] Add deprecation warning for beam search (#6402) · eeceadae
  Woosuk Kwon authored Jul 13, 2024
  
  eeceadae
27 Jun, 2024 1 commit
- [BugFix] Fix `min_tokens` behaviour for multiple eos tokens (#5849) · 365791ff
  Nick Hill authored Jun 27, 2024
  
  365791ff
23 May, 2024 1 commit
- [Core]: Option To Use Prompt Token Ids Inside Logits Processor (#4985) · e3470f87
  Elisei Smirnov authored May 24, 2024
```
Co-authored-by: Elisei Smirnov <el.smirnov@innopolis.university>
```
  e3470f87
01 May, 2024 1 commit
- [Bugfix] Use random seed if seed is -1 (#4531) · 69909126
  sasha0552 authored May 01, 2024
  
  69909126
30 Apr, 2024 1 commit
- [Bugfix][Minor] Make ignore_eos effective (#4468) · dd1a50a8
  Li, Jiang authored May 01, 2024
  
  dd1a50a8
27 Apr, 2024 1 commit
- [BugFix] Fix `min_tokens` when `eos_token_id` is None (#4389) · 81661da7
  Nick Hill authored Apr 27, 2024
```
Co-authored-by: DefTruth <31974251+deftruth@users.noreply.github.com>
```
  81661da7
19 Apr, 2024 1 commit
- Support eos_token_id from generation_config.json (#4182) · a134ef6f
  Simon Mo authored Apr 18, 2024
  
  a134ef6f
12 Apr, 2024 1 commit
- [mypy] Add mypy type annotation part 1 (#4006) · 09473ee4
  SangBin Cho authored Apr 13, 2024
  
  09473ee4
11 Apr, 2024 1 commit
- [BugFix] Fix handling of stop strings and stop token ids (#3672) · e46a60aa
  Nick Hill authored Apr 11, 2024
  
  e46a60aa
05 Apr, 2024 1 commit
- Add option to completion API to truncate prompt tokens (#3144) · 1d7c940d
  Thomas Parnell authored Apr 05, 2024
  
  1d7c940d
04 Apr, 2024 1 commit
- [Core] [Frontend] Make detokenization optional (#3749) · aabe8f40
  Matthias Gerstgrasser authored Apr 03, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  aabe8f40
25 Mar, 2024 1 commit
- feat: implement the min_tokens sampling parameter (#3124) · c13ad1b7
  Travis Johnson authored Mar 25, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  c13ad1b7
11 Mar, 2024 1 commit
- Re-enable the 80 char line width limit (#3305) · 2f8844ba
  Zhuohan Li authored Mar 10, 2024
  
  2f8844ba
29 Feb, 2024 1 commit
- [Fix] Don't deep-copy LogitsProcessors when copying SamplingParams (#3099) · 29a8d6a5
  Nick Hill authored Feb 29, 2024
  
  29a8d6a5
21 Feb, 2024 1 commit
- Support per-request seed (#2514) · 7d2dcce1
  Nick Hill authored Feb 21, 2024
  
  7d2dcce1
24 Jan, 2024 1 commit
- [Bugfix] fix crash if max_tokens=None (#2570) · 3209b490
  Nikola Borisov authored Jan 23, 2024
  
  3209b490
03 Jan, 2024 1 commit
- [Minor] Fix typo and remove unused code (#2305) · 91405610
  Roy authored Jan 03, 2024
  
  91405610
15 Dec, 2023 1 commit
- Add a flag to include stop string in output text (#1976) · c06170cc
  Yunfeng Bai authored Dec 15, 2023
  
  c06170cc
03 Dec, 2023 1 commit
- add custom server params (#1868) · 60dc62dc
  Roy authored Dec 04, 2023
  
  60dc62dc
01 Dec, 2023 1 commit
- Fix the typo in SamplingParams' docstring (#1886) · f86bd619
  Jerry authored Dec 01, 2023
  
  f86bd619