Commits · da7512215f0b5c589c2747303b171357940c0614 · OpenDAS / vllm_cscc · GitLab

19 Jan, 2025 1 commit
- [BUGFIX] Move scores to float32 in case of running xgrammar on cpu (#12152) · 4e94951b
  Michal Adamczyk authored Jan 19, 2025
```
Signed-off-by: Michal Adamczyk <madamczyk@habana.ai>
```
  4e94951b
31 Dec, 2024 1 commit
- [Bugfix] Fix OpenAI parallel sampling when using xgrammar (#11637) · 74fa1d12
  Michael Goin authored Dec 30, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  74fa1d12
30 Dec, 2024 1 commit
- [platforms] enable platform plugins (#11602) · b12e87f9
  youkaichao authored Dec 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b12e87f9
23 Dec, 2024 1 commit
- [Bugfix] Fix CFGGuide and use outlines for grammars that can't convert to GBNF (#11389) · 5bfb30a5
  Michael Goin authored Dec 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  5bfb30a5
19 Dec, 2024 1 commit
- [CI] Expand test_guided_generate to test all backends (#11313) · a30482f0
  Michael Goin authored Dec 18, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  a30482f0
18 Dec, 2024 1 commit
- [Bugfix] Fix guided decoding with tokenizer mode mistral (#11046) · 8b79f9e1
  Wallas Henrique authored Dec 18, 2024
  
  8b79f9e1
14 Dec, 2024 1 commit
- [Core] Update outlines and increase its threadpool size (#11140) · 48259264
  Russell Bryant authored Dec 14, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  48259264
12 Dec, 2024 1 commit
- [Misc] Validate grammar and fail early (#11119) · 2c97eca1
  Cody Yu authored Dec 12, 2024
  
  2c97eca1
11 Dec, 2024 1 commit
- [ci/build] Fix entrypoints test and pin outlines version (#11088) · 9974fca0
  Kevin H. Luu authored Dec 11, 2024
  
  9974fca0
10 Dec, 2024 2 commits
- [Core] Update to outlines >= 0.1.8 (#10576) · e7391949
  Russell Bryant authored Dec 10, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e7391949
- [Bugfix] Fix xgrammar failing to read a vocab_size from LlavaConfig on PixtralHF. (#11043) · e35879c2
  Jeff Cook authored Dec 09, 2024
  
  e35879c2
06 Dec, 2024 1 commit
- [Core] Support Lark grammars for XGrammar (#10870) · 8b596318
  Michael Goin authored Dec 06, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  8b596318
05 Dec, 2024 1 commit
- [Bugfix] Fallback to outlines for complex json schemas (#10899) · 8d370e91
  Michael Goin authored Dec 04, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  8d370e91
03 Dec, 2024 2 commits
- [Bugfix] Only require XGrammar on x86 (#10865) · 7090c27b
  Michael Goin authored Dec 03, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  7090c27b
- [Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785) · 9323a315
  Aaron Pham authored Dec 03, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  9323a315
26 Oct, 2024 1 commit
- [Frontend] Bad words sampling parameter (#9717) · 07e981fd
  Vasiliy Alekseev authored Oct 26, 2024
```
Signed-off-by: Vasily Alexeev <alvasian@yandex.ru>
```
  07e981fd
25 Oct, 2024 1 commit

[Bugfix] Fix crash with llama 3.2 vision models and guided decoding (#9631) · 6567e137

Travis Johnson authored Oct 25, 2024


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: pavlo-ruban <pavlo.ruban@servicenow.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

6567e137

01 Oct, 2024 1 commit
- [Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
  Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  062c89e7
19 Sep, 2024 1 commit
- Revert "[Misc][Bugfix] Disable guided decoding for mistral tokenizer" (#8593) · 02c9afa2
  Roger Wang authored Sep 18, 2024
  
  02c9afa2
18 Sep, 2024 1 commit

[CI/Build] Update Ruff version (#8469) · 9d104b5b

Aaron Pham authored Sep 18, 2024


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9d104b5b

17 Sep, 2024 1 commit
- [Misc][Bugfix] Disable guided decoding for mistral tokenizer (#8521) · ee2bceaa
  Roger Wang authored Sep 16, 2024
  
  ee2bceaa
04 Sep, 2024 1 commit

[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498

Kyle Mistele authored Sep 04, 2024


Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>

e02ce498

24 Aug, 2024 2 commits
- [misc][core] lazy import outlines (#7831) · 7d9ffa2a
  youkaichao authored Aug 24, 2024
  
  7d9ffa2a
- [Frontend] add json_schema support from OpenAI protocol (#7654) · d81abefd
  Tyler Rockwood authored Aug 24, 2024
  
  d81abefd
04 Aug, 2024 1 commit
- Support for guided decoding for offline LLM (#6878) · 654bc5ca
  Yihuan Bu authored Aug 03, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  654bc5ca
03 Aug, 2024 1 commit

[ Frontend ] Multiprocessing for OpenAI Server with `zeromq` (#6883) · ed812a73

Robert Shaw authored Aug 02, 2024


Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

ed812a73

08 Jul, 2024 1 commit
- [Bugfix] use diskcache in outlines _get_guide #5436 (#6203) · 185ad31f
  Eric authored Jul 09, 2024
  
  185ad31f
05 Jun, 2024 1 commit
- [Frontend][Core] Update Outlines Integration from `FSM` to `Guide` (#4109) · 7b0a0dfb
  Breno Faria authored Jun 06, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Breno Faria <breno.faria@intrafind.com>
```
  7b0a0dfb
03 Jun, 2024 1 commit
- [FRONTEND] OpenAI `tools` support named functions (#5032) · f775a07e
  Breno Faria authored Jun 04, 2024
  
  f775a07e
01 May, 2024 1 commit
- Allow user to define whitespace pattern for outlines (#4305) · c3845d82
  Robert Caulk authored May 01, 2024
  
  c3845d82
29 Apr, 2024 1 commit
- [mypy][5/N] Support all typing on model executor (#4427) · df29793d
  SangBin Cho authored Apr 29, 2024
  
  df29793d
20 Apr, 2024 1 commit
- [Bugfix] Add fix for JSON whitespace (#4189) · 138485a8
  Ayush Rautwar authored Apr 19, 2024
```
Co-authored-by: Ubuntu <ubuntu@ip-172-31-13-147.ec2.internal>
```
  138485a8
18 Apr, 2024 1 commit
- [Typing] Mypy typing part 2 (#4043) · 533d2a1f
  SangBin Cho authored Apr 18, 2024
```
Co-authored-by: SangBin Cho <sangcho@sangcho-LT93GQWG9C.local>
```
  533d2a1f
16 Apr, 2024 1 commit
- LM Format Enforcer Guided Decoding Support (#3868) · 05434764
  Noam Gat authored Apr 16, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  05434764