Commits · 5bfb30a529283f7d9a8baa6715ab3bfef204cddd · OpenDAS / vllm_cscc

23 Dec, 2024 1 commit
- [Bugfix] Fix CFGGuide and use outlines for grammars that can't convert to GBNF (#11389) · 5bfb30a5
  Michael Goin authored Dec 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  5bfb30a5
19 Dec, 2024 1 commit
- [CI] Expand test_guided_generate to test all backends (#11313) · a30482f0
  Michael Goin authored Dec 18, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  a30482f0
17 Dec, 2024 1 commit

[CI] Add test case with JSON schema using references + use xgrammar by default... · 0064f697

Michael Goin authored Dec 16, 2024


[CI] Add test case with JSON schema using references + use xgrammar by default with OpenAI parse (#10935)
Signed-off-by: mgoin <michael@neuralmagic.com>

0064f697

05 Dec, 2024 1 commit
- [Bugfix] Fallback to outlines for complex json schemas (#10899) · 8d370e91
  Michael Goin authored Dec 04, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  8d370e91
03 Dec, 2024 1 commit

[Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785) · 9323a315

Aaron Pham authored Dec 03, 2024


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

9323a315

18 Oct, 2024 1 commit
- [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) · d11bf435
  Cody Yu authored Oct 18, 2024
  
  d11bf435
01 Oct, 2024 1 commit
- [Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
  Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  062c89e7
04 Aug, 2024 1 commit
- Support for guided decoding for offline LLM (#6878) · 654bc5ca
  Yihuan Bu authored Aug 03, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  654bc5ca