Commits · 17ca964273464fad7e682380bab8288d4fac05c5 · OpenDAS / vllm_cscc

"lib/bench/kv_router/common/shared.rs" did not exist on "88478b4ba359112cd16ae049db3d2efce3223d85"

17 Dec, 2024 1 commit

[CI] Add test case with JSON schema using references + use xgrammar by default... · 0064f697

Michael Goin authored Dec 16, 2024


[CI] Add test case with JSON schema using references + use xgrammar by default with OpenAI parse (#10935)
Signed-off-by: mgoin <michael@neuralmagic.com>

0064f697

05 Dec, 2024 1 commit
- [Bugfix] Fallback to outlines for complex json schemas (#10899) · 8d370e91
  Michael Goin authored Dec 04, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  8d370e91
03 Dec, 2024 1 commit

[Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785) · 9323a315

Aaron Pham authored Dec 03, 2024


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

9323a315

18 Oct, 2024 1 commit
- [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) · d11bf435
  Cody Yu authored Oct 18, 2024
  
  d11bf435
01 Oct, 2024 1 commit
- [Frontend][Core] Move guided decoding params into sampling params (#8252) · 062c89e7
  Joe Runde authored Sep 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  062c89e7
04 Aug, 2024 1 commit
- Support for guided decoding for offline LLM (#6878) · 654bc5ca
  Yihuan Bu authored Aug 03, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  654bc5ca