Commits · 362cff1eb3d6c1af434d29e8ed022dec048211fa · OpenDAS / vllm_cscc

18 Dec, 2024 1 commit
- [Bugfix] Fix guided decoding with tokenizer mode mistral (#11046) · 8b79f9e1
  Wallas Henrique authored Dec 18, 2024
  
  8b79f9e1
14 Dec, 2024 2 commits
- [Core] Update outlines and increase its threadpool size (#11140) · 48259264
  Russell Bryant authored Dec 14, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  48259264
- update compressed-tensors to latest version (#11183) · 24a3d12b
  dhuangnm authored Dec 13, 2024
```
Co-authored-by: dhuangnm <dhuang@MacBook-Pro-2.local>
```
  24a3d12b
12 Dec, 2024 1 commit

[V1] VLM preprocessor hashing (#11020) · 4e116833

Alexander Matveev authored Dec 11, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Alexander Matveev <alexm@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

4e116833

11 Dec, 2024 2 commits
- [torch.compile] use depyf to dump torch.compile internals (#10972) · 91642db9
  youkaichao authored Dec 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  91642db9
- [ci/build] Fix entrypoints test and pin outlines version (#11088) · 9974fca0
  Kevin H. Luu authored Dec 11, 2024
  
  9974fca0
10 Dec, 2024 1 commit
- [Core] Update to outlines >= 0.1.8 (#10576) · e7391949
  Russell Bryant authored Dec 10, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e7391949
09 Dec, 2024 1 commit
- [Core] Require xgrammar >= 0.1.6 (#11021) · e691b26f
  Russell Bryant authored Dec 09, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e691b26f
03 Dec, 2024 2 commits
- [Bugfix] Only require XGrammar on x86 (#10865) · 7090c27b
  Michael Goin authored Dec 03, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  7090c27b
- [Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785) · 9323a315
  Aaron Pham authored Dec 03, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  9323a315
28 Nov, 2024 1 commit
- [misc] upgrade filelock version (#10731) · cb4e1c3f
  youkaichao authored Nov 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  cb4e1c3f
15 Nov, 2024 2 commits
- [Misc] bump mistral common version (#10367) · a6221a14
  Simon Mo authored Nov 15, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a6221a14
- [Bugfix] Ensure special tokens are properly filtered out for guided structured... · 691a3ec0
  Guillaume Calmettes authored Nov 15, 2024
```
[Bugfix] Ensure special tokens are properly filtered out for guided structured output with MistralTokenizer (#10363)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  691a3ec0
13 Nov, 2024 1 commit
- Bump to compressed-tensors v0.8.0 (#10279) · 56a955e7
  Dipika Sikka authored Nov 13, 2024
```
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  56a955e7
31 Oct, 2024 1 commit
- [Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens... · abbfb613
  Guillaume Calmettes authored Oct 31, 2024
```
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)
```
  abbfb613
18 Oct, 2024 1 commit
- [BugFix] Stop silent failures on compressed-tensors parsing (#9381) · 48138a84
  Dipika Sikka authored Oct 17, 2024
  
  48138a84
16 Oct, 2024 1 commit
- [Misc] Standardize RoPE handling for Qwen2-VL (#9250) · 7e7eae33
  Cyrus Leung authored Oct 16, 2024
  
  7e7eae33
15 Oct, 2024 1 commit
- [Misc] Directly use compressed-tensors for checkpoint definitions (#8909) · 22f8a695
  Michael Goin authored Oct 15, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  22f8a695
30 Sep, 2024 1 commit
- [Misc][CI/Build] Include `cv2` via `mistral_common[opencv]` (#8951) · b6d73925
  Roger Wang authored Sep 29, 2024
  
  b6d73925
28 Sep, 2024 1 commit

[Bugfix][Intel] Fix XPU Dockerfile Build (#7824) · 260024a3

Tyler Titsworth authored Sep 27, 2024


Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: youkaichao <youkaichao@126.com>

260024a3

26 Sep, 2024 1 commit
- [Installation] Allow lower versions of FastAPI to maintain Ray 2.9 compatibility (#8764) · 1b49148e
  Cyrus Leung authored Sep 27, 2024
  
  1b49148e
25 Sep, 2024 1 commit

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

22 Sep, 2024 2 commits
- [misc] upgrade mistral-common (#8715) · 92ba7e74
  youkaichao authored Sep 22, 2024
  
  92ba7e74
- [build] enable existing pytorch (for GH200, aarch64, nightly) (#8713) · d4a2ac83
  youkaichao authored Sep 22, 2024
  
  d4a2ac83
17 Sep, 2024 1 commit
- [Bugfix] Fix 3.12 builds on main (#8510) · cca61642
  Joe Runde authored Sep 16, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cca61642
15 Sep, 2024 1 commit
- [Bugfix][Kernel] Add `IQ1_M` quantization implementation to GGUF kernel (#8357) · fc990f97
  Isotr0py authored Sep 16, 2024
  
  fc990f97
13 Sep, 2024 2 commits
- [Installation] Gate FastAPI version for Python 3.8 (#8456) · ecd7a1d5
  Cyrus Leung authored Sep 14, 2024
  
  ecd7a1d5
- [Bugfix] Bump fastapi and pydantic version (#8435) · 3f79bc3d
  Cyrus Leung authored Sep 13, 2024
  
  3f79bc3d
11 Sep, 2024 2 commits

Pixtral (#8377) · d394787e
Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
d394787e

[Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77

Yang Fan authored Sep 12, 2024


Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

3b7fea77

07 Sep, 2024 1 commit
- [CI/Build] Use python 3.12 in cuda image (#8133) · cfe712bf
  Joe Runde authored Sep 07, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cfe712bf
05 Sep, 2024 1 commit
- [bugfix] >1.43 constraint for openai (#8169) · 1afc9319
  William Lin authored Sep 04, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  1afc9319
04 Sep, 2024 1 commit

[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649) · e02ce498

Kyle Mistele authored Sep 04, 2024


Co-authored-by: constellate <constellate@1-ai-appserver-staging.codereach.com>
Co-authored-by: Kyle Mistele <kyle@constellate.ai>

e02ce498

01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199
30 Aug, 2024 1 commit

[Frontend]-config-cli-args (#7737) · 058344f8

Kaunil Dhruv authored Aug 30, 2024


Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com>

058344f8

27 Aug, 2024 1 commit
- [Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739) · 6fc4e6e0
  Patrick von Platen authored Aug 27, 2024
  
  6fc4e6e0
21 Aug, 2024 1 commit
- [mypy] Enable following imports for entrypoints (#7248) · baaedfdb
  Cyrus Leung authored Aug 21, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Fei <dfdfcai4@gmail.com>
```
  baaedfdb
19 Aug, 2024 1 commit
- [Core] Optimize SPMD architecture with delta + serialization optimization (#7109) · ff7ec82c
  SangBin Cho authored Aug 18, 2024
  
  ff7ec82c
17 Aug, 2024 1 commit
- [Bugfix] add >= 1.0 constraint for openai dependency (#7612) · 7c0b7ea2
  Xander Johnson authored Aug 16, 2024
  
  7c0b7ea2
15 Aug, 2024 1 commit
- [Misc] Update dockerfile for CPU to cover protobuf installation (#7182) · f4da5f7b
  PHILO-HE authored Aug 16, 2024
  
  f4da5f7b