Commits · afd0da2186c1d58fb48e138df0a2f548612b5d7d · OpenDAS / vllm_cscc

01 Feb, 2025 1 commit
- [ci] Upgrade transformers to 4.48.2 in CI dependencies (#12599) · 35b7a055
  Kevin H. Luu authored Jan 31, 2025
  
  35b7a055
24 Jan, 2025 1 commit
- Update compressed-tensors version (#12367) · 55ef66ed
  Dipika Sikka authored Jan 23, 2025
  
  55ef66ed
23 Jan, 2025 1 commit
- support qwen2-vl video · 1a11f127
  zhuwenwen authored Jan 23, 2025
  
  1a11f127
21 Jan, 2025 1 commit
- Remove pytorch comments for outlines + compressed-tensors (#12260) · 9a7c3a00
  Thomas Parnell authored Jan 21, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  9a7c3a00
08 Jan, 2025 1 commit
- resolve transformers version conflicts with lmslim · 0890ebc1
  zhuwenwen authored Jan 08, 2025
  
  0890ebc1
20 Dec, 2024 1 commit

[ci][gh200] dockerfile clean up (#11351) · 7801f56e

youkaichao authored Dec 19, 2024


Signed-off-by: drikster80 <ed.sealing@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: cenzhiyao <2523403608@qq.com>

7801f56e

18 Dec, 2024 2 commits
- [FIX] update openai version (#11287) · f954fe0e
  Kunshang Ji authored Dec 19, 2024
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f954fe0e
- [Bugfix] Fix guided decoding with tokenizer mode mistral (#11046) · 8b79f9e1
  Wallas Henrique authored Dec 18, 2024
  
  8b79f9e1
14 Dec, 2024 2 commits
- [Core] Update outlines and increase its threadpool size (#11140) · 48259264
  Russell Bryant authored Dec 14, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  48259264
- update compressed-tensors to latest version (#11183) · 24a3d12b
  dhuangnm authored Dec 13, 2024
```
Co-authored-by: dhuangnm <dhuang@MacBook-Pro-2.local>
```
  24a3d12b
12 Dec, 2024 2 commits

update transformer version · 38dc43cd
zhuwenwen authored Dec 12, 2024

38dc43cd

[V1] VLM preprocessor hashing (#11020) · 4e116833

Alexander Matveev authored Dec 11, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Alexander Matveev <alexm@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

4e116833

11 Dec, 2024 2 commits
- [torch.compile] use depyf to dump torch.compile internals (#10972) · 91642db9
  youkaichao authored Dec 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  91642db9
- [ci/build] Fix entrypoints test and pin outlines version (#11088) · 9974fca0
  Kevin H. Luu authored Dec 11, 2024
  
  9974fca0
10 Dec, 2024 1 commit
- [Core] Update to outlines >= 0.1.8 (#10576) · e7391949
  Russell Bryant authored Dec 10, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e7391949
09 Dec, 2024 1 commit
- [Core] Require xgrammar >= 0.1.6 (#11021) · e691b26f
  Russell Bryant authored Dec 09, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e691b26f
03 Dec, 2024 2 commits
- [Bugfix] Only require XGrammar on x86 (#10865) · 7090c27b
  Michael Goin authored Dec 03, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  7090c27b
- [Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785) · 9323a315
  Aaron Pham authored Dec 03, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  9323a315
28 Nov, 2024 1 commit
- [misc] upgrade filelock version (#10731) · cb4e1c3f
  youkaichao authored Nov 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  cb4e1c3f
15 Nov, 2024 2 commits
- [Misc] bump mistral common version (#10367) · a6221a14
  Simon Mo authored Nov 15, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a6221a14
- [Bugfix] Ensure special tokens are properly filtered out for guided structured... · 691a3ec0
  Guillaume Calmettes authored Nov 15, 2024
```
[Bugfix] Ensure special tokens are properly filtered out for guided structured output with MistralTokenizer (#10363)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  691a3ec0
13 Nov, 2024 1 commit
- Bump to compressed-tensors v0.8.0 (#10279) · 56a955e7
  Dipika Sikka authored Nov 13, 2024
```
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  56a955e7
31 Oct, 2024 1 commit
- [Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens... · abbfb613
  Guillaume Calmettes authored Oct 31, 2024
```
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)
```
  abbfb613
18 Oct, 2024 1 commit
- [BugFix] Stop silent failures on compressed-tensors parsing (#9381) · 48138a84
  Dipika Sikka authored Oct 17, 2024
  
  48138a84
16 Oct, 2024 1 commit
- [Misc] Standardize RoPE handling for Qwen2-VL (#9250) · 7e7eae33
  Cyrus Leung authored Oct 16, 2024
  
  7e7eae33
15 Oct, 2024 1 commit
- [Misc] Directly use compressed-tensors for checkpoint definitions (#8909) · 22f8a695
  Michael Goin authored Oct 15, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  22f8a695
30 Sep, 2024 1 commit
- [Misc][CI/Build] Include `cv2` via `mistral_common[opencv]` (#8951) · b6d73925
  Roger Wang authored Sep 29, 2024
  
  b6d73925
28 Sep, 2024 1 commit

[Bugfix][Intel] Fix XPU Dockerfile Build (#7824) · 260024a3

Tyler Titsworth authored Sep 27, 2024


Signed-off-by: tylertitsworth <tyler.titsworth@intel.com>
Co-authored-by: youkaichao <youkaichao@126.com>

260024a3

26 Sep, 2024 1 commit
- [Installation] Allow lower versions of FastAPI to maintain Ray 2.9 compatibility (#8764) · 1b49148e
  Cyrus Leung authored Sep 27, 2024
  
  1b49148e
25 Sep, 2024 1 commit

[Model] Add support for the multi-modal Llama 3.2 model (#8811) · 770ec602

Chen Zhang authored Sep 25, 2024


Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

770ec602

22 Sep, 2024 2 commits
- [misc] upgrade mistral-common (#8715) · 92ba7e74
  youkaichao authored Sep 22, 2024
  
  92ba7e74
- [build] enable existing pytorch (for GH200, aarch64, nightly) (#8713) · d4a2ac83
  youkaichao authored Sep 22, 2024
  
  d4a2ac83
17 Sep, 2024 1 commit
- [Bugfix] Fix 3.12 builds on main (#8510) · cca61642
  Joe Runde authored Sep 16, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cca61642
15 Sep, 2024 1 commit
- [Bugfix][Kernel] Add `IQ1_M` quantization implementation to GGUF kernel (#8357) · fc990f97
  Isotr0py authored Sep 16, 2024
  
  fc990f97
13 Sep, 2024 2 commits
- [Installation] Gate FastAPI version for Python 3.8 (#8456) · ecd7a1d5
  Cyrus Leung authored Sep 14, 2024
  
  ecd7a1d5
- [Bugfix] Bump fastapi and pydantic version (#8435) · 3f79bc3d
  Cyrus Leung authored Sep 13, 2024
  
  3f79bc3d
11 Sep, 2024 3 commits
- Pixtral (#8377) · d394787e
  Patrick von Platen authored Sep 11, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  d394787e
- [Model][VLM] Add Qwen2-VL model support (#7905) · 3b7fea77
  Yang Fan authored Sep 12, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3b7fea77
- update openai version · a48d654d
  zhuwenwen authored Sep 11, 2024
  
  a48d654d
07 Sep, 2024 1 commit
- [CI/Build] Use python 3.12 in cuda image (#8133) · cfe712bf
  Joe Runde authored Sep 07, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  cfe712bf