Commits · 68ffbca7e462cfa6a32b46dabc9a604c7c1b918d · OpenDAS / vllm_cscc

02 Dec, 2025 3 commits

[Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851) · 68ffbca7
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
68ffbca7

Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e

Julien Denize authored Dec 02, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>

d8c6210e

[Chore] Move tokenizer initialization methods (#29793) · 653591d5
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
653591d5

01 Dec, 2025 4 commits
- [Hardware][AMD] Remove ROCm skip conditions for transformers backend tests (#29782) · d0985c5f
  BADAOUI Abdennacer authored Dec 01, 2025
```
Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>
```
  d0985c5f
- [multimodal][test] Reduce memory utilization for test_siglip to avoid OOM (#29504) · ad9d656b
  Zhengxu Chen authored Dec 01, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ad9d656b
- [Misc] Unify tokenizer registration (#29767) · f0a28bf6
  Cyrus Leung authored Dec 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a28bf6
- [CI] Skip paddleocr_vl for transformer 4.57.3 (#29758) · 83805a60
  Huamin Li authored Nov 30, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  83805a60
30 Nov, 2025 1 commit
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba
29 Nov, 2025 2 commits
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
- [ROCm][Bugfix] Patch for the `Multi-Modal Processor Test` group (#29702) · ea3370b4
  Andreas Karatzas authored Nov 28, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ea3370b4
28 Nov, 2025 4 commits

[Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30

Cyrus Leung authored Nov 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7675ba30

[Misc] Remove redundant attention var constants (#29650) · 33b06a6f
Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
33b06a6f

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

[Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594) · 37b15e97

EanWang211123 authored Nov 28, 2025


Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

37b15e97

26 Nov, 2025 1 commit
- Fix TeleChatForCausalLM not register issue (#29473) · bb706d60
  Yejing Lai authored Nov 26, 2025
```
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
```
  bb706d60
25 Nov, 2025 2 commits

[Feature]: Improve GGUF loading from HuggingFace user experience like repo_id:quant_type (#29137) · 794029f0

Injae Ryou authored Nov 25, 2025


Signed-off-by: Injae Ryou <injaeryou@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

794029f0

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

24 Nov, 2025 1 commit

[Model] Add OpenCUA-7B support (#29068) · 30854783

Zero authored Nov 24, 2025

Signed-off-by: lim4349 <rockmanzero@naver.com>
Signed-off-by: Zero <rockmanzero@naver.com>
Co-authored-by: Cloud User <ubuntu@a100-80g-4.novalocal>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

30854783

23 Nov, 2025 1 commit
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
21 Nov, 2025 2 commits

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

Update model references for OLMo3 (#29099) · 87cbbdff

Michael Goin authored Nov 20, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

87cbbdff

20 Nov, 2025 2 commits
- [MODEL] Implement plamo3 (#28834) · c9e09311
  Shinichi Hemmi authored Nov 20, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
  c9e09311
- [Model][QwenVL] Replace `torch.repeat_interleave` with faster `np.repeat` (#28964) · a9705a29
  Lukas Geiger authored Nov 20, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  a9705a29
19 Nov, 2025 3 commits

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304

[Misc] Update embedding/cross encoder tests to use `mteb` v2 (#27329) · 71d0ae1c

Roman Solomatin authored Nov 19, 2025


Signed-off-by: Roman Solomatin <36135455+Samoed@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

71d0ae1c

Enable bitsandbytes quantization on AMD GPUs that use warp size 32 (#27307) · 814843e0
Strahinja Stamenkovic authored Nov 19, 2025
```
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
```
814843e0

18 Nov, 2025 2 commits

[chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78

Kevin H. Luu authored Nov 18, 2025


Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c64c0b78

[Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371

Luciano Martins authored Nov 18, 2025

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c2612371

17 Nov, 2025 1 commit

[Model] Add Afmoe architecture implementation (#28332) · f77bce00

Pranav authored Nov 17, 2025


Signed-off-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
Signed-off-by: Pranav <veldurthipranav@gmail.com>
Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>

f77bce00

16 Nov, 2025 1 commit
- [Model] Allow users to control skip reading cache per request. (#28194) · a55b6463
  wang.yuqi authored Nov 16, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  a55b6463
14 Nov, 2025 4 commits
- Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110) · 2e0ad629
  Laith Sakka authored Nov 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  2e0ad629
- [Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
  Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5f3cd7f7
- [Fix] improve aspect ratio in dummy image generation and add common VLM tests... · c934caee
  dongbo910220 authored Nov 15, 2025
```
[Fix] improve aspect ratio in dummy image generation and add common  VLM tests for PaddleOCR-VL (#28711)
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  c934caee
- [Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
  Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  511a6b61
13 Nov, 2025 1 commit
- [Misc] Turn off encoder torch compile by default (#28634) · d3387750
  Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d3387750
12 Nov, 2025 4 commits
- [CI] Skip "Multi-Modal Models Test (Extended) 3" test that's broken in current... · a39dd7bb
  Harry Mellor authored Nov 12, 2025
```
[CI] Skip "Multi-Modal Models Test (Extended) 3" test that's broken in current Transformers (#28559)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a39dd7bb
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
- `VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf
  Andreas Karatzas authored Nov 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
```
  9f0247cf
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
11 Nov, 2025 1 commit
- [Quantization] fix attention quantization of gpt_oss model (#27334) · 5a1271d8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  5a1271d8