Commits · c9abb104893b16958d8c73f927ea37e65985f4ca · OpenDAS / vllm_cscc

25 Aug, 2025 1 commit

[Bugfix] Fix Dense module loading for sentence-transformers embedding models... · c9abb104

LIYIFAN_liyifan authored Aug 24, 2025


[Bugfix] Fix Dense module loading for sentence-transformers embedding models (simplified V2) (#23408)
Signed-off-by: FFFfff1FFFfff <yifanli0919@gmail.com>

c9abb104

23 Aug, 2025 1 commit

Revert "[PERF] Use faster way of decode in tokenizer: avoid useless... · b4e9fd81

Cyrus Leung authored Aug 23, 2025


Revert "[PERF] Use faster way of decode in tokenizer: avoid useless list-to-list conversion (#20000)" (#23396)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

b4e9fd81

21 Aug, 2025 1 commit
- [Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c31e28e
20 Aug, 2025 2 commits

[Perf] Speed up function `_convert_tokens_to_string_with_added_encoders` by 13.7x (#20413) · bf7c99df

Saurabh Misra authored Aug 20, 2025

Signed-off-by: Saurabh Misra <misra.saurabh1@gmail.com>
Signed-off-by: Aseem Saxena <aseem.bits@gmail.com>
Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
Co-authored-by: Aseem Saxena <aseem.bits@gmail.com>

bf7c99df

[Fix] fix offline env use local mode path (#22526) · 38217877
rongfu.leng authored Aug 20, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
38217877

19 Aug, 2025 1 commit

[Model] support new model ovis2.5 (#23084) · b87cb97a

myselvess authored Aug 19, 2025


Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b87cb97a

18 Aug, 2025 1 commit

chore: remove unnecessary patch_padding_side for the chatglm model (#23090) · 569aefd1

杨朱 · Kiki authored Aug 18, 2025


Signed-off-by: carlory <baofa.fan@daocloud.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

569aefd1

14 Aug, 2025 2 commits
- [Bugfix] Replace custom Encoding class with BatchEncoding in MistralTokenizer (#22786) · 625ccd1c
  Jiangyun Zhu authored Aug 14, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  625ccd1c
- Remove Phi 4 Flash configuration workaround (#22723) · f4efda82
  Harry Mellor authored Aug 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f4efda82
11 Aug, 2025 3 commits
- [BugFix] [Spec Decode] Remove LlamaForCausalLMEagle3 to fix CI (#22611) · 807d21b8
  22quinn authored Aug 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  807d21b8
- [Misc] Further clean up some redundant config definitions (#22649) · 8e13d9fe
  Isotr0py authored Aug 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8e13d9fe
- [Model] NemotronH Support (#22349) · 14a5d903
  danielafrimi authored Aug 11, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  14a5d903
10 Aug, 2025 2 commits
- Refactor sliding window configuration to Transformers best practice (#21927) · c4984839
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4984839
- [Config] add "qwen" as a native eagle3 target supported model (#22333) · 3d7363e6
  Le Chen authored Aug 10, 2025
```
Signed-off-by: lechen <lecself@163.com>
Signed-off-by: LeChen <lecself@163.com>
```
  3d7363e6
09 Aug, 2025 1 commit

GLM-4.5V with new class name at transformers (#22520) · a6022e6f

Yuxuan Zhang authored Aug 09, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a6022e6f

06 Aug, 2025 1 commit

Update transformers to `v4.55` (#21931) · 796bae07

Harry Mellor authored Aug 06, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

796bae07

05 Aug, 2025 1 commit
- [NVIDIA] Auto detect modelopt quant and fix DSR1-FP4 weight loading (#22073) · bdcb42e4
  Po-Han Huang (NVIDIA) authored Aug 05, 2025
  
  bdcb42e4
04 Aug, 2025 2 commits
- [Bugfix] Fix failing GGUF models test (#22174) · fed5849d
  Isotr0py authored Aug 04, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fed5849d
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
03 Aug, 2025 1 commit
- [Misc] Add tensor schema test coverage for multimodal models (#21754) · 3dddbf1f
  Isotr0py authored Aug 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3dddbf1f
02 Aug, 2025 1 commit
- [PERF] Use faster way of decode in tokenizer: avoid useless list-to-list conversion (#20000) · 58eee5f2
  Vadim Gimpelson authored Aug 02, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  58eee5f2
01 Aug, 2025 2 commits
- [Speculative Decoding] Add `speculators` config support (#21345) · dfbc1f88
  Dipika Sikka authored Aug 01, 2025
  
  dfbc1f88
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
31 Jul, 2025 1 commit

[Model] Add step3 vl (#21998) · 94846416

Song authored Jul 31, 2025


Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>

94846416

30 Jul, 2025 2 commits
- [CI/Build] Fix registry tests (#21934) · 004203e9
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  004203e9
- [Misc] Remove redundant config definitions (#21891) · 2ca5f82c
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ca5f82c
28 Jul, 2025 2 commits

[Bugfix] Mistral crashes on tool with no description (#21167) · 25708d31
Michard Hugo authored Jul 28, 2025
```
Signed-off-by: HugoMichard <hugo@harfanglab.fr>
```
25708d31

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

27 Jul, 2025 1 commit
- [VLM] Support HF format Phi-4-MM model (#17121) · eed2f463
  Isotr0py authored Jul 27, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  eed2f463
26 Jul, 2025 2 commits
- [Misc] remove unused try-except in pooling config check (#21618) · 05c1126f
  Reid authored Jul 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  05c1126f
- [Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818) · 62965de5
  Farzad Abdolhosseini authored Jul 26, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
Signed-off-by: Patrick Li <patrick8289@gmail.com>
Co-authored-by: Patrick Li <patrick8289@gmail.com>
```
  62965de5
25 Jul, 2025 1 commit
- [Bugfix] GGUF: fix AttributeError: 'PosixPath' object has no attribute 'startswith' (#21579) · 7311f744
  Kebe authored Jul 25, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  7311f744
24 Jul, 2025 1 commit
- Add think chunk (#21333) · 6d8d0a24
  Julien Denize authored Jul 24, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  6d8d0a24
23 Jul, 2025 1 commit
- [Bugfix] Fix nightly transformers CI failure (#21427) · 4ecedd18
  Isotr0py authored Jul 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  4ecedd18
21 Jul, 2025 1 commit
- [Bugfix] Fix missing placeholder in logger debug (#21280) · 378d33c3
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  378d33c3
19 Jul, 2025 2 commits
- [Model] EXAONE 4.0 model support (#21060) · 3e04107d
  김종곤 authored Jul 19, 2025
```
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
```
  3e04107d
- [V0 Deprecation] Remove V0 Spec Decode workers (#21152) · dd572c0a
  Woosuk Kwon authored Jul 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dd572c0a
18 Jul, 2025 1 commit

[Bugfix] The special_tokens in tokenizer should also be controlled by... · 5895afd7

wang.yuqi authored Jul 18, 2025


[Bugfix] The special_tokens in tokenizer should also be controlled by do_lower_case in encoder_config. (#20750)
Signed-off-by: wang.yuqi <noooop@126.com>

5895afd7

17 Jul, 2025 1 commit

[VLM] Add Nemotron-Nano-VL-8B-V1 support (#20349) · 4ef00b5c

kYLe authored Jul 17, 2025


Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4ef00b5c

16 Jul, 2025 1 commit
- Remove Qwen Omni workaround that's no longer necessary (#21057) · a931b4cd
  Harry Mellor authored Jul 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a931b4cd