Commits · a04720bc36401d831cb048c3917b9e58173d9c1d · OpenDAS / vllm_cscc

22 May, 2025 1 commit
- [V1][Spec Decode][Bugfix] Load quantize weights for EAGLE (#18290) · a04720bc
  Ekagra Ranjan authored May 22, 2025
  
  a04720bc
17 May, 2025 1 commit

[BugFix] Correct max_model_len derivation from config.json for Mistral format (#17937) · 4ee4826e

汪志鹏 authored May 16, 2025


Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: tracelogfb <48808670+tracelogfb@users.noreply.github.com>
Co-authored-by: Stephen Chen <tracelog@meta.com>

4ee4826e

13 May, 2025 1 commit
- Update deprecated type hinting in `vllm/transformers_utils` (#18058) · 8c946cec
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c946cec
12 May, 2025 2 commits
- [Misc] Improve modelscope import error (#17983) · 7ea6cb28
  Jee Jee Li authored May 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7ea6cb28
- [Model] Broadcast Ovis2 implementation to fit Ovis1.6 (#17861) · 021c16c7
  Isotr0py authored May 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  021c16c7
11 May, 2025 1 commit
- [Bugfix] Add revision to `transformers.Auto*.from_pretrained` processors (#17948) · 90d0a74b
  xinli-centml authored May 11, 2025
```
Signed-off-by: Xin Li <xin@centml.ai>
```
  90d0a74b
08 May, 2025 1 commit
- [Frontend] Chat template fallbacks for multimodal models (#17805) · 96722aa8
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96722aa8
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
01 May, 2025 1 commit
- [Model] Refactor Ovis2 to support original tokenizer (#17537) · 88c83041
  Isotr0py authored May 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  88c83041
30 Apr, 2025 3 commits

[Bugfix] Fixed mistral tokenizer path when pointing to file (#17457) · 739e03b3
Pete Savage authored Apr 30, 2025
```
Signed-off-by: Pete Savage <psavage@redhat.com>
```
739e03b3

[MODEL ADDITION] Ovis2 Model Addition (#15826) · 54072f31

Marco authored Apr 30, 2025


Signed-off-by: Marco <121761685+mlinmg@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

54072f31

Truncation control for embedding models (#14776) · 1c2bc7ea

Gabriel Marinho authored Apr 29, 2025


Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1c2bc7ea

29 Apr, 2025 3 commits
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
- [Model] support MiniMax-VL-01 model (#16328) · cde384cd
  qscqesze authored Apr 29, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  cde384cd
- [V1][Spec Decode] Make Eagle model arch config driven (#17323) · e1360005
  Ekagra Ranjan authored Apr 28, 2025
  
  e1360005
28 Apr, 2025 1 commit
- [Core] Remove legacy input mapper/processor from V0 (#15686) · aec9674d
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aec9674d
27 Apr, 2025 1 commit
- [Misc] Make cached tokenizer pickle-compatible (#17048) · 93a126fb
  Cyrus Leung authored Apr 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  93a126fb
25 Apr, 2025 1 commit
- Use Transformers helper `get_text_config()` instead of checking for `text_config` (#17105) · 423e9f1c
  Harry Mellor authored Apr 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  423e9f1c
24 Apr, 2025 3 commits
- Better error message for missing mistral params.json (#17132) · 9420a1fc
  Michael Goin authored Apr 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9420a1fc
- [Misc] Remove OLMo2 config copy (#17066) · b0c1f620
  Isotr0py authored Apr 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b0c1f620
- Simplify `TokenizerGroup` (#16790) · 0a05ed57
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0a05ed57
23 Apr, 2025 2 commits
- Mistral-format support for compressed-tensors (#16803) · aa72d9a4
  Michael Goin authored Apr 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  aa72d9a4
- Revert "[Misc] Add S3 environment variables for better support of MinIO." (#17021) · 6bc1e30e
  Chauncey authored Apr 23, 2025
  
  6bc1e30e
22 Apr, 2025 1 commit
- [Misc] Add S3 environment variables for better support of MinIO. (#16977) · 68d4c332
  Chauncey authored Apr 22, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  68d4c332
19 Apr, 2025 1 commit

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) · 2c1bd848

Yang Fan authored Apr 19, 2025


Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>

2c1bd848

14 Apr, 2025 1 commit
- [Model][VLM] Add Kimi-VL model support (#16387) · b1308b84
  courage17340 authored Apr 15, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  b1308b84
10 Apr, 2025 2 commits
- [V1][Spec Decode] Eagle Model loading (#16035) · e8224f3d
  Lily Liu authored Apr 10, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  e8224f3d
- [Bugfix]: do not shutdown server if `skip_special_use=False` for MistralTokenizer (#14094) · 1da6a092
  Guillaume Calmettes authored Apr 10, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  1da6a092
06 Apr, 2025 2 commits
- [Bugfix] add hf_token to EngineArgs (#16093) · da224daa
  paolovic authored Apr 06, 2025
```
Signed-off-by: paolovic <paul-philipp.luley@uzh.ch>
Co-authored-by: paolovic <paul-philipp.luley@uzh.ch>
```
  da224daa
- [Misc] Improve model redirect to accept json dictionary (#16119) · c2a96715
  Isotr0py authored Apr 06, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c2a96715
04 Apr, 2025 1 commit

[Misc] improve gguf check (#15974) · 86cbd2ee

Reid authored Apr 04, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

86cbd2ee

03 Apr, 2025 1 commit
- fix: better error message for get_config close #13889 (#15943) · 37bfee92
  yihong authored Apr 03, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  37bfee92
30 Mar, 2025 1 commit
- fix: Comments to English for better dev experience (#15768) · 70fedd0f
  yihong authored Mar 31, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  70fedd0f
29 Mar, 2025 1 commit

[Model] Support Skywork-R1V (#15397) · de1cb387

pengyuange authored Mar 29, 2025


Signed-off-by: jiacai.liu <932997367@qq.com>
Co-authored-by: jiacai.liu <932997367@qq.com>

de1cb387

28 Mar, 2025 1 commit
- [Bugfix] Fix regex compile display format (#15368) · 432cf22a
  Kebe authored Mar 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  432cf22a
27 Mar, 2025 1 commit
- [Misc] Use model_redirect to redirect the model name to a local folder. (#14116) · 3f532cb6
  wang.yuqi authored Mar 27, 2025
  
  3f532cb6
26 Mar, 2025 1 commit
- [Feature] Enhance EAGLE Architecture with Proper RMS Norms (#14990) · 781d0562
  Bryan Lu authored Mar 26, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  781d0562
21 Mar, 2025 1 commit
- [V1] Avoid redundant input processing in n>1 case (#14985) · da6ea29f
  Nick Hill authored Mar 20, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da6ea29f
20 Mar, 2025 1 commit
- Fixing Imprecise Type Annotations (#15192) · c607a265
  Wang Ran (汪然) authored Mar 20, 2025
  
  c607a265
19 Mar, 2025 1 commit
- [Model] Remove duplicated message check in Mistral chat completion request (#15069) · 8b3e94a3
  Brayden Zhong authored Mar 19, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  8b3e94a3