Commits · 42f52cc95bf34a2e15f4cdbc8474503a9bcc970f · OpenDAS / vllm_cscc

11 Jun, 2025 1 commit
- [New Model]: Support Qwen3 Embedding & Reranker (#19260) · 3952731e
  wang.yuqi authored Jun 11, 2025
  
  3952731e
10 Jun, 2025 1 commit
- [Model] use AutoWeightsLoader for commandr (#19399) · 33f8dba7
  py-andy-c authored Jun 10, 2025
```
Signed-off-by: py-andy-c <pychen1017@gmail.com>
```
  33f8dba7
06 Jun, 2025 2 commits
- [Model] Optimize nemotron_h implementation (#19249) · 7661e92e
  Jee Jee Li authored Jun 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7661e92e
- [Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033) · 3465b87e
  Benjamin Chislett authored Jun 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  3465b87e
05 Jun, 2025 1 commit

[Model] NemotronH support (#18863) · cb6d572e

Luis Vega authored Jun 05, 2025


Signed-off-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
Co-authored-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>

cb6d572e

04 Jun, 2025 2 commits
- [CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678) · 01dc9a76
  Cyrus Leung authored Jun 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  01dc9a76
- Improve the output precision of embedding models (#19092) · 35cf32df
  wang.yuqi authored Jun 04, 2025
  
  35cf32df
03 Jun, 2025 3 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Misc] Update `WeightsMapper` for qwen2-vl/qwen2.5-vl (#19054) · ec2dcd80
  Isotr0py authored Jun 03, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ec2dcd80
- Add tarsier model support (#18985) · 1282bd81
  汪志鹏 authored Jun 03, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  1282bd81
02 Jun, 2025 1 commit

[Model] enable data parallel for Llama4 vision encoder (#18368) · ebb1ec93

jennyyyyzhen authored Jun 02, 2025


Signed-off-by: yzhen <yzhen@devgpu093.cco2.facebook.com>
Co-authored-by: yZhen <yZhen@fb.com>
Co-authored-by: yzhen <yzhen@devgpu093.cco2.facebook.com>

ebb1ec93

01 Jun, 2025 2 commits

[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with... · a35ca765

Isotr0py authored Jun 01, 2025


[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with arbitrary components (#18987)
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>

a35ca765

[Bugfix] Fix EAGLE3 broken logits (#18909) · 1bc86a3d
Benjamin Chislett authored May 31, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
1bc86a3d

30 May, 2025 6 commits
- [VLM] Add PP support and fix GPTQ inference for Ovis models (#18958) · 5a864163
  Isotr0py authored May 31, 2025
```
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5a864163
- [Feature] minicpm eagle support (#18943) · e1fadf11
  Shawn Huang authored May 30, 2025
```
Signed-off-by: huangyuxiang03 <huangyx0321@gmail.com>
Co-authored-by: huangyuxiang03 <huangyx0321@gmail.com>
```
  e1fadf11
- [Model] Use in-place adds in SigLIP (#18922) · c3bb9f23
  Lukas Geiger authored May 30, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  c3bb9f23
- [Deprecation] Remove mean pooling default for `Qwen2EmbeddingModel` (#18913) · 4f4a6b84
  Cyrus Leung authored May 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4f4a6b84
- [Model] Use AutoWeightsLoader for mamba2 (#18918) · 3987e2ae
  iLeGend authored May 30, 2025
```
Signed-off-by: iLeGend <824040212@qq.com>
```
  3987e2ae
- [Misc] Update type annotation for rotary embedding `base` (#18914) · 1aa2f81b
  Cyrus Leung authored May 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1aa2f81b
29 May, 2025 2 commits
- [LoRA] Add LoRA support for InternVL (#18842) · 34d6c447
  Jee Jee Li authored May 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  34d6c447
- Prevent the cross-encoder logic from being applied to classification tasks (#18838) · 515b413e
  Maximilien de Bayser authored May 28, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  515b413e
28 May, 2025 2 commits
- [Misc] fix olmoe model layer can't laod in tp gt 1 (#18828) · c68b5c63
  rongfu.leng authored May 29, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  c68b5c63
- [Bugfix] Fix nomic max_model_len (#18755) · 3e9ce609
  wang.yuqi authored May 28, 2025
  
  3e9ce609
27 May, 2025 5 commits
- [Core] Automatically cast multi-modal input dtype (#18756) · 696259ca
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  696259ca
- [Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c
  Hyogeun Oh (오효근) authored May 27, 2025
```
[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  a68e293c
- [BUG FIX] minicpm (#18739) · 68811079
  Shawn Huang authored May 27, 2025
```
Signed-off-by: huangyuxiang03 <huangyx0321@gmail.com>
Co-authored-by: huangyuxiang03 <huangyx0321@gmail.com>
```
  68811079
- [Model][Gemma3] Cast image pixel values already on CPU (#18732) · b50602d5
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b50602d5
- [Model][Gemma3] Simplify image input validation (#18710) · 0eebd748
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0eebd748
26 May, 2025 3 commits
- [Bugfix] Fix Llama GGUF initialization (#18717) · a869baca
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a869baca
- [Model] Add support for YARN in NemotronNAS models (#18427) · 6d68030f
  Naveassaf authored May 26, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  6d68030f
- [Bugfix] Fix the lm_head in gpt_bigcode in lora mode (#6357) · 561b77a0
  Maximilien de Bayser authored May 26, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
  561b77a0
25 May, 2025 2 commits
- [Bugfix] Fix profiling dummy data for Pixtral (#18677) · 57fd13a7
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  57fd13a7
- [VLM] Initialize video input support for InternVL models (#18499) · 75f81750
  Isotr0py authored May 25, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  75f81750
24 May, 2025 2 commits
- [Model] use AutoWeightsLoader for gpt2 (#18625) · 2cd4d58d
  ztang2370 authored May 24, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  2cd4d58d
- [Model] Add support for Qwen2.5-Omni-7B-AWQ (Qwen2_5OmniForConditionalGeneration) (#18647) · a8593205
  Yuanhao WU authored May 24, 2025
  
  a8593205
23 May, 2025 5 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [CI] Enable test_initialization to run on V1 (#16736) · 0ddf88e1
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0ddf88e1
- [V1] Support Deepseek MTP (#18435) · 2628a69e
  Jiayi Yao authored May 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  2628a69e
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a
- [Bugfix][Model] Fix baichuan model loader for tp (#18597) · 4ce64e2d
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  4ce64e2d