Commits · c68b5c63eba0ecccda8ab34ca1829cb4ced2c430 · OpenDAS / vllm_cscc

"csrc/vscode:/vscode.git/clone" did not exist on "d0bc2f810b7a34247154b078c2429bf62519e9ca"

28 May, 2025 2 commits
- [Misc] fix olmoe model layer can't laod in tp gt 1 (#18828) · c68b5c63
  rongfu.leng authored May 29, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  c68b5c63
- [Bugfix] Fix nomic max_model_len (#18755) · 3e9ce609
  wang.yuqi authored May 28, 2025
  
  3e9ce609
27 May, 2025 5 commits
- [Core] Automatically cast multi-modal input dtype (#18756) · 696259ca
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  696259ca
- [Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c
  Hyogeun Oh (오효근) authored May 27, 2025
```
[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  a68e293c
- [BUG FIX] minicpm (#18739) · 68811079
  Shawn Huang authored May 27, 2025
```
Signed-off-by: huangyuxiang03 <huangyx0321@gmail.com>
Co-authored-by: huangyuxiang03 <huangyx0321@gmail.com>
```
  68811079
- [Model][Gemma3] Cast image pixel values already on CPU (#18732) · b50602d5
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b50602d5
- [Model][Gemma3] Simplify image input validation (#18710) · 0eebd748
  Lukas Geiger authored May 27, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  0eebd748
26 May, 2025 3 commits
- [Bugfix] Fix Llama GGUF initialization (#18717) · a869baca
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a869baca
- [Model] Add support for YARN in NemotronNAS models (#18427) · 6d68030f
  Naveassaf authored May 26, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  6d68030f
- [Bugfix] Fix the lm_head in gpt_bigcode in lora mode (#6357) · 561b77a0
  Maximilien de Bayser authored May 26, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
```
  561b77a0
25 May, 2025 2 commits
- [Bugfix] Fix profiling dummy data for Pixtral (#18677) · 57fd13a7
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  57fd13a7
- [VLM] Initialize video input support for InternVL models (#18499) · 75f81750
  Isotr0py authored May 25, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  75f81750
24 May, 2025 2 commits
- [Model] use AutoWeightsLoader for gpt2 (#18625) · 2cd4d58d
  ztang2370 authored May 24, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  2cd4d58d
- [Model] Add support for Qwen2.5-Omni-7B-AWQ (Qwen2_5OmniForConditionalGeneration) (#18647) · a8593205
  Yuanhao WU authored May 24, 2025
  
  a8593205
23 May, 2025 10 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [CI] Enable test_initialization to run on V1 (#16736) · 0ddf88e1
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0ddf88e1
- [V1] Support Deepseek MTP (#18435) · 2628a69e
  Jiayi Yao authored May 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  2628a69e
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a
- [Bugfix][Model] Fix baichuan model loader for tp (#18597) · 4ce64e2d
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  4ce64e2d
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- [Spec Decode] Make EAGLE3 draft token ID mapping optional (#18488) · 583507d1
  Benjamin Chislett authored May 22, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  583507d1
- Enable hybrid attention models for Transformers backend (#18494) · 4b0da7b6
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b0da7b6
- [V1][Spec Decoding] Use model_loader.get_model() to load models (#18273) · c6b636f9
  Mark McLoughlin authored May 23, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  c6b636f9
- Re-submit: Fix: Proper RGBA -> RGB conversion for PIL images. (#18569) · 04eb88dc
  Chenheli Hua authored May 22, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  04eb88dc
22 May, 2025 3 commits
- [Bugfix][Model] Make Olmo2Model weight loading return loaded weights (#18504) · 51797775
  Shane A authored May 21, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
  51797775
- [Bugfix] Inconsistent token calculation compared to HF in llava family (#18479) · d022115c
  youngrok cha authored May 22, 2025
```
Signed-off-by: jaycha <jaycha@ncsoft.com>
```
  d022115c
- [FalconH1] Fix output dtype in RMSNorm fallback path for Falcon-H1 (e.g. 0.5B) (#18500) · 20bd6f4d
  Dhia Eddine Rhaiem authored May 22, 2025
```
Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>
```
  20bd6f4d
21 May, 2025 2 commits

Dhia Eddine Rhaiem authored May 21, 2025


Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>

eca18691

[Bugfix] config.head_dim is now explicitly set to None (#18432) · 0c15c2e4
Gregory Shtrasberg authored May 21, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
0c15c2e4

20 May, 2025 2 commits
- [Model] use AutoWeightsLoader for bloom (#18300) · e1f5a71e
  Calvin Chen authored May 21, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  e1f5a71e
- [Misc] Allow `AutoWeightsLoader` to skip loading weights with specific substr in name (#18358) · f07a673e
  Isotr0py authored May 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f07a673e
19 May, 2025 1 commit
- [Spec Decode][V0] Fix spec decode correctness test in V0 eagle/medusa (#18175) · 9da1095d
  wwl2755 authored May 18, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  9da1095d
18 May, 2025 1 commit
- Fix copy-paste error in phi4mm image processing (#18315) · 4fb349f6
  Lifu Huang authored May 18, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  4fb349f6
17 May, 2025 1 commit
- [Model] use AutoWeightsLoader for solar (#18113) · 9214e606
  rongfu.leng authored May 17, 2025
  
  9214e606
16 May, 2025 3 commits
- [Model] Use autoweightloader for dbrx (#18251) · 87d87147
  learner0810 authored May 16, 2025
```
Signed-off-by: learner0810 <zhongjun.li@daocloud.io>
```
  87d87147
- [PERF] Speed up Qwen2.5-VL model by speed up rotary position embedding (#17973) · 67da5720
  Vadim Gimpelson authored May 16, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  67da5720
- [Model] vLLM v1 supports Medusa (#17956) · f4937a51
  Sky Lee authored May 16, 2025
```
Signed-off-by: lisiqi23 <lisiqi23@xiaomi.com>
Signed-off-by: skylee-01 <497627264@qq.com>
Co-authored-by: lisiqi23 <lisiqi23@xiaomi.com>
```
  f4937a51
15 May, 2025 3 commits
- fix: typos (#18151) · a9944aab
  omahs authored May 15, 2025
```
Signed-off-by: omahs <73983677+omahs@users.noreply.github.com>
```
  a9944aab
- [Model] Allow the use of sliding window in Qwen2 (#17772) · dd2a9459
  inkcherry authored May 15, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@intel.com>
```
  dd2a9459
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193