Commits · c7c80af084e4d87c4e73148cb71ee990970281ff · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "77ae0f0de89d6d7a7c5040d8cb229b9389531e5f"

26 Aug, 2025 11 commits
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [Misc] Fix comments in `tests/kernels/quantization` (#23675) · c37c0af9
  Jiangyun Zhu authored Aug 27, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c37c0af9
- [Bugfix] Fix incorrect original shape in hashing (#23672) · 9715f7bb
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  9715f7bb
- [Kernel] Added flashinfer fp8 per-tensor gemms (#22895) · f66673a3
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f66673a3
- Support FlashAttention Backend for Hybrid SSM Models (#23299) · 2b4fc9bd
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  2b4fc9bd
- feat: add usage to TranscriptionResponse (text and json response_format) (#23576) · ebd5a77b
  Guillaume Calmettes authored Aug 26, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  ebd5a77b
- [Bugfix] Fix scheduling when repeated images in one request (#23544) · b5d34af3
  Roger Wang authored Aug 26, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
```
  b5d34af3
- [fix] fix seed-oss-parser (#23560) · 959783fb
  Bin Jia authored Aug 26, 2025
```
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
```
  959783fb
- [CI/Build] Fix typo in #23561 (#23616) · ce0e9dbd
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ce0e9dbd
- [CI/Build] Use vLLM client's user agent to fetch images (#23561) · 6fd45e7b
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6fd45e7b
- [CI Fix] Pin deepep and pplx tags in tools/ep_kernels/, gate multigpu tests (#23568) · 906e461e
  Michael Goin authored Aug 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  906e461e
25 Aug, 2025 10 commits
- [Kernel] Add fused grouped_topk kernel for MoE (#23274) · 8a3cd90a
  Xin Yang authored Aug 25, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  8a3cd90a
- [test][RL] Add sleep level 2 test and fix reload with sleep mode (#23521) · 2a167b2e
  22quinn authored Aug 25, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  2a167b2e
- Updates to Flex + VLLm integration (#21416) · e0329ed4
  Driss Guessous authored Aug 25, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  e0329ed4
- [Refactor] Pass `tokenizer` explicitly instead of binding to prompt update (#23542) · 6879cd80
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6879cd80
- [Attention] Unify mamba and attention backend selection (#23171) · 5c4b6e66
  Ayush Satyam authored Aug 25, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
```
  5c4b6e66
- Feature/benchmark/random mm data/images (#23119) · 0cb7b065
  Breno Baldas Skuk authored Aug 25, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  0cb7b065
- [Core][Multimodal] Track encode cache entries by mm_hash and enable embedding... · d765cf01
  Chenguang Zheng authored Aug 25, 2025
```
[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  d765cf01
- [Refactor] Dynamic `target` and `content` for prompt updates (#23411) · 712d0f88
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  712d0f88
- [Bugfix] Fix Dense module loading for sentence-transformers embedding models... · c9abb104
  LIYIFAN_liyifan authored Aug 24, 2025
```
[Bugfix] Fix Dense module loading for sentence-transformers embedding models (simplified V2) (#23408)
Signed-off-by: FFFfff1FFFfff <yifanli0919@gmail.com>
```
  c9abb104
- Frontend: Adding LM Format Enforcer support to V1 engine (#22564) · 39971db3
  Noam Gat authored Aug 25, 2025
```
Signed-off-by: Noam Gat <noamgat@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  39971db3
24 Aug, 2025 3 commits
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
- (Misc): add missing test for zero truncation size. (#23457) · 5e021b49
  TeeKen Lau authored Aug 24, 2025
```
Signed-off-by: teekenl <teekenlau@gmail.com>
```
  5e021b49
- [kernel] Support W4A8 on Hopper (#23198) · e76e2335
  czhu-cohere authored Aug 24, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  e76e2335
23 Aug, 2025 1 commit
- fix(tests): Correct unreachable assertion in truncation test (#23425) · d9a55204
  Aziz authored Aug 23, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
```
  d9a55204
22 Aug, 2025 14 commits
- [NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703) · 24d0c9e6
  elvischenv authored Aug 23, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  24d0c9e6
- [PERF] PyTorch Symmetric Memory All-Reduce (#20759) · 0313cf85
  Ilya Markov authored Aug 22, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0313cf85
- [Model] Add Ovis2.5 PP support (#23405) · 32d2b406
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32d2b406
- Add unit tests for batched guided and non-guided requests (#23389) · b6d7d34f
  Yong Hoon Shin authored Aug 22, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  b6d7d34f
- fix(tests): Ensure reliable CUDA cache clearing in MoE test (#23416) · 341923b9
  Aziz authored Aug 22, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  341923b9
- [V0 Deprecation] Remove V0 LoRA test (#23418) · 285178b3
  Jee Jee Li authored Aug 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  285178b3
- [P/D][Nixl] Make kv cache register compatible with hybrid memory allocator (#23079) · 53415653
  Flora Feng authored Aug 21, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  53415653
- [Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154) · 17373dcd
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  17373dcd
- [New Model] Add Seed-Oss model (#23241) · 59640693
  Bin Jia authored Aug 22, 2025
```
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  59640693
- [CI] Add end-to-end V1 min_tokens test coverage (#22495) · 111692bb
  Arjun Reddy authored Aug 21, 2025
```
Signed-off-by: Arjun Reddy <189282188+arjunbreddy22@users.noreply.github.com>
Co-authored-by: Arjun Reddy <189282188+arjunbreddy22@users.noreply.github.com>
```
  111692bb
- [CI/Build] Skip Idefics3 and SmolVLM generation test again (#23356) · 3ac84966
  Isotr0py authored Aug 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3ac84966
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
- [Core] Support custom executor qualname (#23314) · 480bdf5a
  22quinn authored Aug 21, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  480bdf5a
21 Aug, 2025 1 commit
- [Feature][Responses API] Support logprobs(non-stream) (#23319) · 5368f768
  Kebe authored Aug 22, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5368f768