Commits · 9a521c23ec2413e6f8a05ee1c082e56f1ac99ed7 · OpenDAS / vllm_cscc

01 Sep, 2025 3 commits
- update fused_moe,py · 9a521c23
  zhuwenwen authored Sep 01, 2025
  
  9a521c23
- update invoke_fused_moe_kernel() arguments · 90c5cc41
  zhuwenwen authored Sep 01, 2025
  
  90c5cc41
- update invoke_fused_moe_kernel() arguments · 40ff7bb2
  zhuwenwen authored Sep 01, 2025
  
  40ff7bb2
26 Aug, 2025 1 commit
- support --no-enable-prefix-caching · ea0ccfe6
  zhuwenwen authored Aug 26, 2025
  
  ea0ccfe6
21 Aug, 2025 1 commit
- Merge tag 'v0.10.1.1' into v0.10.1.1-ori · 7a5df8f7
  zhuwenwen authored Aug 21, 2025
  
  7a5df8f7
20 Aug, 2025 3 commits

Do not use eval() to convert unknown types (#23266) · 1da94e67
Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
1da94e67

Limit HTTP header count and size (#23267) · d8b736f9

Russell Bryant authored Aug 20, 2025


Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

d8b736f9

[BugFix] fix CUTLASS MLA full cudagraph (#23200) · 3a8708f6
Lucas Wilkinson authored Aug 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
3a8708f6

19 Aug, 2025 2 commits
- remove conch-triton-kernels and skip AiterFlashAttentionMetadata · 5876ee95
  zhuwenwen authored Aug 19, 2025
  
  5876ee95
- Merge remote-tracking branch 'mirror/releases/v0.10.1' into v0.10.1-ori · 185d5e7c
  zhuwenwen authored Aug 19, 2025
  
  185d5e7c
18 Aug, 2025 4 commits
- Use Blackwell FlashInfer MXFP4 MoE by default if available (#23008) · aab54987
  Michael Goin authored Aug 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  aab54987
- fix: OpenAI SDK compat (ResponseTextConfig) (#23126) · ba6928cf
  Breno Baldas Skuk authored Aug 19, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
Signed-off-by: Breno Baldas Skuk <breno.skuk@hcompany.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ba6928cf
- [CI Bugfix] Pin `openai<1.100` to unblock CI (#23118) · befedf86
  Michael Goin authored Aug 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  befedf86
- Merge tag 'v0.10.1' into v0.10.1-ori · bc74e4c4
  zhuwenwen authored Aug 18, 2025
  
  bc74e4c4
17 Aug, 2025 12 commits
- fix: gptq marlin weight loading failure (#23066) · 0fc8fa75
  Simon Mo authored Aug 17, 2025
  
  0fc8fa75
- [XPU] fix xpu to set cudagraph batch sizes (#23044) · 21e39436
  Calvin Chen authored Aug 18, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  21e39436
- [Misc] Convert use_structured_output property into constant (#23060) · 6d243efe
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d243efe
- [Misc] Remove dead return (#23061) · c55bc1db
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c55bc1db
- [BugFix] Fix for IMA in FA3 varlen combine (#22967) · 292084e7
  Lucas Wilkinson authored Aug 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  292084e7
- [Misc] fix typo in the multimodal doc (#23051) · 16bff144
  Kevinzz authored Aug 17, 2025
  
  16bff144
- [Bugfix] should use stack instead of concat (#22972) · fe0411fc
  947132885 authored Aug 17, 2025
```
Signed-off-by: 947132885 <947132885@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fe0411fc
- [Kernel] Add cuda kernel for gpt_oss activation (#22951) · 4d4061b6
  Jee Jee Li authored Aug 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d4061b6
- [Misc] method name typo fix (#23042) · 87f48623
  Ning Xie authored Aug 17, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  87f48623
- [Refactor] Defer tensor data construction in MultiModalKwargs (#23030) · 5c32143b
  Cyrus Leung authored Aug 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5c32143b
- [UX] Separate marlin moe config logic from triton moe (#23006) · 94096a47
  Michael Goin authored Aug 16, 2025
  
  94096a47
- [Bugfix] fix qwen3 moe fp8 accuracy issue (#23031) · a258ad8b
  Jinzhen Lin authored Aug 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
  a258ad8b
16 Aug, 2025 14 commits

[V1] Logits processors extensibility (#19912) · bf7f470b

afeldman-nm authored Aug 16, 2025


Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: Andrew Feldman <afeld2012@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf7f470b

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

[Flaky CI] Increase timeout tolerance for... · 3253ae76

Michael Goin authored Aug 16, 2025


[Flaky CI] Increase timeout tolerance for test_mp_crash_detection+test_default_mm_lora_chat_completions (#23028)
Signed-off-by: mgoin <mgoin64@gmail.com>

3253ae76

[Bugfix gpt-oss] Fix float32 convert for flashinfer sink support (#23016) · 000cceca
Michael Goin authored Aug 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
000cceca
[Frontend] Added support for HermesToolParser for models without special tokens (#16890) · 68373d31
Woonggi Min authored Aug 17, 2025
```
Signed-off-by: minpeter <kali2005611@gmail.com>
```
68373d31
Fix handling of `max_num_batched_tokens` for pooling tasks (#23004) · 52ce1420
Maximilien de Bayser authored Aug 16, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
52ce1420
[New Model]mBART model (#22883) · 829bbd78
汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
829bbd78
[Refactor] Allow optional MultiModalKwargsItem in IPC (#23022) · 4dff91c9
Cyrus Leung authored Aug 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4dff91c9
Add docs for PrefixRepetitionDataset + enable usage with `vllm bench throughput` (#23012) · de9cb617
Seiji Eicher authored Aug 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
de9cb617
[CI][Bugfix] Skip Ovis2 generation test because of broken remote code (#22954) · 2dbccce8
Isotr0py authored Aug 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
2dbccce8

[Core] Make cudagraph check cuda platform only (#23005) · 933f4533

Chengji Yao authored Aug 16, 2025


Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

933f4533

[Multimodal] Update Tensor schema test to cover arbitrary shape mm inputs (#22867) · cc826a20
Isotr0py authored Aug 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
cc826a20
[Misc] Add --save-dir option to benchmark_moe (#23020) · 6d3da472
Jee Jee Li authored Aug 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
6d3da472

[BugFix] Add support for loading prompt embeds tensors serialized on... · 78863f8c

Andrew Sansom authored Aug 16, 2025


[BugFix] Add support for loading prompt embeds tensors serialized on unavailable devices and sparse tensors (#22962)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>

78863f8c