Commits · 01ffd437e6eaf37ce9d515ad95fea62561ce79e8 · OpenDAS / vllm_cscc · GitLab

22 Aug, 2025 3 commits
- support adaptive max_num_seqs and cuda_graph_sizes · 01ffd437
  zhuwenwen authored Aug 22, 2025
  
  01ffd437
- update v1 fa layout and set v1 attention use fa · 981f8370
  zhuwenwen authored Aug 22, 2025
  
  981f8370
- remove redundant SpeculativeConfig · c0f0b209
  zhuwenwen authored Aug 22, 2025
  
  c0f0b209
21 Aug, 2025 5 commits
- update ray version · 11770f88
  zhuwenwen authored Aug 21, 2025
  
  11770f88
- revert 修改flashmla的接口 · ce7212d2
  zhuwenwen authored Aug 21, 2025
  
  ce7212d2
- update version · ff8507ce
  zhuwenwen authored Aug 21, 2025
  
  ff8507ce
- Merge tag 'v0.10.1.1' into v0.10.1.1-dev · 9dbb4c8d
  zhuwenwen authored Aug 21, 2025
  
  9dbb4c8d
- update gen_model_json · 034aae03
  zhuwenwen authored Aug 21, 2025
  
  034aae03
20 Aug, 2025 6 commits
- Do not use eval() to convert unknown types (#23266) · 1da94e67
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  1da94e67
- Limit HTTP header count and size (#23267) · d8b736f9
  Russell Bryant authored Aug 20, 2025
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  d8b736f9
- [BugFix] fix CUTLASS MLA full cudagraph (#23200) · 3a8708f6
  Lucas Wilkinson authored Aug 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  3a8708f6
- [fix]v0 SamplerOutput在非tree decoding时不传入logits · 1c7f32cd
  zhuwenwen authored Aug 20, 2025
  
  1c7f32cd
- update utils.py · ad038b4e
  zhuwenwen authored Aug 20, 2025
  
  ad038b4e
- fix ds-v2 run error · 78d833ae
  zhuwenwen authored Aug 20, 2025
  
  78d833ae
19 Aug, 2025 6 commits
- fix dense run error · 5b0a1c93
  zhuwenwen authored Aug 19, 2025
  
  5b0a1c93
- update version · 8f3d67b5
  zhuwenwen authored Aug 19, 2025
  
  8f3d67b5
- fix cudaDeviceProp · 4ab3e3db
  zhuwenwen authored Aug 19, 2025
  
  4ab3e3db
- Revert "skip moe_fused_gate" · a4b438d0
  zhuwenwen authored Aug 19, 2025
```
This reverts commit 7a6ab87a.
```
  a4b438d0
- skip moe_fused_gate · 7a6ab87a
  zhuwenwen authored Aug 19, 2025
  
  7a6ab87a
- Merge tag 'v0.10.1' into v0.10.1-dev · 19071331
  zhuwenwen authored Aug 19, 2025
  
  19071331
18 Aug, 2025 11 commits
- Use Blackwell FlashInfer MXFP4 MoE by default if available (#23008) · aab54987
  Michael Goin authored Aug 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  aab54987
- fix: OpenAI SDK compat (ResponseTextConfig) (#23126) · ba6928cf
  Breno Baldas Skuk authored Aug 19, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
Signed-off-by: Breno Baldas Skuk <breno.skuk@hcompany.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ba6928cf
- [CI Bugfix] Pin `openai<1.100` to unblock CI (#23118) · befedf86
  Michael Goin authored Aug 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  befedf86
- fix issue from merge · 4f359a91
  zhuwenwen authored Aug 18, 2025
  
  4f359a91
- [fix]解决v1 deepseek cudagraph模式显存占用增长 · e85207b7
  zhuwenwen authored Aug 18, 2025
  
  e85207b7
- 修改flashmla的接口 · b909d6fc
  zhuwenwen authored Aug 18, 2025
  
  b909d6fc
- 增加marlin对cache13的支持，以及新增flash mla的kvcache fp8的支持 · 22a46529
  zhuwenwen authored Aug 18, 2025
  
  22a46529
- debug and fix erro · e70b0ea0
  zhuwenwen authored Aug 18, 2025
  
  e70b0ea0
- fix mtp accept rate issu · 1555157e
  zhuwenwen authored Aug 18, 2025
  
  1555157e
- add v1 engine + deepseek r1 mtp + zero-overhead scheduler · 22a95571
  zhuwenwen authored Aug 18, 2025
  
  22a95571
- [fix]修复mtp eager模式下显存占用增加问题 · ac4cc84e
  zhuwenwen authored Aug 18, 2025
  
  ac4cc84e
17 Aug, 2025 9 commits
- fix: gptq marlin weight loading failure (#23066) · 0fc8fa75
  Simon Mo authored Aug 17, 2025
  
  0fc8fa75
- [XPU] fix xpu to set cudagraph batch sizes (#23044) · 21e39436
  Calvin Chen authored Aug 18, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  21e39436
- [Misc] Convert use_structured_output property into constant (#23060) · 6d243efe
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d243efe
- [Misc] Remove dead return (#23061) · c55bc1db
  Woosuk Kwon authored Aug 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c55bc1db
- [BugFix] Fix for IMA in FA3 varlen combine (#22967) · 292084e7
  Lucas Wilkinson authored Aug 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  292084e7
- [Misc] fix typo in the multimodal doc (#23051) · 16bff144
  Kevinzz authored Aug 17, 2025
  
  16bff144
- [Bugfix] should use stack instead of concat (#22972) · fe0411fc
  947132885 authored Aug 17, 2025
```
Signed-off-by: 947132885 <947132885@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  fe0411fc
- [Kernel] Add cuda kernel for gpt_oss activation (#22951) · 4d4061b6
  Jee Jee Li authored Aug 17, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4d4061b6
- [Misc] method name typo fix (#23042) · 87f48623
  Ning Xie authored Aug 17, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  87f48623