Commits · 9e94b9d83808faa9be3fe2f1e1680d7cefc6bfda · OpenDAS / vllm_cscc

10 Jan, 2026 1 commit
- remove pa · 29a9e952
  zhuwenwen authored Jan 10, 2026
  
  29a9e952
13 Nov, 2025 2 commits
- add VLLM_USE_OPT_ZEROS to replace triton_ (torch.zeros) · e7f2785f
  zhuwenwen authored Nov 13, 2025
```
set default_max_num_batched_tokens = 10240
update qwen3_moe of layernorm
off lightop of moe_fused_gate
```
  e7f2785f
- feat: w8a8_marlin 接入，通过-q slimquant_marlin开启，优化w4a8_marlin代码 · f2bac431
  zhuwenwen authored Nov 13, 2025
  
  f2bac431
27 Oct, 2025 1 commit
- update scaling_alpha · b01011d2
  zhuwenwen authored Oct 27, 2025
  
  b01011d2
25 Oct, 2025 1 commit
- [Models] support HunYuanForCausalLM · f386ba88
  zhuwenwen authored Oct 25, 2025
  
  f386ba88
15 Oct, 2025 1 commit
- support --no-enable-chunked-prefill of v1 · 573531eb
  zhuwenwen authored Oct 15, 2025
  
  573531eb
13 Oct, 2025 2 commits
- remove --no-enable-chunked-prefill of v1 · 2cf181fd
  zhuwenwen authored Oct 13, 2025
  
  2cf181fd
- disable cascade_attn · 6791e80c
  zhuwenwen authored Oct 13, 2025
  
  6791e80c
11 Oct, 2025 1 commit
- skip silu_mul_fp8_quant_deep_gemm_cuda and remove zero_overhead · 1bd3ae33
  zhuwenwen authored Oct 11, 2025
  
  1bd3ae33
01 Oct, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

28 Sep, 2025 1 commit

Add option to restrict media domains (#25783) · 32335c8b

Russell Bryant authored Sep 26, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

32335c8b

26 Sep, 2025 1 commit

EVS Support (Video tokens pruning) (#22980) · 392edee3

Eugene Khvedchenya authored Sep 26, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenya@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

392edee3

25 Sep, 2025 3 commits
- [Model] Define `merge_by_field_config` MM interface (#25676) · 0ea80c87
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0ea80c87
- [V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
  wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  7f570f1c
- [Model] Add LongCat-Flash (#23991) · 845adb3e
  XuruiYang authored Sep 25, 2025
```
Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>
```
  845adb3e
24 Sep, 2025 2 commits
- [V0 Deprecation] Remove max_seq_len_to_capture (#25543) · 2e19a848
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e19a848
- [BUG] Allows for RunAI Streamer and Torch.compile cache to be used together (#24922) · c8bde933
  ahao-anyscale authored Sep 23, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  c8bde933
23 Sep, 2025 1 commit
- [Speculators][Speculative Decoding] Fix gpt-oss eagle3 accuracy issue (#25406) · d5944d51
  jiahanc authored Sep 23, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  d5944d51
21 Sep, 2025 3 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- feat: Enable engine-level arguments with speculators models (#25250) · c438b295
  Rahul Tuli authored Sep 21, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  c438b295
- [V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334) · 0ff8ebb2
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0ff8ebb2
20 Sep, 2025 1 commit
- [Optimization] Avoid repeated model architecture conversion for pooling models (#25261) · c60e6137
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c60e6137
19 Sep, 2025 3 commits
- Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5
  Zhiyu authored Sep 19, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  431535b5
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
- Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  058525b9
18 Sep, 2025 5 commits
- [Model] Add LongCat-Flash · 50281e36
  zhuwenwen authored Sep 18, 2025
  
  50281e36
- Fix `validate-config` pre-commit check (#25157) · 3ed1ec4a
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3ed1ec4a
- Move `StructuredOutputsConfig` from `config/__init__.py` to `config/structured_outputs.py` (#25153) · 8ed039d5
  Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8ed039d5
- [Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89
  Aaron Pham authored Sep 18, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  29283e89
- [Bugfix] when use s3 model cannot use default load_format (#24435) · 350c94de
  rongfu.leng authored Sep 18, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  350c94de
17 Sep, 2025 2 commits
- [BUG] Exclude .pth files when pulling remote files (#25092) · f20c3b09
  ahao-anyscale authored Sep 17, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  f20c3b09
- [UX] Remove "quantization is not fully optimized yet" log (#25012) · 67532a1a
  Michael Goin authored Sep 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67532a1a
16 Sep, 2025 3 commits

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

Move `SpeculativeConfig` from `config/__init__.py` to `config/speculative.py` (#24904) · 0faf3cc3
Harry Mellor authored Sep 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
0faf3cc3
Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b

15 Sep, 2025 1 commit

Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` (#24659) · c4afdb69

Harry Mellor authored Sep 15, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c4afdb69

12 Sep, 2025 2 commits
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
- [CI] Add ci_envs for convenient local testing (#24630) · d21a36f5
  wang.yuqi authored Sep 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  d21a36f5
11 Sep, 2025 2 commits
- [Doc] Clarify cudagraph capture size logic and default behavior in scheduler (#18698) · 7a30fa87
  Zazzle516 authored Sep 12, 2025
```
Signed-off-by: Zazzle516 <2405677060@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7a30fa87
- [HybridKVCache][Platform] Add support_hybrid_kv_cache for platform (#24646) · 4f6593b0
  Mengqing Cao authored Sep 11, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  4f6593b0