Commits · e9532d9e54c3ca670ece74c3a73fb6b7ee2c6404 · OpenDAS / vllm_cscc

03 Dec, 2025 1 commit
- set VLLM_USE_OPT_RESHAPE_AND_CACHE=1 for qwen3-30b · 8364249c
  zhuwenwen authored Dec 03, 2025
  
  8364249c
02 Dec, 2025 1 commit
- add VLLM_USE_V32_ENCODE to use encoding_dsv32.py · 2ae2d013
  zhuwenwen authored Dec 02, 2025
  
  2ae2d013
01 Dec, 2025 2 commits
- update VLLM_USE_LIGHTOP_RMS_ROPE_CONCAT · d4d251fe
  zhuwenwen authored Dec 01, 2025
  
  d4d251fe
- add VLLM_USE_OPT_RESHAPE_AND_CACHE (test) · 64e307c7
  zhuwenwen authored Dec 01, 2025
  
  64e307c7
23 Nov, 2025 1 commit
- update VLLM_USE_CAT_MLA · 83c1f04a
  zhuwenwen authored Nov 23, 2025
  
  83c1f04a
19 Nov, 2025 3 commits
- update VLLM_USE_PD_SPLIT=0 · 90fc8f66
  zhuwenwen authored Nov 19, 2025
  
  90fc8f66
- set VLLM_USE_PD_SPLIT=0 (dpsk-v3) · d95a8fff
  zhuwenwen authored Nov 19, 2025
  
  d95a8fff
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=0 · 46006aee
  zhuwenwen authored Nov 19, 2025
  
  46006aee
17 Nov, 2025 4 commits
- update VLLM_USE_LIGHTOP_FILL_MOE_ALIGN · 813f81fb
  zhuwenwen authored Nov 17, 2025
  
  813f81fb
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIN=0 for dpsk · 70f1c878
  zhuwenwen authored Nov 17, 2025
  
  70f1c878
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · 904b87ba
  zhuwenwen authored Nov 17, 2025
  
  904b87ba
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · cff5c2d2
  zhuwenwen authored Nov 17, 2025
  
  cff5c2d2
24 Oct, 2025 1 commit
- set USE_FUSED_RMS_QUANT=0 and USE_FUSED_SILU_MUL_QUANT=0 · 46dd30e7
  zhuwenwen authored Oct 24, 2025
```
add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD
```
  46dd30e7
23 Oct, 2025 1 commit
- update test_moe.py · 86d92eb9
  zhuwenwen authored Oct 23, 2025
```
set USE_FUSED_RMS_QUANT=1 and USE_FUSED_SILU_MUL_QUANT=1
```
  86d92eb9
26 Sep, 2025 1 commit
- VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · c1ece8c6
  zhuwenwen authored Sep 26, 2025
```
add shared_output and routed_scaling_factor of CompressedTensorsW8A8Int8MoEMethod
```
  c1ece8c6
24 Sep, 2025 2 commits
- update VLLM_USE_OPT_CAT · 4d97c5fc
  zhuwenwen authored Sep 24, 2025
  
  4d97c5fc
- [kernel] add lightop's moe_sum(mul+add) fusion operator for deepseek · 8d2cac26
  zhuwenwen authored Sep 24, 2025
```
[FIX] 修复mtp和VLLM_USE_TRITON_CAT不能一起开的bug
```
  8d2cac26
03 Jul, 2025 2 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
01 Jul, 2025 1 commit
- [Quant] [Bugfix] Fix quantization config matching with `hf_to_vllm_mapper` (#20046) · 9025a9a7
  Kyle Sayers authored Jul 01, 2025
  
  9025a9a7
13 Jun, 2025 1 commit
- [torch.compile] reorganize the cache directory to support compiling multiple models (#19064) · d70bc7c0
  youkaichao authored Jun 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d70bc7c0
06 Jun, 2025 1 commit
- [Model] Add VLLM_USE_NN to use nn layout · 6880bf15
  zhuwenwen authored Jun 06, 2025
  
  6880bf15
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
23 May, 2025 2 commits
- [Bugfix] Fix transformers model impl ignored for mixtral quant (#18602) · 6220f3c6
  Tristan Leclercq authored May 23, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  6220f3c6
- [V1][Spec Decoding] Use model_loader.get_model() to load models (#18273) · c6b636f9
  Mark McLoughlin authored May 23, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  c6b636f9
15 May, 2025 2 commits
- Update deprecated type hinting in `model_loader` (#18130) · 07ad2712
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  07ad2712
- fix qwen3-235b run error and remove update_environment_variables of hip · 3f9af065
  zhuwenwen authored May 15, 2025
  
  3f9af065
13 May, 2025 1 commit
- add qwen3 moe configs · 09e372e7
  zhuwenwen authored May 13, 2025
```
support telechat2 and glm4 nn layout
remove log of request_id
```
  09e372e7
07 May, 2025 2 commits
- [Quantization] Quark MXFP4 format loading (#16943) · db593aa6
  Bowen Bao authored May 07, 2025
  
  db593aa6
- [Misc] Split model loader (#17712) · 822de7fb
  Jee Jee Li authored May 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  822de7fb
06 May, 2025 1 commit
- support qwen3-moe nn layout · 4dc24bc8
  zhuwenwen authored May 06, 2025
  
  4dc24bc8
30 Apr, 2025 1 commit
- support qwen3 nn layout · 8a12a939
  zhuwenwen authored Apr 30, 2025
  
  8a12a939
24 Apr, 2025 2 commits
- fix llama and qwen layout · 61898ea3
  zhuwenwen authored Apr 24, 2025
  
  61898ea3
- More informative error when using Transformers backend (#16988) · 2c8ed8ee
  Harry Mellor authored Apr 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2c8ed8ee
23 Apr, 2025 1 commit
- Improve Transformers backend model loading QoL (#17039) · 8e630d68
  Harry Mellor authored Apr 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8e630d68
01 Apr, 2025 1 commit
- Rename fallback model and refactor supported models section (#15829) · a76f547e
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a76f547e
31 Mar, 2025 1 commit
- Fix Transformers backend compatibility check (#15290) · d4bfc23e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4bfc23e
26 Mar, 2025 1 commit

Separate base model from `TransformersModel` (#15467) · cf5c8f16

Harry Mellor authored Mar 26, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

cf5c8f16

24 Mar, 2025 1 commit
- [Bugfix][V1] Avoid importing PreTrainedModel (#15366) · 948ab03e
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Mar 24, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  948ab03e
15 Mar, 2025 1 commit
- 支持fusemoe对int4的scale合zero合并读取操作 · 2b47d4fa
  zhuwenwen authored Mar 15, 2025
  
  2b47d4fa