Commits · 755d78b4c11f65ef1062a35c76b1382e9e48ccdd · OpenDAS / vllm_cscc

23 Nov, 2025 1 commit
- update VLLM_USE_CAT_MLA · 83c1f04a
  zhuwenwen authored Nov 23, 2025
  
  83c1f04a
19 Nov, 2025 3 commits
- update VLLM_USE_PD_SPLIT=0 · 90fc8f66
  zhuwenwen authored Nov 19, 2025
  
  90fc8f66
- set VLLM_USE_PD_SPLIT=0 (dpsk-v3) · d95a8fff
  zhuwenwen authored Nov 19, 2025
  
  d95a8fff
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIGN=0 · 46006aee
  zhuwenwen authored Nov 19, 2025
  
  46006aee
17 Nov, 2025 4 commits
- update VLLM_USE_LIGHTOP_FILL_MOE_ALIGN · 813f81fb
  zhuwenwen authored Nov 17, 2025
  
  813f81fb
- set VLLM_USE_LIGHTOP_FILL_MOE_ALIN=0 for dpsk · 70f1c878
  zhuwenwen authored Nov 17, 2025
  
  70f1c878
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · 904b87ba
  zhuwenwen authored Nov 17, 2025
  
  904b87ba
- add VLLM_USE_LIGHTOP_FILL_MOE_ALIN · cff5c2d2
  zhuwenwen authored Nov 17, 2025
  
  cff5c2d2
24 Oct, 2025 1 commit
- set USE_FUSED_RMS_QUANT=0 and USE_FUSED_SILU_MUL_QUANT=0 · 46dd30e7
  zhuwenwen authored Oct 24, 2025
```
add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD
```
  46dd30e7
23 Oct, 2025 1 commit
- update test_moe.py · 86d92eb9
  zhuwenwen authored Oct 23, 2025
```
set USE_FUSED_RMS_QUANT=1 and USE_FUSED_SILU_MUL_QUANT=1
```
  86d92eb9
26 Sep, 2025 1 commit
- VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · c1ece8c6
  zhuwenwen authored Sep 26, 2025
```
add shared_output and routed_scaling_factor of CompressedTensorsW8A8Int8MoEMethod
```
  c1ece8c6
24 Sep, 2025 2 commits
- update VLLM_USE_OPT_CAT · 4d97c5fc
  zhuwenwen authored Sep 24, 2025
  
  4d97c5fc
- [kernel] add lightop's moe_sum(mul+add) fusion operator for deepseek · 8d2cac26
  zhuwenwen authored Sep 24, 2025
```
[FIX] 修复mtp和VLLM_USE_TRITON_CAT不能一起开的bug
```
  8d2cac26
26 Aug, 2025 1 commit
- [fix]fix tests of kernels · 31584b45
  zhuwenwen authored Aug 26, 2025
  
  31584b45
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 3 commits
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
01 Jul, 2025 1 commit
- [Quant] [Bugfix] Fix quantization config matching with `hf_to_vllm_mapper` (#20046) · 9025a9a7
  Kyle Sayers authored Jul 01, 2025
  
  9025a9a7
30 Jun, 2025 1 commit
- [Quantization] Improve BitsAndBytesModelLoader (#20242) · 8fe7fc86
  Jee Jee Li authored Jun 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8fe7fc86
21 Jun, 2025 1 commit
- [Bugfix] Fix bnb 8bit model weights loading (#19917) · 6f170f11
  Isotr0py authored Jun 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6f170f11
19 Jun, 2025 1 commit
- [Quantization] Modify the logic of BNB double quantization (#19742) · 49599150
  Jee Jee Li authored Jun 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  49599150
13 Jun, 2025 1 commit
- [torch.compile] reorganize the cache directory to support compiling multiple models (#19064) · d70bc7c0
  youkaichao authored Jun 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d70bc7c0
12 Jun, 2025 1 commit
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
10 Jun, 2025 1 commit

[Misc] Slight improvement of the BNB (#19418) · b6553be1

Jee Jee Li authored Jun 10, 2025

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b6553be1

06 Jun, 2025 1 commit
- [Model] Add VLLM_USE_NN to use nn layout · 6880bf15
  zhuwenwen authored Jun 06, 2025
  
  6880bf15
03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
02 Jun, 2025 1 commit
- [Core] Support inplace model weights loading (#18745) · 9760fd8f
  22quinn authored Jun 02, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  9760fd8f
01 Jun, 2025 1 commit

[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with... · a35ca765

Isotr0py authored Jun 01, 2025


[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with arbitrary components (#18987)
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>

a35ca765

31 May, 2025 1 commit

[Neuron] Add Multi-Modal model support for Neuron (#18921) · 2a50ef57

Satyajith Chilappagari authored May 31, 2025


Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Ashraf Mahgoub <ashymahg@amazon.com>
Co-authored-by: Rohith Nallamaddi <nalrohit@amazon.com>
Co-authored-by: FeliciaLuo <luof@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>

2a50ef57

29 May, 2025 2 commits
- Fix an error in dummy weight loading for quantization models (#18855) · f8977c23
  Chenyaaang authored May 29, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  f8977c23
- [Neuron] Add multi-LoRA support for Neuron. (#18284) · 972eddf7
  Satyajith Chilappagari authored May 29, 2025
```
Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
```
  972eddf7
26 May, 2025 1 commit
- [Doc] Move examples and further reorganize user guide (#18666) · 82e2339b
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82e2339b
25 May, 2025 3 commits
- [BUGFIX] catch subclass first for try...except (#18672) · 44073a7a
  Ning Xie authored May 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  44073a7a
- [Misc][ModelScope] Change to use runtime VLLM_USE_MODELSCOPE (#18655) · 6ab681bc
  Mengqing Cao authored May 25, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  6ab681bc
- [MISC] correct signature for LoaderFunction (#18670) · 6c6dcd86
  Ning Xie authored May 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6c6dcd86
23 May, 2025 2 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Bugfix] Fix transformers model impl ignored for mixtral quant (#18602) · 6220f3c6
  Tristan Leclercq authored May 23, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  6220f3c6