Commits · cf975626934bba2261afbc5830290630128d3a20 · OpenDAS / vllm_cscc

13 Nov, 2025 2 commits

add VLLM_USE_OPT_ZEROS to replace triton_ (torch.zeros) · e7f2785f
zhuwenwen authored Nov 13, 2025
```
set default_max_num_batched_tokens = 10240
update qwen3_moe of layernorm
off lightop of moe_fused_gate
```
e7f2785f

set VLLM_USE_LIGHTOP=0 for dpsk-v3 · 6a8fd297

zhuwenwen authored Nov 13, 2025

add VLLM_USE_PD_SPLIT to split prefill and decode
replace triton_ of rms and act_and_mul

6a8fd297

26 Sep, 2025 1 commit
- update VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · f8cf43ae
  zhuwenwen authored Sep 26, 2025
  
  f8cf43ae
25 Sep, 2025 2 commits
- [Optimization] Use a cheaper cache key in `get_model_architecture` (#25682) · 89fa54e6
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  89fa54e6
- update VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · f70d0ec6
  zhuwenwen authored Sep 25, 2025
  
  f70d0ec6
24 Sep, 2025 1 commit
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
22 Sep, 2025 1 commit
- [TPU] Deprecate `xm.mark_step` in favor of ``torch_xla.sync` (#25254) · 4cf71cc8
  Nicolò Lucchesi authored Sep 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  4cf71cc8
21 Sep, 2025 1 commit

[V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4

Woosuk Kwon authored Sep 20, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

52c2a8d4

20 Sep, 2025 2 commits

Generate _ModelInfo properties file when loading to improve loading speed (#23558) · bf8b26ca

Manoel Marques authored Sep 20, 2025

Signed-off-by: Manoel Marques <manoel.marques@ibm.com>
Signed-off-by: Manoel Marques <manoelmrqs@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

bf8b26ca

[Optimization] Avoid repeated model architecture conversion for pooling models (#25261) · c60e6137
Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c60e6137

19 Sep, 2025 1 commit
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
13 Sep, 2025 1 commit
- Enable conversion of multimodal models to pooling tasks (#24451) · bbb70036
  Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  bbb70036
12 Sep, 2025 3 commits
- [Docs] Fix warnings in mkdocs build (continued) (#24740) · 41f17bf2
  Hyogeun Oh (오효근) authored Sep 12, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  41f17bf2
- [Bugfix] Fix BNB name match (#24735) · 60a09519
  Jee Jee Li authored Sep 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  60a09519
- Enable conversion of multimodal models to pooling tasks (#24451) · e090b7b4
  Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e090b7b4
11 Sep, 2025 2 commits

Fix typing for `safetensors_load_strategy` (#24641) · d6249d06
Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d6249d06

[Core] feat: Add --safetensors-load-strategy flag for faster safetensors... · 41329a0f

shengshiqi-google authored Sep 11, 2025


[Core] feat: Add --safetensors-load-strategy flag for faster safetensors loading from Lustre (#24469)
Signed-off-by: Shiqi Sheng <shengshiqi@google.com>
Signed-off-by: shengshiqi-google <160179165+shengshiqi-google@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

41329a0f

10 Sep, 2025 2 commits

Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f36355ab

[Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae

pwschuurman authored Sep 09, 2025


Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4377b1ae

08 Sep, 2025 3 commits
- [Model loader]: support multi-thread model weight loading (#23928) · 43d9ad03
  Yang Kaiyong authored Sep 09, 2025
```
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  43d9ad03
- [Model] Remove quantized mixtral (#24437) · 8d7f39b4
  Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8d7f39b4
- [Bugfix] Fix get_quant_config when using modelscope (#24421) · 5e537f45
  Li Wang authored Sep 08, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  5e537f45
06 Sep, 2025 2 commits

[V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4172235a

[Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd

Isotr0py authored Sep 06, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

53b19ccd

03 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
01 Sep, 2025 1 commit
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
29 Aug, 2025 1 commit
- [Misc] Make `download_weights_from_hf` more reliable (#23863) · 5674a403
  Harry Mellor authored Aug 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5674a403
22 Aug, 2025 2 commits
- [Quantization] Allow GGUF quantization to skip unquantized layer (#23188) · 4645024d
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4645024d
- [misc] Remove outdate comment about runai_model_streamer (#23421) · 695e7adc
  杨朱 · Kiki authored Aug 22, 2025
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
```
  695e7adc
21 Aug, 2025 1 commit
- [Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c31e28e
19 Aug, 2025 1 commit

[TPU] make ptxla not imported when using tpu_commons (#23081) · e9d6a3db

Chengji Yao authored Aug 18, 2025


Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>

e9d6a3db

13 Aug, 2025 1 commit
- Fix GGUF loader for Qwen3 MoE. (#22785) · b159c0a6
  Gh0u1L5 authored Aug 13, 2025
```
Signed-off-by: Gh0u1L5 <Gh0u1L5@outlook.com>
```
  b159c0a6
12 Aug, 2025 1 commit

Enable 4bit bnb prequant MOE (#21548) · 9b94d6ec

Andy Chen authored Aug 11, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9b94d6ec

08 Aug, 2025 1 commit
- Add ModelOpt Qwen3 nvfp4 support (#20101) · d57dc236
  Zhiyu authored Aug 07, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  d57dc236
07 Aug, 2025 1 commit
- [Bugfix] Add proper comparison for package versions (#22314) · 609b533c
  Syed Muhammad Bin Asif authored Aug 07, 2025
```
Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>
```
  609b533c
01 Aug, 2025 1 commit
- [Quantization] Enable BNB support for InternS1 (#21953) · 28b18cc7
  Jee Jee Li authored Aug 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  28b18cc7
31 Jul, 2025 1 commit
- update unused code · 3de379de
  zhuwenwen authored Jul 31, 2025
  
  3de379de
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

25 Jul, 2025 1 commit
- [Bugfix] fix modelscope snapshot_download serialization (#21536) · adaf2c6d
  Ning Xie authored Jul 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  adaf2c6d
24 Jul, 2025 1 commit
- [Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13abd0ea