Commits · cf278ff3b231b4fca0232db2d1183427dbc200bb · OpenDAS / vllm_cscc

12 Sep, 2025 3 commits
- [Docs] Fix warnings in mkdocs build (continued) (#24740) · 41f17bf2
  Hyogeun Oh (오효근) authored Sep 12, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  41f17bf2
- [Bugfix] Fix BNB name match (#24735) · 60a09519
  Jee Jee Li authored Sep 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  60a09519
- Enable conversion of multimodal models to pooling tasks (#24451) · e090b7b4
  Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e090b7b4
11 Sep, 2025 2 commits

Fix typing for `safetensors_load_strategy` (#24641) · d6249d06
Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d6249d06

[Core] feat: Add --safetensors-load-strategy flag for faster safetensors... · 41329a0f

shengshiqi-google authored Sep 11, 2025


[Core] feat: Add --safetensors-load-strategy flag for faster safetensors loading from Lustre (#24469)
Signed-off-by: Shiqi Sheng <shengshiqi@google.com>
Signed-off-by: shengshiqi-google <160179165+shengshiqi-google@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

41329a0f

10 Sep, 2025 2 commits

Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f36355ab

[Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae

pwschuurman authored Sep 09, 2025


Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4377b1ae

08 Sep, 2025 3 commits
- [Model loader]: support multi-thread model weight loading (#23928) · 43d9ad03
  Yang Kaiyong authored Sep 09, 2025
```
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  43d9ad03
- [Model] Remove quantized mixtral (#24437) · 8d7f39b4
  Jee Jee Li authored Sep 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8d7f39b4
- [Bugfix] Fix get_quant_config when using modelscope (#24421) · 5e537f45
  Li Wang authored Sep 08, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  5e537f45
06 Sep, 2025 2 commits

[V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4172235a

[Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd

Isotr0py authored Sep 06, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

53b19ccd

03 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
01 Sep, 2025 1 commit
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
29 Aug, 2025 1 commit
- [Misc] Make `download_weights_from_hf` more reliable (#23863) · 5674a403
  Harry Mellor authored Aug 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5674a403
22 Aug, 2025 2 commits
- [Quantization] Allow GGUF quantization to skip unquantized layer (#23188) · 4645024d
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4645024d
- [misc] Remove outdate comment about runai_model_streamer (#23421) · 695e7adc
  杨朱 · Kiki authored Aug 22, 2025
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
```
  695e7adc
21 Aug, 2025 1 commit
- [Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
  Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0c31e28e
19 Aug, 2025 1 commit

[TPU] make ptxla not imported when using tpu_commons (#23081) · e9d6a3db

Chengji Yao authored Aug 18, 2025


Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>

e9d6a3db

13 Aug, 2025 1 commit
- Fix GGUF loader for Qwen3 MoE. (#22785) · b159c0a6
  Gh0u1L5 authored Aug 13, 2025
```
Signed-off-by: Gh0u1L5 <Gh0u1L5@outlook.com>
```
  b159c0a6
12 Aug, 2025 1 commit

Enable 4bit bnb prequant MOE (#21548) · 9b94d6ec

Andy Chen authored Aug 11, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9b94d6ec

08 Aug, 2025 1 commit
- Add ModelOpt Qwen3 nvfp4 support (#20101) · d57dc236
  Zhiyu authored Aug 07, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  d57dc236
07 Aug, 2025 1 commit
- [Bugfix] Add proper comparison for package versions (#22314) · 609b533c
  Syed Muhammad Bin Asif authored Aug 07, 2025
```
Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>
```
  609b533c
01 Aug, 2025 1 commit
- [Quantization] Enable BNB support for InternS1 (#21953) · 28b18cc7
  Jee Jee Li authored Aug 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  28b18cc7
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

25 Jul, 2025 1 commit
- [Bugfix] fix modelscope snapshot_download serialization (#21536) · adaf2c6d
  Ning Xie authored Jul 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  adaf2c6d
24 Jul, 2025 3 commits

[Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
13abd0ea
[Core] Support model loader plugins (#21067) · 610852a4
22quinn authored Jul 24, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
610852a4

feat(gguf_loader): accept HF repo paths & URLs for GGUF (#20793) · 11599b0e

Hardik Gupta authored Jul 23, 2025


Signed-off-by: Hardik <hardikgupta1999@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

11599b0e

23 Jul, 2025 1 commit
- add clear messages for deprecated models (#21424) · 2f5c14de
  youkaichao authored Jul 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2f5c14de
22 Jul, 2025 1 commit
- Adds parallel model weight loading for runai_streamer (#21330) · b194557a
  Benjamin Bartels authored Jul 22, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  b194557a
20 Jul, 2025 1 commit

[Model] Support VLMs with transformers backend (#20543) · 9499e26e

Raushan Turganbay authored Jul 20, 2025


Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9499e26e

18 Jul, 2025 1 commit
- [Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103) · ca4eb82b
  wang.yuqi authored Jul 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  ca4eb82b
17 Jul, 2025 1 commit
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
16 Jul, 2025 1 commit

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33

Nir David authored Jul 16, 2025


Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>

01513a33

15 Jul, 2025 1 commit
- Enabled BnB NF4 inference on Gaudi (#20172) · 016b8d1b
  Ruheena Suhani Shaik authored Jul 15, 2025
```
Signed-off-by: Ruheena Suhani Shaik <rsshaik@habana.ai>
```
  016b8d1b
14 Jul, 2025 1 commit
- [Quantization] add BNB for MixtralForCausalLM (#20893) · a99b9f7d
  Jee Jee Li authored Jul 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a99b9f7d
12 Jul, 2025 1 commit
- Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419) · 4afe687a
  Zhiyu authored Jul 11, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  4afe687a
11 Jul, 2025 1 commit
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
10 Jul, 2025 1 commit
- [Docs] Lazy import gguf (#20785) · b854321f
  Simon Mo authored Jul 10, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  b854321f