Commits · 9e77ffca3f41e0e73879098f1686a4c82b8619d9 · OpenDAS / vllm_cscc

08 Dec, 2025 1 commit

[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract... · 9e77ffca

wang.yuqi authored Dec 08, 2025


[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract hidden states prefer using new multi-vector retrieval API (#26686)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

9e77ffca

07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
04 Dec, 2025 1 commit

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145) · 74c4d80c

wang.yuqi authored Dec 04, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

74c4d80c

03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

02 Dec, 2025 2 commits
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- [BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761) · 3b221cb6
  Boyuan Feng authored Dec 01, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  3b221cb6
28 Nov, 2025 1 commit

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
07 Oct, 2025 1 commit
- [UX] Support nested dicts in hf_overrides (#25727) · c6873c4e
  Michael Goin authored Oct 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c6873c4e
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
25 Sep, 2025 1 commit
- [V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
  wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  7f570f1c
24 Sep, 2025 1 commit
- [BUG] Allows for RunAI Streamer and Torch.compile cache to be used together (#24922) · c8bde933
  ahao-anyscale authored Sep 23, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  c8bde933
19 Sep, 2025 1 commit
- Move `PoolerConfig` from `config/__init__.py` to `config/pooler.py` (#25181) · 058525b9
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  058525b9
16 Sep, 2025 1 commit
- Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
  Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  759ef49b
15 Sep, 2025 1 commit

Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` (#24659) · c4afdb69

Harry Mellor authored Sep 15, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c4afdb69

10 Sep, 2025 1 commit
- Move `LoadConfig` from `config/__init__.py` to `config/load.py` (#24566) · f36355ab
  Harry Mellor authored Sep 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f36355ab
11 Aug, 2025 1 commit
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
10 Aug, 2025 1 commit
- Refactor sliding window configuration to Transformers best practice (#21927) · c4984839
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4984839
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

14 Jul, 2025 1 commit
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
13 Jul, 2025 1 commit

[Core] Support multiple tasks per model (#20771) · 020f58ab

Nicolò Lucchesi authored Jul 13, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

020f58ab

03 Jul, 2025 1 commit
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
02 Jul, 2025 1 commit
- [Bugfix] Fix the max_seq_len limit of 16384 for DeepSeek models (#20322) · ccbfb1d1
  WangHuaqiang authored Jul 02, 2025
```
Signed-off-by: Wang Huaqiang <huaqiang.wang@intel.com>
```
  ccbfb1d1
01 Jul, 2025 1 commit
- [Perf] Validate @config in pre-commit instead of dynamically (#20200) · c05596f1
  Lionel Villard authored Jul 01, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  c05596f1
16 Jun, 2025 1 commit

[Misc] Fix skipped max-model-len validation when deriving max model length... · b692e9cd

Ye (Charlotte) Qi authored Jun 15, 2025


[Misc] Fix skipped max-model-len validation when deriving max model length from tokenizer config (#19660)
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>

b692e9cd

11 Jun, 2025 1 commit
- Support non-string values in JSON keys from CLI (#19471) · a2142f01
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a2142f01
06 Jun, 2025 1 commit
- Fix CompilationConfig repr (#19091) · da511d54
  Richard Zou authored Jun 06, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  da511d54
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
02 May, 2025 1 commit
- Add `pt_load_map_location` to allow loading to cuda (#16869) · 109e15a3
  Jerry Zhang authored May 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  109e15a3
30 Apr, 2025 1 commit
- Improve configs - `ModelConfig` (#17130) · 13698db6
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13698db6
29 Apr, 2025 1 commit
- Improve literal dataclass field conversion to argparse argument (#17391) · 2ef5d106
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2ef5d106
17 Apr, 2025 1 commit
- Improve configs - `TokenizerPoolConfig` + `DeviceConfig` (#16603) · d27ea940
  Harry Mellor authored Apr 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d27ea940
08 Mar, 2025 1 commit
- Default to `generation_config` from model (#12622) · 47512b32
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  47512b32
28 Feb, 2025 1 commit
- Use smaller embedding model when not testing model specifically (#13891) · 76c89fca
  Harry Mellor authored Feb 28, 2025
  
  76c89fca
23 Feb, 2025 1 commit
- [ci] Use env var to control whether to use S3 bucket in CI (#13634) · 2c5e637b
  Kevin H. Luu authored Feb 22, 2025
  
  2c5e637b
20 Feb, 2025 1 commit
- [2/n][ci] S3: Use full model path (#13564) · a64a8443
  Kevin H. Luu authored Feb 20, 2025
```
Signed-off-by: <>
```
  a64a8443
19 Feb, 2025 1 commit

[1/n][CI] Load models in CI from S3 instead of HF (#13205) · d5d214ac

Kevin H. Luu authored Feb 18, 2025



Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>

d5d214ac

14 Feb, 2025 1 commit
- Consolidate Llama model usage in tests (#13094) · f2b20fe4
  Harry Mellor authored Feb 14, 2025
  
  f2b20fe4