Commits · d7db129ab909dfcf4d4b4eb0201174d07b5b0680 · OpenDAS / vllm_cscc · GitLab

26 Jan, 2026 1 commit
- [Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcd80206
22 Jan, 2026 1 commit

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3

Eldar Kurtić authored Jan 22, 2026


Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>

44f08af3

09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
11 Dec, 2025 1 commit
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
04 Dec, 2025 1 commit
- Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e10c84e0
29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

26 Nov, 2025 1 commit
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
13 Nov, 2025 1 commit
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
11 Nov, 2025 1 commit
- [LoRA][1/N]Remove LoRA extra vocab (#28382) · 9d1c4747
  Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9d1c4747
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
08 Oct, 2025 1 commit
- [Models] Improve iteration over layers (#26425) · 93f2c0aa
  Lukas Geiger authored Oct 08, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  93f2c0aa
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
21 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
02 Sep, 2025 1 commit
- Fix weights loading for Apertus (#24100) · 598bd74c
  nathan authored Sep 02, 2025
```
Signed-off-by: Nathan Ranchin <nranchin@student.ethz.ch>
```
  598bd74c
29 Aug, 2025 2 commits

[MODEL] `Apertus` and `XIELU` (#23068) · 1cf3753b

EduardDurech authored Aug 29, 2025


Signed-off-by: EduardDurech <39579228+EduardDurech@users.noreply.github.com>
Co-authored-by: AllenHaoHuang <allenhuangdd@gmail.com>

1cf3753b

[Models] Improve iteration over layers (#19497) · de533ab2
Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
de533ab2

26 Aug, 2025 1 commit
- [mypy] Fix incorrect type hint for EAGLE3 support (#23617) · 7d67a9d9
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d67a9d9
22 Aug, 2025 1 commit
- [Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154) · 17373dcd
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  17373dcd
12 Aug, 2025 1 commit
- Add: `SupportsEagle3` interface for explicit EAGLE3 support (#22642) · 5a4b4b37
  Rahul Tuli authored Aug 12, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  5a4b4b37
10 Aug, 2025 1 commit
- Refactor sliding window configuration to Transformers best practice (#21927) · c4984839
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4984839
18 Jul, 2025 1 commit
- [Model] Re-add the implicit conversion feature for as_seq_cls_model (#21103) · ca4eb82b
  wang.yuqi authored Jul 18, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  ca4eb82b
13 Jul, 2025 1 commit
- Support for LlamaForSequenceClassification (#20807) · bd4c1e6f
  Minkyu Kim authored Jul 13, 2025
```
Signed-off-by: thechaos16 <thechaos16@gmail.com>
```
  bd4c1e6f
07 Jul, 2025 1 commit
- [Config] Refactor mistral configs (#20570) · 14601f5f
  Patrick von Platen authored Jul 08, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  14601f5f
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
27 May, 2025 1 commit
- 修复0.8.5 config找不到的bug · 823b3332
  gaoqiong authored May 27, 2025
  
  823b3332
26 May, 2025 2 commits
- [Bugfix] Fix Llama GGUF initialization (#18717) · a869baca
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a869baca
- [Model] Add support for YARN in NemotronNAS models (#18427) · 6d68030f
  Naveassaf authored May 26, 2025
```
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
```
  6d68030f
22 May, 2025 1 commit
- 优化awq权重转换的方式，修复可能会导致蒸馏模型加载时报错的bug · a94ed3ea
  yangql authored May 22, 2025
  
  a94ed3ea
15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
14 May, 2025 1 commit
- [Model] GritLM supports other attention backends (#18109) · d62a076e
  Cyrus Leung authored May 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d62a076e
13 May, 2025 1 commit
- add qwen3 moe configs · 09e372e7
  zhuwenwen authored May 13, 2025
```
support telechat2 and glm4 nn layout
remove log of request_id
```
  09e372e7
01 May, 2025 1 commit
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
28 Apr, 2025 1 commit
- [Minor][Models] Pass partial_rotary_factor parameter to rope (#17266) · 7fcc4223
  Wanrui Dai authored Apr 28, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  7fcc4223
26 Apr, 2025 1 commit
- [Minor][Models] Fix Return Types of Llama & Eagle (#17220) · b2789112
  Woosuk Kwon authored Apr 25, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b2789112
25 Apr, 2025 1 commit

[V1][Spec Decode] EAGLE-3 Support (#16937) · a0e619e6

Benjamin Chislett authored Apr 25, 2025


Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Bryan Lu <yuzhelu@amazon.com>

a0e619e6

24 Apr, 2025 2 commits
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
- fix llama and qwen layout · 61898ea3
  zhuwenwen authored Apr 24, 2025
  
  61898ea3
07 Apr, 2025 1 commit

Upstream Llama4 Support to Main (#16113) · 55dcce91

Lu Fang authored Apr 07, 2025


Signed-off-by: Aston Zhang <22279212+astonzhang@users.noreply.github.com>
Signed-off-by: Chris Thi <chris.c.thi@gmail.com>
Signed-off-by: drisspg <drisspguessous@gmail.com>
Signed-off-by: Jon Swenson <jmswen@gmail.com>
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Xiaodong Wang <xdwang@meta.com>
Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Lu Fang <lufang@fb.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

55dcce91

06 Apr, 2025 1 commit
- [Model] Support Llama4 in vLLM (#16104) · c5752323
  Lu Fang authored Apr 05, 2025
  
  c5752323