Commits · d02421a7dbd85eb173cb2620da3dbc16d81135f4 · OpenDAS / vllm_cscc

17 Apr, 2026 1 commit
- [CPU] Refactor CPU affinity and memory management (#39781) · d02421a7
  Li, Jiang authored Apr 17, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  d02421a7
16 Apr, 2026 1 commit
- [CI/Build] Improve stability of CPU tests (#39966) · 324a3d2b
  Li, Jiang authored Apr 16, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  324a3d2b
15 Apr, 2026 1 commit

Update to transformers v5 (#30566) · 03f8d3a5

Harry Mellor authored Apr 16, 2026


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>

03f8d3a5

16 Mar, 2026 1 commit
- [Model] Add HyperCLOVAX-SEED-Think-14B language model support (#37107) · 2390d442
  bigshanedogg authored Mar 16, 2026
```
Signed-off-by: bigshanedogg <bigshane319@gmail.com>
```
  2390d442
11 Mar, 2026 1 commit
- Make Gemma and Gemma 2 accept `inputs_embeds` like Gemma 3 (#36787) · 65986db6
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  65986db6
09 Mar, 2026 1 commit
- [ROCm][CI] Fix logprob divergence for TitanML/tiny-mixtral under AITER rms_norm (#36101) · 1e0f917b
  Andreas Karatzas authored Mar 09, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  1e0f917b
05 Mar, 2026 1 commit
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
22 Jan, 2026 1 commit

[ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346) · eb1629da

Andreas Karatzas authored Jan 21, 2026


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

eb1629da

31 Dec, 2025 1 commit

[ROCm][CI] Update MiniCPM model test: MiniCPM3-4B to MiniCPM4.1-8B and... · cf16342d

Andreas Karatzas authored Dec 31, 2025


[ROCm][CI] Update MiniCPM model test: MiniCPM3-4B to MiniCPM4.1-8B and simplify attention backend testing (#31551)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

cf16342d

23 Nov, 2025 1 commit
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
12 Nov, 2025 1 commit
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [CI/Build] Fix model nightly tests (#26466) · 0f29dca9
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f29dca9
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
21 Sep, 2025 1 commit

[V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4

Woosuk Kwon authored Sep 20, 2025


Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

52c2a8d4

19 Sep, 2025 1 commit

[CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4

Andrew Sansom authored Sep 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9a4600e4

12 Sep, 2025 3 commits
- [CI] Speed up model unit tests in CI (#24253) · c8c42597
  afeldman-nm authored Sep 12, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  c8c42597
- [CI/Build] Skip prompt embeddings tests on V1-only CPU backend (#24721) · 59d5d2c7
  Li, Jiang authored Sep 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  59d5d2c7
- Fix implementation divergence for BLOOM models between vLLM and HuggingFace... · ddcec289
  Andrew Sansom authored Sep 11, 2025
```
Fix implementation divergence for BLOOM models between vLLM and HuggingFace when using prompt embeds (#24686)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ddcec289
09 Sep, 2025 1 commit
- [Bugfix] Fix Apertus HF repo name (#24447) · 948dd344
  Cyrus Leung authored Sep 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  948dd344
02 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24077) · fad73be1
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fad73be1
29 Aug, 2025 1 commit

[MODEL] `Apertus` and `XIELU` (#23068) · 1cf3753b

EduardDurech authored Aug 29, 2025


Signed-off-by: EduardDurech <39579228+EduardDurech@users.noreply.github.com>
Co-authored-by: AllenHaoHuang <allenhuangdd@gmail.com>

1cf3753b

04 Aug, 2025 1 commit
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
11 Jul, 2025 1 commit

[Bugfix] Fix OOM in language generation test (#20814) · 0d21b266

Isotr0py authored Jul 12, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0d21b266

08 Jul, 2025 1 commit
- [CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560) · 7721ef17
  Li, Jiang authored Jul 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7721ef17
01 Jul, 2025 1 commit
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
04 Jun, 2025 1 commit
- [CPU] V1 support for the CPU backend (#16441) · 4555143e
  Li, Jiang authored Jun 04, 2025
  
  4555143e
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
11 May, 2025 1 commit
- [BugFix] [ROCm]: Bugfix and handle addition case of input for `rocm_aiter_rms_norm` (#17857) · a810b5b0
  TJian authored May 11, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  a810b5b0
03 May, 2025 1 commit
- [Core] Gate `prompt_embeds` behind a feature flag (#17607) · 887d7af8
  Cyrus Leung authored May 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  887d7af8
02 May, 2025 1 commit

[Core] [Bugfix] Add Input Embeddings (#15428) · cc2a77d7

Andrew Sansom authored May 02, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

cc2a77d7

01 May, 2025 2 commits
- [Misc] Clean up test docstrings and names (#17521) · 48e925fa
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  48e925fa
- [CI/Build] Reorganize models tests (#17459) · afb4429b
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afb4429b
29 Apr, 2025 1 commit
- Remove Falcon3 2x7B from CI (#17404) · 0350809f
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0350809f
26 Apr, 2025 1 commit
- [Bugfix] Fix standard models tests (#17217) · 909fdaf1
  Cyrus Leung authored Apr 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  909fdaf1
25 Apr, 2025 1 commit
- Bump Transformers to 4.51.3 (#17116) · 0bd7f8fc
  Harry Mellor authored Apr 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0bd7f8fc
22 Mar, 2025 1 commit
- [FEAT] [ROCm]: Add AITER RMS Norm (Layer Norm) Feature (#14959) · ec870fba
  TJian authored Mar 22, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  ec870fba
15 Mar, 2025 1 commit

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

13 Feb, 2025 1 commit
- [VLM] Merged multi-modal processor for Molmo (#12966) · c9d3ecf0
  Cyrus Leung authored Feb 13, 2025
  
  c9d3ecf0
10 Feb, 2025 1 commit
- [Bugfix] Clean up and fix multi-modal processors (#13012) · 51f0b5f7
  Cyrus Leung authored Feb 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0b5f7