Commits · 7acd539cd772953bbeb14de1888f788a0926a5cd · OpenDAS / vllm_cscc · GitLab

01 Apr, 2025 34 commits
- [Docs] update usage stats language (#15898) · 7acd539c
  Simon Mo authored Apr 01, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  7acd539c
- [V1][Spec Decode] Implement Eagle Proposer [1/N] (#15729) · e75a6301
  Woosuk Kwon authored Apr 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e75a6301
- [V1][Metrics] Initial speculative decoding metrics (#15151) · a79cc68b
  Mark McLoughlin authored Apr 01, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  a79cc68b
- [CI] Disable flaky structure decoding test temporarily. (#15892) · 7e3f7a4e
  Roger Wang authored Apr 01, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  7e3f7a4e
- [Model] Add module name prefixes to gemma3 (#15889) · 9ec82579
  cloud11665 authored Apr 02, 2025
```
Signed-off-by: Bartholomew Sabat <bartek@recursal.ai>
Co-authored-by: Bartholomew Sabat <bartek@recursal.ai>
```
  9ec82579
- [Model] Aya Vision (#15441) · 38327cf4
  Jennifer Zhao authored Apr 01, 2025
```
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  38327cf4
- [CI/Build] Clean up LoRA tests (#15867) · dfa82e2a
  Jee Jee Li authored Apr 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dfa82e2a
- Add option to use DeepGemm contiguous grouped gemm kernel for fused MoE operations. (#13932) · e59ca942
  bnellnm authored Apr 01, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e59ca942
- [ROCm][Build][Bugfix] Bring the base dockerfile in sync with the ROCm fork (#15820) · a57a3044
  Gregory Shtrasberg authored Apr 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a57a3044
- [Misc] Allow using OpenCV as video IO fallback (#15055) · 4e5a0f6a
  Isotr0py authored Apr 01, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e5a0f6a
- Reinstate `format.sh` and make `pre-commit` installation simpler (#15890) · b63bd149
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b63bd149
- [Doc] Quark quantization documentation (#15861) · 2041c0e3
  chaow-amd authored Apr 01, 2025
```
Signed-off-by: chaow <chaow@amd.com>
```
  2041c0e3
- [New Model]: jinaai/jina-reranker-v2-base-multilingual (#15876) · 085cbc4f
  wang.yuqi authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  085cbc4f
- Remove `format.sh` as it's been unsupported >70 days (#15884) · 2b93162f
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2b93162f
- [Misc] remove unused script (#15746) · 2e45bd29
  Reid authored Apr 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2e45bd29
- [Model] Support Mistral3 in the HF Transformers format (#15505) · 51d7c6a2
  Michael Goin authored Apr 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  51d7c6a2
- setup correct nvcc version with CUDA_HOME (#15725) · f3aca1ee
  Yang Chen authored Apr 01, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  f3aca1ee
- [Misc] Use envs.VLLM_USE_RAY_COMPILED_DAG_CHANNEL_TYPE (#15831) · 8dd41d6b
  Rui Qiao authored Apr 01, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8dd41d6b
- [Bugfix] Fix no video/image profiling edge case for `MultiModalDataParser` (#15828) · 0a298ea4
  Isotr0py authored Apr 01, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  0a298ea4
- [Docs] Fix small error in link text (#15868) · d330558b
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d330558b
- [Misc] Fix speculative config repr string (#15860) · 656fd729
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  656fd729
- [Misc] Enable V1 LoRA by default (#15320) · 79455cf4
  Varun Sundar Rabindranath authored Apr 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  79455cf4
- [Feature] specify model in config.yaml (#15798) · 30d6a015
  Wei Zeng authored Apr 01, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  30d6a015
- fix: can not use uv run collect_env close #13888 (#15792) · 8af5a5c4
  yihong authored Apr 01, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  8af5a5c4
- [V1] Implement sliding window attention in kv_cache_manager (#14097) · 3a5f0afc
  Chen Zhang authored Apr 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  3a5f0afc
- [ROCm] Use device name in the warning (#15838) · c7e63aa4
  Gregory Shtrasberg authored Apr 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  c7e63aa4
- [sleep mode] clear pytorch cache after sleep (#15248) · 4a9ce178
  Lionel Villard authored Apr 01, 2025
```
Signed-off-by: <villard@us.ibm.com>
```
  4a9ce178
- [V1] TPU - Fix fused MOE (#15834) · 7e4e709b
  Alexander Matveev authored Apr 01, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  7e4e709b
- [Bugfix]: Fix is_embedding_layer condition in VocabParallelEmbedding (#15824) · 63d8eabe
  Alexey Kiryushin authored Apr 01, 2025
```
Signed-off-by: alexwl <alexey.a.kiryushin@gmail.com>
```
  63d8eabe
- [Bugfix] Fix extra comma (#15851) · e830b013
  Percy authored Apr 01, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  e830b013
- [Bugfix][Model] fix mllama multi-image (#14883) · ff647398
  Yan Ma authored Apr 01, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  ff647398
- [Frontend] Add Phi-4-mini function calling support (#14886) · a164aea3
  Kinfey authored Apr 01, 2025
```
Signed-off-by: Kinfey <kinfeylo@microsoft.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a164aea3
- Rename fallback model and refactor supported models section (#15829) · a76f547e
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a76f547e
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
31 Mar, 2025 6 commits
- Move dockerfiles into their own directory (#14549) · e6e3c55e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6e3c55e
- [V1][Core] Remove unused speculative config from scheduler (#15818) · f98a4920
  Mark McLoughlin authored Mar 31, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  f98a4920
- Fix Transformers backend compatibility check (#15290) · d4bfc23e
  Harry Mellor authored Mar 31, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4bfc23e
- [V1] TPU CI - Add basic perf regression test (#15414) · 9a2160fa
  Alexander Matveev authored Mar 31, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9a2160fa
- fix: change GB to GiB in logging close #14979 (#15807) · 2de41182
  yihong authored Apr 01, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2de41182
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef