Commits · aa557e64227d9640e2af8c03a6fc92f3513e3f54 · OpenDAS / vllm_cscc · GitLab

02 Apr, 2025 8 commits
- [Benchmark]Fix error message (#15866) · aa557e64
  Li Wang authored Apr 02, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  aa557e64
- [V1][Bugfix] Fix typo in MoE TPU checking (#15927) · 0e00d40e
  Roger Wang authored Apr 01, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0e00d40e
- [Doc] Update rocm.inc.md (#15917) · c920e012
  chun authored Apr 02, 2025
```
Signed-off-by: chun37 <chun.jb.37@gmail.com>
```
  c920e012
- [V1][Minor] Enhance SpecDecoding Metrics Log in V1 (#15902) · 274d8e88
  Woosuk Kwon authored Apr 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  274d8e88
- [Bugfix] Fix imports for MoE on CPU (#15841) · 2039c630
  Thien Tran authored Apr 02, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  2039c630
- [V1] Fix: make sure `k_index` is int64 for `apply_top_k_only` (#15907) · 6efb195a
  Brayden Zhong authored Apr 01, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  6efb195a
- [Spec Decode] Fix input triton kernel for eagle (#15909) · 24b7fb45
  Ekagra Ranjan authored Apr 01, 2025
  
  24b7fb45
- [Docs] Add Intel as Sponsor (#15913) · 58f5a597
  Simon Mo authored Apr 01, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  58f5a597
01 Apr, 2025 32 commits
- [Docs] Add Ollama meetup slides (#15905) · db9dfcfa
  Simon Mo authored Apr 01, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  db9dfcfa
- [Model][MiniMaxText01] Support MiniMaxText01 model inference (#13454) · 9ef98d52
  Gerald authored Apr 02, 2025
```
Signed-off-by: qscqesze <475517977@qq.com>
Co-authored-by: qingjun <qingjun@minimaxi.com>
Co-authored-by: qscqesze <475517977@qq.com>
```
  9ef98d52
- [BugFix] make sure socket close (#15875) · 93491aef
  yihong authored Apr 02, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  93491aef
- [Docs] update usage stats language (#15898) · 7acd539c
  Simon Mo authored Apr 01, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  7acd539c
- [V1][Spec Decode] Implement Eagle Proposer [1/N] (#15729) · e75a6301
  Woosuk Kwon authored Apr 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e75a6301
- [V1][Metrics] Initial speculative decoding metrics (#15151) · a79cc68b
  Mark McLoughlin authored Apr 01, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  a79cc68b
- [CI] Disable flaky structure decoding test temporarily. (#15892) · 7e3f7a4e
  Roger Wang authored Apr 01, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  7e3f7a4e
- [Model] Add module name prefixes to gemma3 (#15889) · 9ec82579
  cloud11665 authored Apr 02, 2025
```
Signed-off-by: Bartholomew Sabat <bartek@recursal.ai>
Co-authored-by: Bartholomew Sabat <bartek@recursal.ai>
```
  9ec82579
- [Model] Aya Vision (#15441) · 38327cf4
  Jennifer Zhao authored Apr 01, 2025
```
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  38327cf4
- [CI/Build] Clean up LoRA tests (#15867) · dfa82e2a
  Jee Jee Li authored Apr 02, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  dfa82e2a
- Add option to use DeepGemm contiguous grouped gemm kernel for fused MoE operations. (#13932) · e59ca942
  bnellnm authored Apr 01, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e59ca942
- [ROCm][Build][Bugfix] Bring the base dockerfile in sync with the ROCm fork (#15820) · a57a3044
  Gregory Shtrasberg authored Apr 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a57a3044
- [Misc] Allow using OpenCV as video IO fallback (#15055) · 4e5a0f6a
  Isotr0py authored Apr 01, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e5a0f6a
- Reinstate `format.sh` and make `pre-commit` installation simpler (#15890) · b63bd149
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b63bd149
- [Doc] Quark quantization documentation (#15861) · 2041c0e3
  chaow-amd authored Apr 01, 2025
```
Signed-off-by: chaow <chaow@amd.com>
```
  2041c0e3
- [New Model]: jinaai/jina-reranker-v2-base-multilingual (#15876) · 085cbc4f
  wang.yuqi authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  085cbc4f
- Remove `format.sh` as it's been unsupported >70 days (#15884) · 2b93162f
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2b93162f
- [Misc] remove unused script (#15746) · 2e45bd29
  Reid authored Apr 01, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2e45bd29
- [Model] Support Mistral3 in the HF Transformers format (#15505) · 51d7c6a2
  Michael Goin authored Apr 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  51d7c6a2
- setup correct nvcc version with CUDA_HOME (#15725) · f3aca1ee
  Yang Chen authored Apr 01, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  f3aca1ee
- [Misc] Use envs.VLLM_USE_RAY_COMPILED_DAG_CHANNEL_TYPE (#15831) · 8dd41d6b
  Rui Qiao authored Apr 01, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8dd41d6b
- [Bugfix] Fix no video/image profiling edge case for `MultiModalDataParser` (#15828) · 0a298ea4
  Isotr0py authored Apr 01, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  0a298ea4
- [Docs] Fix small error in link text (#15868) · d330558b
  Harry Mellor authored Apr 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d330558b
- [Misc] Fix speculative config repr string (#15860) · 656fd729
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  656fd729
- [Misc] Enable V1 LoRA by default (#15320) · 79455cf4
  Varun Sundar Rabindranath authored Apr 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  79455cf4
- [Feature] specify model in config.yaml (#15798) · 30d6a015
  Wei Zeng authored Apr 01, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  30d6a015
- fix: can not use uv run collect_env close #13888 (#15792) · 8af5a5c4
  yihong authored Apr 01, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  8af5a5c4
- [V1] Implement sliding window attention in kv_cache_manager (#14097) · 3a5f0afc
  Chen Zhang authored Apr 01, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  3a5f0afc
- [ROCm] Use device name in the warning (#15838) · c7e63aa4
  Gregory Shtrasberg authored Apr 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  c7e63aa4
- [sleep mode] clear pytorch cache after sleep (#15248) · 4a9ce178
  Lionel Villard authored Apr 01, 2025
```
Signed-off-by: <villard@us.ibm.com>
```
  4a9ce178
- [V1] TPU - Fix fused MOE (#15834) · 7e4e709b
  Alexander Matveev authored Apr 01, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  7e4e709b
- [Bugfix]: Fix is_embedding_layer condition in VocabParallelEmbedding (#15824) · 63d8eabe
  Alexey Kiryushin authored Apr 01, 2025
```
Signed-off-by: alexwl <alexey.a.kiryushin@gmail.com>
```
  63d8eabe