Commits · 126f6beeb4bacc20bb1282a98454976c0f1235e3 · OpenDAS / vllm_cscc · GitLab

27 Feb, 2025 20 commits
- Bump azure/setup-helm from 4.2.0 to 4.3.0 (#13742) · 126f6bee
  dependabot[bot] authored Feb 27, 2025
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  126f6bee
- [Attention] MLA support for V1 (#13789) · 58d1b2aa
  Yang Chen authored Feb 27, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  58d1b2aa
- [VLM] Generalized prompt updates for multi-modal processor (#13964) · f1579b22
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f1579b22
- [Bugfix] Fix qwen2.5-vl overflow issue (#13968) · 78648758
  Isotr0py authored Feb 28, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  78648758
- Update LMFE version to v0.10.11 to support new versions of transforme… (#13930) · 1dd422b6
  Noam Gat authored Feb 27, 2025
  
  1dd422b6
- [bugfix] Fix profiling for RayDistributedExecutor (#13945) · 06c8f8d8
  Rui Qiao authored Feb 27, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  06c8f8d8
- Deduplicate `.pre-commit-config.yaml`'s `exclude` (#13967) · 5677c9bb
  Harry Mellor authored Feb 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5677c9bb
- Update quickstart.md (#13958) · 512d77d5
  王博伟 authored Feb 28, 2025
  
  512d77d5
- [Model] Deepseek GGUF support (#13167) · 7f0be2aa
  Szymon Ożóg authored Feb 27, 2025
  
  7f0be2aa
- [VLM] Support multimodal inputs for Florence-2 models (#13320) · edf309eb
  Isotr0py authored Feb 27, 2025
  
  edf309eb
- Fix test_block_fp8.py test for MoE (#13915) · 788f284b
  Michael Goin authored Feb 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  788f284b
- [PP] Correct cache size check (#13873) · 4b1d141f
  Yang Zheng authored Feb 27, 2025
```
Signed-off-by: Yang Zheng <zhengy.gator@gmail.com>
```
  4b1d141f
- [Misc] fixed 'required' is an invalid argument for positionals (#13948) · 10c3b8c1
  Chauncey authored Feb 27, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  10c3b8c1
- [CI/Build] Add examples/ directory to be labelled by `mergify` (#13944) · a7f37314
  Brayden Zhong authored Feb 27, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  a7f37314
- [V1][Metrics] Handle preemptions (#13169) · cd711c48
  Mark McLoughlin authored Feb 27, 2025
  
  cd711c48
- [ROCm][V1] Update reshape_and_cache to properly work with CUDA graph padding (#13922) · 378b3ef6
  Sage Moore authored Feb 26, 2025
  
  378b3ef6
- [misc] Rename Ray ADAG to Compiled Graph (#13928) · c9944acb
  Rui Qiao authored Feb 26, 2025
  
  c9944acb
- Use CUDA 12.4 as default for release and nightly wheels (#12098) · ca377cf1
  Michael Goin authored Feb 26, 2025
  
  ca377cf1
- [ROCm][Quantization][Kernel] Use FP8 FNUZ when OCP flag is 0 or undefined (#13851) · a31614e3
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Feb 27, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  a31614e3
- [Kernel] FlashMLA integration (#13747) · f9590390
  Lucas Wilkinson authored Feb 26, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f9590390
26 Feb, 2025 20 commits
- [BugFix] Make FP8 Linear compatible with torch.compile (#13918) · b382a7f2
  Woosuk Kwon authored Feb 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b382a7f2
- [Bugfix] Backend option to disable xgrammar any_whitespace (#12744) · 4cb6fa0a
  Wallas Henrique authored Feb 26, 2025
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Joe Runde <Joseph.Runde@ibm.com>
```
  4cb6fa0a
- [Misc] fixed qwen_vl_utils parameter error (#13906) · d08b285a
  Chauncey authored Feb 27, 2025
  
  d08b285a
- [TPU] use torch2.6 with whl package (#13860) · b27122ac
  Chenyaaang authored Feb 26, 2025
```
Signed-off-by: Chenyaaang <llccyy1212@gmail.com>
```
  b27122ac
- [Bugfix] Update expected token counts for Ultravox tests (#13895) · 934bb99c
  Cyrus Leung authored Feb 26, 2025
  
  934bb99c
- [Bugfix] Do not crash V0 engine on input errors (#13101) · 3f808cc0
  Joe Runde authored Feb 26, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  3f808cc0
- [Misc]: Add support for goodput on guided benchmarking + TPOT calculation refactor (#13736) · ec8a5e53
  Brayden Zhong authored Feb 26, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  ec8a5e53
- [Bugfix] Handle None parameters in Mistral function calls. (#13786) · 215bf150
  Florian Greinacher authored Feb 26, 2025
  
  215bf150
- Add comments on accessing `kv_cache` and `attn_metadata` (#13887) · 0ecdd980
  Harry Mellor authored Feb 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0ecdd980
- [Bugfix] Add test example for Ultravox v0.5 (#13890) · 7b700ec8
  Cyrus Leung authored Feb 26, 2025
  
  7b700ec8
- [Misc] Fix input processing for Ultravox (#13871) · 7ca1da02
  Roger Wang authored Feb 25, 2025
  
  7ca1da02
- [Misc] Improve LoRA spelling (#13831) · 5157338e
  Jee Jee Li authored Feb 26, 2025
  
  5157338e
- [v0][Core] Use xgrammar shared context to avoid copy overhead for offline engine (#13837) · e206b543
  Seth Kimmel authored Feb 25, 2025
```
Signed-off-by: Seth Kimmel <seth.kimmel3@gmail.com>
```
  e206b543
- [ROCm] Disable chunked prefill/prefix caching when running MLA on non-cuda platforms (#13844) · 1d35662e
  Sage Moore authored Feb 25, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  1d35662e
- [Doc] fix the incorrect module path of tensorize_vllm_model (#13863) · e656f638
  Albert authored Feb 26, 2025
  
  e656f638
- Improve pipeline partitioning (#13839) · 145944cb
  Harry Mellor authored Feb 26, 2025
  
  145944cb
- [Kernel][Build/CI] Bump CUTLASS to 3.8 and add initializers for cutlass epilogues (#13797) · 094b7d94
  Henry Tsang authored Feb 25, 2025
  
  094b7d94
- [Misc]Code Cleanup (#13859) · e1fe7591
  Chenguang Li authored Feb 26, 2025
```
Signed-off-by: noemotiovon <noemotiovon@gmail.com>
Co-authored-by: noemotiovon <noemotiovon@gmail.com>
```
  e1fe7591
- [V1][Spec Decode] Change Spec Decode Rejection Sampling API (#13729) · 5629f26d
  Lily Liu authored Feb 25, 2025
  
  5629f26d
- [misc] Show driver IP info when Ray fails to allocate driver worker (#13858) · 9ba28043
  Rui Qiao authored Feb 25, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  9ba28043