Commits · 556ef7f714e09e8090cc535d045b3e1184653a12 · OpenDAS / vllm_cscc · GitLab

14 Feb, 2025 18 commits
- [Misc] Log time consumption of sleep and wake-up (#13115) · 556ef7f7
  Jun Duan authored Feb 14, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  556ef7f7
- [Bugfix] Fix missing parentheses (#13263) · 83481ceb
  Xu Song authored Feb 14, 2025
  
  83481ceb
- [Frontend] Optionally remove memory buffer used for uploading to URLs in run_batch (#12927) · 185cc19f
  Pooya Davoodi authored Feb 14, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  185cc19f
- [WIP] TPU V1 Support Refactored (#13049) · 45f90bcb
  Alexander Matveev authored Feb 14, 2025
  
  45f90bcb
- [Bugfix][V1] GPUModelRunner._update_states should return True when there is a... · b0ccfc56
  Kero Liang authored Feb 14, 2025
```
[Bugfix][V1] GPUModelRunner._update_states should return True when there is a finished request in batch (#13126)
```
  b0ccfc56
- [ROCm][V1] Add intial ROCm support to V1 (#12790) · ba59b78a
  Sage Moore authored Feb 13, 2025
  
  ba59b78a
- [V1] LoRA - Enable Serving Usecase (#12883) · cbc40128
  Varun Sundar Rabindranath authored Feb 14, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  cbc40128
- Expand MLA to support most types of quantization (#13181) · f0b2da72
  Michael Goin authored Feb 14, 2025
  
  f0b2da72
- Consolidate Llama model usage in tests (#13094) · f2b20fe4
  Harry Mellor authored Feb 14, 2025
  
  f2b20fe4
- [Misc] Remove redundant statements in scheduler.py (#13229) · 40932d7a
  Wang Ran (汪然) authored Feb 14, 2025
  
  40932d7a
- [Bugfix] Offline example of disaggregated prefill (#13214) · 84683fa2
  XiaobingZhang authored Feb 14, 2025
  
  84683fa2
- [Bugfix][CI] Inherit codespell settings from pyproject.toml in the pre-commit-config (#13237) · 06767826
  Tyler Michael Smith authored Feb 13, 2025
  
  06767826
- [Bugfix/CI] Turn test_compressed_tensors_2of4_sparse back on (#13250) · 09545c0a
  Tyler Michael Smith authored Feb 13, 2025
  
  09545c0a
- [V1] Consolidate MM cache size to vllm.envs (#13239) · dd5ede44
  Roger Wang authored Feb 13, 2025
  
  dd5ede44
- [Kernel] Fix awq error when n is not divisable by 128 (#13227) · 8c32b08a
  Jinzhen Lin authored Feb 14, 2025
  
  8c32b08a
- [ROCm] Avoid using the default stream on ROCm (#13238) · 41088695
  Gregory Shtrasberg authored Feb 13, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  41088695
- Revert "Add label if pre-commit passes" (#13242) · e38be640
  Harry Mellor authored Feb 14, 2025
  
  e38be640
- [Kernel][Bugfix] Refactor and Fix CUTLASS 2:4 Sparse Kernels (#13198) · c1e37bf7
  Tyler Michael Smith authored Feb 13, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  c1e37bf7
13 Feb, 2025 22 commits
- Optimize moe_align_block_size for deepseek_v3 (#12850) · 2344192a
  Michael Goin authored Feb 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  2344192a
- Add label if pre-commit passes (#12527) · bffddd9a
  Harry Mellor authored Feb 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bffddd9a
- [Frontend] Add `/v1/audio/transcriptions` OpenAI API endpoint (#12909) · d84cef76
  Nicolò Lucchesi authored Feb 13, 2025
  
  d84cef76
- [Bugfix] Missing Content Type returns 500 Internal Server Error (#13193) · 37dfa600
  Vaibhav Jain authored Feb 13, 2025
  
  37dfa600
- [VLM] Separate text-only and vision variants of the same model architecture (#13157) · 1bc3b5e7
  Cyrus Leung authored Feb 13, 2025
  
  1bc3b5e7
- [Misc] Qwen2.5-VL Optimization (#13155) · 02ed8a1f
  燃 authored Feb 13, 2025
  
  02ed8a1f
- [V1][Core] Add worker_base for v1 worker (#12816) · 2092a6fa
  Aoyu authored Feb 13, 2025
```
Signed-off-by: Aoyu <aoyuzhan@amazon.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Aoyu <aoyuzhan@amazon.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2092a6fa
- [VLM] Merged multi-modal processor for Molmo (#12966) · c9d3ecf0
  Cyrus Leung authored Feb 13, 2025
  
  c9d3ecf0
- [V1] Clarify input processing and multimodal feature caching logic (#13211) · fdcf64d3
  Roger Wang authored Feb 13, 2025
  
  fdcf64d3
- [Frontend] Pass pre-created socket to uvicorn (#13113) · 578087e5
  Russell Bryant authored Feb 13, 2025
  
  578087e5
- [VLM] Remove input processor from clip and siglip (#13165) · fa253f1a
  Isotr0py authored Feb 13, 2025
  
  fa253f1a
- [V1][core] Implement pipeline parallel on Ray (#12996) · 9605c125
  Rui Qiao authored Feb 13, 2025
  
  9605c125
- [CI/Build] Allow ruff to auto-fix some issues (#13180) · 0ccd8769
  Russell Bryant authored Feb 13, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  0ccd8769
- Allow Unsloth Dynamic 4bit BnB quants to work (#12974) · cb944d58
  Daniel Han authored Feb 12, 2025
  
  cb944d58
- [Frontend] Move CLI code into vllm.cmd package (#12971) · d46d490c
  Russell Bryant authored Feb 13, 2025
  
  d46d490c
- [Bugfix] deepseek_r1_reasoning_parser put reason content in wrong field in... · 04f50ad9
  LikeSundayLikeRain authored Feb 13, 2025
```
[Bugfix] deepseek_r1_reasoning_parser put reason content in wrong field in certain edge case (#13097)
```
  04f50ad9
- [Build] Automatically use the wheel of the base commit with Python-only build (#13178) · 60c68df6
  Cody Yu authored Feb 12, 2025
  
  60c68df6
- Simplify logic of locating CUDART so file path (#13203) · 009439ca
  Lu Fang authored Feb 12, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  009439ca
- [VLM] Implement merged multimodal processor for Mllama (#11427) · bc55d130
  Isotr0py authored Feb 13, 2025
  
  bc55d130
- [Bugfix][Example] Fix GCed profiling server for TPU (#12792) · d88c8666
  Michael Goin authored Feb 12, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  d88c8666
- [NVIDIA] Support nvfp4 quantization (#12784) · 4fc5c23b
  Kaixi Hou authored Feb 12, 2025
  
  4fc5c23b
- [perf-benchmark] cleanup unused Docker images and volumes in H100 benchmark instance (#12706) · 9f9704dc
  Kevin H. Luu authored Feb 12, 2025
  
  9f9704dc