Commits · 02ed8a1fbe41e3ad1bc04fd29b754facd28e329f · OpenDAS / vllm_cscc · GitLab

13 Feb, 2025 18 commits
- [Misc] Qwen2.5-VL Optimization (#13155) · 02ed8a1f
  燃 authored Feb 13, 2025
  
  02ed8a1f
- [V1][Core] Add worker_base for v1 worker (#12816) · 2092a6fa
  Aoyu authored Feb 13, 2025
```
Signed-off-by: Aoyu <aoyuzhan@amazon.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Aoyu <aoyuzhan@amazon.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2092a6fa
- [VLM] Merged multi-modal processor for Molmo (#12966) · c9d3ecf0
  Cyrus Leung authored Feb 13, 2025
  
  c9d3ecf0
- [V1] Clarify input processing and multimodal feature caching logic (#13211) · fdcf64d3
  Roger Wang authored Feb 13, 2025
  
  fdcf64d3
- [Frontend] Pass pre-created socket to uvicorn (#13113) · 578087e5
  Russell Bryant authored Feb 13, 2025
  
  578087e5
- [VLM] Remove input processor from clip and siglip (#13165) · fa253f1a
  Isotr0py authored Feb 13, 2025
  
  fa253f1a
- [V1][core] Implement pipeline parallel on Ray (#12996) · 9605c125
  Rui Qiao authored Feb 13, 2025
  
  9605c125
- [CI/Build] Allow ruff to auto-fix some issues (#13180) · 0ccd8769
  Russell Bryant authored Feb 13, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  0ccd8769
- Allow Unsloth Dynamic 4bit BnB quants to work (#12974) · cb944d58
  Daniel Han authored Feb 12, 2025
  
  cb944d58
- [Frontend] Move CLI code into vllm.cmd package (#12971) · d46d490c
  Russell Bryant authored Feb 13, 2025
  
  d46d490c
- [Bugfix] deepseek_r1_reasoning_parser put reason content in wrong field in... · 04f50ad9
  LikeSundayLikeRain authored Feb 13, 2025
```
[Bugfix] deepseek_r1_reasoning_parser put reason content in wrong field in certain edge case (#13097)
```
  04f50ad9
- [Build] Automatically use the wheel of the base commit with Python-only build (#13178) · 60c68df6
  Cody Yu authored Feb 12, 2025
  
  60c68df6
- Simplify logic of locating CUDART so file path (#13203) · 009439ca
  Lu Fang authored Feb 12, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  009439ca
- [VLM] Implement merged multimodal processor for Mllama (#11427) · bc55d130
  Isotr0py authored Feb 13, 2025
  
  bc55d130
- [Bugfix][Example] Fix GCed profiling server for TPU (#12792) · d88c8666
  Michael Goin authored Feb 12, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  d88c8666
- [NVIDIA] Support nvfp4 quantization (#12784) · 4fc5c23b
  Kaixi Hou authored Feb 12, 2025
  
  4fc5c23b
- [perf-benchmark] cleanup unused Docker images and volumes in H100 benchmark instance (#12706) · 9f9704dc
  Kevin H. Luu authored Feb 12, 2025
  
  9f9704dc
- [CI/Build] Ignore ruff warning up007 (#13182) · 8eafe5ea
  Russell Bryant authored Feb 12, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  8eafe5ea
12 Feb, 2025 20 commits
- [V1][Bugfix] Copy encoder input ids to fix set iteration issue during VLM abort (#13173) · 4c0d93f4
  Murali Andoorveedu authored Feb 12, 2025
```
Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
```
  4c0d93f4
- [CI] Fix failing FP8 cpu offload test (#13170) · 14b7899d
  Michael Goin authored Feb 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  14b7899d
- [Bugfix] Allow fallback to AWQ from AWQMarlin at per-layer granularity (#13119) · 09972e71
  Michael Goin authored Feb 12, 2025
  
  09972e71
- [CORE] [QUANT] Support for GPTQModel's `dynamic` quantization per module override/control (#7086) · 36a08630
  Qubitium-ModelCloud authored Feb 13, 2025
  
  36a08630
- [CI/Build] Use mypy matcher for pre-commit CI job (#13162) · 2c2b560f
  Russell Bryant authored Feb 12, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  2c2b560f
- Introduce VLLM_CUDART_SO_PATH to allow users specify the .so path (#12998) · 042c3419
  Lu Fang authored Feb 12, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  042c3419
- [Misc] Delete unused LoRA modules (#13151) · 82cabf53
  Jee Jee Li authored Feb 13, 2025
  
  82cabf53
- [Frontend] Generate valid tool call IDs when using `tokenizer-mode=mistral` (#12332) · 314cfade
  Rafael Vasquez authored Feb 12, 2025
  
  314cfade
- [Bugfix] Fix num video tokens calculation for Qwen2-VL (#13148) · 985b4a2b
  Cyrus Leung authored Feb 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  985b4a2b
- [Bug] [V1] Try fetching stop_reason from EngineOutput before checking the request (#13108) · f4d97e4f
  bnellnm authored Feb 12, 2025
  
  f4d97e4f
- [Misc] AMD Build Improvements (#12923) · f1042e86
  Shiyan Deng authored Feb 12, 2025
  
  f1042e86
- Further reduce the HTTP calls to huggingface.co (#13107) · 7c4033ac
  Maximilien de Bayser authored Feb 12, 2025
  
  7c4033ac
- Bump actions/setup-python from 5.3.0 to 5.4.0 (#12672) · d59def47
  dependabot[bot] authored Feb 12, 2025
  
  d59def47
- Bump helm/chart-testing-action from 2.6.1 to 2.7.0 (#12463) · 0c7d9eff
  dependabot[bot] authored Feb 12, 2025
  
  0c7d9eff
- Bump actions/stale from 9.0.0 to 9.1.0 (#12462) · dd3b4a01
  dependabot[bot] authored Feb 12, 2025
  
  dd3b4a01
- Bump helm/kind-action from 1.10.0 to 1.12.0 (#11612) · a0597c6b
  dependabot[bot] authored Feb 12, 2025
  
  a0597c6b
- [Neuron][Kernel] Support Longer Sequences in NKI-based Flash PagedAttention... · e92694b6
  Lingfan Yu authored Feb 11, 2025
```
[Neuron][Kernel] Support Longer Sequences in NKI-based Flash PagedAttention and Improve Efficiency (#12921)
Signed-off-by: Lingfan Yu <lingfany@amazon.com>
```
  e92694b6
- [ci] Add more source file dependencies for some tests (#13123) · 842b0fd4
  Kevin H. Luu authored Feb 11, 2025
```
Signed-off-by: <>
Co-authored-by: EC2 Default User <ec2-user@ip-172-31-20-117.us-west-2.compute.internal>
```
  842b0fd4
- [Model] IBM/NASA Prithvi Geospatial model (#12830) · 974dfd49
  Christian Pinto authored Feb 12, 2025
  
  974dfd49
- [RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM (#12518) · 3ee696a6
  Keyun Tong authored Feb 11, 2025
```
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
```
  3ee696a6
11 Feb, 2025 2 commits
- [Misc] Move pre-commit suggestion back to the end (#13114) · 72c2b68d
  Russell Bryant authored Feb 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  72c2b68d
- [Bugfix] Guided decoding falls back to outlines when fails to import xgrammar (#12976) · 14ecab5b
  Yuan Tang authored Feb 11, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  14ecab5b