Commits · eb24dc4a4538445504d06a1eb1f4f053cceec593 · OpenDAS / vllm_cscc · GitLab

23 Feb, 2025 8 commits
- [v1] torchrun compatibility (#13642) · eb24dc4a
  youkaichao authored Feb 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  eb24dc4a
- [Misc] Deprecate `--dataset` from `benchmark_serving.py` (#13708) · 9bebc951
  Roger Wang authored Feb 23, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9bebc951
- [Core][Distributed] Use IPC (domain socket) ZMQ socket for local comms (#13688) · 5a2ba16f
  Nick Hill authored Feb 23, 2025
  
  5a2ba16f
- [LMM] Implement merged multimodal processor for whisper (#13278) · ba5106e5
  Isotr0py authored Feb 23, 2025
  
  ba5106e5
- [Quant] BaiChuan SupportsQuant (#13710) · d5ca2110
  Kyle Sayers authored Feb 22, 2025
  
  d5ca2110
- [ci] Use env var to control whether to use S3 bucket in CI (#13634) · 2c5e637b
  Kevin H. Luu authored Feb 22, 2025
  
  2c5e637b
- [BugFix] Minor: logger import in attention backend (#13706) · 322d2a27
  Andy Lo authored Feb 23, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  322d2a27
- [CI/Build] Fix pre-commit errors from #13571 (#13709) · 82e0d601
  Roger Wang authored Feb 22, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  82e0d601
22 Feb, 2025 26 commits
- [CI/Build] fix uv caching in Dockerfile (#13611) · 78ac0f59
  Daniele authored Feb 22, 2025
  
  78ac0f59
- [XPU]fix setuptools version for xpu (#13548) · b56155e7
  Yan Ma authored Feb 23, 2025
  
  b56155e7
- [Bugfix] Fix boolean conversion for OpenVINO env variable (#13615) · 382f66fb
  Helena Kloosterman authored Feb 22, 2025
  
  382f66fb
- [Doc] Dockerfile instructions for optional dependencies and dev transformers (#13699) · 8354f664
  Cyrus Leung authored Feb 22, 2025
  
  8354f664
- [ROCm] Apply FP8 weights padding to values not divisible by 512 bytes on ROCm (#13231) · c904fddd
  Gregory Shtrasberg authored Feb 22, 2025
  
  c904fddd
- [V1][Kernel] Refactor the prefix_prefill kernel so that the caller no longer... · 558db808
  Sage Moore authored Feb 22, 2025
```
[V1][Kernel] Refactor the prefix_prefill kernel so that the caller no longer has to pass in the context lengths (#13095)
```
  558db808
- [NVIDIA] Support nvfp4 cutlass gemm (#13571) · e109e598
  Kaixi Hou authored Feb 22, 2025
  
  e109e598
- Support SSL Key Rotation in HTTP Server (#13495) · 8db1b9d0
  Keyun Tong authored Feb 22, 2025
  
  8db1b9d0
- [ci] fix linter (#13701) · 2382ad29
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2382ad29
- [core] set up data parallel communication (#13591) · 3e472d88
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3e472d88
- [CI/Build] Fix pre-commit errors (#13696) · 7f6bae56
  Cyrus Leung authored Feb 22, 2025
  
  7f6bae56
- [Misc] Reduce LoRA-related static variable (#13166) · 105b8ce4
  Jee Jee Li authored Feb 22, 2025
  
  105b8ce4
- [Metrics] Add `--show-hidden-metrics-for-version` CLI arg (#13295) · 2cb8c154
  Mark McLoughlin authored Feb 22, 2025
  
  2cb8c154
- [V1][Metrics] Support `vllm:cache_config_info` (#13299) · 1cd981da
  Mark McLoughlin authored Feb 22, 2025
  
  1cd981da
- Correction to TP logic for Mamba Mixer 2 when Num Groups not divisible by TP Size (#13660) · fca20841
  Yu Chin Fabian Lim authored Feb 22, 2025
  
  fca20841
- [Bugfix] V1 Memory Profiling: V0 Sampler Integration without Rejection Sampler (#13594) · da31b533
  Jennifer Zhao authored Feb 22, 2025
```
Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  da31b533
- [v1] Support allowed_token_ids in v1 Sampler (#13210) · bb78fb31
  Lu Fang authored Feb 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  bb78fb31
- [Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when... · 8aca27fa
  Robin authored Feb 22, 2025
```
[Bugfix] Fix benchmark script bug: inaccurate stats for vllm backend when max_model_len < input_len + output_len (#13691)
Signed-off-by: WangErXiao <863579016@qq.com>
```
  8aca27fa
- [Misc] Bump compressed-tensors (#13619) · 95c617e0
  Dipika Sikka authored Feb 22, 2025
  
  95c617e0
- [Bugfix][Model] OLMo 2: split qkv correctly for GQA and MQA (#13687) · 9a1f1da5
  Shane A authored Feb 21, 2025
  
  9a1f1da5
- [ROCM] fix native attention function call (#13650) · 68d630a0
  Gordon Wong authored Feb 22, 2025
  
  68d630a0
- [Misc] Capture and log the time of loading weights (#13666) · 68d535ef
  Jun Duan authored Feb 22, 2025
  
  68d535ef
- [Bugfix][API Server] Fix invalid usage of 'ge' and 'le' in port valid… (#13672) · c6ed9386
  Robin authored Feb 22, 2025
  
  c6ed9386
- [HTTP Server] Make model param optional in request (#13568) · 0ffdf8ce
  Keyun Tong authored Feb 21, 2025
  
  0ffdf8ce
- docs: Add a note on full CI run in contributing guide (#13646) · 8c0dd3d4
  Yuan Tang authored Feb 22, 2025
  
  8c0dd3d4
- [Misc] Fix yapf linting tools etc not running on pre-commit (#13695) · ada7c780
  Isotr0py authored Feb 22, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ada7c780
21 Feb, 2025 6 commits
- [Attention] MLA with chunked prefill (#12639) · 288cc6c2
  Lucas Wilkinson authored Feb 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Patrick Horn <patrick.horn@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  288cc6c2
- fix typo of grafana dashboard, with correct datasource (#13668) · 900edbfa
  John Zheng authored Feb 22, 2025
```
Signed-off-by: John Zheng <john.zheng@hp.com>
```
  900edbfa
- [Bugfix][CPU] Fix cpu all-reduce using native pytorch implementation (#13586) · b2c3fc5d
  Isotr0py authored Feb 21, 2025
  
  b2c3fc5d
- [Kernel]Add streamK for block-quantized CUTLASS kernels (#12978) · 839b27c6
  leoneo authored Feb 21, 2025
  
  839b27c6
- [ci] Fix metrics test model path (#13635) · 34ad27fe
  Kevin H. Luu authored Feb 20, 2025
  
  34ad27fe
- [FEATURE] Enables /score endpoint for embedding models (#12846) · 1c3c9757
  Gabriel Marinho authored Feb 21, 2025
  
  1c3c9757