Commits · d5ae4f7f421eacd8de2f7fb012ca7b1ef88e9c71 · OpenDAS / vllm_cscc · GitLab

06 Apr, 2025 10 commits
- [Doc][Bugfix] Add missing EOF in k8s deploy doc (#16025) · d5ae4f7f
  Paul Schweigert authored Apr 06, 2025
  
  d5ae4f7f
- [Misc] refactor example eagle (#16100) · b6c502a1
  Reid authored Apr 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b6c502a1
- [CI][V1] Fix passing `tokenizer` as kwarg to `validate_guidance_grammar` (#16117) · 9ca710e5
  Roger Wang authored Apr 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9ca710e5
- [Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501) · eb07c8cb
  Ben Jackson authored Apr 06, 2025
```
Signed-off-by: Ben Jackson <ben@ben.com>
```
  eb07c8cb
- [Benchmark] Add sampling parameters to benchmark_serving. (#16022) · ba108019
  Hyesoo Yang authored Apr 05, 2025
```
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
```
  ba108019
- [Model] fix model testing for TeleChat2ForCausalLM and V0 llama4 (#16112) · 620fc2d0
  Lucia Fang authored Apr 05, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  620fc2d0
- [Model] use AutoWeightsLoader for phi, gemma, deepseek (#16088) · 29283eaa
  Jonghyun Choe authored Apr 06, 2025
```
Signed-off-by: Jonghyun Choe <andy.choe729@gmail.com>
```
  29283eaa
- [Bugfix] fix use_atomic_add support of marlin kernel when using v1 engine (#15946) · 2fa66ef7
  Jinzhen Lin authored Apr 06, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  2fa66ef7
- [Misc] Remove redundant code (#16098) · 13affc43
  Chauncey authored Apr 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  13affc43
- [Misc] format output for encoder_decoder.py (#16095) · d8f094a9
  Reid authored Apr 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d8f094a9
05 Apr, 2025 6 commits
- Fix some capitalisations in generated examples doc titles (#16094) · 97ae6d77
  Harry Mellor authored Apr 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97ae6d77
- Revert "doc: add info for macos clang errors (#16049)" (#16091) · 6baeee70
  yihong authored Apr 05, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  6baeee70
- [doc] fix 404 (#16082) · d2517a49
  Reid authored Apr 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  d2517a49
- fix: support clang17 for macos and fix the real libomp (#16086) · 6342adc4
  yihong authored Apr 05, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  6342adc4
- [CI] Fix benchmark script level (#16089) · 0adba915
  Kevin H. Luu authored Apr 05, 2025
  
  0adba915
- [Misc] Auto detect bitsandbytes pre-quantized models (#16027) · 4285e423
  Tristan Leclercq authored Apr 05, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  4285e423
04 Apr, 2025 21 commits
- [V1][Spec Decode] Update N-gram Proposer Interface (#15750) · 63375f0c
  Woosuk Kwon authored Apr 04, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  63375f0c
- [Bugfix][TPU] Fix V1 TPU worker for sliding window (#16059) · 70ad3f9e
  Michael Goin authored Apr 04, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  70ad3f9e
- [Kernel][Minor] Re-fuse triton moe weight application (#16071) · d6fc629f
  bnellnm authored Apr 04, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  d6fc629f
- Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
  Roger Wang authored Apr 04, 2025
  
  af51d80f
- [V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50
  Cyrus Leung authored Apr 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f5722a50
- [V1] DP scale-out (1/N): Use zmq ROUTER/DEALER sockets for input queue (#15906) · 651cf0fe
  Nick Hill authored Apr 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  651cf0fe
- [CI] Reorganize .buildkite directory (#16001) · 4dc52e1c
  Kevin H. Luu authored Apr 04, 2025
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  4dc52e1c
- [Bugfix] Fix default behavior/fallback for pp in v1 (#16057) · 4708f13a
  Michael Goin authored Apr 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4708f13a
- [ROCm][Bugfix] Bring back fallback to eager mode removed in #14917, but for ROCm only (#15413) · a6d042df
  Gregory Shtrasberg authored Apr 04, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  a6d042df
- [ROCm][Bugfix] Use platform specific FP8 dtype (#15717) · 40a36ccf
  Gregory Shtrasberg authored Apr 04, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  40a36ccf
- [Distributed] [ROCM] Fix custom allreduce enable checks (#16010) · ef608c37
  Ilya Markov authored Apr 04, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  ef608c37
- [CPU] Change default block_size for CPU backend (#16002) · 2386803f
  Li, Jiang authored Apr 05, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  2386803f
- [Benchmark][Doc] Update throughput benchmark and README (#15998) · 95862f7b
  Ziji Shi (Steven) authored Apr 04, 2025
```
Signed-off-by: StevenShi-23 <shi.ziji.sm@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  95862f7b
- [Bugfix][kernels] Fix half2float conversion in gguf kernels (#15995) · 230b131b
  Isotr0py authored Apr 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  230b131b
- [Hardware][Gaudi][BugFix] fix arguments of hpu fused moe (#15945) · 0812d8dd
  liuzhenwei authored Apr 05, 2025
```
Signed-off-by: zhenwei <zhenweiliu@habana.ai>
```
  0812d8dd
- [Model] use AutoWeightsLoader for baichuan, gpt-neox, mpt (#15939) · bf7e3c51
  Jonghyun Choe authored Apr 05, 2025
```
Signed-off-by: Jonghyun Choe <andy.choe729@gmail.com>
```
  bf7e3c51
- [V1][Spec Decode] Avoid logging useless nan metrics (#16023) · a35a8a83
  Mark McLoughlin authored Apr 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  a35a8a83
- doc: add info for macos clang errors (#16049) · 4ef0bb1f
  yihong authored Apr 04, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  4ef0bb1f
- [TPU][V1] Remove ragged attention kernel parameter hard coding (#16041) · fadc59c0
  Chengji Yao authored Apr 04, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  fadc59c0
- [Misc] improve gguf check (#15974) · 86cbd2ee
  Reid authored Apr 04, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  86cbd2ee
- [ROCm] Tweak the benchmark script to run on ROCm (#14252) · 092475f7
  Huy Do authored Apr 03, 2025
  
  092475f7
03 Apr, 2025 3 commits
- [Bugfix] Fix function names in test_block_fp8.py (#16033) · dcc56d62
  bnellnm authored Apr 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dcc56d62
- [TPU] Switch Test to Non-Sliding Window (#15981) · f15e70d9
  Robert Shaw authored Apr 03, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  f15e70d9
- [TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. (#15732) · b6be6f8d
  iefgnoix authored Apr 03, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  b6be6f8d