Commits · d3aa2a8b2f93f50ed40fe7d8617701a2294a13e4 · OpenDAS / vllm_cscc

01 Nov, 2024 4 commits
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
- [torch.compile] rework test plans (#9866) · 566cd277
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  566cd277
- [torch.compile] directly register custom op (#9896) · 96e0c9cb
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  96e0c9cb
- [Bugfix][Frontend] Reject guided decoding in multistep mode (#9892) · 031a7995
  Joe Runde authored Oct 31, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  031a7995
31 Oct, 2024 4 commits

[BugFix][Kernel] Fix Illegal memory access in causal_conv1d in H100 (#9838) · 9fb12f78
Mor Zusman authored Oct 31, 2024
```
Signed-off-by: mzusman <mor.zusmann@gmail.com>
```
9fb12f78

[Bugfix] Fix `illegal memory access` error with chunked prefill, prefix... · 55650c83

sasha0552 authored Oct 31, 2024


[Bugfix] Fix `illegal memory access` error with chunked prefill, prefix caching, block manager v2 and xformers enabled together (#9532)
Signed-off-by: sasha0552 <admin@sasha0552.org>

55650c83

[CI/Build] Add Model Tests for Qwen2-VL (#9846) · 16b8f7a8

Alex Brooks authored Oct 31, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

16b8f7a8

[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens... · abbfb613
Guillaume Calmettes authored Oct 31, 2024
```
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)
```
abbfb613

30 Oct, 2024 6 commits
- [torch.compile] upgrade tests (#9858) · 64384bbc
  youkaichao authored Oct 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  64384bbc
- [CI/Build] Simplify exception trace in api server tests (#9787) · 00d91c8a
  Yongzao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  00d91c8a
- [Bugfix][core] replace heartbeat with pid check (#9818) · 3b3f1e74
  Joe Runde authored Oct 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  3b3f1e74
- [Misc] Add chunked-prefill support on FlashInfer. (#9781) · 9ff4511e
  Elfie Guo authored Oct 30, 2024
  
  9ff4511e
- [CI/Build] VLM Test Consolidation (#9372) · cc98f1e0
  Alex Brooks authored Oct 30, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  cc98f1e0
- [torch.compile] rework compile control with piecewise cudagraph (#9715) · ff5ed6e1
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ff5ed6e1
29 Oct, 2024 5 commits
- [Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339) · 882a1ad0
  Will Eaton authored Oct 29, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
```
  882a1ad0
- [Bugfix][Frontend] Guard against bad token ids (#9634) · 67bdf8e5
  Joe Runde authored Oct 29, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  67bdf8e5
- [CI][Bugfix] Skip chameleon for transformers 4.46.1 (#9808) · ab6f9816
  Michael Goin authored Oct 29, 2024
  
  ab6f9816
- [Hardware] using current_platform.seed_everything (#9785) · 622b7ab9
  wangshuai09 authored Oct 29, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  622b7ab9
- [Frontend] re-enable multi-modality input in the new beam search implementation (#9427) · ef7865b4
  Zhong Qishuai authored Oct 29, 2024
```
Signed-off-by: Qishuai Ferdinandzhong@gmail.com
```
  ef7865b4
28 Oct, 2024 3 commits
- [Model][VLM] Add multi-video support for LLaVA-Onevision (#8905) · 5f8d8075
  litianjian authored Oct 29, 2024
```
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f8d8075
- [torch.compile] support moe models (#9632) · 32176fee
  youkaichao authored Oct 27, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  32176fee
- [Hardware][ROCM] using current_platform.is_rocm (#9642) · 4e2d95e3
  wangshuai09 authored Oct 28, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  4e2d95e3
27 Oct, 2024 2 commits
- [Bugfix] Fix load config when using bools (#9533) · 34a99416
  madt2709 authored Oct 27, 2024
  
  34a99416
- [Misc] Upgrade to pytorch 2.5 (#9588) · 3cb07a36
  bnellnm authored Oct 27, 2024
```
Signed-off-by: Bill Nell <bill@neuralmagic.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  3cb07a36
26 Oct, 2024 3 commits
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
- [Frontend] Bad words sampling parameter (#9717) · 07e981fd
  Vasiliy Alekseev authored Oct 26, 2024
```
Signed-off-by: Vasily Alexeev <alvasian@yandex.ru>
```
  07e981fd
- [Hardware][openvino] is_openvino --> current_platform.is_openvino (#9716) · 5cbdccd1
  Mengqing Cao authored Oct 26, 2024
  
  5cbdccd1
25 Oct, 2024 1 commit
- [ci/Build] Skip Chameleon for transformers 4.46.0 on broadcast test #9675 (#9676) · 9f7b4ba8
  Kevin H. Luu authored Oct 24, 2024
  
  9f7b4ba8
24 Oct, 2024 9 commits
- [Performance][Kernel] Fused_moe Performance Improvement (#9384) · 59449095
  Charlie Fu authored Oct 24, 2024
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  59449095
- [Model] Compute Llava Next Max Tokens / Dummy Data From Gridpoints (#9650) · 722d46ed
  Alex Brooks authored Oct 24, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  722d46ed
- [CI/Build] Fix VLM test failures when using transformers v4.46 (#9666) · c866e007
  Cyrus Leung authored Oct 25, 2024
  
  c866e007
- [torch.compile] Adding torch compile annotations to some models (#9641) · d27cfbf7
  Yongzao authored Oct 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d27cfbf7
- [Kernel] add kernel for FATReLU (#9610) · 295a061f
  Jee Jee Li authored Oct 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  295a061f
- [torch.compile] Adding torch compile annotations to some models (#9639) · 8a02cd04
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8a02cd04
- [core] simplify seq group code (#9569) · 4fdc581f
  youkaichao authored Oct 24, 2024
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  4fdc581f
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
- [Bugfix]: Make chat content text allow type content (#9358) · 33bab410
  Vinay R Damodaran authored Oct 24, 2024
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
```
  33bab410
23 Oct, 2024 3 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [Frontend] Enable Online Multi-image Support for MLlama (#9393) · 150b7790
  Alex Brooks authored Oct 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  150b7790
- [Model] Add min_pixels / max_pixels to Qwen2VL as mm_processor_kwargs (#9612) · 31a08f5b
  Alex Brooks authored Oct 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  31a08f5b