Commits · 4581d2cc02f655e76233f9cb129f07c6b65d39f4 · OpenDAS / vllm_cscc · GitLab

01 Nov, 2024 12 commits
- [Core] Refactor: Clean up unused argument in Scheduler._preempt (#9696) · 4581d2cc
  André Jonasson authored Nov 01, 2024
```
Signed-off-by: André Jonasson <andre.jonasson@gmail.com>
```
  4581d2cc
- [Bugfix] Fix edge cases for MistralTokenizer (#9625) · 1dd4cb29
  Travis Johnson authored Nov 01, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  1dd4cb29
- [Frontend] Use a proper chat template for VLM2Vec (#9912) · ba0d8920
  Cyrus Leung authored Nov 01, 2024
  
  ba0d8920
- [CI/Build] Add Model Tests for PixtralHF (#9813) · 30a2e807
  Michael Goin authored Nov 01, 2024
  
  30a2e807
- [Frontend] Chat-based Embeddings API (#9759) · 06386a64
  Cyrus Leung authored Nov 01, 2024
  
  06386a64
- [Doc] Update multi-input support (#9906) · d3aa2a8b
  Cyrus Leung authored Nov 01, 2024
  
  d3aa2a8b
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
- [Model] Support bitsandbytes for MiniCPMV (#9891) · 93a76dd2
  Michael Goin authored Nov 01, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  93a76dd2
- [torch.compile] rework test plans (#9866) · 566cd277
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  566cd277
- [Bugfix] Fix layer skip logic with bitsandbytes (#9887) · 37a4947d
  Michael Goin authored Nov 01, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  37a4947d
- [torch.compile] directly register custom op (#9896) · 96e0c9cb
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  96e0c9cb
- [Bugfix][Frontend] Reject guided decoding in multistep mode (#9892) · 031a7995
  Joe Runde authored Oct 31, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  031a7995
31 Oct, 2024 10 commits
- [ci/build] Configure dependabot to update pip dependencies (#9811) · b63c64d9
  Kevin H. Luu authored Oct 31, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  b63c64d9
- [BugFix][Kernel] Fix Illegal memory access in causal_conv1d in H100 (#9838) · 9fb12f78
  Mor Zusman authored Oct 31, 2024
```
Signed-off-by: mzusman <mor.zusmann@gmail.com>
```
  9fb12f78
- [Bugfix] Fix `illegal memory access` error with chunked prefill, prefix... · 55650c83
  sasha0552 authored Oct 31, 2024
```
[Bugfix] Fix `illegal memory access` error with chunked prefill, prefix caching, block manager v2 and xformers enabled together (#9532)
Signed-off-by: sasha0552 <admin@sasha0552.org>
```
  55650c83
- [CI/Build] Adding a forced docker system prune to clean up space (#9849) · 77f7ef29
  Alexei-V-Ivanov-AMD authored Oct 31, 2024
  
  77f7ef29
- [CI/Build] Add Model Tests for Qwen2-VL (#9846) · 16b8f7a8
  Alex Brooks authored Oct 31, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  16b8f7a8
- [Doc] Update Qwen documentation (#9869) · 5608e611
  Jee Jee Li authored Oct 31, 2024
  
  5608e611
- [Misc] Remove deprecated arg for cuda graph capture (#9864) · 3ea2dc2e
  Roger Wang authored Oct 31, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  3ea2dc2e
- [Model] Support quantization of Qwen2VisionTransformer (#9817) · d087bf86
  Michael Goin authored Oct 31, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  d087bf86
- Revert "[Bugfix] Use host argument to bind to interface (#9798)" (#9852) · 890ca360
  Kevin H. Luu authored Oct 30, 2024
  
  890ca360
- [Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens... · abbfb613
  Guillaume Calmettes authored Oct 31, 2024
```
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)
```
  abbfb613
30 Oct, 2024 18 commits
- [torch.compile] upgrade tests (#9858) · 64384bbc
  youkaichao authored Oct 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  64384bbc
- [CI/Build] Simplify exception trace in api server tests (#9787) · 00d91c8a
  Yongzao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  00d91c8a
- [doc] update pp support (#9853) · c2cd1a21
  youkaichao authored Oct 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c2cd1a21
- [Neuron] Update Dockerfile.neuron to fix build failure (#9822) · c787f2d8
  Harsha vardhan manoj Bikki authored Oct 30, 2024
  
  c787f2d8
- [Doc] link bug for multistep guided decoding (#9843) · 33d25773
  Joe Runde authored Oct 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  33d25773
- [Bugfix][core] replace heartbeat with pid check (#9818) · 3b3f1e74
  Joe Runde authored Oct 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  3b3f1e74
- [Misc] Add chunked-prefill support on FlashInfer. (#9781) · 9ff4511e
  Elfie Guo authored Oct 30, 2024
  
  9ff4511e
- [Model] Support math-shepherd-mistral-7b-prm model (#9697) · 81f09cfd
  Went-Liang authored Oct 31, 2024
```
Signed-off-by: Went-Liang <wenteng_liang@163.com>
```
  81f09cfd
- [CI/Build] VLM Test Consolidation (#9372) · cc98f1e0
  Alex Brooks authored Oct 30, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  cc98f1e0
- [TPU] Correctly profile peak memory usage & Upgrade PyTorch XLA (#9438) · 211fe91a
  Woosuk Kwon authored Oct 30, 2024
  
  211fe91a
- [Misc] Specify minimum pynvml version (#9827) · 6aa6020f
  Jee Jee Li authored Oct 30, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6aa6020f
- [torch.compile] rework compile control with piecewise cudagraph (#9715) · ff5ed6e1
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ff5ed6e1
- [Doc] Add the DCO to CONTRIBUTING.md (#9803) · 7b0365ef
  Russell Bryant authored Oct 30, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  7b0365ef
- [Bugfix] Fix multi nodes TP+PP for XPU (#8884) · 04a3ae0a
  Yan Ma authored Oct 30, 2024
```
Signed-off-by: YiSheng5 <syhm@mail.ustc.edu.cn>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: YiSheng5 <syhm@mail.ustc.edu.cn>
```
  04a3ae0a
- [ci/build] Pin CI dependencies version with pip-compile (#9810) · 62fac4b9
  Kevin H. Luu authored Oct 29, 2024
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  62fac4b9
- [Bugfix][VLM] Make apply_fp8_linear work with >2D input (#9812) · 226688bd
  Michael Goin authored Oct 29, 2024
  
  226688bd
- Update README.md (#9819) · 64cb1cdc
  Lily Liu authored Oct 29, 2024
  
  64cb1cdc
- [core][distributed] fix custom allreduce in pytorch 2.5 (#9815) · 1ab6f6b4
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1ab6f6b4