Commits · 2b5bf20988edaab21621b78a9eb589edc93f2763 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "e78587a64ccf236c8506c8b536965ac74560ab48"

01 Nov, 2024 6 commits
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
- [Model] Support bitsandbytes for MiniCPMV (#9891) · 93a76dd2
  Michael Goin authored Nov 01, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  93a76dd2
- [torch.compile] rework test plans (#9866) · 566cd277
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  566cd277
- [Bugfix] Fix layer skip logic with bitsandbytes (#9887) · 37a4947d
  Michael Goin authored Nov 01, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  37a4947d
- [torch.compile] directly register custom op (#9896) · 96e0c9cb
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  96e0c9cb
- [Bugfix][Frontend] Reject guided decoding in multistep mode (#9892) · 031a7995
  Joe Runde authored Oct 31, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  031a7995
31 Oct, 2024 6 commits
- [Bugfix] Fix `illegal memory access` error with chunked prefill, prefix... · 55650c83
  sasha0552 authored Oct 31, 2024
```
[Bugfix] Fix `illegal memory access` error with chunked prefill, prefix caching, block manager v2 and xformers enabled together (#9532)
Signed-off-by: sasha0552 <admin@sasha0552.org>
```
  55650c83
- [Doc] Update Qwen documentation (#9869) · 5608e611
  Jee Jee Li authored Oct 31, 2024
  
  5608e611
- [Misc] Remove deprecated arg for cuda graph capture (#9864) · 3ea2dc2e
  Roger Wang authored Oct 31, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  3ea2dc2e
- [Model] Support quantization of Qwen2VisionTransformer (#9817) · d087bf86
  Michael Goin authored Oct 31, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  d087bf86
- Revert "[Bugfix] Use host argument to bind to interface (#9798)" (#9852) · 890ca360
  Kevin H. Luu authored Oct 30, 2024
  
  890ca360
- [Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens... · abbfb613
  Guillaume Calmettes authored Oct 31, 2024
```
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)
```
  abbfb613
30 Oct, 2024 9 commits
- [Bugfix][core] replace heartbeat with pid check (#9818) · 3b3f1e74
  Joe Runde authored Oct 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  3b3f1e74
- [Misc] Add chunked-prefill support on FlashInfer. (#9781) · 9ff4511e
  Elfie Guo authored Oct 30, 2024
  
  9ff4511e
- [Model] Support math-shepherd-mistral-7b-prm model (#9697) · 81f09cfd
  Went-Liang authored Oct 31, 2024
```
Signed-off-by: Went-Liang <wenteng_liang@163.com>
```
  81f09cfd
- [CI/Build] VLM Test Consolidation (#9372) · cc98f1e0
  Alex Brooks authored Oct 30, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  cc98f1e0
- [TPU] Correctly profile peak memory usage & Upgrade PyTorch XLA (#9438) · 211fe91a
  Woosuk Kwon authored Oct 30, 2024
  
  211fe91a
- [torch.compile] rework compile control with piecewise cudagraph (#9715) · ff5ed6e1
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ff5ed6e1
- [Bugfix] Fix multi nodes TP+PP for XPU (#8884) · 04a3ae0a
  Yan Ma authored Oct 30, 2024
```
Signed-off-by: YiSheng5 <syhm@mail.ustc.edu.cn>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: YiSheng5 <syhm@mail.ustc.edu.cn>
```
  04a3ae0a
- [Bugfix][VLM] Make apply_fp8_linear work with >2D input (#9812) · 226688bd
  Michael Goin authored Oct 29, 2024
  
  226688bd
- [core][distributed] fix custom allreduce in pytorch 2.5 (#9815) · 1ab6f6b4
  youkaichao authored Oct 29, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1ab6f6b4
29 Oct, 2024 15 commits
- [Bugfix] Fix prefix strings for quantized VLMs (#9772) · bc73e982
  Michael Goin authored Oct 29, 2024
  
  bc73e982
- [Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339) · 882a1ad0
  Will Eaton authored Oct 29, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
```
  882a1ad0
- [Bugfix][Frontend] Guard against bad token ids (#9634) · 67bdf8e5
  Joe Runde authored Oct 29, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  67bdf8e5
- [MISC] Set label value to timestamp over 0, to keep track of recent history (#9777) · 0ad216f5
  Kunjan authored Oct 29, 2024
```
Signed-off-by: Kunjan Patel <kunjanp@google.com>
```
  0ad216f5
- [Model] Add LlamaEmbeddingModel as an embedding Implementation of LlamaModel (#9806) · ac3d748d
  Junichi Sato authored Oct 30, 2024
  
  ac3d748d
- [Misc]: Typo fix: Renaming classes (casualLM -> causalLM) (#9801) · 0ce7798f
  yannicks1 authored Oct 29, 2024
```
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
```
  0ce7798f
- [Bugfix] Use host argument to bind to interface (#9798) · 0f433871
  Sven Seeberg authored Oct 29, 2024
  
  0f433871
- Fix the log to correct guide user to install modelscope (#9793) · 08600ddc
  tastelikefeet authored Oct 30, 2024
```
Signed-off-by: yuze.zyz <yuze.zyz@alibaba-inc.com>
```
  08600ddc
- [Misc] Add metrics for request queue time, forward time, and execute time (#9659) · 74fc2d77
  科英 authored Oct 30, 2024
  
  74fc2d77
- [Hardware] using current_platform.seed_everything (#9785) · 622b7ab9
  wangshuai09 authored Oct 29, 2024
```
Signed-off-by: wangshuai09 <391746016@qq.com>
```
  622b7ab9
- [Model] Add BNB quantization support for Mllama (#9720) · 09500f7d
  Isotr0py authored Oct 29, 2024
  
  09500f7d
- [Frontend] re-enable multi-modality input in the new beam search implementation (#9427) · ef7865b4
  Zhong Qishuai authored Oct 29, 2024
```
Signed-off-by: Qishuai Ferdinandzhong@gmail.com
```
  ef7865b4
- [Bugfix] Use temporary directory in registry (#9721) · eae3d481
  Cyrus Leung authored Oct 29, 2024
  
  eae3d481
- [Doc] Specify async engine args in docs (#9726) · e74f2d44
  Cyrus Leung authored Oct 29, 2024
  
  e74f2d44
- [Model][LoRA]LoRA support added for Qwen (#9622) · 7a4df5f2
  Jee Jee Li authored Oct 29, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7a4df5f2
28 Oct, 2024 4 commits
- [torch.compile] add deepseek v2 compile (#9775) · 76ed5340
  youkaichao authored Oct 28, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  76ed5340
- [misc] avoid circular import (#9765) · 97b61bfa
  youkaichao authored Oct 28, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  97b61bfa
- Adding "torch compile" annotations to moe models (#9758) · aa0addb3
  Yongzao authored Oct 29, 2024
  
  aa0addb3
- [Model][VLM] Add multi-video support for LLaVA-Onevision (#8905) · 5f8d8075
  litianjian authored Oct 29, 2024
```
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f8d8075