Commits · 5952d811398d3a22f30d72d2d2943787a78f66ea · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "5d2a1a9cf0f47ac4f1676c17a835a05d4b4e4175"

04 Nov, 2024 2 commits
- [Doc] Update VLM doc about loading from local files (#9999) · 6e056bcf
  Roger Wang authored Nov 04, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  6e056bcf
- [Model] Add support for H2OVL-Mississippi models (#9747) · 54597724
  shanshan wang authored Nov 03, 2024
```
Signed-off-by: Shanshan Wang <shanshan.wang@h2o.ai>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  54597724
02 Nov, 2024 2 commits
- [Doc] Updated tpu-installation.rst with more details (#9926) · 1d4cfe2b
  Michael Green authored Nov 02, 2024
```
Signed-off-by: Michael Green <mikegre@google.com>
```
  1d4cfe2b
- [Docs] Update Granite 3.0 models in supported models table (#9930) · eed92f12
  Nick Hill authored Nov 02, 2024
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  eed92f12
01 Nov, 2024 5 commits
- [Frontend] Use a proper chat template for VLM2Vec (#9912) · ba0d8920
  Cyrus Leung authored Nov 01, 2024
  
  ba0d8920
- [Frontend] Chat-based Embeddings API (#9759) · 06386a64
  Cyrus Leung authored Nov 01, 2024
  
  06386a64
- [Doc] Update multi-input support (#9906) · d3aa2a8b
  Cyrus Leung authored Nov 01, 2024
  
  d3aa2a8b
- [torch.compile] Adding torch compile annotations to some models (#9876) · 2b5bf209
  Yongzao authored Nov 01, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  2b5bf209
- [Bugfix][Frontend] Reject guided decoding in multistep mode (#9892) · 031a7995
  Joe Runde authored Oct 31, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  031a7995
31 Oct, 2024 2 commits
- [Doc] Update Qwen documentation (#9869) · 5608e611
  Jee Jee Li authored Oct 31, 2024
  
  5608e611
- [Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens... · abbfb613
  Guillaume Calmettes authored Oct 31, 2024
```
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)
```
  abbfb613
30 Oct, 2024 4 commits
- [doc] update pp support (#9853) · c2cd1a21
  youkaichao authored Oct 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c2cd1a21
- [Doc] link bug for multistep guided decoding (#9843) · 33d25773
  Joe Runde authored Oct 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  33d25773
- [TPU] Correctly profile peak memory usage & Upgrade PyTorch XLA (#9438) · 211fe91a
  Woosuk Kwon authored Oct 30, 2024
  
  211fe91a
- [Bugfix] Fix multi nodes TP+PP for XPU (#8884) · 04a3ae0a
  Yan Ma authored Oct 30, 2024
```
Signed-off-by: YiSheng5 <syhm@mail.ustc.edu.cn>
Signed-off-by: yan ma <yan.ma@intel.com>
Co-authored-by: YiSheng5 <syhm@mail.ustc.edu.cn>
```
  04a3ae0a
29 Oct, 2024 2 commits

[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339) · 882a1ad0

Will Eaton authored Oct 29, 2024


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>

882a1ad0

[Doc] fix third-party model example (#9771) · c5d7fb9d
Russell Bryant authored Oct 28, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
c5d7fb9d

26 Oct, 2024 1 commit
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
25 Oct, 2024 1 commit
- [Doc] Improve quickstart documentation (#9256) · 228cfbd0
  Rafael Vasquez authored Oct 25, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  228cfbd0
24 Oct, 2024 4 commits
- [Doc] Move additional tips/notes to the top (#9647) · b979143d
  Cyrus Leung authored Oct 24, 2024
  
  b979143d
- [torch.compile] Adding torch compile annotations to some models (#9639) · 8a02cd04
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8a02cd04
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
- [Bugfix]: Make chat content text allow type content (#9358) · 33bab410
  Vinay R Damodaran authored Oct 24, 2024
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
```
  33bab410
23 Oct, 2024 2 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
22 Oct, 2024 4 commits
- [Doc]: Update tensorizer docs to include vllm[tensorizer] (#7889) · 208cb34c
  Seth Kimmel authored Oct 22, 2024
```
Co-authored-by: Kaunil Dhruv <dhruv.kaunil@gmail.com>
```
  208cb34c
- [Hardware][Intel CPU][DOC] Update docs for CPU backend (#6212) · 32a1ee74
  Yuan authored Oct 22, 2024
```
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Gubrud, Aaron D <aaron.d.gubrud@intel.com>
Co-authored-by: adgubrud <96072084+adgubrud@users.noreply.github.com>
```
  32a1ee74
- [Model][VLM] Initialize support for Mono-InternVL model (#9528) · bb392ea2
  Isotr0py authored Oct 23, 2024
  
  bb392ea2
- [Doc] Use shell code-blocks and fix section headers (#9508) · f7db5f0f
  Rafael Vasquez authored Oct 22, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  f7db5f0f
21 Oct, 2024 2 commits
- [doc] fix format (#9562) · d621c43d
  youkaichao authored Oct 21, 2024
  
  d621c43d
- [Model] FalconMamba Support (#9325) · f6b97293
  Dhia Eddine Rhaiem authored Oct 21, 2024
  
  f6b97293
18 Oct, 2024 3 commits
- [Model] Support Pixtral models in the HF Transformers format (#9036) · 3921a2f2
  Michael Goin authored Oct 18, 2024
  
  3921a2f2
- [Model] Add user-configurable task for models that support both generation and embedding (#9424) · 051eaf6d
  Cyrus Leung authored Oct 19, 2024
  
  051eaf6d
- [Frontend][Feature] Add jamba tool parser (#9154) · d2b1bf55
  tomeras91 authored Oct 18, 2024
  
  d2b1bf55
17 Oct, 2024 2 commits

[Core] Deprecating block manager v1 and make block manager v2 default (#8704) · 81ede99c

Kuntai Du authored Oct 17, 2024

Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching).

81ede99c

[Hardware][CPU] compressed-tensor INT8 W8A8 AZP support (#9344) · 5eda21e7
Li, Jiang authored Oct 18, 2024

5eda21e7

16 Oct, 2024 4 commits
- [Model][Bugfix] Add FATReLU activation and support for openbmb/MiniCPM-S-1B-sft (#9396) · 5b8a1fde
  Junhao Li authored Oct 16, 2024
  
  5b8a1fde
- [Misc] Consolidate example usage of OpenAI client for multimodal models (#9412) · 59230ef3
  Roger Wang authored Oct 16, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59230ef3
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
- [Model] VLM2Vec, the first multimodal embedding model in vLLM (#9303) · 7abba39e
  Cyrus Leung authored Oct 16, 2024
  
  7abba39e