Commits · b4be5a8adba95020187ae3cb43a7db7eef20c0ff · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "19d289943978d72fa6b96eeaae154a418e82097c"

20 Nov, 2024 1 commit
- [Bugfix] Enforce no chunked prefill for embedding models (#10470) · b4be5a8a
  Cyrus Leung authored Nov 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b4be5a8a
19 Nov, 2024 2 commits
- [Doc] Add the start of an arch overview page (#10368) · 5390d666
  Russell Bryant authored Nov 19, 2024
  
  5390d666
- Add openai.beta.chat.completions.parse example to structured_outputs.rst (#10433) · 74f8c2cf
  Michael Goin authored Nov 18, 2024
  
  74f8c2cf
18 Nov, 2024 3 commits
- [Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107) · 6b2d25ef
  Yan Ma authored Nov 19, 2024
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  6b2d25ef
- [Doc] Add documentation for Structured Outputs (#9943) · 31894a21
  ismael-dm authored Nov 18, 2024
```
Signed-off-by: ismael-dm <ismaeldm99@gmail.com>
```
  31894a21
- [Doc] Update doc for LoRA support in GLM-4V (#10425) · 4186be81
  B-201 authored Nov 18, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  4186be81
16 Nov, 2024 2 commits
- [doc] add doc for the plugin system (#10372) · 755b8535
  youkaichao authored Nov 15, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  755b8535
- [Frontend] Automatic detection of chat content format from AST (#9919) · 32e46e00
  Cyrus Leung authored Nov 16, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32e46e00
15 Nov, 2024 5 commits
- [Docs] Misc updates to TPU installation instructions (#10165) · 4f168f69
  Michael Green authored Nov 15, 2024
  
  4f168f69
- [Doc] Move PR template content to docs (#10159) · 3e8d14d8
  Russell Bryant authored Nov 15, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3e8d14d8
- [Docs] Add Nebius as sponsors (#10371) · c76ac49d
  Simon Mo authored Nov 15, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  c76ac49d
- [Misc] Consolidate pooler config overrides (#10351) · 2ac6d0e7
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ac6d0e7
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
14 Nov, 2024 3 commits
- [Docs] Publish meetup slides (#10331) · 1dbae032
  Woosuk Kwon authored Nov 14, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1dbae032
- [Frontend] Pythonic tool parser (#9859) · f67ce05d
  Mike Depinet authored Nov 13, 2024
```
Signed-off-by: Mike Depinet <mike@fixie.ai>
```
  f67ce05d
- [misc] error early for old-style class (#10304) · 504ac53d
  youkaichao authored Nov 13, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  504ac53d
13 Nov, 2024 4 commits
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [Model][LoRA]LoRA support added for idefics3 (#10281) · d909acf9
  B-201 authored Nov 13, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  d909acf9
- [Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944) · 1b886aa1
  Austin Veselka authored Nov 13, 2024
```
Signed-off-by: FurtherAI <austin.veselka@lighton.ai>
Co-authored-by: FurtherAI <austin.veselka@lighton.ai>
```
  1b886aa1
- [Model] Add support for Qwen2-VL video embeddings input & multiple image... · 3945c823
  电脑星人 authored Nov 13, 2024
```
[Model] Add support for Qwen2-VL video embeddings input & multiple image embeddings input with varied resolutions (#10221)
Signed-off-by: imkero <kerorek@outlook.com>
```
  3945c823
12 Nov, 2024 5 commits
- Revert "[ci][build] limit cmake version" (#10271) · 377b74fe
  youkaichao authored Nov 12, 2024
  
  377b74fe
- [doc] improve debugging doc (#10270) · 18081451
  youkaichao authored Nov 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  18081451
- [doc] fix location of runllm widget (#10266) · 96ae0eae
  youkaichao authored Nov 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  96ae0eae
- [BugFix] Do not raise a `ValueError` when `tool_choice` is set to the... · 36c513a0
  Guillaume Calmettes authored Nov 12, 2024
```
[BugFix] Do not raise a `ValueError` when `tool_choice` is set to the supported `none` option and `tools` are not defined. (#10000)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  36c513a0
- [doc] explain the class hierarchy in vLLM (#10240) · 3a28f18b
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3a28f18b
11 Nov, 2024 3 commits
- [doc] update debugging guide (#10236) · d1c6799b
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d1c6799b
- Add docs on serving with Llama Stack (#10183) · 4800339c
  Yuan Tang authored Nov 11, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  4800339c
- [doc] improve debugging code (#10206) · f0f2e563
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f0f2e563
10 Nov, 2024 3 commits

[Misc] small fixes to function tracing file path (#9543) · 20cf2f55

Shawn Du authored Nov 11, 2024


Signed-off-by: Shawn Du <shawnd200@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

20cf2f55

[doc] Polish the integration with huggingface doc (#10195) · bfb7d61a

Yongzao authored Nov 11, 2024


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

bfb7d61a

[ci][build] limit cmake version (#10188) · 9fa4bdde
youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
9fa4bdde

09 Nov, 2024 4 commits
- [Frontend] add `add_request_id` middleware (#9594) · d88bff1b
  cjackal authored Nov 09, 2024
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  d88bff1b
- [doc] explaining the integration with huggingface (#10173) · 8a4358ec
  youkaichao authored Nov 09, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  8a4358ec
- [Doc] Adjust RunLLM location (#10176) · 49d2a41a
  Cyrus Leung authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  49d2a41a
- [0/N] Rename `MultiModalInputs` to `MultiModalKwargs` (#10040) · e0191a95
  Cyrus Leung authored Nov 09, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e0191a95
08 Nov, 2024 3 commits
- [Misc] Improve Web UI (#10090) · 6b304715
  Rafael Vasquez authored Nov 08, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  6b304715
- [Doc] Move CONTRIBUTING to docs site (#9924) · 3a7f15a3
  Russell Bryant authored Nov 08, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3a7f15a3
- [Doc] Update FAQ links in spec_decode.rst (#9662) · 40d0e741
  whyiug authored Nov 08, 2024
```
Signed-off-by: whyiug <whyiug@hotmail.com>
```
  40d0e741
07 Nov, 2024 2 commits

Online video support for VLMs (#10020) · 28b2877d

litianjian authored Nov 08, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

28b2877d

[Frontend] Tool calling parser for Granite 3.0 models (#9027) · ae62fd17
Maximilien de Bayser authored Nov 07, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
ae62fd17