Commits · a6760f6456b714409685e23301c820a85da856ca · OpenDAS / vllm_cscc

26 Nov, 2024 1 commit

[Feature] vLLM ARM Enablement for AARCH64 CPUs (#9228) · a6760f64

Sanket Kale authored Nov 26, 2024


Signed-off-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

a6760f64

25 Nov, 2024 7 commits
- [Model] Add OLMo November 2024 model (#10503) · 9db713a1
  Shane A authored Nov 25, 2024
  
  9db713a1
- [Doc] Fix typos in docs (#10636) · 1b583cfe
  Cyrus Leung authored Nov 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1b583cfe
- [Model]: Add support for Aria model (#10514) · b1d92053
  zhou fan authored Nov 26, 2024
```
Signed-off-by: xffxff <1247714429@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  b1d92053
- Super tiny little typo fix (#10633) · 2b0879bf
  fzyzcjy authored Nov 25, 2024
  
  2b0879bf
- [Model] Support `is_causal` HF config field for Qwen2 model (#10621) · ed46f143
  Cyrus Leung authored Nov 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ed46f143
- [Doc] Add encoder-based models to Supported Models page (#10616) · a30a605d
  Cyrus Leung authored Nov 25, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a30a605d
- Support Cross encoder models (#10400) · 214efc2c
  Maximilien de Bayser authored Nov 24, 2024
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>
```
  214efc2c
24 Nov, 2024 1 commit

[doc] update the code to add models (#10603) · e4fbb144

youkaichao authored Nov 24, 2024


Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

e4fbb144

21 Nov, 2024 1 commit
- Add small example to metrics.rst (#10550) · 9afa0145
  Michael Goin authored Nov 21, 2024
  
  9afa0145
20 Nov, 2024 3 commits
- [Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355) · 63f1fde2
  Li, Jiang authored Nov 20, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  63f1fde2
- [CI/Build] Support compilation with local cutlass path (#10423) (#10424) · 7629a9c6
  wchen61 authored Nov 20, 2024
  
  7629a9c6
- [Bugfix] Enforce no chunked prefill for embedding models (#10470) · b4be5a8a
  Cyrus Leung authored Nov 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b4be5a8a
19 Nov, 2024 2 commits
- [Doc] Add the start of an arch overview page (#10368) · 5390d666
  Russell Bryant authored Nov 19, 2024
  
  5390d666
- Add openai.beta.chat.completions.parse example to structured_outputs.rst (#10433) · 74f8c2cf
  Michael Goin authored Nov 18, 2024
  
  74f8c2cf
18 Nov, 2024 3 commits
- [Hardware][XPU] AWQ/GPTQ support for xpu backend (#10107) · 6b2d25ef
  Yan Ma authored Nov 19, 2024
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  6b2d25ef
- [Doc] Add documentation for Structured Outputs (#9943) · 31894a21
  ismael-dm authored Nov 18, 2024
```
Signed-off-by: ismael-dm <ismaeldm99@gmail.com>
```
  31894a21
- [Doc] Update doc for LoRA support in GLM-4V (#10425) · 4186be81
  B-201 authored Nov 18, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  4186be81
16 Nov, 2024 2 commits
- [doc] add doc for the plugin system (#10372) · 755b8535
  youkaichao authored Nov 15, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  755b8535
- [Frontend] Automatic detection of chat content format from AST (#9919) · 32e46e00
  Cyrus Leung authored Nov 16, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32e46e00
15 Nov, 2024 5 commits
- [Docs] Misc updates to TPU installation instructions (#10165) · 4f168f69
  Michael Green authored Nov 15, 2024
  
  4f168f69
- [Doc] Move PR template content to docs (#10159) · 3e8d14d8
  Russell Bryant authored Nov 15, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3e8d14d8
- [Docs] Add Nebius as sponsors (#10371) · c76ac49d
  Simon Mo authored Nov 15, 2024
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  c76ac49d
- [Misc] Consolidate pooler config overrides (#10351) · 2ac6d0e7
  Cyrus Leung authored Nov 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ac6d0e7
- [Model] Support Qwen2 embeddings and use tags to select model tests (#10184) · b40cf640
  Cyrus Leung authored Nov 15, 2024
  
  b40cf640
14 Nov, 2024 3 commits
- [Docs] Publish meetup slides (#10331) · 1dbae032
  Woosuk Kwon authored Nov 14, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1dbae032
- [Frontend] Pythonic tool parser (#9859) · f67ce05d
  Mike Depinet authored Nov 13, 2024
```
Signed-off-by: Mike Depinet <mike@fixie.ai>
```
  f67ce05d
- [misc] error early for old-style class (#10304) · 504ac53d
  youkaichao authored Nov 13, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  504ac53d
13 Nov, 2024 4 commits
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [Model][LoRA]LoRA support added for idefics3 (#10281) · d909acf9
  B-201 authored Nov 13, 2024
```
Signed-off-by: B-201 <Joy25810@foxmail.com>
```
  d909acf9
- [Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944) · 1b886aa1
  Austin Veselka authored Nov 13, 2024
```
Signed-off-by: FurtherAI <austin.veselka@lighton.ai>
Co-authored-by: FurtherAI <austin.veselka@lighton.ai>
```
  1b886aa1
- [Model] Add support for Qwen2-VL video embeddings input & multiple image... · 3945c823
  电脑星人 authored Nov 13, 2024
```
[Model] Add support for Qwen2-VL video embeddings input & multiple image embeddings input with varied resolutions (#10221)
Signed-off-by: imkero <kerorek@outlook.com>
```
  3945c823
12 Nov, 2024 5 commits
- Revert "[ci][build] limit cmake version" (#10271) · 377b74fe
  youkaichao authored Nov 12, 2024
  
  377b74fe
- [doc] improve debugging doc (#10270) · 18081451
  youkaichao authored Nov 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  18081451
- [doc] fix location of runllm widget (#10266) · 96ae0eae
  youkaichao authored Nov 12, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  96ae0eae
- [BugFix] Do not raise a `ValueError` when `tool_choice` is set to the... · 36c513a0
  Guillaume Calmettes authored Nov 12, 2024
```
[BugFix] Do not raise a `ValueError` when `tool_choice` is set to the supported `none` option and `tools` are not defined. (#10000)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  36c513a0
- [doc] explain the class hierarchy in vLLM (#10240) · 3a28f18b
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3a28f18b
11 Nov, 2024 3 commits
- [doc] update debugging guide (#10236) · d1c6799b
  youkaichao authored Nov 11, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d1c6799b
- Add docs on serving with Llama Stack (#10183) · 4800339c
  Yuan Tang authored Nov 11, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  4800339c
- [doc] improve debugging code (#10206) · f0f2e563
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f0f2e563