Commits · 8c38ee7007c50ac5aef9ed43ae91c6f031799c40 · OpenDAS / vllm_cscc

29 Dec, 2024 1 commit
- [Doc] Convert list tables to MyST (#11594) · 32b4c63f
  Cyrus Leung authored Dec 29, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32b4c63f
28 Dec, 2024 1 commit
- [Doc] Minor documentation fixes (#11580) · d427e5cf
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d427e5cf
27 Dec, 2024 2 commits
- Update deploying_with_k8s.md with AMD ROCm GPU example (#11465) · d003f3ea
  AlexHe99 authored Dec 27, 2024
```
Signed-off-by: Alex He <alehe@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d003f3ea
- Update openai_compatible_server.md (#11536) · 0c0c2015
  Robert Shaw authored Dec 26, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0c0c2015
25 Dec, 2024 1 commit
- [Doc] Improve GitHub links (#11491) · 6ad909fd
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ad909fd
24 Dec, 2024 1 commit
- [Frontend] Online Pooling API (#11457) · 9edca6bf
  Cyrus Leung authored Dec 24, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9edca6bf
23 Dec, 2024 1 commit
- [Docs] Convert rST to MyST (Markdown) (#11145) · 32aa2059
  Rafael Vasquez authored Dec 23, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  32aa2059
20 Dec, 2024 2 commits

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) · 995f5623
omer-dayan authored Dec 20, 2024
```
Signed-off-by: OmerD <omer@run.ai>
```
995f5623

[ci][gh200] dockerfile clean up (#11351) · 7801f56e

youkaichao authored Dec 19, 2024


Signed-off-by: drikster80 <ed.sealing@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: cenzhiyao <2523403608@qq.com>

7801f56e

17 Dec, 2024 2 commits
- [Frontend] Add OpenAI API support for input_audio (#11027) · 66d4b167
  kYLe authored Dec 17, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  66d4b167
- fix gh200 tests on main (#11246) · 35bae114
  youkaichao authored Dec 16, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  35bae114
16 Dec, 2024 3 commits
- [Docs] hint to enable use of GPU performance counters in profiling tools for... · 35ffa682
  bk-TurbaAI authored Dec 16, 2024
```
[Docs] hint to enable use of GPU performance counters in profiling tools for multi-node distributed serving (#11235)
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  35ffa682
- WIP: [CI/Build] simplify Dockerfile build for ARM64 / GH200 (#11212) · b3b1526f
  cennn authored Dec 16, 2024
```
Signed-off-by: drikster80 <ed.sealing@gmail.com>
Co-authored-by: drikster80 <ed.sealing@gmail.com>
```
  b3b1526f
- Update deploying_with_k8s.rst (#10922) · da6f4092
  AlexHe99 authored Dec 16, 2024
  
  da6f4092
13 Dec, 2024 1 commit
- [Doc] Reorganize online pooling APIs (#11172) · 0920ab91
  Cyrus Leung authored Dec 14, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0920ab91
12 Dec, 2024 2 commits
- fix(docs): typo in helm install instructions (#11141) · d4d5291c
  Ramon Ziai authored Dec 12, 2024
```
Signed-off-by: Ramon Ziai <ramon.ziai@bettermarks.com>
```
  d4d5291c
- Update link to LlamaStack remote vLLM guide in serving_with_llamastack.rst (#11112) · 24a36d6d
  Yuan Tang authored Dec 11, 2024
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  24a36d6d
10 Dec, 2024 2 commits
- Add example of helm chart for vllm deployment on k8s (#9199) · fe2e10c7
  Maxime Fournioux authored Dec 10, 2024
```
Signed-off-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>
```
  fe2e10c7
- [Docs] Add dedicated tool calling page to docs (#10554) · 6d525288
  Michael Goin authored Dec 09, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  6d525288
06 Dec, 2024 1 commit
- [Doc] add KubeAI to serving integrations (#10837) · 74062740
  Sam Stoelinga authored Dec 06, 2024
```
Signed-off-by: Sam Stoelinga <sammiestoel@gmail.com>
```
  74062740
05 Dec, 2024 1 commit
- [Doc] Create a new "Usage" section (#10827) · aa39a8e1
  Cyrus Leung authored Dec 05, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa39a8e1
26 Nov, 2024 1 commit

[Bugfix] Fix for Spec model TP + Chunked Prefill (#10232) · db66e018

Murali Andoorveedu authored Nov 26, 2024


Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
Signed-off-by: Sourashis Roy <sroy@roblox.com>
Co-authored-by: Sourashis Roy <sroy@roblox.com>

db66e018

25 Nov, 2024 2 commits

[Doc] Fix typos in docs (#10636) · 1b583cfe
Cyrus Leung authored Nov 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
1b583cfe

Support Cross encoder models (#10400) · 214efc2c

Maximilien de Bayser authored Nov 24, 2024


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Flavia Beo <flavia.beo@ibm.com>
Co-authored-by: Flavia Beo <flavia.beo@ibm.com>

214efc2c

21 Nov, 2024 1 commit
- Add small example to metrics.rst (#10550) · 9afa0145
  Michael Goin authored Nov 21, 2024
  
  9afa0145
20 Nov, 2024 2 commits
- [Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355) · 63f1fde2
  Li, Jiang authored Nov 20, 2024
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  63f1fde2
- [Bugfix] Enforce no chunked prefill for embedding models (#10470) · b4be5a8a
  Cyrus Leung authored Nov 20, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b4be5a8a
16 Nov, 2024 1 commit
- [Frontend] Automatic detection of chat content format from AST (#9919) · 32e46e00
  Cyrus Leung authored Nov 16, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32e46e00
14 Nov, 2024 1 commit
- [Frontend] Pythonic tool parser (#9859) · f67ce05d
  Mike Depinet authored Nov 13, 2024
```
Signed-off-by: Mike Depinet <mike@fixie.ai>
```
  f67ce05d
12 Nov, 2024 1 commit

[BugFix] Do not raise a `ValueError` when `tool_choice` is set to the... · 36c513a0

Guillaume Calmettes authored Nov 12, 2024


[BugFix] Do not raise a `ValueError` when `tool_choice` is set to the supported `none` option and `tools` are not defined. (#10000)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>

36c513a0

11 Nov, 2024 1 commit

Add docs on serving with Llama Stack (#10183) · 4800339c

Yuan Tang authored Nov 11, 2024


Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

4800339c

09 Nov, 2024 1 commit
- [Frontend] add `add_request_id` middleware (#9594) · d88bff1b
  cjackal authored Nov 09, 2024
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  d88bff1b
07 Nov, 2024 2 commits
- [Frontend] Tool calling parser for Granite 3.0 models (#9027) · ae62fd17
  Maximilien de Bayser authored Nov 07, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  ae62fd17
- [Misc] Consolidate ModelConfig code related to HF config (#10104) · db7db4aa
  Cyrus Leung authored Nov 07, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db7db4aa
01 Nov, 2024 2 commits
- [Frontend] Chat-based Embeddings API (#9759) · 06386a64
  Cyrus Leung authored Nov 01, 2024
  
  06386a64
- [Bugfix][Frontend] Reject guided decoding in multistep mode (#9892) · 031a7995
  Joe Runde authored Oct 31, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  031a7995
31 Oct, 2024 1 commit
- [Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens... · abbfb613
  Guillaume Calmettes authored Oct 31, 2024
```
[Misc][OpenAI] deprecate max_tokens in favor of new max_completion_tokens field for chat completion endpoint (#9837)
```
  abbfb613
30 Oct, 2024 2 commits
- [doc] update pp support (#9853) · c2cd1a21
  youkaichao authored Oct 30, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c2cd1a21
- [Doc] link bug for multistep guided decoding (#9843) · 33d25773
  Joe Runde authored Oct 30, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  33d25773
29 Oct, 2024 1 commit

[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339) · 882a1ad0

Will Eaton authored Oct 29, 2024


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>

882a1ad0