Commits · cb506ecb5afa58670c6105b589696e6e176f60aa · OpenDAS / vllm_cscc

22 May, 2025 1 commit

[Misc] improve Automatic Prefix Caching example (#18554) · cb506ecb

Reid authored May 22, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

cb506ecb

20 May, 2025 1 commit

[Misc] refactor prompt embedding examples (#18405) · 8f55962a

Reid authored May 20, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

8f55962a

19 May, 2025 1 commit
- [Doc] Move input-related docs to Features (#18353) · 43b5f61d
  Cyrus Leung authored May 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43b5f61d
18 May, 2025 2 commits
- [Doc] Add doc to explain the usage of Qwen3 thinking (#18291) · d1211f87
  Robin authored May 19, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d1211f87
- [doc] update reasoning doc (#18306) · 1a8f68bb
  Reid authored May 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  1a8f68bb
14 May, 2025 1 commit

[V1] Structured Outputs + Thinking compatibility (#16577) · 2fc9075b

Aaron Pham authored May 14, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2fc9075b

12 May, 2025 2 commits
- [Lora][Frontend]Add default local directory LoRA resolver plugin. (#16855) · 98ea3560
  Jonathan Berkhahn authored May 12, 2025
```
Signed-off-by: jberkhahn <jaberkha@us.ibm.com>
```
  98ea3560
- [Feature] Support DeepSeekV3 Function Call (#17784) · 3a5ea751
  Xu Wenqing authored May 12, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  3a5ea751
11 May, 2025 1 commit

[doc] update lora doc (#17936) · d1110f5b

Reid authored May 11, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

d1110f5b

09 May, 2025 1 commit
- [Doc] Update several links in reasoning_outputs.md (#17846) · 89a0315f
  Michael Yao authored May 09, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  89a0315f
07 May, 2025 1 commit

[doc] update the issue link (#17782) · 7377dd03

Reid authored May 07, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

7377dd03

06 May, 2025 2 commits
- [Docs] Use gh-file to add links to tool_calling.md (#17709) · 0d115460
  Michael Yao authored May 06, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  0d115460
- Update nm to rht in doc links + refine fp8 doc (#17678) · 98834fef
  Michael Goin authored May 05, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  98834fef
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
02 May, 2025 3 commits
- Add NVIDIA TensorRT Model Optimizer in vLLM documentation (#17561) · 182f40ea
  Zhiyu authored May 02, 2025
  
  182f40ea
- [doc] miss result (#17589) · 3a500cd0
  Reid authored May 02, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  3a500cd0
- [doc] add the print result (#17584) · 6d1479ca
  Reid authored May 02, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6d1479ca
01 May, 2025 2 commits
- [Feature][Frontend]: Deprecate --enable-reasoning (#17452) · 98060b00
  Chauncey authored May 01, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  98060b00
- [Bugfix] Temporarily disable gptq_bitblas on ROCm (#17411) · 1144a8ef
  NaLan ZeYu authored May 01, 2025
```
Signed-off-by: Yan Cangang <nalanzeyu@gmail.com>
```
  1144a8ef
30 Apr, 2025 1 commit

[doc] add install tips (#17373) · 2ac74d09

Reid authored May 01, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

2ac74d09

29 Apr, 2025 1 commit
- [Bugfix] add qwen3 reasoning-parser fix content is None when disable … (#17369) · a39203f9
  mofanke authored Apr 30, 2025
```
Signed-off-by: mofanke <mofanke@gmail.com>
```
  a39203f9
28 Apr, 2025 1 commit

[doc] update wrong model id (#17287) · 3ad986c2

Reid authored Apr 28, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

3ad986c2

26 Apr, 2025 1 commit
- [Docs] Update structured output doc for V1 (#17135) · 52b4f4a8
  Russell Bryant authored Apr 26, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  52b4f4a8
25 Apr, 2025 3 commits
- [doc] update wrong hf model links (#17184) · df5c8795
  Reid authored Apr 26, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  df5c8795
- [Doc] Add two links to disagg_prefill.md (#17168) · f851b842
  Michael Yao authored Apr 25, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  f851b842
- [Doc] Add headings to improve gptqmodel.md (#17164) · ef19e67d
  Michael Yao authored Apr 25, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  ef19e67d
24 Apr, 2025 3 commits
- Add chat template for Llama 4 models (#16428) · 05e1fbfc
  Maximilien de Bayser authored Apr 24, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  05e1fbfc
- [doc] update to hyperlink (#17096) · 9c1244de
  Reid authored Apr 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  9c1244de
- [V1] Update structured output (#16812) · db2f8d91
  Reid authored Apr 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  db2f8d91
23 Apr, 2025 1 commit
- [Doc] Add top anchor and a note to quantization/bitblas.md (#17042) · f7912cba
  Michael Yao authored Apr 23, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  f7912cba
22 Apr, 2025 1 commit
- [Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036) · 8d32dc60
  Lei Wang authored Apr 22, 2025
```
Signed-off-by: xinyuxiao <xinyuxiao2024@gmail.com>
Co-authored-by: xinyuxiao <xinyuxiao2024@gmail.com>
```
  8d32dc60
18 Apr, 2025 1 commit
- [Doc] Updated Llama section in tool calling docs to have llama 3.2 config info (#16857) · 490b1698
  Justin Ho authored Apr 18, 2025
```
Signed-off-by: jmho <jaylenho734@gmail.com>
```
  490b1698
15 Apr, 2025 1 commit

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546) · fdcb850f

Angky William authored Apr 15, 2025


Signed-off-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>
Co-authored-by: Angky William <angkywilliam@Angkys-MacBook-Pro.local>

fdcb850f

11 Apr, 2025 2 commits
- [Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463) · 16eda8c4
  Ye (Charlotte) Qi authored Apr 11, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Kai Wu <kaiwu@meta.com>
```
  16eda8c4
- Update supported_hardware.md for TPU INT8 (#16437) · ed375995
  Michael Goin authored Apr 10, 2025
  
  ed375995
07 Apr, 2025 2 commits
- Torchao (#14231) · 652907b3
  Driss Guessous authored Apr 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  652907b3
- doc: fix some typos in doc (#16154) · 95d63f38
  yihong authored Apr 07, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  95d63f38
05 Apr, 2025 1 commit
- [Misc] Auto detect bitsandbytes pre-quantized models (#16027) · 4285e423
  Tristan Leclercq authored Apr 05, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  4285e423
02 Apr, 2025 1 commit

[Frontend] Implement Tool Calling with `tool_choice='required'` (#13483) · cefb9e5a

Matthias Matt authored Apr 02, 2025


Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

cefb9e5a

01 Apr, 2025 1 commit
- [Doc] Quark quantization documentation (#15861) · 2041c0e3
  chaow-amd authored Apr 01, 2025
```
Signed-off-by: chaow <chaow@amd.com>
```
  2041c0e3