Commits · a7e3eba66fff82f7e12bb2354c4b26635f0f7761 · OpenDAS / vllm_cscc

29 Jan, 2025 1 commit

[Frontend] Support reasoning content for deepseek r1 (#12473) · a7e3eba6

Ce Gao authored Jan 29, 2025


Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

a7e3eba6

24 Jan, 2025 1 commit
- [Docs] Update spec decode + structured output in compat matrix (#12373) · c5cffcd0
  Russell Bryant authored Jan 23, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  c5cffcd0
23 Jan, 2025 2 commits

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) · e97f802b

Gregory Shtrasberg authored Jan 23, 2025


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

e97f802b

[Docs] Update FP8 KV Cache documentation (#12238) · 01a55941

Michael Goin authored Jan 22, 2025


Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

01a55941

15 Jan, 2025 1 commit
- [Doc] Update examples to remove SparseAutoModelForCausalLM (#12062) · 3f9b7ab9
  Kyle Sayers authored Jan 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  3f9b7ab9
14 Jan, 2025 1 commit

[Doc] Update Quantization Hardware Support Documentation (#12025) · 8a1f938e

TJian authored Jan 14, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

8a1f938e

13 Jan, 2025 1 commit
- [Doc] Organise installation documentation into categories and tabs (#11935) · e8c23ff9
  Harry Mellor authored Jan 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e8c23ff9
12 Jan, 2025 2 commits

[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100) · 8bddb735

Akshat Tripathi authored Jan 12, 2025


Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

8bddb735

[CI/Build] Add markdown linter (#11857) · 43f3d9e6
Rafael Vasquez authored Jan 12, 2025
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
43f3d9e6

10 Jan, 2025 2 commits
- [Doc] Rename offline inference examples (#11927) · 482cdc49
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  482cdc49
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
08 Jan, 2025 1 commit
- [Doc] Move examples into categories (#11840) · aba8d6ee
  Harry Mellor authored Jan 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aba8d6ee
07 Jan, 2025 2 commits
- [Doc]Add documentation for using EAGLE in vLLM (#11417) · 973f5dc5
  sroy745 authored Jan 07, 2025
```
Signed-off-by: Sourashis Roy <sroy@roblox.com>
```
  973f5dc5
- [Doc][3/N] Reorganize Serving section (#11766) · 8ceffbf3
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8ceffbf3
06 Jan, 2025 1 commit
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5