Commits · 01513a334a451e53162a2526ae28caba7fa868d4 · OpenDAS / vllm_cscc

16 Jul, 2025 4 commits
- Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33
  Nir David authored Jul 16, 2025
```
Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>
```
  01513a33
- [Docs] Add intro and fix 1-2-3 list in frameworks/open-webui.md (#19199) · 260127ea
  Michael Yao authored Jul 16, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  260127ea
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Docs] Enhance Anyscale documentation, add quickstart links for vLLM (#21018) · 3ed94f9d
  Ricardo Decal authored Jul 15, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  3ed94f9d
15 Jul, 2025 8 commits
- Add full serve CLI reference back to docs (#20978) · b637e9dc
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b637e9dc
- [Deprecation] Remove everything scheduled for removal in v0.10.0 (#20979) · 313ae8c1
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  313ae8c1
- [Deprecation] Remove `TokenizerPoolConfig` (#20968) · 56fe4bed
  Harry Mellor authored Jul 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  56fe4bed
- [doc] Add more details for Ray-based DP (#20948) · d9127818
  Rui Qiao authored Jul 15, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  d9127818
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- [frontend] Add --help=page option for paginated help output (#20961) · 68d28e37
  Reid authored Jul 15, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  68d28e37
- [Doc] Clearer mistral3 and pixtral model support description (#20926) · fc017915
  Isotr0py authored Jul 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  fc017915
- [Docs] Add Kuberay to deployment integrations (#20592) · 054c8657
  Ricardo Decal authored Jul 14, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  054c8657
14 Jul, 2025 1 commit
- [Model] Add Ling implementation (#20680) · 38efa282
  ant-yy authored Jul 14, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
```
  38efa282
12 Jul, 2025 3 commits
- [docs] convert supported configs to table (#20858) · a86754a1
  Reid authored Jul 12, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  a86754a1
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
- [Docs] Update basic.md (#20846) · fb25e956
  Lucia Fang authored Jul 12, 2025
  
  fb25e956
11 Jul, 2025 4 commits
- Update kimi-k2 tool calling docs, enable unit tests (#20821) · 5f0af36a
  bigmoyan authored Jul 12, 2025
```
Signed-off-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@moonshot.cn>
Co-authored-by: wangzhengtao <wangzhengtao@msh.team>
```
  5f0af36a
- [Docs] Data Parallel deployment documentation (#20768) · 9907fc44
  Nick Hill authored Jul 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9907fc44
- [doc] fix ordered list issue (#20819) · 6fb16244
  Reid authored Jul 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  6fb16244
- [doc] fold long code block (#20795) · 6a9e6b2a
  Reid authored Jul 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  6a9e6b2a
10 Jul, 2025 4 commits
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- [doc] fix ordered list (#20749) · 65393ee0
  Reid authored Jul 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  65393ee0
09 Jul, 2025 8 commits

[Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1

fxmarty-amd authored Jul 09, 2025


Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

332d4cb1

Remove heading form installation `inc.md` file (#20697) · 403b4815
Harry Mellor authored Jul 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
403b4815

[Doc] Update CPU doc (#20676) · 138709f8

Li, Jiang authored Jul 10, 2025

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

138709f8

[doc] update doc format (#20673) · efe73d05
Reid authored Jul 09, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
efe73d05
[Doc] Update notes (#20668) · 70ca5484
Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
70ca5484

[V1] [Doc] Update V1 docs for Mamba models (#20499) · 5358cce5

Thomas Parnell authored Jul 09, 2025


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

5358cce5

[Docs] fix minimax tool_calling docs error (#20667) · f95570a5
qscqesze authored Jul 09, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
f95570a5
Fix bullets in incremental_build.md (#20642) · 9e0ef888
Michael Goin authored Jul 09, 2025

9e0ef888

08 Jul, 2025 7 commits
- Stop using title frontmatter and fix doc that can only be reached by search (#20623) · b942c094
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b942c094
- Remove unnecessary explicit title anchors and use relative links instead (#20620) · b4bab816
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b4bab816
- [Docs] Add Anyscale to frameworks (#20590) · 3eb4ad53
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  3eb4ad53
- [Docs] Add Ray Serve LLM section to openai compatible server guide (#20595) · 90a2769f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  90a2769f
- [Docs] Rewrite offline inference guide (#20594) · 0d914c81
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  0d914c81
- [Doc] Syntax highlight request responses as JSON instead of bash (#20582) · 6e428cdd
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6e428cdd
- Make distinct `code` and `console` admonitions so readers are less likely to miss them (#20585) · af107d5a
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af107d5a
07 Jul, 2025 1 commit
- Fix links in multi-modal model contributing page (#18615) · 042d131f
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  042d131f