Commits · 212007b168139f526588288b4840214e728697b2 · OpenDAS / vllm_cscc · GitLab

09 Mar, 2025 1 commit
- [Hardware][TPU] Fix the recompiling issue in logits processor after warmup (#14510) · 212007b1
  Chengji Yao authored Mar 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  212007b1
08 Mar, 2025 1 commit
- [VLM] Add TP support for Phi-4-MM (#14453) · 03fe18ae
  Isotr0py authored Mar 08, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  03fe18ae
07 Mar, 2025 1 commit
- [Misc] Add Phi4-MM example (#14343) · 952a0749
  Jee Jee Li authored Mar 08, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  952a0749
06 Mar, 2025 5 commits
- [Distributed] Add enable_expert_parallel arg (#14305) · cc2f9b32
  Tyler Michael Smith authored Mar 06, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  cc2f9b32
- [RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185) · 151b08e0
  youkaichao authored Mar 07, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  151b08e0
- [Doc] Update reasoning with stream example to use OpenAI library (#14077) · 0ddc991f
  Yanyi Liu authored Mar 06, 2025
```
Signed-off-by: liuyanyi <wolfsonliu@163.com>
```
  0ddc991f
- [Frontend][Docs] Transcription API streaming (#13301) · fa82b938
  Nicolò Lucchesi authored Mar 06, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  fa82b938
- [Bugfix][Structured Output] Support outlines engine with reasoning outputs for DeepSeek R1 (#14114) · f5f7f00c
  Ce Gao authored Mar 06, 2025
  
  f5f7f00c
05 Mar, 2025 3 commits

Deprecate `best_of` Sampling Parameter in anticipation for vLLM V1 (#13997) · a4f1ee35

Vincent authored Mar 05, 2025

Signed-off-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a4f1ee35

[Bugfix] Fix broken vision language example (#14292) · f71b00a1
Isotr0py authored Mar 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
f71b00a1
[V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
Tyler Michael Smith authored Mar 05, 2025

72c62eae

04 Mar, 2025 1 commit
- [V1][Molmo] Fix get_multimodal_embeddings() in molmo.py (#14161) · b3cf368d
  lkchen authored Mar 04, 2025
  
  b3cf368d
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 1 commit
- [v0][structured output] Support reasoning output (#12955) · bf33700e
  Ce Gao authored Mar 03, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  bf33700e
01 Mar, 2025 1 commit
- [Doc] Consolidate `whisper` and `florence2` examples (#14050) · fdcc4053
  Isotr0py authored Mar 01, 2025
  
  fdcc4053
27 Feb, 2025 2 commits
- [VLM] Support multimodal inputs for Florence-2 models (#13320) · edf309eb
  Isotr0py authored Feb 27, 2025
  
  edf309eb
- [Misc] fixed 'required' is an invalid argument for positionals (#13948) · 10c3b8c1
  Chauncey authored Feb 27, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  10c3b8c1
26 Feb, 2025 2 commits
- [Misc] fixed qwen_vl_utils parameter error (#13906) · d08b285a
  Chauncey authored Feb 27, 2025
  
  d08b285a
- [Doc] fix the incorrect module path of tensorize_vllm_model (#13863) · e656f638
  Albert authored Feb 26, 2025
  
  e656f638
25 Feb, 2025 1 commit
- [Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953) · 2f42a488
  Jiayi Yao authored Feb 25, 2025
  
  2f42a488
24 Feb, 2025 1 commit
- [CI/Build] add python-json-logger to requirements-common (#12842) · 7940d8a6
  Roger Meier authored Feb 24, 2025
  
  7940d8a6
22 Feb, 2025 2 commits
- [ci] fix linter (#13701) · 2382ad29
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2382ad29
- [core] set up data parallel communication (#13591) · 3e472d88
  youkaichao authored Feb 22, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3e472d88
21 Feb, 2025 2 commits
- fix typo of grafana dashboard, with correct datasource (#13668) · 900edbfa
  John Zheng authored Feb 22, 2025
```
Signed-off-by: John Zheng <john.zheng@hp.com>
```
  900edbfa
- [Misc] Adding script to setup ray for multi-node vllm deployments (#12913) · 981f3c83
  Edwin Hernandez authored Feb 20, 2025
  
  981f3c83
20 Feb, 2025 2 commits
- [Frontend] Add backend-specific options for guided decoding (#13505) · bfbc0b32
  Joe Runde authored Feb 20, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  bfbc0b32
- Merge similar examples in `offline_inference` into single `basic` example (#12737) · 992e5c3d
  Harry Mellor authored Feb 20, 2025
  
  992e5c3d
19 Feb, 2025 1 commit
- [VLM][Bugfix] Pass processor kwargs properly on init (#13516) · 377d10bd
  Cyrus Leung authored Feb 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  377d10bd
16 Feb, 2025 1 commit
- [V1] Update doc and examples for H2O-VL (#13349) · b7d30986
  Roger Wang authored Feb 16, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b7d30986
14 Feb, 2025 1 commit
- [Bugfix] Offline example of disaggregated prefill (#13214) · 84683fa2
  XiaobingZhang authored Feb 14, 2025
  
  84683fa2
13 Feb, 2025 3 commits
- [Frontend] Add `/v1/audio/transcriptions` OpenAI API endpoint (#12909) · d84cef76
  Nicolò Lucchesi authored Feb 13, 2025
  
  d84cef76
- [VLM] Separate text-only and vision variants of the same model architecture (#13157) · 1bc3b5e7
  Cyrus Leung authored Feb 13, 2025
  
  1bc3b5e7
- [Bugfix][Example] Fix GCed profiling server for TPU (#12792) · d88c8666
  Michael Goin authored Feb 12, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  d88c8666
12 Feb, 2025 1 commit
- [Model] IBM/NASA Prithvi Geospatial model (#12830) · 974dfd49
  Christian Pinto authored Feb 12, 2025
  
  974dfd49
11 Feb, 2025 2 commits
- [BugFix] Pop instead of del CUDA_VISIBLE_DEVICES (#12962) · 6c4dbe23
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Feb 11, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  6c4dbe23
- [Bugfix]: Reasoning output bug according to the chat template change (#13025) · fc6485d2
  Ce Gao authored Feb 11, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  fc6485d2
10 Feb, 2025 2 commits
- [Model] Ultravox Model: Support v0.5 Release (#12912) · 08b2d845
  Farzad Abdolhosseini authored Feb 10, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  08b2d845
- [core][rlhf] add colocate example for RLHF (#12984) · aa0ca5eb
  youkaichao authored Feb 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  aa0ca5eb
08 Feb, 2025 2 commits
- [VLM] Merged multi-modal processor for GLM4V (#12449) · 86222a3d
  Jee Jee Li authored Feb 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  86222a3d
- [CI/Build] Auto-fix Markdown files (#12941) · 8a69e0e2
  Cyrus Leung authored Feb 08, 2025
  
  8a69e0e2