Commits · 247181536fc2cab728077f3e7489622e19671d2d · OpenDAS / vllm_cscc · GitLab

26 Mar, 2025 2 commits
- [Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
  Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
  1711b929
- [Misc] Enhance warning information to user-defined chat template (#15408) · 99f536f8
  wwl2755 authored Mar 26, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  99f536f8
25 Mar, 2025 1 commit
- Add workaround for shared field_names in pydantic model class (#13925) · e977c111
  Maximilien de Bayser authored Mar 25, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e977c111
24 Mar, 2025 1 commit

[Bugfix] Fix chat template loading (#15143) · cbcdf2c6

Cyrus Leung authored Mar 24, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

cbcdf2c6

23 Mar, 2025 1 commit
- [Frontend] Support tool calling and reasoning parser (#14511) · d6cd59f1
  Robin authored Mar 24, 2025
```
Signed-off-by: WangErXiao <863579016@qq.com>
```
  d6cd59f1
20 Mar, 2025 1 commit
- [Misc]fixed disable these http request logs (#14754) · ae65f3e2
  Chauncey authored Mar 20, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  ae65f3e2
19 Mar, 2025 1 commit
- [FEAT]Support reset prefix cache by specified device (#15003) · 26dd972a
  maobaolong authored Mar 20, 2025
  
  26dd972a
18 Mar, 2025 2 commits
- [Bugfix] Register serializers for V0 MQ Engine (#15009) · 3b457143
  Simon Mo authored Mar 18, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  3b457143
- [Bugfix][Frontend] Fix validation of `logprobs` in `ChatCompletionRequest` (#14352) · dd732028
  Sebastian Schoennenbeck authored Mar 18, 2025
```
Signed-off-by: Sebastian Schönnenbeck <sebastian.schoennenbeck@comma-soft.com>
```
  dd732028
15 Mar, 2025 2 commits

[Core] Expose API endpoint `/is_sleeping` (#14312) · 74bc397b
Jun Duan authored Mar 15, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
74bc397b

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

14 Mar, 2025 3 commits
- [Frontend] track server_load (#13950) · 73deea2f
  daniel-salib authored Mar 14, 2025
  
  73deea2f
- [Frontend] Fix log message to use http vs https (#14774) · 0b0d6421
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  0b0d6421
- [BugFix]: properly catch templating error when preprocess input (#13976) · fd8e055f
  Guillaume Calmettes authored Mar 14, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  fd8e055f
10 Mar, 2025 1 commit
- Correct capitalisation: `VLLM` -> `vLLM` (#14562) · 3b352a2f
  Harry Mellor authored Mar 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3b352a2f
08 Mar, 2025 1 commit
- Default to `generation_config` from model (#12622) · 47512b32
  Harry Mellor authored Mar 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  47512b32
06 Mar, 2025 2 commits
- Reinstate `best_of` for V0 (#14356) · bf0560bd
  Harry Mellor authored Mar 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bf0560bd
- [Frontend][Docs] Transcription API streaming (#13301) · fa82b938
  Nicolò Lucchesi authored Mar 06, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  fa82b938
05 Mar, 2025 2 commits

Deprecate `best_of` Sampling Parameter in anticipation for vLLM V1 (#13997) · a4f1ee35

Vincent authored Mar 05, 2025

Signed-off-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a4f1ee35

[Frontend] Allow return_tokens_as_token_ids to be passed as a request param (#14066) · 32985bed
Benjamin Chislett authored Mar 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
32985bed

04 Mar, 2025 2 commits
- [Frontend] Do `prompt_logprobs` clamping for chat as well as completions (#14225) · e5b2f160
  Harry Mellor authored Mar 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e5b2f160
- Fix performance when `--generation-config` is not `None` (#14223) · 9badee53
  Harry Mellor authored Mar 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9badee53
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
02 Mar, 2025 1 commit
- [v0][structured output] Support reasoning output (#12955) · bf33700e
  Ce Gao authored Mar 03, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  bf33700e
26 Feb, 2025 1 commit
- [Misc] Improve LoRA spelling (#13831) · 5157338e
  Jee Jee Li authored Feb 26, 2025
  
  5157338e
25 Feb, 2025 2 commits
- Fix `/v1/audio/transcriptions ` Bad Request Error (#13811) · 6522d55b
  Wen Sun authored Feb 25, 2025
  
  6522d55b
- [Misc] set single whitespace between log sentences (#13771) · 51010a18
  cjackal authored Feb 25, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  51010a18
22 Feb, 2025 3 commits
- Support SSL Key Rotation in HTTP Server (#13495) · 8db1b9d0
  Keyun Tong authored Feb 22, 2025
  
  8db1b9d0
- [CI/Build] Fix pre-commit errors (#13696) · 7f6bae56
  Cyrus Leung authored Feb 22, 2025
  
  7f6bae56
- [HTTP Server] Make model param optional in request (#13568) · 0ffdf8ce
  Keyun Tong authored Feb 21, 2025
  
  0ffdf8ce
21 Feb, 2025 2 commits
- [FEATURE] Enables /score endpoint for embedding models (#12846) · 1c3c9757
  Gabriel Marinho authored Feb 21, 2025
  
  1c3c9757
- [Bugfix] Add `mm_processor_kwargs` to chat-related protocols (#13644) · a30c0935
  Roger Wang authored Feb 20, 2025
  
  a30c0935
20 Feb, 2025 2 commits
- [Misc] add mm_processor_kwargs to extra_body for Qwen2.5-VL (#13533) · 041e2947
  燃 authored Feb 20, 2025
  
  041e2947
- [core] add sleep and wake up endpoint and v1 support (#12987) · ba811639
  youkaichao authored Feb 20, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: cennn <2523403608@qq.com>
Co-authored-by: cennn <2523403608@qq.com>
```
  ba811639
18 Feb, 2025 2 commits
- [Bugfix] Handle content type with optional parameters (#13383) · d3231cb4
  zifeitong authored Feb 18, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  d3231cb4
- [Bugfix] Only print out chat template when supplied (#13444) · a1074b3e
  Yuan Tang authored Feb 18, 2025
  
  a1074b3e
14 Feb, 2025 1 commit
- [Frontend] Optionally remove memory buffer used for uploading to URLs in run_batch (#12927) · 185cc19f
  Pooya Davoodi authored Feb 14, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  185cc19f
13 Feb, 2025 3 commits
- [Frontend] Add `/v1/audio/transcriptions` OpenAI API endpoint (#12909) · d84cef76
  Nicolò Lucchesi authored Feb 13, 2025
  
  d84cef76
- [Bugfix] Missing Content Type returns 500 Internal Server Error (#13193) · 37dfa600
  Vaibhav Jain authored Feb 13, 2025
  
  37dfa600
- [Frontend] Pass pre-created socket to uvicorn (#13113) · 578087e5
  Russell Bryant authored Feb 13, 2025
  
  578087e5