Commits · a40a133cf1ab32768c48f218f11737b9e1b5efc3 · OpenDAS / vllm_cscc

06 Jul, 2025 1 commit
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
03 Jul, 2025 1 commit
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
02 Jul, 2025 1 commit
- [Misc][Doc] Add missing comment for LLM (#20285) · 9ec1e306
  Lifans authored Jul 01, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  9ec1e306
30 Jun, 2025 1 commit
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
24 Jun, 2025 1 commit
- [BugFix] Fix multi-node offline data parallel (#19937) · 8619e715
  Nick Hill authored Jun 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8619e715
20 Jun, 2025 1 commit
- Fix: Check the type of params to be a Sequence not list. (#19910) · 8ca81bb0
  Rabin Adhikari authored Jun 21, 2025
```
Signed-off-by: Rabin Adhikari <rabin.adk1@gmail.com>
```
  8ca81bb0
19 Jun, 2025 3 commits

[Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
ead21102

[Frontend] Add optional token-level progress bar to `LLM.beam_search` (#19301) · 466166dc

NekoMimiUnagi authored Jun 19, 2025


Signed-off-by: Ruosen Li <rxl190028@utdallas.edu>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Ubuntu <ubuntu@ip-172-31-71-179.ec2.internal>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

466166dc

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

14 Jun, 2025 1 commit
- [Fix] Convert kv_transfer_config from dict to KVTransferConfig (#19262) · 08500011
  maobaolong authored Jun 15, 2025
  
  08500011
13 Jun, 2025 1 commit
- [CUDA] Enable full cudagraph for FlashMLA (#18581) · 3597b06a
  Luka Govedič authored Jun 13, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  3597b06a
10 Jun, 2025 1 commit
- [Frontend] Add tqdm_leave_pbar to control progress bar visibility (#19357) · 6cd4ae8a
  Reid authored Jun 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6cd4ae8a
09 Jun, 2025 1 commit
- [Frontend] Remove unreachable code from llm.py (#19288) · 8335667c
  Kseniya Parkhamchuk authored Jun 08, 2025
```
Signed-off-by: KsuParkhamchuk <k.parkhamchuk@gmail.com>
```
  8335667c
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
29 May, 2025 1 commit
- [Deprecation] Disallow pos-args other than `model` when initializing `LLM` (#18802) · c2903403
  Cyrus Leung authored May 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c2903403
28 May, 2025 2 commits
- [Core] Add Lora Support to Beam Search (#18346) · 321331b8
  Alex Brooks authored May 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  321331b8
- Enable Pydantic mypy checks and convert configs to Pydantic dataclasses (#17599) · 4c2b38ce
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4c2b38ce
27 May, 2025 2 commits
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
- [Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c
  Hyogeun Oh (오효근) authored May 27, 2025
```
[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  a68e293c
23 May, 2025 4 commits
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
- [Misc] refactor: simplify input validation and num_requests handling in _convert_v1_inputs (#18482) · fae453f8
  CYJiang authored May 23, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  fae453f8
20 May, 2025 1 commit
- support qiyuan-8b-v2 and FM9GForCausalLM · 8fb5dea5
  zhuwenwen authored May 20, 2025
  
  8fb5dea5
14 May, 2025 1 commit
- [Fix] Move "model_config" as keyword args in chat_utils.py (#18098) · 6685890d
  lkchen authored May 13, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  6685890d
09 May, 2025 6 commits
- Improve configs - the rest! (#17562) · 4b2ed792
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b2ed792
- add spec decode zero overhead · 01c30741
  lizhigong authored Apr 27, 2025
  
  01c30741
- fix stop remote worker bug · 351d607d
  lizhigong authored Apr 27, 2025
  
  351d607d
- add VLLM_ZERO_DISABLE_AUTO_THREAD VLLM_ZERO_NO_THREAD change zero scheduling logic · 9076ef2b
  lizhigong authored Apr 15, 2025
  
  9076ef2b
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
- add v0 zero overhead · 54294854
  lizhigong authored Apr 11, 2025
  
  54294854
08 May, 2025 1 commit
- [Frontend] Chat template fallbacks for multimodal models (#17805) · 96722aa8
  Cyrus Leung authored May 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96722aa8
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
02 May, 2025 1 commit
- [Misc] Clean up input processing (#17582) · cb234955
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cb234955
01 May, 2025 1 commit
- [Frontend] Show progress bar for adding requests (#17525) · 1903c0b8
  Cyrus Leung authored May 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1903c0b8
30 Apr, 2025 2 commits

Improve configs - `ModelConfig` (#17130) · 13698db6
Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
13698db6

Truncation control for embedding models (#14776) · 1c2bc7ea

Gabriel Marinho authored Apr 29, 2025


Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1c2bc7ea

29 Apr, 2025 1 commit
- [Frontend] Support `chat_template_kwargs` in `LLM.chat` (#17356) · 88ad9ec6
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  88ad9ec6
26 Apr, 2025 1 commit
- [V1] Add `structural_tag` support using xgrammar (#17085) · f8acd01f
  Russell Bryant authored Apr 26, 2025
  
  f8acd01f
25 Apr, 2025 1 commit
- [BugFix][Frontend] Fix `LLM.chat()` tokenization (#16081) · 70116459
  Nick Hill authored Apr 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  70116459