Commits · da224daaa9b4864e4ce08ca0fce1bc089e1baa98 · OpenDAS / vllm_cscc

06 Apr, 2025 1 commit

[Bugfix] add hf_token to EngineArgs (#16093) · da224daa

paolovic authored Apr 06, 2025


Signed-off-by: paolovic <paul-philipp.luley@uzh.ch>
Co-authored-by: paolovic <paul-philipp.luley@uzh.ch>

da224daa

05 Apr, 2025 1 commit
- [Misc] Auto detect bitsandbytes pre-quantized models (#16027) · 4285e423
  Tristan Leclercq authored Apr 05, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  4285e423
04 Apr, 2025 1 commit
- [Bugfix] Fix default behavior/fallback for pp in v1 (#16057) · 4708f13a
  Michael Goin authored Apr 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4708f13a
01 Apr, 2025 3 commits
- [V1][Spec Decode] Implement Eagle Proposer [1/N] (#15729) · e75a6301
  Woosuk Kwon authored Apr 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e75a6301
- [Misc] Enable V1 LoRA by default (#15320) · 79455cf4
  Varun Sundar Rabindranath authored Apr 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  79455cf4
- [ROCm] Use device name in the warning (#15838) · c7e63aa4
  Gregory Shtrasberg authored Apr 01, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  c7e63aa4
31 Mar, 2025 2 commits
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
28 Mar, 2025 4 commits
- [Misc] cli auto show default value (#15582) · 26df46ee
  Reid authored Mar 29, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  26df46ee
- [V1] Support disable_any_whtespace for guidance backend (#15584) · 7329ff54
  Russell Bryant authored Mar 28, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7329ff54
- [Refactor][Frontend] Keep all logic about reasoning into one class (#14428) · 32b14baf
  Ce Gao authored Mar 28, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
```
  32b14baf
- [Quantization][V1] BitsAndBytes support V1 (#15611) · 726efc6a
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  726efc6a
27 Mar, 2025 3 commits
- [V1] AsyncLLM data parallel (#13923) · 15dac210
  Nick Hill authored Mar 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  15dac210
- [Misc] Replace `is_encoder_decoder_inputs` with `split_enc_dec_inputs` (#15620) · 24718153
  Cyrus Leung authored Mar 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24718153
- [Misc] Restrict ray version dependency and update PP feature warning in V1 (#15556) · df8d3d12
  Rui Qiao authored Mar 26, 2025
  
  df8d3d12
26 Mar, 2025 3 commits
- Support SHA256 as hash function in prefix caching (#15297) · 27df5199
  marko authored Mar 26, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  27df5199
- [Model] Add Reasoning Parser for Granite Models (#14202) · 1711b929
  Alex Brooks authored Mar 26, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>
```
  1711b929
- Transformers backend already supports V1 (#15463) · e42389f9
  Harry Mellor authored Mar 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e42389f9
25 Mar, 2025 3 commits
- [V1] Support long_prefill_token_threshold in v1 scheduler (#15419) · 082ab86f
  Lu Fang authored Mar 25, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  082ab86f
- [bugfix] add supports_v1 platform interface (#15417) · 5f063a80
  Joe Runde authored Mar 25, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  5f063a80
- [V1] guidance backend for structured output + `auto` fallback mode (#14779) · a09ad90a
  Russell Bryant authored Mar 25, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <jc1da.3011@gmail.com>
Co-authored-by: Michal Moskal <michal@moskal.me>
```
  a09ad90a
23 Mar, 2025 3 commits
- [V1] Enable V1 Fp8 cache for FA3 in the oracle (#15191) · dccf535f
  Lucas Wilkinson authored Mar 23, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  dccf535f
- [V1][Usage] Refactor speculative decoding configuration and tests (#14434) · 50c9636d
  shangmingc authored Mar 23, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50c9636d
- Fix v1 supported oracle for worker-cls and worker-extension-cls (#15324) · 0661cfef
  hijkzzz authored Mar 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  0661cfef
22 Mar, 2025 3 commits
- Remove openvino support in favor of external plugin (#15339) · b877031d
  Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  b877031d
- [V1] Add `disable-any-whitespace` option support for xgrammar (#15316) · eb63ea1e
  Russell Bryant authored Mar 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  eb63ea1e
- [Doc] add load_format items in docs (#14804) · 1c2bec0f
  wwl2755 authored Mar 22, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  1c2bec0f
21 Mar, 2025 4 commits
- [V1] Enable Triton(ROCm) Attention backend for Nvidia GPUs (#14071) · f8a08cb9
  Isotr0py authored Mar 21, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f8a08cb9
- [Misc] Better RayExecutor and multiprocessing compatibility (#14705) · 5df2da5b
  Cody Yu authored Mar 20, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  5df2da5b
- [Misc] Clean up the BitsAndBytes arguments (#15140) · 10f55fe6
  Jee Jee Li authored Mar 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  10f55fe6
- [V1] Scheduler Refactoring [1/N] - Add Scheduler Interface (#15250) · 0c6f5023
  Woosuk Kwon authored Mar 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  0c6f5023
20 Mar, 2025 1 commit
- [V1] Add flag to disable cascade attention (#15243) · 2b22290c
  Woosuk Kwon authored Mar 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2b22290c
19 Mar, 2025 2 commits
- [V1][Bugfix] Fix oracle for device checking (#15104) · dafb4e50
  Roger Wang authored Mar 19, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  dafb4e50
- [Misc][V1] Skip device checking if not available (#15061) · 4f065f12
  Cody Yu authored Mar 18, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  4f065f12
17 Mar, 2025 2 commits
- [V1] Guard Against Main Thread Usage (#14972) · e41e1602
  Robert Shaw authored Mar 17, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  e41e1602
- [V1] Default MLA to V1 (#14921) · 89fca671
  Simon Mo authored Mar 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  89fca671
16 Mar, 2025 1 commit
- [V1] Remove V0 fallback for mistral-tokenizer (#14873) · b30c75dd
  Roger Wang authored Mar 15, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b30c75dd
15 Mar, 2025 1 commit

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

12 Mar, 2025 1 commit
- [core][V1] pluggable scheduler (#14466) · 47532cd9
  Joe Runde authored Mar 11, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  47532cd9
11 Mar, 2025 1 commit
- [MISC][V1] Handle exception of current_platform.get_device_name() in arg_utils (#14379) · 485afdd3
  Cody Yu authored Mar 10, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  485afdd3