Commits · f54ad7b9f38e4f09da45c2cf56fab921f0ba3c4d · OpenDAS / vllm_cscc · GitLab

13 Jun, 2025 3 commits
- [fix]还原部分代码 · ccaeb6c0
  王敏 authored Jun 13, 2025
  
  ccaeb6c0
- [fix]修复并行解码integration、mtp相关单测问题 · 5c77fabd
  王敏 authored Jun 13, 2025
  
  5c77fabd
- [fix]修复并行解码eagle和mlp相关单测问题 · 08cb5d8f
  王敏 authored Jun 13, 2025
  
  08cb5d8f
12 Jun, 2025 1 commit
- [tests] fix tests · 04629132
  zhuwenwen authored Jun 12, 2025
  
  04629132
09 Jun, 2025 1 commit
- [tests] update models · 90e10dee
  zhuwenwen authored Jun 09, 2025
  
  90e10dee
05 Jun, 2025 4 commits
- [test] update mq_llm_engine · 2ea8bd27
  zhuwenwen authored Jun 05, 2025
  
  2ea8bd27
- release rc1 · fe306013
  zhuwenwen authored Jun 05, 2025
  
  fe306013
- [tests] fix quantization and plugins_tests · 2fbec36a
  zhuwenwen authored Jun 05, 2025
  
  2fbec36a
- [tests] fix v1, tokenization and runai_model_streamer_test · a68aef25
  zhuwenwen authored Jun 05, 2025
  
  a68aef25
04 Jun, 2025 1 commit
- [tests] update v1 tests · 2e3bfb1e
  zhuwenwen authored Jun 04, 2025
  
  2e3bfb1e
03 Jun, 2025 2 commits
- [tests]skip tpu and weight_loading tests, fix tests of worker · 5e078c69
  zhuwenwen authored Jun 03, 2025
  
  5e078c69
- [tests] fix tests of core, engine and detokenizer · ced28510
  zhuwenwen authored Jun 03, 2025
  
  ced28510
29 May, 2025 2 commits
- [test]fix basic_correctness and benchmarks · dbd62f84
  zhuwenwen authored May 29, 2025
  
  dbd62f84
- [tests]fix start with test and async_engine · 2664c459
  zhuwenwen authored May 29, 2025
  
  2664c459
28 May, 2025 1 commit
- update test_flash_mla · 1e302221
  zhuwenwen authored May 28, 2025
  
  1e302221
26 May, 2025 1 commit
- fix kernels tests of attention and core · f1467ce5
  zhuwenwen authored May 26, 2025
  
  f1467ce5
13 May, 2025 1 commit
- fix kernels tests · f2f1b550
  zhuwenwen authored May 13, 2025
  
  f2f1b550
08 May, 2025 1 commit
- skip cutlass mla tests · 45366531
  zhuwenwen authored May 08, 2025
  
  45366531
02 May, 2025 1 commit
- [BugFix] Fix Memory Leak (#17567) · edb5286e
  Robert Shaw authored May 02, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  edb5286e
28 Apr, 2025 3 commits
- Make name of `compressed-tensors` quant method consistent across vLLM (#17255) · b6dd32aa
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b6dd32aa
- Improve conversion from dataclass configs to argparse arguments (#17303) · f9488694
  Harry Mellor authored Apr 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f9488694
- [Model] Add Granite Speech Support (#16246) · fa93cd9f
  Alex Brooks authored Apr 28, 2025
```
Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  fa93cd9f
27 Apr, 2025 6 commits
- [V1][Spec Decode] Make eagle compatible with prefix caching. (#17137) · 20e489ea
  Lily Liu authored Apr 27, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  20e489ea
- [Feature] support sequence parallelism using compilation pass (#16155) · 690fe019
  cascade authored Apr 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  690fe019
- [NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032) · ed7a29d9
  Kaixi Hou authored Apr 27, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
```
  ed7a29d9
- [Bugfix] Fix Lora Name Parsing (#17196) · 756848e7
  Alex Brooks authored Apr 27, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  756848e7
- [Misc] Make cached tokenizer pickle-compatible (#17048) · 93a126fb
  Cyrus Leung authored Apr 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  93a126fb
- [Kernel][Triton][FP8] Adding fp8 and variable length sequence support to... · 8e4b351a
  rasmith authored Apr 26, 2025
```
[Kernel][Triton][FP8] Adding fp8 and variable length sequence support to Triton FAv2 kernel (#12591)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  8e4b351a
26 Apr, 2025 9 commits
- Update test_flash_attn.py (#17102) · 9869453c
  Happy authored Apr 27, 2025
```
Signed-off-by: ShuaibinLi <lishuaibin@live.cn>
```
  9869453c
- [MISC] rename interval to max_recent_requests (#14285) · fd11a325
  Ning Xie authored Apr 27, 2025
  
  fd11a325
- [V1] Add `structural_tag` support using xgrammar (#17085) · f8acd01f
  Russell Bryant authored Apr 26, 2025
  
  f8acd01f
- [Bugfix] Fix standard models tests (#17217) · 909fdaf1
  Cyrus Leung authored Apr 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  909fdaf1
- [Core] Remove prompt string from engine core data structures (#17214) · df6f3ce8
  Nick Hill authored Apr 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  df6f3ce8
- [CI/test] Fix Eagle Correctness Test (#17209) · 513f0747
  Woosuk Kwon authored Apr 25, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  513f0747
- [BugFix] Avoid race conditions in zero-copy tensor transmission (#17203) · b07bf83c
  Nick Hill authored Apr 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b07bf83c
- [V1][Metrics] Allow V1 AsyncLLM to use custom logger (#14661) · 53e8cf53
  Zijing Liu authored Apr 25, 2025
```
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  53e8cf53
- Allocate kv_cache with stride order (#16605) · 9e96f56e
  Shu Wang authored Apr 26, 2025
```
Signed-off-by: shuw <shuw@nvidia.com>
```
  9e96f56e
25 Apr, 2025 3 commits
- [V1][Spec Decode] EAGLE-3 Support (#16937) · a0e619e6
  Benjamin Chislett authored Apr 25, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Bryan Lu <yuzhelu@amazon.com>
```
  a0e619e6
- [BugFix][Frontend] Fix `LLM.chat()` tokenization (#16081) · 70116459
  Nick Hill authored Apr 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  70116459
- [Bugfix] Fix hybrid model tests (#17182) · 43faa046
  Cyrus Leung authored Apr 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43faa046