Commits · ebb2f383b817bf7ade6a36f4f247944262aaf223 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "ffacb222cbc3c1ac6ef05270bf8a2536a786ae06"

09 Jun, 2025 5 commits
- [Bugfix][Core] Prevent token lengths exceeding `max_model_len` in V0 (#19348) · c1c7dbbe
  22quinn authored Jun 09, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  c1c7dbbe
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea
- [v1] Add fp32 support to v1 engine through flex attn (#19319) · b8089195
  Isotr0py authored Jun 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b8089195
- [CI/Build] Fix LoRA test (#19350) · 95a6568b
  Jee Jee Li authored Jun 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  95a6568b
- [Misc] Cleanup compilation tests (#19343) · 3a4d4177
  Richard Zou authored Jun 09, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  3a4d4177
08 Jun, 2025 3 commits
- [Quantization] Add compressed-tensors NVFP4 support (#18312) · c123bc33
  Dipika Sikka authored Jun 08, 2025
  
  c123bc33
- [Misc] Change tests/compile to use VLLM_V1 by default (#19302) · 3d64d366
  Richard Zou authored Jun 08, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  3d64d366
- [Bugfix] Re-enable use_cudagraph in vLLM v1 (#19299) · eaa2e510
  Richard Zou authored Jun 07, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  eaa2e510
07 Jun, 2025 5 commits
- [BugFix][V1] Fix memory profiling bug (#18974) · 2d8476e4
  Luka Govedič authored Jun 07, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  2d8476e4
- [CI/Build] Improve Llama GGUF test robustness (#19287) · d2f0e7e6
  Isotr0py authored Jun 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d2f0e7e6
- Add FlexAttention to V1 (#16078) · cf02f9b2
  Driss Guessous authored Jun 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  cf02f9b2
- [Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee
  ElizaWszola authored Jun 07, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  84166fee
- [Easy][Test] Simplify test_function_tool_use with multiple parametrizes (#19269) · 6e0cd10f
  Lu Fang authored Jun 07, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  6e0cd10f
06 Jun, 2025 11 commits
- [BugFix] Fix tpu_model_runner block_id concatenation (#19228) · 46ecc579
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  46ecc579
- [Bugfix][Core] Update cancellation logic in `generate()` to handle Generator exits (#19225) · ca27f0f9
  Adolfo Victoria authored Jun 06, 2025
```
Co-authored-by: Adolfo Victoria <adovi@meta.com>
```
  ca27f0f9
- [BugFix] Fix MultiConnector test after HMA changes (#19291) · aad30bd3
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aad30bd3
- [Core] Raise when non-multi-instance DP clients target a DP rank (#19227) · 7353492a
  jmswen authored Jun 06, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  7353492a
- Unit Test for run_dp_sharded_vision_model (#19103) · f168b857
  Siqi Yan authored Jun 06, 2025
```
Signed-off-by: Siqi Yan <siqi@meta.com>
Co-authored-by: Siqi Yan <siqi@meta.com>
```
  f168b857
- Fix CompilationConfig repr (#19091) · da511d54
  Richard Zou authored Jun 06, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  da511d54
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- [TPU] update torch_xla pin (#19231) · b61dc5f9
  Chengji Yao authored Jun 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  b61dc5f9
- [v1] Hybrid Memory Allocator (#17996) · f8a1a2d1
  Chen Zhang authored Jun 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f8a1a2d1
- [Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033) · 3465b87e
  Benjamin Chislett authored Jun 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  3465b87e
- Fix AOPerModuleConfig name changes (#18869) · c8134bea
  Jerry Zhang authored Jun 05, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c8134bea
05 Jun, 2025 7 commits
- [Model] NemotronH support (#18863) · cb6d572e
  Luis Vega authored Jun 05, 2025
```
Signed-off-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
Co-authored-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
```
  cb6d572e
- [Quantization] Skip Fp4 Test for `compressed-tensors` (#19217) · aa49f148
  Dipika Sikka authored Jun 05, 2025
  
  aa49f148
- [MISC][Bugfix] Use less CPU when message queue has been empty for some time (#16226) · 85e2b7bb
  Povilas Kanapickas authored Jun 05, 2025
```
Signed-off-by: Povilas Kanapickas <povilas@radix.lt>
```
  85e2b7bb
- [Hardware][NVIDIA] FP4 MoE kernel optimization (#19110) · 61059bee
  Chiyue Wei authored Jun 05, 2025
```
Signed-off-by: Chiyue Wei <chiyuew@nvidia.com>
Co-authored-by: Chiyue Wei <chiyuew@nvidia.com>
```
  61059bee
- [Bugfix] properly catch PIL-related errors for vision models when incorrect... · 9bc8bb07
  Guillaume Calmettes authored Jun 05, 2025
```
[Bugfix] properly catch PIL-related errors for vision models when incorrect data urls are provided (#19202)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  9bc8bb07
- [Bugfix]: Fix the incompatibility issue with stream when Thinking is disabled (#19135) · 8fc57501
  Chauncey authored Jun 05, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8fc57501
- [Bugfix][Nixl] Fix full prefix cache hit bug (#18632) · c56ed8bb
  Robert Shaw authored Jun 04, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  c56ed8bb
04 Jun, 2025 9 commits
- [P/D] Heterogeneous TP (#18833) · b2fac671
  Nicolò Lucchesi authored Jun 05, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  b2fac671
- [Kernel] Integrate batched/masked deepgemm kernel (#19111) · c3fd4d66
  Varun Sundar Rabindranath authored Jun 04, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  c3fd4d66
- [TPU] Update dynamo dump file name in compilation test (#19108) · 7ee25904
  Siyuan Liu authored Jun 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  7ee25904
- Allow AsyncLLMEngine.generate to target a specific DP rank (#19102) · c8dcc159
  jmswen authored Jun 04, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  c8dcc159
- [CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678) · 01dc9a76
  Cyrus Leung authored Jun 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  01dc9a76
- Improve the output precision of embedding models (#19092) · 35cf32df
  wang.yuqi authored Jun 04, 2025
  
  35cf32df
- Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113) · 2669a0d7
  Seiji Eicher authored Jun 04, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  2669a0d7
- [TPU] Skip hanging tests (#19115) · 8e972d9c
  Siyuan Liu authored Jun 04, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  8e972d9c
- [Bugfix] Fix FA3 full cuda graph correctness (#19106) · b124e108
  Woosuk Kwon authored Jun 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b124e108