Commits · 2ffb9b6e079b73eb10a15bb795fa886b3587f85a · myrfy001 / vllm_dsv4

"examples/offline_inference/basic.py" did not exist on "d1557e66d3227355e5aed8018a945a5e6a733147"

08 Jun, 2025 8 commits
- [Bugfix] model_max_length should consider max_model_len in tokenizer_config (#19201) · 2ffb9b6e
  wang.yuqi authored Jun 08, 2025
  
  2ffb9b6e
- [Multi Modal] Add an env var for message queue max chunk bytes (#19242) · cda10fa3
  jennyyyyzhen authored Jun 08, 2025
```
Signed-off-by: yZhen <yZhen@fb.com>
Co-authored-by: yZhen <yZhen@fb.com>
```
  cda10fa3
- [Quantization] Add compressed-tensors NVFP4 support (#18312) · c123bc33
  Dipika Sikka authored Jun 08, 2025
  
  c123bc33
- [Hardware][POWER] Add IBM POWER11 Support to CPU Extension Detection (#19082) · b9a1791e
  Akash kaothalkar authored Jun 08, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  b9a1791e
- Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B (#19315) · 989dcee9
  Xu Wenqing authored Jun 08, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  989dcee9
- [Misc] Change tests/compile to use VLLM_V1 by default (#19302) · 3d64d366
  Richard Zou authored Jun 08, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  3d64d366
- [Bugfix] Re-enable use_cudagraph in vLLM v1 (#19299) · eaa2e510
  Richard Zou authored Jun 07, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  eaa2e510
- [Bugfix]: Fix TypeError: 'float' object cannot be interpreted as an integer (#19283) · d77f7fb8
  Chauncey authored Jun 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  d77f7fb8
07 Jun, 2025 10 commits
- [BugFix][V1] Fix memory profiling bug (#18974) · 2d8476e4
  Luka Govedič authored Jun 07, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  2d8476e4
- [AMD] Update compatible packaging version (#19309) · 88be823d
  pramenku authored Jun 07, 2025
```
Signed-off-by: pramkuma <Pramendra.Kumar@amd.com>
```
  88be823d
- [Nit][Benchmark]Fix example in benchmark_serving_structured_output.py (#19311) · 4e4f63ad
  Lifans authored Jun 07, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  4e4f63ad
- [CI/Build] Improve Llama GGUF test robustness (#19287) · d2f0e7e6
  Isotr0py authored Jun 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d2f0e7e6
- [Misc] refactor context extension (#19246) · 122cdca5
  Reid authored Jun 07, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  122cdca5
- Add FlexAttention to V1 (#16078) · cf02f9b2
  Driss Guessous authored Jun 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  cf02f9b2
- [CI][PowerPC] Use a more appropriate way to select testcase in... · c4296b1a
  Aaruni Aggarwal authored Jun 07, 2025
```
[CI][PowerPC] Use a more appropriate way to select testcase in tests/models/language/pooling/test_embedding.py (#19253)
Signed-off-by: Aaruni Aggarwal <aaruniagg@gmail.com>
```
  c4296b1a
- [TPU][Test] Add script to run benchmark on TPU for buildkite (#19039) · 66c508b1
  QiliangCui authored Jun 06, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  66c508b1
- [Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee
  ElizaWszola authored Jun 07, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  84166fee
- [Easy][Test] Simplify test_function_tool_use with multiple parametrizes (#19269) · 6e0cd10f
  Lu Fang authored Jun 07, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  6e0cd10f
06 Jun, 2025 22 commits
- [Build][ROCm] Update Dockerfile.rocm (#19296) · e010688f
  Alexei-V-Ivanov-AMD authored Jun 06, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  e010688f
- [Misc][Tools][Benchmark] Fix and improve auto tune script (#19163) · 441b65d8
  Chenyaaang authored Jun 06, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  441b65d8
- [BugFix] Fix tpu_model_runner block_id concatenation (#19228) · 46ecc579
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  46ecc579
- [Core] Fix abrupt request abort (#18485) · b6a3a9f7
  Nicolò Lucchesi authored Jun 07, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  b6a3a9f7
- [Bugfix][Core] Update cancellation logic in `generate()` to handle Generator exits (#19225) · ca27f0f9
  Adolfo Victoria authored Jun 06, 2025
```
Co-authored-by: Adolfo Victoria <adovi@meta.com>
```
  ca27f0f9
- [BugFix] Fix MultiConnector test after HMA changes (#19291) · aad30bd3
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aad30bd3
- Fixed ppc build when it runs on non-RHEL based linux distros (#18422) · 94ecee62
  Nishidha authored Jun 07, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
Signed-off-by: Md. Shafi Hussain <Md.Shafi.Hussain@ibm.com>
Signed-off-by: npanpaliya <nishidha.panpaliya@partner.ibm.com>
Co-authored-by: Md. Shafi Hussain <Md.Shafi.Hussain@ibm.com>
```
  94ecee62
- improve logits bias (#19041) · 8267f991
  Yu Guo authored Jun 06, 2025
  
  8267f991
- [Core] Raise when non-multi-instance DP clients target a DP rank (#19227) · 7353492a
  jmswen authored Jun 06, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  7353492a
- [Model] Optimize nemotron_h implementation (#19249) · 7661e92e
  Jee Jee Li authored Jun 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7661e92e
- Unit Test for run_dp_sharded_vision_model (#19103) · f168b857
  Siqi Yan authored Jun 06, 2025
```
Signed-off-by: Siqi Yan <siqi@meta.com>
Co-authored-by: Siqi Yan <siqi@meta.com>
```
  f168b857
- Fix CompilationConfig repr (#19091) · da511d54
  Richard Zou authored Jun 06, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  da511d54
- [Docs] Improve V1 KVConnector interface documentation (#19172) · 65c69444
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  65c69444
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- [TPU] fix kv cache dtype in model runner (#19244) · 0d49483e
  Chengji Yao authored Jun 06, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  0d49483e
- [v1][P/D] Fix a edge case in kv cache schedule (#19182) · 90b78ec5
  Jinghui Zhang authored Jun 05, 2025
```
Co-authored-by: jinghui <jinghui@fb.com>
```
  90b78ec5
- [Chore] update CODEOWNERS (#19247) · 91a2ef98
  Aaron Pham authored Jun 06, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  91a2ef98
- Support allowed_token_ids in ChatCompletionRequest (#19143) · 3da2313d
  Xu Song authored Jun 06, 2025
```
Signed-off-by: Xu Song <xusong.vip@gmail.com>
```
  3da2313d
- [TPU] update torch_xla pin (#19231) · b61dc5f9
  Chengji Yao authored Jun 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  b61dc5f9
- [v1] Hybrid Memory Allocator (#17996) · f8a1a2d1
  Chen Zhang authored Jun 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f8a1a2d1
- [Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033) · 3465b87e
  Benjamin Chislett authored Jun 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  3465b87e
- Fix AOPerModuleConfig name changes (#18869) · c8134bea
  Jerry Zhang authored Jun 05, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c8134bea