Commits · a2142f01969a7c327da69be1e82a6c01a530116c · OpenDAS / vllm_cscc

"docker/Dockerfile.cpu" did not exist on "0b952af458ce86a69e58333f956081ab4b2665de"

11 Jun, 2025 14 commits
- Support non-string values in JSON keys from CLI (#19471) · a2142f01
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a2142f01
- [Misc] Reduce warning message introduced in env_override (#19476) · 871d6b7c
  Lu Fang authored Jun 11, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  871d6b7c
- [Doc] Support "important" and "announcement" admonitions (#19479) · 29a38f03
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  29a38f03
- [Doc] Fix quantization link titles (#19478) · a5115f4f
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a5115f4f
- [Doc] Update V1 User Guide for Hardware and Models (#19474) · 68b4a261
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68b4a261
- [Kernel] Support deep_gemm for linear methods (#19085) · b8e809a0
  artetaout authored Jun 11, 2025
```
Signed-off-by: artetaout <lulala341@gmail.com>
```
  b8e809a0
- [ROCm] Add rules to automatically label ROCm related PRs (#19405) · 5039ec23
  Lu Fang authored Jun 11, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  5039ec23
- Fix Typo in Documentation and Function Name (#19442) · 7c644ab6
  leopardracer authored Jun 11, 2025
  
  7c644ab6
- Add fused MOE config for Qwen3 30B A3B on B200 (#19455) · 2d40665f
  Junhao Li authored Jun 11, 2025
```
Signed-off-by: Junhao Li <junhao@ubicloud.com>
```
  2d40665f
- [Misc] Remove unused `MultiModalHasher.hash_prompt_mm_data` (#19422) · 96ada386
  Lukas Geiger authored Jun 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  96ada386
- [CI] Disable failing GGUF model test (#19454) · 1e473b30
  Michael Goin authored Jun 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1e473b30
- Fix test_max_model_len in tests/entrypoints/llm/test_generate.py (#19451) · 2b1e2111
  Lu Fang authored Jun 11, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  2b1e2111
- [BugFix] Fix docker build cpu-dev image error (#19394) · a45b979d
  niu_he authored Jun 11, 2025
```
Signed-off-by: niu_he <carlton2tang@gmail.com>
```
  a45b979d
- [New Model]: Support Qwen3 Embedding & Reranker (#19260) · 3952731e
  wang.yuqi authored Jun 11, 2025
  
  3952731e
10 Jun, 2025 22 commits
- [BugFix] Allow use_cudagraph to work with dynamic VLLM_USE_V1 (#19390) · 77f0d465
  Richard Zou authored Jun 10, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  77f0d465
- Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B-FP8 (#19401) · 22c3c0aa
  Xu Wenqing authored Jun 11, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  22c3c0aa
- [Model] use AutoWeightsLoader for commandr (#19399) · 33f8dba7
  py-andy-c authored Jun 10, 2025
```
Signed-off-by: py-andy-c <pychen1017@gmail.com>
```
  33f8dba7
- [ROCm][V1] Adding ROCm to the list of plaforms using V1 by default (#19440) · 5241ca50
  Gregory Shtrasberg authored Jun 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5241ca50
- [Docs] Note that alternative structured output backends are supported (#19426) · da9b523c
  Russell Bryant authored Jun 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  da9b523c
- [Misc] Slight improvement of the BNB (#19418) · b6553be1
  Jee Jee Li authored Jun 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b6553be1
- Simplify ep kernels installation (#19412) · 64a9af5a
  youkaichao authored Jun 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  64a9af5a
- [BugFix][CPU] Fix CPU CI by ignore collecting test_pixtral (#19411) · e4248849
  Li, Jiang authored Jun 10, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  e4248849
- [BugFix][FlashInfer] Fix attention backend interface mismatch with unexpected... · 467bef18
  Rachel Guo authored Jun 10, 2025
```
[BugFix][FlashInfer] Fix attention backend interface mismatch with unexpected keyword `use_irope` (#19134)
Signed-off-by: Yunqiu Guo <guorachel@meta.com>
```
  467bef18
- Revert "[v1] Add fp32 support to v1 engine through flex attn" (#19404) · 5f1ac1e1
  Isotr0py authored Jun 10, 2025
  
  5f1ac1e1
- Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930) · 9368cc90
  Louie Tsai authored Jun 09, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
```
  9368cc90
- Add clear documentation around the impact of debugging flag (#19369) · 32b3946b
  Anna Pendleton authored Jun 09, 2025
```
Signed-off-by: Anna Pendleton <pendleton@google.com>
```
  32b3946b
- [Misc] refactor neuron_multimodal and profiling (#19397) · 6b1391ca
  Reid authored Jun 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6b1391ca
- Add security warning to bug report template (#19365) · a3f66e75
  Russell Bryant authored Jun 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
```
  a3f66e75
- [Core] Batch multi modal input using pinned memory (#19169) · 319cb1e3
  Lukas Geiger authored Jun 10, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  319cb1e3
- [Bugfix] Fix modelscope token passed in (#19389) · 1efef716
  Li Wang authored Jun 10, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1efef716
- [Core] Use tuple for kv cache group block ids (#19175) · 646d62f6
  Nick Hill authored Jun 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  646d62f6
- [Frontend] Add tqdm_leave_pbar to control progress bar visibility (#19357) · 6cd4ae8a
  Reid authored Jun 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6cd4ae8a
- Fix docs/mkdocs/hooks/remove_announcement.py (#19382) · c016047e
  Harry Mellor authored Jun 10, 2025
  
  c016047e
- Use xla flag to improve the quantized model performance (#19303) · 9af6d22e
  XiongfeiWei authored Jun 09, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  9af6d22e
- [Bugfix] Fix benchmark_moe.py (#19016) · 4589b940
  Tianyu Guo authored Jun 10, 2025
```
Signed-off-by: Tianyu Guo <guoty9@mail2.sysu.edu.cn>
```
  4589b940
- [V1] Reuse V0's memory_profiling util for gpu worker memory profiling (#19312) · cc867be1
  Ye (Charlotte) Qi authored Jun 09, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  cc867be1
09 Jun, 2025 4 commits
- [Misc] Fix a config typo in disable_hybrid_kv_cache_manager configuration (#19383) · 3a7cd627
  Siyuan Liu authored Jun 09, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
```
  3a7cd627
- [HOT-FIX] Add `kv_sharing_target_layer_name` argument to cutlass_mla backend (#19374) · 8058c911
  Pavani Majety authored Jun 09, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  8058c911
- [TPU]Fix KV cache sharing tests (#19371) · 7d44c469
  Siyuan Liu authored Jun 09, 2025
  
  7d44c469
- [Frontend] Make TIMEOUT_KEEP_ALIVE configurable through env var (#18472) · 31f58be9
  liusiqian-tal authored Jun 10, 2025
```
Signed-off-by: liusiqian <liusiqian@tal.com>
```
  31f58be9