Commits · fdadb6f43a3fbba1e0bedfb904ef920257963c50 · OpenDAS / vllm_cscc

"docs/contributing/dockerfile/dockerfile.md" did not exist on "8ceffbf3152d3b26d293ba1e157d0c187884572b"

10 Jul, 2025 29 commits
- [Bugfix] Fused MoE Modular Kernel chunking loop (#20392) · fdadb6f4
  Varun Sundar Rabindranath authored Jul 10, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fdadb6f4
- [Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126) · 41060c6e
  Alex Brooks authored Jul 10, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  41060c6e
- [Bugfix] Remove assertion of expert_map being None (#20714) · 3de2ed76
  Ming Yang authored Jul 10, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3de2ed76
- [CI] Fix pre commit issue (#20782) · 299252ea
  Wentao Ye authored Jul 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  299252ea
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
- [Bugfix] [CI] Fix Tensorizer LoRA test (#20760) · 5e53c89a
  Sanger Steel authored Jul 10, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  5e53c89a
- [Test] Remove docker build from test. (#20542) · c66e38ea
  QiliangCui authored Jul 10, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  c66e38ea
- Fix DeepSeek-R1-0528 chat template (#20717) · 25159536
  sfbemerk authored Jul 10, 2025
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
```
  25159536
- [Model][VLM] Support JinaVL Reranker (#20260) · 4bed1677
  shineran96 authored Jul 11, 2025
```
Signed-off-by: shineran96 <shinewang96@gmail.com>
```
  4bed1677
- [Model] Add reason parser for Hunyuan A13B Model. (#20625) · b140416a
  Asher authored Jul 11, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  b140416a
- [ROCm][Regression] Remove tensor creation that harms performance on ROCm (#20741) · 5b8366b6
  Gregory Shtrasberg authored Jul 10, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5b8366b6
- [Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129) · c7753a98
  nishith-fujitsu authored Jul 10, 2025
```
Signed-off-by: nishith-fujitsu <nishith.jaiswal@fujitsu.com>
```
  c7753a98
- Update Dockerfile FlashInfer to v0.2.8rc1 (#20718) · 4b9a9435
  Michael Goin authored Jul 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4b9a9435
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
- [Misc] Clean up mark to fork process in BNB tests (#20692) · 77f77a95
  Isotr0py authored Jul 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  77f77a95
- Normalize lm-eval command between baseline and correctness test (#18560) · 1a4f35e2
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1a4f35e2
- [CI Bugfix] Skip failing Tensorizer+LoRA test (#20724) · be1e128d
  Michael Goin authored Jul 10, 2025
  
  be1e128d
- [doc] fix ordered list (#20749) · 65393ee0
  Reid authored Jul 10, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  65393ee0
- [Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA... · dc221ad7
  Gregory Shtrasberg authored Jul 10, 2025
```
[Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA where it is defined (#20738)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  dc221ad7
- [CI/Build] Fix Basic Models Test (#20728) · 7571a4a7
  Jee Jee Li authored Jul 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7571a4a7
- [Misc] loose new-model tagger conditions (#20747) · f67d986d
  Isotr0py authored Jul 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f67d986d
- [KVConnector] Aggregate finished requests on the scheduler (#19555) · cc876d0f
  Or Ozeri authored Jul 10, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cc876d0f
- [TPU][Core]Make load weight exceed hbm error more instructive for customers (#20644) · fdfd409f
  Chenyaaang authored Jul 10, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  fdfd409f
- [BugFix] Fix `VllmConfig()` construction on all platforms (#20695) · ffbcc9e7
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ffbcc9e7
- [BugFix][CPU] Fix CPU worker dependency on cumem_allocator (#20696) · 59389c92
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  59389c92
- [Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629) · 8f2720de
  Chauncey authored Jul 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8f2720de
- Correct PPMissingLayer handling in Deepseek-V2-Lite PP deployment (#20665) · ad6c2e1a
  Seiji Eicher authored Jul 09, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  ad6c2e1a
- Use NVCC `--compress-mode` to reduce binary size by 30% (#20694) · 49e8c7ea
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  49e8c7ea
- [Misc] DP : Add ExpertTokensMetadata (#20332) · 805d62ca
  Varun Sundar Rabindranath authored Jul 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  805d62ca
09 Jul, 2025 11 commits
- [CI/Build] Fix FlashInfer double build in Dockerfile (#20651) · b7d9e941
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b7d9e941
- [Misc] Simplify the prefix caching logic on draft tokens (#20701) · 7c12a765
  Woosuk Kwon authored Jul 09, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7c12a765
- [BugFix]: Properly set engine_id when using multi connector (#19487) · cd587c93
  Yiming authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: leiyiming <leiyiming@kingsoft.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  cd587c93
- [Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1
  fxmarty-amd authored Jul 09, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
```
  332d4cb1
- [Kernel] Add Conch backend for mixed-precision linear layer (#19818) · bf03ff35
  Jacob Manning authored Jul 09, 2025
```
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
```
  bf03ff35
- [Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6
  Tuan, Hoang-Trong authored Jul 09, 2025
```
Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  47043eb6
- Support Llama 4 for cutlass_moe_fp4 (#20453) · 31b96d1c
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  31b96d1c
- [CI/Build] Enlarge tolerance for a CPU multi-modal test (#20684) · e59ba9e1
  Li, Jiang authored Jul 10, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e59ba9e1
- Remove heading form installation `inc.md` file (#20697) · 403b4815
  Harry Mellor authored Jul 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  403b4815
- [Doc] Update CPU doc (#20676) · 138709f8
  Li, Jiang authored Jul 10, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  138709f8
- [Bench] Add NVFP4 GEMM benchmark script (#20578) · 0bbac1c1
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0bbac1c1