Commits · 1129e2b1abc50edd5038cafb185b7c2456e07e65 · OpenDAS / vllm_cscc

"docs/serving/offline_inference.md" did not exist on "98834fefaaabe7219e35499ada8d6026a1f9b6a2"

12 Jun, 2025 14 commits
- [V1][NixlConnector] Drop `num_blocks` check (#19532) · 1129e2b1
  Nicolò Lucchesi authored Jun 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  1129e2b1
- [Doc] Add V1 column to supported models list (#19523) · c742438f
  Cyrus Leung authored Jun 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c742438f
- [Quantization] Improve AWQ logic (#19431) · 73e2e011
  Jee Jee Li authored Jun 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  73e2e011
- [Bugfix] Respect num-gpu-blocks-override in v1 (#19503) · c9280e63
  jmswen authored Jun 12, 2025
```
Signed-off-by: Jon Swenson <jmswen@gmail.com>
```
  c9280e63
- [Bugfix][V1] Allow manual FlashAttention for Blackwell (#19492) · af09b3f0
  Michael Goin authored Jun 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  af09b3f0
- [Security] Prevent new imports of (cloud)pickle (#18018) · 4f6c42fa
  Russell Bryant authored Jun 12, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Aaron Pham <Aaronpham0103@gmail.com>
```
  4f6c42fa
- Fix typo (#19525) · dff68000
  niu_he authored Jun 12, 2025
```
Signed-off-by: 2niuhe <carlton2tang@gmail.com>
```
  dff68000
- [AMD][Kernel][BugFix] fix test_rocm_compressed_tensors_w8a8 for rocm (#19509) · 2e090bd5
  rasmith authored Jun 12, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2e090bd5
- [BugFix] Handle missing sep_token for Qwen3-Reranker in Score API (#19522) · 1b0b065e
  wonjun Jang authored Jun 12, 2025
```
Signed-off-by: strutive07 <strutive07@gmail.com>
```
  1b0b065e
- [BugFix] Work-around incremental detokenization edge case error (#19449) · d5bdf899
  Nick Hill authored Jun 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d5bdf899
- [Frontend] Improve error message in tool_choice validation (#19239) · 7e3e74c9
  22quinn authored Jun 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  7e3e74c9
- Add Triton Fused MoE kernel config for E=16 on B200 (#19518) · 3f6341bf
  Brayden Zhong authored Jun 12, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  3f6341bf
- [BugFix] Force registration of w8a8_block_fp8_matmul_deepgemm via lazy import (#19514) · e5d35d62
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e5d35d62
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 26 commits
- [CI/Build] Fix torch nightly CI dependencies (#19505) · 42f52cc9
  Richard Zou authored Jun 11, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  42f52cc9
- [UX] Add Feedback During CUDAGraph Capture (#19501) · 97a9465b
  Robert Shaw authored Jun 11, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  97a9465b
- [AMD] [Quantization] Add override flag for attention dtype instead of using... · c7ea0b56
  rasmith authored Jun 11, 2025
```
[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger (#17331)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  c7ea0b56
- [Kernels] Add activation chunking logic to FusedMoEModularKernel (#19168) · 29fa5cac
  bnellnm authored Jun 11, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  29fa5cac
- [Docs] Remove WIP features in V1 guide (#19498) · b2d9be6f
  Woosuk Kwon authored Jun 11, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b2d9be6f
- [Misc] Fix misleading ROCm warning (#19486) · 04a55612
  Jee Jee Li authored Jun 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  04a55612
- [doc] fix "Other AI accelerators" getting started page (#19457) · 89b0f84e
  David Xia authored Jun 11, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  89b0f84e
- [CI] Update FlashInfer to 0.2.6.post1 (#19297) · 497a91e9
  Michael Goin authored Jun 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  497a91e9
- [Bugfix] Update the example code, make it work with the latest lmcache (#19453) · 943ffa57
  runzhen authored Jun 11, 2025
```
Signed-off-by: Runzhen Wang <wangrunzhen@gmail.com>
```
  943ffa57
- Support no privileged mode on CPU for docker and kubernetes deployments (#19241) · 5c8d34a4
  Louie Tsai authored Jun 11, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
  5c8d34a4
- Fix some typo (#19475) · 3c8694ea
  Ximingwang-09 authored Jun 11, 2025
```
Signed-off-by: ximing.wxm <ximing.wxm@antgroup.com>
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  3c8694ea
- Add cache to cuda get_device_capability (#19436) · 7484e1fc
  Michael Goin authored Jun 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7484e1fc
- Support non-string values in JSON keys from CLI (#19471) · a2142f01
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a2142f01
- [Misc] Reduce warning message introduced in env_override (#19476) · 871d6b7c
  Lu Fang authored Jun 11, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  871d6b7c
- [Doc] Support "important" and "announcement" admonitions (#19479) · 29a38f03
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  29a38f03
- [Doc] Fix quantization link titles (#19478) · a5115f4f
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a5115f4f
- [Doc] Update V1 User Guide for Hardware and Models (#19474) · 68b4a261
  Cyrus Leung authored Jun 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  68b4a261
- [Kernel] Support deep_gemm for linear methods (#19085) · b8e809a0
  artetaout authored Jun 11, 2025
```
Signed-off-by: artetaout <lulala341@gmail.com>
```
  b8e809a0
- [ROCm] Add rules to automatically label ROCm related PRs (#19405) · 5039ec23
  Lu Fang authored Jun 11, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  5039ec23
- Fix Typo in Documentation and Function Name (#19442) · 7c644ab6
  leopardracer authored Jun 11, 2025
  
  7c644ab6
- Add fused MOE config for Qwen3 30B A3B on B200 (#19455) · 2d40665f
  Junhao Li authored Jun 11, 2025
```
Signed-off-by: Junhao Li <junhao@ubicloud.com>
```
  2d40665f
- [Misc] Remove unused `MultiModalHasher.hash_prompt_mm_data` (#19422) · 96ada386
  Lukas Geiger authored Jun 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  96ada386
- [CI] Disable failing GGUF model test (#19454) · 1e473b30
  Michael Goin authored Jun 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1e473b30
- Fix test_max_model_len in tests/entrypoints/llm/test_generate.py (#19451) · 2b1e2111
  Lu Fang authored Jun 11, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  2b1e2111
- [BugFix] Fix docker build cpu-dev image error (#19394) · a45b979d
  niu_he authored Jun 11, 2025
```
Signed-off-by: niu_he <carlton2tang@gmail.com>
```
  a45b979d
- [New Model]: Support Qwen3 Embedding & Reranker (#19260) · 3952731e
  wang.yuqi authored Jun 11, 2025
  
  3952731e