Commits · 3482fd7e4e52848644a85d70e20d468d8f44e12a · OpenDAS / vllm_cscc

10 Jul, 2025 1 commit
- [Doc] Add engine args back in to the docs (#20674) · 3482fd7e
  Harry Mellor authored Jul 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3482fd7e
09 Jul, 2025 1 commit
- [Kernel] Add Conch backend for mixed-precision linear layer (#19818) · bf03ff35
  Jacob Manning authored Jul 09, 2025
```
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
```
  bf03ff35
08 Jul, 2025 2 commits

Update torch/xla pin to 20250703 (#20589) · 849590a2
XiongfeiWei authored Jul 08, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
849590a2

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e

Sanger Steel authored Jul 08, 2025


[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>

72d14d0e

07 Jul, 2025 1 commit
- [Misc] Set the minimum openai version (#20539) · 4ff79a13
  Jee Jee Li authored Jul 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4ff79a13
04 Jul, 2025 1 commit
- [CI] add kvcache-connector dependency definition and add into CI build (#18193) · 5561681d
  Peter Pan authored Jul 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  5561681d
03 Jul, 2025 2 commits
- [Bugfix] Fix flaky `test_streaming_response` test (#20363) · d1b689c4
  Nicolò Lucchesi authored Jul 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d1b689c4
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
01 Jul, 2025 1 commit
- [Misc] add xgrammar for arm64 (#18359) · 22e9d420
  Prashant Gupta authored Jul 01, 2025
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  22e9d420
27 Jun, 2025 2 commits

[CI] Sync test dependency with test.in for torch nightly (#19632) · 8b64c895

Yang Wang authored Jun 26, 2025


Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

8b64c895

[Quantization] Bump to use latest `compressed-tensors` (#20033) · a57d57fa
Dipika Sikka authored Jun 26, 2025
```
Signed-off-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>
```
a57d57fa

26 Jun, 2025 2 commits
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
25 Jun, 2025 1 commit
- Move to a faster base64 implementation (#19984) · 3443aaf8
  h-avsha authored Jun 25, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  3443aaf8
19 Jun, 2025 1 commit
- [CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838) · 01220ce8
  Li, Jiang authored Jun 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  01220ce8
18 Jun, 2025 1 commit
- [TPU] Update torch-xla version to include paged attention tuned block change (#19813) · 04fefe7c
  QiliangCui authored Jun 18, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  04fefe7c
17 Jun, 2025 1 commit
- [TPU] Update torch version to include paged attention kernel change (#19706) · dac8cc49
  Chenyaaang authored Jun 17, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  dac8cc49
16 Jun, 2025 2 commits
- [MISC] bump huggingface_hub pkg to 0.33.0 (#19547) · c3fec47b
  Ning Xie authored Jun 16, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c3fec47b
- [CI] Add mteb testing for rerank models (#19344) · f40f763f
  wang.yuqi authored Jun 16, 2025
  
  f40f763f
15 Jun, 2025 1 commit
- [CI/Build] Fix torch nightly CI dependencies part 2 (#19589) · 91b2c17a
  Richard Zou authored Jun 15, 2025
  
  91b2c17a
13 Jun, 2025 2 commits
- [Fix] bump mistral common to support magistral (#19533) · ace5cdaf
  汪志鹏 authored Jun 13, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  ace5cdaf
- Revert "[Build/CI] Add tracing deps to vllm container image (#15224)" (#19378) · e6aab5de
  kourosh hakhamaneshi authored Jun 12, 2025
  
  e6aab5de
11 Jun, 2025 1 commit
- [CI/Build] Fix torch nightly CI dependencies (#19505) · 42f52cc9
  Richard Zou authored Jun 11, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  42f52cc9
10 Jun, 2025 1 commit
- Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930) · 9368cc90
  Louie Tsai authored Jun 09, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
```
  9368cc90
09 Jun, 2025 1 commit
- [Quantization] Bump compressed-tensors version (#19295) · ebb2f383
  Kyle Sayers authored Jun 09, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  ebb2f383
07 Jun, 2025 1 commit
- [AMD] Update compatible packaging version (#19309) · 88be823d
  pramenku authored Jun 07, 2025
```
Signed-off-by: pramkuma <Pramendra.Kumar@amd.com>
```
  88be823d
06 Jun, 2025 2 commits
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- [TPU] update torch_xla pin (#19231) · b61dc5f9
  Chengji Yao authored Jun 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  b61dc5f9
05 Jun, 2025 1 commit
- [Torch Nightly]add missing dependency (#18770) · 25b918ee
  Yang Wang authored Jun 04, 2025
```
Signed-off-by: Yang Wang <elainewy@meta.com>
```
  25b918ee
04 Jun, 2025 2 commits
- [CI/Build][Bugfix] Ensure compatibility with transformers 4.52 (#18678) · 01dc9a76
  Cyrus Leung authored Jun 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  01dc9a76
- [CPU] V1 support for the CPU backend (#16441) · 4555143e
  Li, Jiang authored Jun 04, 2025
  
  4555143e
03 Jun, 2025 3 commits
- [Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) · d32aa2e6
  Lu Fang authored Jun 03, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  d32aa2e6
- [V1] Support DP with Ray (#18779) · bdce64f2
  Rui Qiao authored Jun 02, 2025
  
  bdce64f2
- [ROCm][Build] Clean up the ROCm build (#19040) · 9e6f61e8
  Gregory Shtrasberg authored Jun 02, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  9e6f61e8
31 May, 2025 1 commit
- [BugFix] Pydantic part 2 (#18911) · c55d8046
  Luka Govedič authored May 31, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  c55d8046
29 May, 2025 2 commits
- [TPU] remove transpose ops in moe kernel (#18923) · a1cc9f33
  Chengji Yao authored May 29, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  a1cc9f33
- [BugFix] Update pydantic to fix error on python 3.10 (#18852) · f274581f
  Luka Govedič authored May 29, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  f274581f
27 May, 2025 2 commits
- [CI/Build] Remove imports of built-in `re` (#18750) · 4318c055
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4318c055
- [Build] fix cpu build missing libtbbmalloc.so (#18744) · e0f0ff87
  Kebe authored May 27, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  e0f0ff87
26 May, 2025 1 commit
- [Doc] Move examples and further reorganize user guide (#18666) · 82e2339b
  Cyrus Leung authored May 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82e2339b