Commits · dd3b865854c21c99ebc5d1bd34c12936002174c2 · OpenDAS / vllm_cscc

17 Mar, 2025 12 commits
- [Doc] Add vLLM Beijing meetup slide (#14938) · dd3b8658
  Chen Zhang authored Mar 17, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  dd3b8658
- [Misc][XPU] Use None as device capacity for XPU (#14932) · 9b87a579
  Yan Ma authored Mar 17, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  9b87a579
- [V1] Remove input cache client (#14864) · b539222d
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  b539222d
- [V1] [Spec Decode] Support random sampling for spec decode (#13933) · 8d6cf895
  Lily Liu authored Mar 16, 2025
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8d6cf895
- [Benchmark] Do not save detailed info to json by default (#14879) · 583a9778
  Simon Mo authored Mar 16, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  583a9778
- [Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e
  Sibi authored Mar 17, 2025
```
Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  a73e183e
- [BugFix] Fix MLA + V1 + TP==1 causing reinitialization of cuda context (#14910) · 1e799b7e
  Lucas Wilkinson authored Mar 16, 2025
  
  1e799b7e
- [V1][Minor] Add __repr__ to ConstantList (#14907) · 7f6c5ee0
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f6c5ee0
- [V1] Optimize the overhead of rewinding (#14905) · faa02757
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  faa02757
- [CI/Build] Update defaults for test reproducibility (#14893) · 8a5a9b70
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a5a9b70
- [CI] Nightly Tests (#14898) · bb3aeddf
  Robert Shaw authored Mar 16, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  bb3aeddf
- [V1] Enable Entrypoints Tests (#14903) · aecc780d
  Robert Shaw authored Mar 16, 2025
  
  aecc780d
16 Mar, 2025 13 commits
- [Doc] Add guidance for using `ccache` with `pip install -e .` in doc (#14901) · 90df7f23
  Vadim Gimpelson authored Mar 17, 2025
  
  90df7f23
- [Misc] Catching Ray Compiled Graph PP test failures for V1 (#14847) · b9b5bdfc
  Rui Qiao authored Mar 16, 2025
  
  b9b5bdfc
- [V1][BugFix] Detect interleaved sliding window attention (#14896) · 31060b27
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  31060b27
- [BugFix][V1] Fix overhead related to bad_words sampling when not in use (#14894) · fc1f6771
  Nick Hill authored Mar 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  fc1f6771
- Revert "[Bugfix] Limit profiling run sequence length by max_model_len (#14785) (#14892) · f6137adb
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6137adb
- [Bugfix] Explicitly disable Phi-4-multimodal in V1 (#14889) · e53b1350
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e53b1350
- [Bugfix] Limit profiling run sequence length by max_model_len (#14785) · d30aa7e9
  Kyle Sayers authored Mar 16, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d30aa7e9
- [V1] [Spec Decode] Fix ngram tests (#14878) · d1ad2a57
  Lily Liu authored Mar 16, 2025
  
  d1ad2a57
- [BugFix] Fix torch distributed stateless PG backend init (#14870) · b82662d9
  Nick Hill authored Mar 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b82662d9
- [Kernel] Add more tuned configs (#14877) · 71c1e071
  Simon Mo authored Mar 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  71c1e071
- [V1] Remove V0 fallback for mistral-tokenizer (#14873) · b30c75dd
  Roger Wang authored Mar 15, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b30c75dd
- [VLM] Clean up Phi-4-MM ViT implementation (#14812) · def232e1
  Isotr0py authored Mar 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  def232e1
- [Misc][Doc] Minor benchmark README update (#14874) · 3453b964
  Roger Wang authored Mar 15, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  3453b964
15 Mar, 2025 15 commits

[VLM] Merged multi-modal processor for Pixtral (#12211) · 61c6a5a7

Rémi Delacourt authored Mar 15, 2025


Signed-off-by: remi <remi@mistral.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

61c6a5a7

[Core] Expose API endpoint `/is_sleeping` (#14312) · 74bc397b
Jun Duan authored Mar 15, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
74bc397b
[CI][Intel GPU] refine intel GPU ci docker build (#14860) · f58aea00
Kunshang Ji authored Mar 15, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
f58aea00
[VLM] Limit multimodal input cache by memory (#14805) · 3556a414
Cyrus Leung authored Mar 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
3556a414
[Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
9ed6ee92
[Build/CI] Upgrade jinja2 to get 3 moderate CVE fixes (#14839) · ee3778d5
Russell Bryant authored Mar 15, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
ee3778d5

[Doc] V1 user guide (#13991) · aaacf173

Jennifer Zhao authored Mar 14, 2025


Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Jennifer Zhao <JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

aaacf173

[V1][Structured Output] calculate vocab_size eagerly (#14851) · 4c7629ca
Aaron Pham authored Mar 15, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
4c7629ca
[CI/Build] Delete LoRA bias test (#14849) · e0fdfa16
Jee Jee Li authored Mar 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
e0fdfa16
[Attention] Get rid of mla cache alignment (#14842) · 5952d8ab
Lucas Wilkinson authored Mar 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
5952d8ab
[CPU] Support FP8 KV cache (#14741) · a2ae4965
Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
a2ae4965
[Docs] Add new East Coast vLLM Meetup slides to README and meetups.md (#14852) · 877e3522
Simon Mo authored Mar 14, 2025

877e3522

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

[Misc][Easy] Annotate unused vars in the csrc files (#14798) · 8c0d15d5
Lu Fang authored Mar 14, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
8c0d15d5
[Misc] Remove misleading message in gemma2 and gemma3 (#14850) · 97ac781c
Isotr0py authored Mar 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
97ac781c