Commits · 74bc397b0a8c092089bdd21e3ec9130336797471 · OpenDAS / vllm_cscc · GitLab

15 Mar, 2025 19 commits
- [Core] Expose API endpoint `/is_sleeping` (#14312) · 74bc397b
  Jun Duan authored Mar 15, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  74bc397b
- [CI][Intel GPU] refine intel GPU ci docker build (#14860) · f58aea00
  Kunshang Ji authored Mar 15, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f58aea00
- [VLM] Limit multimodal input cache by memory (#14805) · 3556a414
  Cyrus Leung authored Mar 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3556a414
- [Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
  Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  9ed6ee92
- [Build/CI] Upgrade jinja2 to get 3 moderate CVE fixes (#14839) · ee3778d5
  Russell Bryant authored Mar 15, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ee3778d5
- [Doc] V1 user guide (#13991) · aaacf173
  Jennifer Zhao authored Mar 14, 2025
```
Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Jennifer Zhao <JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  aaacf173
- [V1][Structured Output] calculate vocab_size eagerly (#14851) · 4c7629ca
  Aaron Pham authored Mar 15, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  4c7629ca
- [CI/Build] Delete LoRA bias test (#14849) · e0fdfa16
  Jee Jee Li authored Mar 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e0fdfa16
- [Attention] Get rid of mla cache alignment (#14842) · 5952d8ab
  Lucas Wilkinson authored Mar 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5952d8ab
- [CPU] Support FP8 KV cache (#14741) · a2ae4965
  Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a2ae4965
- [Docs] Add new East Coast vLLM Meetup slides to README and meetups.md (#14852) · 877e3522
  Simon Mo authored Mar 14, 2025
  
  877e3522
- [V1] V1 Enablement Oracle (#13726) · d4d93db2
  Robert Shaw authored Mar 15, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  d4d93db2
- [Misc][Easy] Annotate unused vars in the csrc files (#14798) · 8c0d15d5
  Lu Fang authored Mar 14, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8c0d15d5
- [Misc] Remove misleading message in gemma2 and gemma3 (#14850) · 97ac781c
  Isotr0py authored Mar 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  97ac781c
- Disable outlines cache by default (#14837) · 776dcec8
  Russell Bryant authored Mar 14, 2025
  
  776dcec8
- Revert "[Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of U… (#14848) · ccf02fcb
  Tyler Michael Smith authored Mar 14, 2025
  
  ccf02fcb
- [Bugfix][V1] Fix flashinfer sampling (#14815) · acaea3bb
  DefTruth authored Mar 15, 2025
  
  acaea3bb
- [Neuron][CI] update docker run command (#14829) · 9f374227
  Liangfu Chen authored Mar 14, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  9f374227
- [Bugfix] Fix torch_xla in V0 which can't handle None seed introduced … (#14844) · dd344e03
  yarongmu-google authored Mar 14, 2025
```
Signed-off-by: Yarong Mu <ymu@google.com>
```
  dd344e03
14 Mar, 2025 21 commits
- [Doc] More neutral K8s deployment guide (#14084) · 54a88044
  Yuan Tang authored Mar 14, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  54a88044
- [Build/CI] Upgrade aiohttp to incldue CVE fix (#14840) · bbd94a19
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  bbd94a19
- [Build/CI] Move ninja to common deps (#14835) · 233ffce1
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  233ffce1
- [CI] Add TPU v1 test (#14834) · 40677783
  Richard Liu authored Mar 14, 2025
```
Signed-off-by: Richard Liu <ricliu@google.com>
```
  40677783
- Update to torch==2.6.0 (#12721) · 14f301b5
  Michael Goin authored Mar 14, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: luka <luka@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  14f301b5
- [V1] Fix model parameterization for structured output tests (#14833) · 46f98893
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  46f98893
- [Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of Unnecessary Memory Copies (#14778) · fe66b347
  Chih-Chieh Yang authored Mar 14, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  fe66b347
- Re-enable the AMD Entrypoints Test (#14711) · 270a5da4
  Alexei-V-Ivanov-AMD authored Mar 14, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  270a5da4
- [release] Remove log cleanup commands from TPU job (#14838) · 7097b4cc
  Kevin H. Luu authored Mar 14, 2025
  
  7097b4cc
- [Bugfix][Kernel]: Fix AllSpark kernel compilation errors and enable for CUDA < 12.0 (#14430) · 977a1677
  Yajie Wang authored Mar 15, 2025
```
Signed-off-by: wyj371990 <wyj371990@alibaba-inc.com>
```
  977a1677
- [Frontend] track server_load (#13950) · 73deea2f
  daniel-salib authored Mar 14, 2025
  
  73deea2f
- [V1][Metrics] Updated list of deprecated metrics in v0.8 (#14695) · 9d2b4a70
  Mark McLoughlin authored Mar 14, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  9d2b4a70
- [Frontend] Fix log message to use http vs https (#14774) · 0b0d6421
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  0b0d6421
- [V1] Fix vocab size calculation for structured output (#14826) · 1140991a
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  1140991a
- [Bugfix] Fix Aria test loading (#14823) · 613c5bb9
  Cyrus Leung authored Mar 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  613c5bb9
- [BugFix]: properly catch templating error when preprocess input (#13976) · fd8e055f
  Guillaume Calmettes authored Mar 14, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  fd8e055f
- [VLM] Various cleanup and fixes (#14806) · ab93f136
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ab93f136
- [Bugfix][W8A8] fixed cutlass block fp8 binding (#14796) · 40253bab
  DefTruth authored Mar 14, 2025
  
  40253bab
- [V1][Minor] Minor code cleanup for scheduling metrics (#14800) · c77620d2
  Woosuk Kwon authored Mar 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c77620d2
- [Misc] Gemma3ForConditionalGeneration supports LoRA (#14797) · 989ecd20
  Jee Jee Li authored Mar 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  989ecd20
- [Bugfix] Fix small typo in the example of Streaming delimiter (#14793) · 54cc46f3
  WeiCheng authored Mar 14, 2025
  
  54cc46f3