- 14 Apr, 2026 1 commit
-
-
Mark McLoughlin authored
[Core][Metrics][BugFix] Replace num_cached_tokens/num_external_computed_tokens with PrefillStats (#37460) Related to `Counters can only be incremented by non-negative amounts` error with the `vllm:prompt_tokens_by_source_total` metric. Signed-off-by:
Mark McLoughlin <markmc@redhat.com> Co-authored-by:
Or Ozeri <or@ozery.com>
-
- 13 Apr, 2026 3 commits
-
-
Monishver authored
Signed-off-by:
Monishver Chandrasekaran <monishverchandrasekaran@gmail.com> Co-authored-by:
mergify[bot] <37929162+mergify[bot]@users.noreply.github.com> Co-authored-by:
Nicolò Lucchesi <nlucches@redhat.com>
-
mukesh-hai authored
Signed-off-by:
Mukesh Baphna <mukesh@hippocraticai.com> Signed-off-by:
Mark McLoughlin <markmc@redhat.com> Co-authored-by:
Claude Sonnet 4.6 <noreply@anthropic.com> Co-authored-by:
Mark McLoughlin <markmc@redhat.com>
-
zhanqiuhu authored
Signed-off-by:ZhanqiuHu <zhu@redhat.com>
-
- 12 Apr, 2026 3 commits
-
-
Nicolò Lucchesi authored
The number of features supported by the connector has grown substantially and the `nixl_connector.py` file has accumulated a lot of code. Creates a separate directory and isolates connector/scheduler code in the hope of improving clarity and maintainability. Further refactor of components aimed at improving clarity and simplifying code will follow soon. Signed-off-by:NickLucche <nlucches@redhat.com>
-
Mark McLoughlin authored
Signed-off-by:Mark McLoughlin <markmc@redhat.com>
-
Martin Hickey authored
Signed-off-by:
Martin Hickey <martin.hickey@ie.ibm.com> Co-authored-by:
Or Ozeri <or@ozery.com>
-
- 11 Apr, 2026 1 commit
-
-
Yan Ma authored
Signed-off-by:
Yan Ma <yan.ma@intel.com> Co-authored-by:
Kunshang Ji <kunshang.ji@intel.com>
-
- 10 Apr, 2026 4 commits
-
-
zhanqiuhu authored
Signed-off-by:ZhanqiuHu <zhu@redhat.com>
-
Nicolò Lucchesi authored
Signed-off-by:NickLucche <nlucches@redhat.com>
-
Yan Ma authored
Signed-off-by:Yan Ma <yan.ma@intel.com>
-
Chauncey authored
Signed-off-by:chaunceyjiang <chaunceyjiang@gmail.com>
-
- 09 Apr, 2026 4 commits
-
-
Lucas Kabela authored
[Performance Improvement] Update `batched_count_greater_than` to handle batch size 1 without recompile (#38933) Signed-off-by:
Lucas Kabela <lucaskabela@meta.com> Co-authored-by:
Luka Govedič <ProExpertProg@users.noreply.github.com>
-
wang.yuqi authored
Signed-off-by:wang.yuqi <yuqi.wang@daocloud.io>
-
sihao_li authored
Signed-off-by:
sihao.li <sihao.li@intel.com> Co-authored-by:
Kunshang Ji <kunshang.ji@intel.com>
-
Chendi.Xue authored
Signed-off-by:Chendi Xue <chendi.xue@intel.com>
-
- 08 Apr, 2026 7 commits
-
-
Wentao Ye authored
Signed-off-by:yewentao256 <zhyanwentao@126.com>
-
triangleXIV authored
[BugFix] --max-model-len=-1 causes over-limit requests to hang and starve the entire service (#39102) Signed-off-by:
triangle14 <y1019026570@gmail.com> Signed-off-by:
mgoin <mgoin64@gmail.com> Co-authored-by:
mgoin <mgoin64@gmail.com>
-
Rishi Puri authored
Signed-off-by:
Rishi Puri <riship@nvidia.com> Signed-off-by:
Rishi Puri <puririshi98@berkeley.edu> Signed-off-by:
sfeng33 <4florafeng@gmail.com> Co-authored-by:
Benjamin Chislett <chislett.ben@gmail.com> Co-authored-by:
Flora Feng <4florafeng@gmail.com>
-
Wentao Ye authored
Signed-off-by:yewentao256 <zhyanwentao@126.com>
-
Or Ozeri authored
Signed-off-by:Or Ozeri <oro@il.ibm.com>
-
haosdent authored
Signed-off-by:haosdent <haosdent@gmail.com>
-
Giancarlo Delfin authored
Signed-off-by:Giancarlo Delfin <gdelfin@inferact.ai>
-
- 07 Apr, 2026 3 commits
-
-
ibifrost authored
Signed-off-by:
wuchenxin <wuchenxin.wcx@alibaba-inc.com> Signed-off-by:
ibifrost <47308427+ibifrost@users.noreply.github.com> Co-authored-by:
Simon Mo <simon.mo@hey.com>
-
Ronen Schaffer authored
Signed-off-by:Ronen Schaffer <ronen.schaffer@ibm.com>
-
Andreas Karatzas authored
Signed-off-by:Andreas Karatzas <akaratza@amd.com>
-
- 06 Apr, 2026 3 commits
-
-
zhanqiuhu authored
-
Walter Beller-Morales authored
Signed-off-by:walterbm <walter.beller.morales@gmail.com>
-
Julien Denize authored
Signed-off-by:juliendenize <julien.denize@mistral.ai>
-
- 05 Apr, 2026 2 commits
-
-
Greg Pereira authored
Signed-off-by:
greg pereira <grpereir@redhat.com> Signed-off-by:
Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by:
Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
-
Aaron Batilo authored
Signed-off-by:Aaron Batilo <abatilo@coreweave.com>
-
- 03 Apr, 2026 2 commits
-
-
Yusuf Mohammad authored
Signed-off-by:
yusuf <yusuf@deeplearningmachine.mynet> Signed-off-by: <> Co-authored-by:
yusuf <yusuf@deeplearningmachine.mynet>
-
wliao2 authored
Signed-off-by:Liao, Wei <wei.liao@intel.com>
-
- 02 Apr, 2026 2 commits
-
-
zhanqiuhu authored
-
wang.yuqi authored
Signed-off-by:wang.yuqi <yuqi.wang@daocloud.io>
-
- 01 Apr, 2026 5 commits
-
-
Chauncey authored
Signed-off-by:chaunceyjiang <chaunceyjiang@gmail.com>
-
yzong-rh authored
Signed-off-by:
Yifan <yzong@redhat.com> Co-authored-by:
Nicolò Lucchesi <nlucches@redhat.com>
-
Lucas Wilkinson authored
Signed-off-by:Lucas Wilkinson <lwilkins@redhat.com>
-
HarshRathva authored
Signed-off-by:
HarshRathva <harshrathvaai@gmail.com> Co-authored-by:
Or Ozeri <oro@il.ibm.com>
-
Yifan Qiao authored
Signed-off-by:
Yifan Qiao <yifanqiao@berkeley.edu> Signed-off-by:
Yifan Qiao <yifanqiao@inferact.ai>
-