Commits · 34120f5acd693924cc783dfaa33733afbe9ae8b0 · OpenDAS / vllm_cscc · GitLab

30 Apr, 2025 1 commit
- [V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702) · 34120f5a
  Benjamin Chislett authored Apr 29, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  34120f5a
29 Apr, 2025 38 commits
- Remove Bamba 9B from CI (#17407) · 7489ec0b
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7489ec0b
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
- Fix: Python package installation for opentelmetry (#17049) · c9c1b59e
  Dilip Gowda Bhagavan authored Apr 30, 2025
```
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
```
  c9c1b59e
- Remove Falcon3 2x7B from CI (#17404) · 0350809f
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0350809f
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
- [CI/Build] Add retry mechanism for add-apt-repository (#17107) · 08e15def
  Reid authored Apr 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  08e15def
- [CI] Uses Python 3.11 for TPU (#17359) · b37685af
  Aaron Pham authored Apr 29, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  b37685af
- [TPU][V1][CI] Replace `python3 setup.py develop` with standard `pip install --e` on TPU (#17374) · 792595b5
  Nicolò Lucchesi authored Apr 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  792595b5
- [Doc][Typo] Fixing label in new model requests link in overview.md (#17400) · 0c1c7883
  casinca authored Apr 29, 2025
  
  0c1c7883
- [Docs] Propose a deprecation policy for the project (#17063) · 56d64fbe
  Russell Bryant authored Apr 29, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  56d64fbe
- Enabling multi-group kernel tests. (#17115) · 608968b7
  Alexei-V-Ivanov-AMD authored Apr 29, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  608968b7
- [Misc][ROCm] Exclude `cutlass_mla_decode` for ROCm build (#17289) · 06ffc7e1
  TY-AMD authored Apr 30, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  06ffc7e1
- fix gemma3 results all zero (#17364) · d3cf61b8
  Qiming Zhang authored Apr 29, 2025
```
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
```
  d3cf61b8
- [Bugfix] add qwen3 reasoning-parser fix content is None when disable … (#17369) · a39203f9
  mofanke authored Apr 30, 2025
```
Signed-off-by: mofanke <mofanke@gmail.com>
```
  a39203f9
- [V1] Remove num_input_tokens from attn_metadata (#17193) · 24e6ad3f
  Chen Zhang authored Apr 30, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  24e6ad3f
- Improve literal dataclass field conversion to argparse argument (#17391) · 2ef5d106
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2ef5d106
- Fix: Spelling of inference (#17387) · 0ed27ef6
  a2q1p authored Apr 30, 2025
  
  0ed27ef6
- Transformers backend tweaks (#17365) · 900edfa8
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  900edfa8
- [Frontend] Support `chat_template_kwargs` in `LLM.chat` (#17356) · 88ad9ec6
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  88ad9ec6
- `pre-commit autoupdate` (#17380) · 40896bdf
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  40896bdf
- [Bugfix] Clean up MiniMax-VL and fix processing (#17354) · 00ee37ef
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00ee37ef
- [Doc] Fix QWen3MOE info (#17381) · 890f104c
  Jee Jee Li authored Apr 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  890f104c
- Update docs requirements (#17379) · 4a5e1314
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4a5e1314
- [Model] Ignore rotary embed load for Cohere model (#17319) · 97cc8729
  Ekagra Ranjan authored Apr 29, 2025
  
  97cc8729
- [Build][Bugfix] Restrict setuptools version to <80 (#17320) · 44641092
  Gregory Shtrasberg authored Apr 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  44641092
- [Fix] Documentation spacing in compilation config help text (#17342) · 193e78e3
  Hyogeun Oh (오효근) authored Apr 29, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  193e78e3
- [Misc]Use a platform independent interface to obtain the device attributes (#17100) · bdb2cdda
  ponix-j authored Apr 29, 2025
  
  bdb2cdda
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
- [Model] support MiniMax-VL-01 model (#16328) · cde384cd
  qscqesze authored Apr 29, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  cde384cd
- [Misc] Add a Jinja template to support Mistral3 function calling (#17195) · 96e06e3c
  Chauncey authored Apr 29, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  96e06e3c
- [Bugfix] Add contiguous call inside rope kernel wrapper (#17091) · 17eb306f
  Zhengyuan Su (苏政渊) authored Apr 29, 2025
```
Signed-off-by: 苏政渊 <suzhengyuan@moonshot.cn>
Co-authored-by: 苏政渊 <suzhengyuan@moonshot.cn>
```
  17eb306f
- Ignore `'<string>'` filepath (#17330) · 165cb563
  Richard Zou authored Apr 28, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  165cb563
- [Bugfix] Fix `numel()` downcast in fused_layernorm_dynamic_per_token_quant.cu (#17316) · d6da8a8f
  Richard Barnes authored Apr 28, 2025
  
  d6da8a8f
- [model] make llama4 compatible with pure dense layers (#17315) · b4ac4fa0
  Lucia Fang authored Apr 28, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  b4ac4fa0
- [V1][Spec Decode] Make Eagle model arch config driven (#17323) · e1360005
  Ekagra Ranjan authored Apr 28, 2025
  
  e1360005
- implement Structural Tag with Guidance backend (#17333) · 86d9fc29
  Michał Moskal authored Apr 28, 2025
```
Signed-off-by: Michal Moskal <michal@moskal.me>
```
  86d9fc29
- [Optim] Compute multimodal hash only once per item (#17314) · 506475de
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  506475de
28 Apr, 2025 1 commit
- [Benchmark] Add single turn MTBench to Serving Bench (#17202) · cfe45320
  Ekagra Ranjan authored Apr 28, 2025
  
  cfe45320