Commits · a4d577b37944cbfa1bc62e4869667d1e2739d62a · OpenDAS / vllm_cscc · GitLab

18 Feb, 2025 17 commits
- [V1][PP] Enable true PP with Ray executor (#13472) · 4fb8142a
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4fb8142a
- [Bugfix] Handle content type with optional parameters (#13383) · d3231cb4
  zifeitong authored Feb 18, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  d3231cb4
- [ROCm] Make amdsmi import optional for other platforms (#13460) · 435b502a
  Cyrus Leung authored Feb 18, 2025
  
  435b502a
- [Bugfix] Remove noisy error logging during local model loading (#13458) · 29fc5772
  Isotr0py authored Feb 18, 2025
  
  29fc5772
- [Bugfix] Fix failing transformers dynamic module resolving with spawn multiproc method (#13403) · 8cf97f86
  Isotr0py authored Feb 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8cf97f86
- [Bugfix] Ensure LoRA path from the request can be included in err msg (#13450) · e2603fef
  Yuan Tang authored Feb 18, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  e2603fef
- Add outlines fallback when JSON schema has enum (#13449) · b53d7998
  Michael Goin authored Feb 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b53d7998
- [Quant] Aria SupportsQuant (#13416) · d1b649f1
  Kyle Sayers authored Feb 18, 2025
  
  d1b649f1
- [core] fix sleep mode in pytorch 2.6 (#13456) · ac19b519
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ac19b519
- [Bugfix] Only print out chat template when supplied (#13444) · a1074b3e
  Yuan Tang authored Feb 18, 2025
  
  a1074b3e
- [Quant] Arctic SupportsQuant (#13366) · 00294e1b
  Kyle Sayers authored Feb 18, 2025
  
  00294e1b
- [Quant] Molmo SupportsQuant (#13336) · 88787bce
  Kyle Sayers authored Feb 18, 2025
  
  88787bce
- [v1] fix parallel config rank (#13445) · 932b51ce
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  932b51ce
- [ROCm] fix get_device_name for rocm (#13438) · 7c7adf81
  Divakar Verma authored Feb 17, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  7c7adf81
- [Model] Enable quantization support for `transformers` backend (#12960) · 67ef8f66
  Isotr0py authored Feb 18, 2025
  
  67ef8f66
- [Misc] Remove dangling references to `SamplingType.BEAM` (#13402) · efbe8544
  Harry Mellor authored Feb 18, 2025
  
  efbe8544
- [Bugfix][CI][V1] Work around V1 + CUDA Graph + torch._scaled_mm fallback issue (#13425) · b3942e15
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  b3942e15
17 Feb, 2025 10 commits
- [V1][Spec decode] Move drafter to model runner (#13363) · cd4a72a2
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cd4a72a2
- [V1][PP] Fix intermediate tensor values (#13417) · 6ac485a9
  Cody Yu authored Feb 17, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  6ac485a9
- [V1] Get input tokens from scheduler (#13339) · 4c21ce9e
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c21ce9e
- [Bugfix] Fix VLLM_USE_MODELSCOPE issue (#13384) · ce77eb94
  r.4ntix authored Feb 17, 2025
  
  ce77eb94
- [Bugfix] fix xpu communicator (#13368) · 30513d1c
  Yan Ma authored Feb 17, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  30513d1c
- [Model] Support Mamba2 (Codestral Mamba) (#9292) · 1f69c4a8
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  1f69c4a8
- [VLM] Check required fields before initializing field config in `DictEmbeddingItems` (#13380) · 7b623fca
  Cyrus Leung authored Feb 17, 2025
  
  7b623fca
- [MISC] tiny fixes (#13378) · 238dfc8a
  Mengqing Cao authored Feb 17, 2025
  
  238dfc8a
- [Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304) · 46cdd595
  shangmingc authored Feb 17, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  46cdd595
- [V1][Misc] Avoid unnecessary log output (#13289) · 2010f04c
  Jee Jee Li authored Feb 17, 2025
  
  2010f04c
16 Feb, 2025 8 commits
- [V1][BugFix] Clean up rejection sampler & Fix warning msg (#13362) · 69e1d23e
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  69e1d23e
- [Bugfix][Platform][CPU] Fix cuda platform detection on CPU backend edge case (#13358) · d67cc21b
  Isotr0py authored Feb 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d67cc21b
- [V1][PP] Cache Intermediate Tensors (#13353) · e18227b0
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e18227b0
- [V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359) · 7b893865
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b893865
- [Bugfix] Fix 2 Node and Spec Decode tests (#13341) · 5d2965b7
  Cyrus Leung authored Feb 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5d2965b7
- [platform] add base class for communicators (#13208) · a0231b7c
  youkaichao authored Feb 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a0231b7c
- [Quant] Add `SupportsQuant` to phi3 and clip (#13104) · 12913d17
  Kyle Sayers authored Feb 15, 2025
  
  12913d17
- [V1][Spec Decode] Ngram Spec Decode (#12193) · 80f63a39
  Lily Liu authored Feb 15, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  80f63a39
15 Feb, 2025 5 commits
- [Doc] [2/N] Add Fuyu E2E example for multimodal processor (#13331) · 367cb8ce
  Cyrus Leung authored Feb 15, 2025
  
  367cb8ce
- [V1][PP] Run engine busy loop with batch queue (#13064) · 9206b3d7
  Cody Yu authored Feb 15, 2025
  
  9206b3d7
- [AMD] [Model] DeepSeek tunings (#13199) · ed0de3e4
  rasmith authored Feb 15, 2025
  
  ed0de3e4
- [V1][Metrics] Add iteration_tokens_total histogram from V0 (#13288) · 2ad1bc7a
  Mark McLoughlin authored Feb 15, 2025
  
  2ad1bc7a
- [Bugfix] Fix qwen2.5-vl image processor (#13286) · 7fdaaf48
  Isotr0py authored Feb 15, 2025
  
  7fdaaf48