Commits · d0a7a2769d92619afdcdc3b91c78098eaa9e38c0 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "c32e97602d54f34fb60ff956dae09f9a557ec50a"

19 Feb, 2025 1 commit

[Hardware][Gaudi][Feature] Support Contiguous Cache Fetch (#12139) · d0a7a276

Yu-Zhou authored Feb 19, 2025


Signed-off-by: yuzhou <yuzhou@habana.ai>
Signed-off-by: zhouyu5 <yu.zhou@intel.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

d0a7a276

18 Feb, 2025 19 commits
- [V1][Spec Decode] Optimize N-gram matching with Numba (#13365) · 4c822298
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c822298
- [V1] Optimize handling of sampling metadata and req_ids list (#13244) · 30172b49
  Nick Hill authored Feb 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  30172b49
- [V1][PP] Enable true PP with Ray executor (#13472) · 4fb8142a
  Woosuk Kwon authored Feb 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4fb8142a
- [Bugfix] Handle content type with optional parameters (#13383) · d3231cb4
  zifeitong authored Feb 18, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  d3231cb4
- [ROCm] Make amdsmi import optional for other platforms (#13460) · 435b502a
  Cyrus Leung authored Feb 18, 2025
  
  435b502a
- [Bugfix] Remove noisy error logging during local model loading (#13458) · 29fc5772
  Isotr0py authored Feb 18, 2025
  
  29fc5772
- [Bugfix] Fix failing transformers dynamic module resolving with spawn multiproc method (#13403) · 8cf97f86
  Isotr0py authored Feb 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8cf97f86
- [Bugfix] Ensure LoRA path from the request can be included in err msg (#13450) · e2603fef
  Yuan Tang authored Feb 18, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  e2603fef
- Add outlines fallback when JSON schema has enum (#13449) · b53d7998
  Michael Goin authored Feb 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b53d7998
- [Quant] Aria SupportsQuant (#13416) · d1b649f1
  Kyle Sayers authored Feb 18, 2025
  
  d1b649f1
- [core] fix sleep mode in pytorch 2.6 (#13456) · ac19b519
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  ac19b519
- [Bugfix] Only print out chat template when supplied (#13444) · a1074b3e
  Yuan Tang authored Feb 18, 2025
  
  a1074b3e
- [Quant] Arctic SupportsQuant (#13366) · 00294e1b
  Kyle Sayers authored Feb 18, 2025
  
  00294e1b
- [Quant] Molmo SupportsQuant (#13336) · 88787bce
  Kyle Sayers authored Feb 18, 2025
  
  88787bce
- [v1] fix parallel config rank (#13445) · 932b51ce
  youkaichao authored Feb 18, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  932b51ce
- [ROCm] fix get_device_name for rocm (#13438) · 7c7adf81
  Divakar Verma authored Feb 17, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  7c7adf81
- [Model] Enable quantization support for `transformers` backend (#12960) · 67ef8f66
  Isotr0py authored Feb 18, 2025
  
  67ef8f66
- [Misc] Remove dangling references to `SamplingType.BEAM` (#13402) · efbe8544
  Harry Mellor authored Feb 18, 2025
  
  efbe8544
- [Bugfix][CI][V1] Work around V1 + CUDA Graph + torch._scaled_mm fallback issue (#13425) · b3942e15
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  b3942e15
17 Feb, 2025 10 commits
- [V1][Spec decode] Move drafter to model runner (#13363) · cd4a72a2
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cd4a72a2
- [V1][PP] Fix intermediate tensor values (#13417) · 6ac485a9
  Cody Yu authored Feb 17, 2025
```
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
```
  6ac485a9
- [V1] Get input tokens from scheduler (#13339) · 4c21ce9e
  Woosuk Kwon authored Feb 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4c21ce9e
- [Bugfix] Fix VLLM_USE_MODELSCOPE issue (#13384) · ce77eb94
  r.4ntix authored Feb 17, 2025
  
  ce77eb94
- [Bugfix] fix xpu communicator (#13368) · 30513d1c
  Yan Ma authored Feb 17, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  30513d1c
- [Model] Support Mamba2 (Codestral Mamba) (#9292) · 1f69c4a8
  Tyler Michael Smith authored Feb 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
```
  1f69c4a8
- [VLM] Check required fields before initializing field config in `DictEmbeddingItems` (#13380) · 7b623fca
  Cyrus Leung authored Feb 17, 2025
  
  7b623fca
- [MISC] tiny fixes (#13378) · 238dfc8a
  Mengqing Cao authored Feb 17, 2025
  
  238dfc8a
- [Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304) · 46cdd595
  shangmingc authored Feb 17, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  46cdd595
- [V1][Misc] Avoid unnecessary log output (#13289) · 2010f04c
  Jee Jee Li authored Feb 17, 2025
  
  2010f04c
16 Feb, 2025 8 commits
- [V1][BugFix] Clean up rejection sampler & Fix warning msg (#13362) · 69e1d23e
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  69e1d23e
- [Bugfix][Platform][CPU] Fix cuda platform detection on CPU backend edge case (#13358) · d67cc21b
  Isotr0py authored Feb 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d67cc21b
- [V1][PP] Cache Intermediate Tensors (#13353) · e18227b0
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e18227b0
- [V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359) · 7b893865
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b893865
- [Bugfix] Fix 2 Node and Spec Decode tests (#13341) · 5d2965b7
  Cyrus Leung authored Feb 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5d2965b7
- [platform] add base class for communicators (#13208) · a0231b7c
  youkaichao authored Feb 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a0231b7c
- [Quant] Add `SupportsQuant` to phi3 and clip (#13104) · 12913d17
  Kyle Sayers authored Feb 15, 2025
  
  12913d17
- [V1][Spec Decode] Ngram Spec Decode (#12193) · 80f63a39
  Lily Liu authored Feb 15, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  80f63a39
15 Feb, 2025 2 commits
- [Doc] [2/N] Add Fuyu E2E example for multimodal processor (#13331) · 367cb8ce
  Cyrus Leung authored Feb 15, 2025
  
  367cb8ce
- [V1][PP] Run engine busy loop with batch queue (#13064) · 9206b3d7
  Cody Yu authored Feb 15, 2025
  
  9206b3d7