Commits · 45186834a0d9f101dd29fac0e7ccbdb245f27645 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "d8c6210eeaa7f3b474e50cf74926f77a8dc79adf"

17 Feb, 2025 2 commits
- [Feature][Spec Decode] Simplify the use of Eagle Spec Decode (#12304) · 46cdd595
  shangmingc authored Feb 17, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  46cdd595
- [V1][Misc] Avoid unnecessary log output (#13289) · 2010f04c
  Jee Jee Li authored Feb 17, 2025
  
  2010f04c
16 Feb, 2025 8 commits
- [V1][BugFix] Clean up rejection sampler & Fix warning msg (#13362) · 69e1d23e
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  69e1d23e
- [Bugfix][Platform][CPU] Fix cuda platform detection on CPU backend edge case (#13358) · d67cc21b
  Isotr0py authored Feb 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  d67cc21b
- [V1][PP] Cache Intermediate Tensors (#13353) · e18227b0
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e18227b0
- [V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359) · 7b893865
  Woosuk Kwon authored Feb 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b893865
- [Bugfix] Fix 2 Node and Spec Decode tests (#13341) · 5d2965b7
  Cyrus Leung authored Feb 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5d2965b7
- [platform] add base class for communicators (#13208) · a0231b7c
  youkaichao authored Feb 16, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  a0231b7c
- [Quant] Add `SupportsQuant` to phi3 and clip (#13104) · 12913d17
  Kyle Sayers authored Feb 15, 2025
  
  12913d17
- [V1][Spec Decode] Ngram Spec Decode (#12193) · 80f63a39
  Lily Liu authored Feb 15, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  80f63a39
15 Feb, 2025 12 commits
- [Doc] [2/N] Add Fuyu E2E example for multimodal processor (#13331) · 367cb8ce
  Cyrus Leung authored Feb 15, 2025
  
  367cb8ce
- [V1][PP] Run engine busy loop with batch queue (#13064) · 9206b3d7
  Cody Yu authored Feb 15, 2025
  
  9206b3d7
- [AMD] [Model] DeepSeek tunings (#13199) · ed0de3e4
  rasmith authored Feb 15, 2025
  
  ed0de3e4
- [V1][Metrics] Add iteration_tokens_total histogram from V0 (#13288) · 2ad1bc7a
  Mark McLoughlin authored Feb 15, 2025
  
  2ad1bc7a
- [Bugfix] Fix qwen2.5-vl image processor (#13286) · 7fdaaf48
  Isotr0py authored Feb 15, 2025
  
  7fdaaf48
- [Bugfix]Fix search start_index of stop_checker (#13280) · 067fa225
  Xu Song authored Feb 15, 2025
  
  067fa225
- [BugFix] Don't scan entire cache dir when loading model (#13302) · 90763256
  Nick Hill authored Feb 14, 2025
  
  90763256
- [Bugfix] Massage MLA's usage of flash attn for RoCM (#13310) · 97a3d6d9
  Tyler Michael Smith authored Feb 15, 2025
  
  97a3d6d9
- [Bugfix][Docs] Fix offline Whisper (#13274) · 579d7a63
  Nicolò Lucchesi authored Feb 15, 2025
  
  579d7a63
- [Bugfix][AMD] Update torch_bindings so that scaled_fp4_quant isn't build on ROCm (#13235) · c9f9d5b3
  Sage Moore authored Feb 14, 2025
  
  c9f9d5b3
- [V1][PP] Fix memory profiling in PP (#13315) · 0c730268
  Woosuk Kwon authored Feb 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0c730268
- [V1][Sampler] Don't apply temp for greedy-only (#13311) · 6a854c7a
  Nick Hill authored Feb 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6a854c7a
14 Feb, 2025 18 commits
- [V1][Core] min_p sampling support (#13191) · a12934d3
  Aoyu authored Feb 15, 2025
```
Signed-off-by: Aoyu <aoyuzhan@amazon.com>
Co-authored-by: Aoyu <aoyuzhan@amazon.com>
```
  a12934d3
- [Core] Reduce TTFT with concurrent partial prefills (#10235) · 3bcb8c75
  Joe Runde authored Feb 14, 2025
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  3bcb8c75
- [Quant][Perf] Use moe_wna16 kernel by default for MoEs with many experts (#13236) · 5e5c8e09
  Michael Goin authored Feb 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  5e5c8e09
- [Hardware][Gaudi][Bugfix] Fix error for guided decoding (#12317) · c9e2d644
  Yu-Zhou authored Feb 14, 2025
  
  c9e2d644
- [Core] choice-based structured output with xgrammar (#12632) · 7734e9a2
  Russell Bryant authored Feb 14, 2025
  
  7734e9a2
- Support logit_bias in v1 Sampler (#13079) · 6224a9f6
  Lu Fang authored Feb 14, 2025
  
  6224a9f6
- [V1] Simplify GPUModelRunner._update_states check (#13265) · 085b7b2d
  Nick Hill authored Feb 14, 2025
  
  085b7b2d
- [VLM] Keep track of whether prompt replacements have been applied (#13215) · 4da1f667
  Cyrus Leung authored Feb 14, 2025
  
  4da1f667
- [Misc] Log time consumption of sleep and wake-up (#13115) · 556ef7f7
  Jun Duan authored Feb 14, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  556ef7f7
- [Bugfix] Fix missing parentheses (#13263) · 83481ceb
  Xu Song authored Feb 14, 2025
  
  83481ceb
- [Frontend] Optionally remove memory buffer used for uploading to URLs in run_batch (#12927) · 185cc19f
  Pooya Davoodi authored Feb 14, 2025
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
```
  185cc19f
- [WIP] TPU V1 Support Refactored (#13049) · 45f90bcb
  Alexander Matveev authored Feb 14, 2025
  
  45f90bcb
- [Bugfix][V1] GPUModelRunner._update_states should return True when there is a... · b0ccfc56
  Kero Liang authored Feb 14, 2025
```
[Bugfix][V1] GPUModelRunner._update_states should return True when there is a finished request in batch (#13126)
```
  b0ccfc56
- [ROCm][V1] Add intial ROCm support to V1 (#12790) · ba59b78a
  Sage Moore authored Feb 13, 2025
  
  ba59b78a
- [V1] LoRA - Enable Serving Usecase (#12883) · cbc40128
  Varun Sundar Rabindranath authored Feb 14, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  cbc40128
- Expand MLA to support most types of quantization (#13181) · f0b2da72
  Michael Goin authored Feb 14, 2025
  
  f0b2da72
- [Misc] Remove redundant statements in scheduler.py (#13229) · 40932d7a
  Wang Ran (汪然) authored Feb 14, 2025
  
  40932d7a
- [V1] Consolidate MM cache size to vllm.envs (#13239) · dd5ede44
  Roger Wang authored Feb 13, 2025
  
  dd5ede44