Commits · 7e7eae338d2774f90ba4b5a04d6c53e7299f40de · OpenDAS / vllm_cscc · GitLab

16 Oct, 2024 3 commits
- [Misc] Standardize RoPE handling for Qwen2-VL (#9250) · 7e7eae33
  Cyrus Leung authored Oct 16, 2024
  
  7e7eae33
- [Bugfix] Molmo text-only input bug fix (#9397) · ed920135
  Reza Salehi authored Oct 15, 2024
```
Co-authored-by: sanghol <sanghol@allenai.org>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  ed920135
- [Bugfix][CI/Build] Fix CUDA 11.8 Build (#9386) · 717a5f82
  Lucas Wilkinson authored Oct 15, 2024
  
  717a5f82
15 Oct, 2024 8 commits
- [Bugfix] Fix vLLM UsageInfo and logprobs None AssertionError with empty token_ids (#9034) · ba309422
  Chang Su authored Oct 15, 2024
```
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  ba309422
- [Misc] Directly use compressed-tensors for checkpoint definitions (#8909) · 22f8a695
  Michael Goin authored Oct 15, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  22f8a695
- pass ignore_eos parameter to all benchmark_serving calls (#9349) · 5d264f4a
  Grace Ho authored Oct 15, 2024
  
  5d264f4a
- [BugFix] Fix chat API continuous usage stats (#9357) · e9d517f2
  Nick Hill authored Oct 15, 2024
  
  e9d517f2
- [Bugfix] Update InternVL input mapper to support image embeds (#9351) · 55e081fb
  hhzhang16 authored Oct 14, 2024
  
  55e081fb
- [Doc] Fix code formatting in spec_decode.rst (#9348) · 8e836d98
  Michael Goin authored Oct 15, 2024
  
  8e836d98
- [Frontend] Clarify model_type error messages (#9345) · 44eaa5a5
  Steve Grubb authored Oct 15, 2024
  
  44eaa5a5
- [Bugfix] Clean up some cruft in mamba.py (#9343) · 169b5306
  Tyler Michael Smith authored Oct 14, 2024
  
  169b5306
14 Oct, 2024 7 commits
- [Model] Make llama3.2 support multiple and interleaved images (#9095) · f0fe4fe8
  Xiang Xu authored Oct 14, 2024
  
  f0fe4fe8
- [Frontend] merge beam search implementations (#9296) · 4d31cd42
  Brendan Wong authored Oct 14, 2024
  
  4d31cd42
- [TPU] Fix TPU SMEM OOM by Pallas paged attention kernel (#9350) · 473e7b36
  Woosuk Kwon authored Oct 14, 2024
  
  473e7b36
- [Docs] Remove PDF build from Readtehdocs (#9347) · fd47e57f
  Simon Mo authored Oct 14, 2024
  
  fd47e57f
- [CI/Build] setuptools-scm fixes (#8900) · 203ab8f8
  Daniele authored Oct 14, 2024
  
  203ab8f8
- [Hardware][intel GPU] add async output process for xpu (#8897) · 4141608c
  Kunshang Ji authored Oct 15, 2024
  
  4141608c
- [Model] Molmo vLLM Integration (#9016) · dfe43a20
  Reza Salehi authored Oct 14, 2024
```
Co-authored-by: sanghol <sanghol@allenai.org>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  dfe43a20
13 Oct, 2024 2 commits
- [Bugfix] Bandaid fix for speculative decoding tests (#9327) · 16b24e7d
  Tyler Michael Smith authored Oct 13, 2024
  
  16b24e7d
- [CI] Fix merge conflict (#9317) · f519902c
  Lily Liu authored Oct 12, 2024
  
  f519902c
12 Oct, 2024 6 commits
- [Bugfix]Fix MiniCPM's LoRA bug (#9286) · 250e26a6
  Jee Jee Li authored Oct 13, 2024
  
  250e26a6
- [Misc][Installation] Improve source installation script and doc (#9309) · 2b184ddd
  Yunmeng authored Oct 13, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  2b184ddd
- [Bugfix] Fix bug of xformer prefill for encoder-decoder (#9026) · 00298e09
  Xiang Xu authored Oct 12, 2024
  
  00298e09
- [SpecDec] Remove Batch Expansion (2/3) (#9298) · 89feb4c8
  Lily Liu authored Oct 11, 2024
  
  89feb4c8
- [BugFix] Fix tool call finish reason in streaming case (#9209) · ec10cb85
  Maximilien de Bayser authored Oct 11, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  ec10cb85
- [bugfix] fix f-string for error (#9295) · d11b46f3
  Prashant Gupta authored Oct 11, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  d11b46f3
11 Oct, 2024 12 commits
- [Bugfix] Sets `is_first_step_output` for TPUModelRunner (#9202) · c6cf9295
  Allen Wang authored Oct 11, 2024
  
  c6cf9295
- [Bugfix][CI/Build] Fix docker build where CUDA archs < 7.0 are being detected (#9254) · de9fb4be
  Lucas Wilkinson authored Oct 11, 2024
  
  de9fb4be
- [Doc] Compatibility matrix for mutual exclusive features (#8512) · 8baf85e4
  Wallas Henrique authored Oct 11, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  8baf85e4
- [Doc] Remove outdated comment to avoid misunderstanding (#9287) · 1a182387
  homeffjy authored Oct 12, 2024
  
  1a182387
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
- [Kernel] adding fused moe kernel config for L40S TP4 (#9245) · f710090d
  Burkhard Ringlein authored Oct 11, 2024
  
  f710090d
- [Model] Support Mamba (#6484) · 7342a7d7
  Tyler Michael Smith authored Oct 11, 2024
  
  7342a7d7
- [Bugfix] Fix priority in multiprocessing engine (#9277) · df3dcdf4
  Sebastian Schoennenbeck authored Oct 11, 2024
  
  df3dcdf4
- [Misc][LoRA] Support loading LoRA weights for target_modules in reg format (#9275) · 36ea7907
  Jee Jee Li authored Oct 11, 2024
  
  36ea7907
- [Misc] Collect model support info in a single process per model (#9233) · e808156f
  Cyrus Leung authored Oct 11, 2024
  
  e808156f
- [misc] hide best_of from engine (#9261) · cbc2ef55
  youkaichao authored Oct 10, 2024
```
Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>
```
  cbc2ef55
- [Misc] Fix sampling from sonnet for long context case (#9235) · 94bf9ae4
  Andy Dai authored Oct 10, 2024
  
  94bf9ae4
10 Oct, 2024 2 commits
- [Doc][Neuron] add note to neuron documentation about resolving triton issue (#9257) · f990bab2
  omrishiv authored Oct 10, 2024
```
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
```
  f990bab2
- [torch.compile] generic decorators (#9258) · e00c094f
  youkaichao authored Oct 10, 2024
  
  e00c094f