Commits · 2b184ddd4f9e4ff5305af87327410b9845a06baf · OpenDAS / vllm_cscc · GitLab

12 Oct, 2024 5 commits
- [Misc][Installation] Improve source installation script and doc (#9309) · 2b184ddd
  Yunmeng authored Oct 13, 2024
```
Co-authored-by: youkaichao <youkaichao@126.com>
```
  2b184ddd
- [Bugfix] Fix bug of xformer prefill for encoder-decoder (#9026) · 00298e09
  Xiang Xu authored Oct 12, 2024
  
  00298e09
- [SpecDec] Remove Batch Expansion (2/3) (#9298) · 89feb4c8
  Lily Liu authored Oct 11, 2024
  
  89feb4c8
- [BugFix] Fix tool call finish reason in streaming case (#9209) · ec10cb85
  Maximilien de Bayser authored Oct 11, 2024
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  ec10cb85
- [bugfix] fix f-string for error (#9295) · d11b46f3
  Prashant Gupta authored Oct 11, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
```
  d11b46f3
11 Oct, 2024 12 commits
- [Bugfix] Sets `is_first_step_output` for TPUModelRunner (#9202) · c6cf9295
  Allen Wang authored Oct 11, 2024
  
  c6cf9295
- [Bugfix][CI/Build] Fix docker build where CUDA archs < 7.0 are being detected (#9254) · de9fb4be
  Lucas Wilkinson authored Oct 11, 2024
  
  de9fb4be
- [Doc] Compatibility matrix for mutual exclusive features (#8512) · 8baf85e4
  Wallas Henrique authored Oct 11, 2024
```
Signed-off-by: Wallas Santos <wallashss@ibm.com>
```
  8baf85e4
- [Doc] Remove outdated comment to avoid misunderstanding (#9287) · 1a182387
  homeffjy authored Oct 12, 2024
  
  1a182387
- [Model] Add GLM-4v support and meet vllm==0.6.2 (#9242) · 6cf1167c
  sixgod authored Oct 12, 2024
  
  6cf1167c
- [Kernel] adding fused moe kernel config for L40S TP4 (#9245) · f710090d
  Burkhard Ringlein authored Oct 11, 2024
  
  f710090d
- [Model] Support Mamba (#6484) · 7342a7d7
  Tyler Michael Smith authored Oct 11, 2024
  
  7342a7d7
- [Bugfix] Fix priority in multiprocessing engine (#9277) · df3dcdf4
  Sebastian Schoennenbeck authored Oct 11, 2024
  
  df3dcdf4
- [Misc][LoRA] Support loading LoRA weights for target_modules in reg format (#9275) · 36ea7907
  Jee Jee Li authored Oct 11, 2024
  
  36ea7907
- [Misc] Collect model support info in a single process per model (#9233) · e808156f
  Cyrus Leung authored Oct 11, 2024
  
  e808156f
- [misc] hide best_of from engine (#9261) · cbc2ef55
  youkaichao authored Oct 10, 2024
```
Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>
```
  cbc2ef55
- [Misc] Fix sampling from sonnet for long context case (#9235) · 94bf9ae4
  Andy Dai authored Oct 10, 2024
  
  94bf9ae4
10 Oct, 2024 19 commits
- [Doc][Neuron] add note to neuron documentation about resolving triton issue (#9257) · f990bab2
  omrishiv authored Oct 10, 2024
```
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
```
  f990bab2
- [torch.compile] generic decorators (#9258) · e00c094f
  youkaichao authored Oct 10, 2024
  
  e00c094f
- [ci/build] Add placeholder command for custom models test (#9262) · a78c6ba7
  Kevin H. Luu authored Oct 10, 2024
  
  a78c6ba7
- Bump actions/setup-python from 3 to 5 (#9195) · fb870fd4
  dependabot[bot] authored Oct 10, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  fb870fd4
- Bump actions/checkout from 3 to 4 (#9196) · 270953ba
  dependabot[bot] authored Oct 10, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  270953ba
- Bump actions/github-script from 6 to 7 (#9197) · 9cc811c4
  dependabot[bot] authored Oct 10, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  9cc811c4
- [torch.compile] integration with compilation control (#9058) · e4d652ea
  youkaichao authored Oct 10, 2024
  
  e4d652ea
- Suggest codeowners for the core componenets (#9210) · 78c0b416
  Simon Mo authored Oct 10, 2024
  
  78c0b416
- [CI/Build] Make the `Dockerfile.cpu` file's `PIP_EXTRA_INDEX_URL`... · 21efb603
  jordanyono authored Oct 10, 2024
```
[CI/Build] Make the `Dockerfile.cpu` file's  `PIP_EXTRA_INDEX_URL` Configurable as a Build Argument (#9252)
```
  21efb603
- [Doc] Improve debugging documentation (#9204) · 055f3270
  Rafael Vasquez authored Oct 10, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  055f3270
- [Bugfix] Fix Machete unittests failing with `NotImplementedError` (#9218) · 18511aed
  Lucas Wilkinson authored Oct 10, 2024
  
  18511aed
- [OpenVINO] Use torch 2.4.0 and newer optimim version (#9121) · 83ea5c72
  Ilya Lavrenov authored Oct 10, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83ea5c72
- [Model] support input image embedding for minicpmv (#9237) · 04de9057
  whyiug authored Oct 10, 2024
  
  04de9057
- [Bugfix] Fix lm_head weights tying with lora for llama (#9227) · 07c11cf4
  Isotr0py authored Oct 10, 2024
  
  07c11cf4
- [Core] Add an environment variable which needs to be set explicitly to allow... · f3a507f1
  sroy745 authored Oct 09, 2024
```
[Core] Add an environment variable which needs to be set explicitly to allow BlockSpaceManagerV1 (#9149)
```
  f3a507f1
- [Bugfix] Machete garbage results for some models (large K dim) (#9212) · a64e7b94
  Lucas Wilkinson authored Oct 10, 2024
  
  a64e7b94
- [Bugfix] Fix Weight Loading Multiple GPU Test - Large Models (#9213) · ce00231a
  Michael Goin authored Oct 10, 2024
  
  ce00231a
- [misc] improve model support check in another process (#9208) · de895f16
  youkaichao authored Oct 09, 2024
  
  de895f16
- [Core] Fix invalid args to _process_request (#9201) · cf25b93b
  Russell Bryant authored Oct 10, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cf25b93b
09 Oct, 2024 4 commits
- [CI/Build] Update Dockerfile install+deploy image to ubuntu 22.04 (#9130) · d5fbb870
  Michael Goin authored Oct 09, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d5fbb870
- [CI/Build] mypy: check vllm/entrypoints (#9194) · cdca8994
  Russell Bryant authored Oct 09, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cdca8994
- [Hardware][CPU] Support AWQ for CPU backend (#7515) · ca77dd7a
  Li, Jiang authored Oct 10, 2024
  
  ca77dd7a
- Add Dependabot configuration for GitHub Actions updates (#1217) · 7dea2890
  Ewout ter Hoeven authored Oct 09, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7dea2890