Commits · df3dcdf49dccfa4914d825fa08b74de8ae050e1e · OpenDAS / vllm_cscc · GitLab

11 Oct, 2024 5 commits
- [Bugfix] Fix priority in multiprocessing engine (#9277) · df3dcdf4
  Sebastian Schoennenbeck authored Oct 11, 2024
  
  df3dcdf4
- [Misc][LoRA] Support loading LoRA weights for target_modules in reg format (#9275) · 36ea7907
  Jee Jee Li authored Oct 11, 2024
  
  36ea7907
- [Misc] Collect model support info in a single process per model (#9233) · e808156f
  Cyrus Leung authored Oct 11, 2024
  
  e808156f
- [misc] hide best_of from engine (#9261) · cbc2ef55
  youkaichao authored Oct 10, 2024
```
Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>
```
  cbc2ef55
- [Misc] Fix sampling from sonnet for long context case (#9235) · 94bf9ae4
  Andy Dai authored Oct 10, 2024
  
  94bf9ae4
10 Oct, 2024 19 commits
- [Doc][Neuron] add note to neuron documentation about resolving triton issue (#9257) · f990bab2
  omrishiv authored Oct 10, 2024
```
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
```
  f990bab2
- [torch.compile] generic decorators (#9258) · e00c094f
  youkaichao authored Oct 10, 2024
  
  e00c094f
- [ci/build] Add placeholder command for custom models test (#9262) · a78c6ba7
  Kevin H. Luu authored Oct 10, 2024
  
  a78c6ba7
- Bump actions/setup-python from 3 to 5 (#9195) · fb870fd4
  dependabot[bot] authored Oct 10, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  fb870fd4
- Bump actions/checkout from 3 to 4 (#9196) · 270953ba
  dependabot[bot] authored Oct 10, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  270953ba
- Bump actions/github-script from 6 to 7 (#9197) · 9cc811c4
  dependabot[bot] authored Oct 10, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  9cc811c4
- [torch.compile] integration with compilation control (#9058) · e4d652ea
  youkaichao authored Oct 10, 2024
  
  e4d652ea
- Suggest codeowners for the core componenets (#9210) · 78c0b416
  Simon Mo authored Oct 10, 2024
  
  78c0b416
- [CI/Build] Make the `Dockerfile.cpu` file's `PIP_EXTRA_INDEX_URL`... · 21efb603
  jordanyono authored Oct 10, 2024
```
[CI/Build] Make the `Dockerfile.cpu` file's  `PIP_EXTRA_INDEX_URL` Configurable as a Build Argument (#9252)
```
  21efb603
- [Doc] Improve debugging documentation (#9204) · 055f3270
  Rafael Vasquez authored Oct 10, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  055f3270
- [Bugfix] Fix Machete unittests failing with `NotImplementedError` (#9218) · 18511aed
  Lucas Wilkinson authored Oct 10, 2024
  
  18511aed
- [OpenVINO] Use torch 2.4.0 and newer optimim version (#9121) · 83ea5c72
  Ilya Lavrenov authored Oct 10, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83ea5c72
- [Model] support input image embedding for minicpmv (#9237) · 04de9057
  whyiug authored Oct 10, 2024
  
  04de9057
- [Bugfix] Fix lm_head weights tying with lora for llama (#9227) · 07c11cf4
  Isotr0py authored Oct 10, 2024
  
  07c11cf4
- [Core] Add an environment variable which needs to be set explicitly to allow... · f3a507f1
  sroy745 authored Oct 09, 2024
```
[Core] Add an environment variable which needs to be set explicitly to allow BlockSpaceManagerV1 (#9149)
```
  f3a507f1
- [Bugfix] Machete garbage results for some models (large K dim) (#9212) · a64e7b94
  Lucas Wilkinson authored Oct 10, 2024
  
  a64e7b94
- [Bugfix] Fix Weight Loading Multiple GPU Test - Large Models (#9213) · ce00231a
  Michael Goin authored Oct 10, 2024
  
  ce00231a
- [misc] improve model support check in another process (#9208) · de895f16
  youkaichao authored Oct 09, 2024
  
  de895f16
- [Core] Fix invalid args to _process_request (#9201) · cf25b93b
  Russell Bryant authored Oct 10, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cf25b93b
09 Oct, 2024 16 commits
- [CI/Build] Update Dockerfile install+deploy image to ubuntu 22.04 (#9130) · d5fbb870
  Michael Goin authored Oct 09, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d5fbb870
- [CI/Build] mypy: check vllm/entrypoints (#9194) · cdca8994
  Russell Bryant authored Oct 09, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cdca8994
- [Hardware][CPU] Support AWQ for CPU backend (#7515) · ca77dd7a
  Li, Jiang authored Oct 10, 2024
  
  ca77dd7a
- Add Dependabot configuration for GitHub Actions updates (#1217) · 7dea2890
  Ewout ter Hoeven authored Oct 09, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7dea2890
- [Bugfix] Access `get_vocab` instead of `vocab` in tool parsers (#9188) · cfaa6008
  Cyrus Leung authored Oct 09, 2024
  
  cfaa6008
- [Bugfix] Fix lora loading for Compressed Tensors in #9120 (#9179) · 21906a6f
  Ahmad Fahadh Ilyas authored Oct 09, 2024
  
  21906a6f
- [Doc] Fix VLM prompt placeholder sample bug (#9170) · dc4aea67
  Jiangtao Hu authored Oct 09, 2024
  
  dc4aea67
- [ci][test] use load dummy for testing (#9165) · c8627cd4
  youkaichao authored Oct 09, 2024
  
  c8627cd4
- [Bugfix] fix composite weight loading and EAGLE weight loading (#9160) · 8bfaa4e3
  Cyrus Leung authored Oct 09, 2024
  
  8bfaa4e3
- [Frontend] Log the maximum supported concurrency (#8831) · 0b5b5d76
  AlpinDale authored Oct 09, 2024
  
  0b5b5d76
- [Model] Remap FP8 kv_scale in CommandR and DBRX (#9174) · cdc72e3c
  Hui Liu authored Oct 08, 2024
  
  cdc72e3c
- [Bugfix][Doc] Report neuron error in output (#9159) · 7627172b
  Joe Rowell authored Oct 09, 2024
  
  7627172b
- [Misc] Improve validation errors around best_of and n (#9167) · 480b7f40
  Travis Johnson authored Oct 08, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  480b7f40
- Update link to KServe deployment guide (#9173) · acce7630
  Yuan Tang authored Oct 08, 2024
  
  acce7630
- Add classifiers in setup.py (#9171) · ffc4b27e
  Yuan Tang authored Oct 08, 2024
  
  ffc4b27e
- support bitsandbytes quantization with more models (#9148) · 2f4117c3
  chenqianfzh authored Oct 08, 2024
  
  2f4117c3