Commits · 9cc811c4ff3d5200cc23f16709f540821531b77c · OpenDAS / vllm_cscc · GitLab

10 Oct, 2024 14 commits
- Bump actions/github-script from 6 to 7 (#9197) · 9cc811c4
  dependabot[bot] authored Oct 10, 2024
```
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
```
  9cc811c4
- [torch.compile] integration with compilation control (#9058) · e4d652ea
  youkaichao authored Oct 10, 2024
  
  e4d652ea
- Suggest codeowners for the core componenets (#9210) · 78c0b416
  Simon Mo authored Oct 10, 2024
  
  78c0b416
- [CI/Build] Make the `Dockerfile.cpu` file's `PIP_EXTRA_INDEX_URL`... · 21efb603
  jordanyono authored Oct 10, 2024
```
[CI/Build] Make the `Dockerfile.cpu` file's  `PIP_EXTRA_INDEX_URL` Configurable as a Build Argument (#9252)
```
  21efb603
- [Doc] Improve debugging documentation (#9204) · 055f3270
  Rafael Vasquez authored Oct 10, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  055f3270
- [Bugfix] Fix Machete unittests failing with `NotImplementedError` (#9218) · 18511aed
  Lucas Wilkinson authored Oct 10, 2024
  
  18511aed
- [OpenVINO] Use torch 2.4.0 and newer optimim version (#9121) · 83ea5c72
  Ilya Lavrenov authored Oct 10, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83ea5c72
- [Model] support input image embedding for minicpmv (#9237) · 04de9057
  whyiug authored Oct 10, 2024
  
  04de9057
- [Bugfix] Fix lm_head weights tying with lora for llama (#9227) · 07c11cf4
  Isotr0py authored Oct 10, 2024
  
  07c11cf4
- [Core] Add an environment variable which needs to be set explicitly to allow... · f3a507f1
  sroy745 authored Oct 09, 2024
```
[Core] Add an environment variable which needs to be set explicitly to allow BlockSpaceManagerV1 (#9149)
```
  f3a507f1
- [Bugfix] Machete garbage results for some models (large K dim) (#9212) · a64e7b94
  Lucas Wilkinson authored Oct 10, 2024
  
  a64e7b94
- [Bugfix] Fix Weight Loading Multiple GPU Test - Large Models (#9213) · ce00231a
  Michael Goin authored Oct 10, 2024
  
  ce00231a
- [misc] improve model support check in another process (#9208) · de895f16
  youkaichao authored Oct 09, 2024
  
  de895f16
- [Core] Fix invalid args to _process_request (#9201) · cf25b93b
  Russell Bryant authored Oct 10, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cf25b93b
09 Oct, 2024 17 commits
- [CI/Build] Update Dockerfile install+deploy image to ubuntu 22.04 (#9130) · d5fbb870
  Michael Goin authored Oct 09, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d5fbb870
- [CI/Build] mypy: check vllm/entrypoints (#9194) · cdca8994
  Russell Bryant authored Oct 09, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cdca8994
- [Hardware][CPU] Support AWQ for CPU backend (#7515) · ca77dd7a
  Li, Jiang authored Oct 10, 2024
  
  ca77dd7a
- Add Dependabot configuration for GitHub Actions updates (#1217) · 7dea2890
  Ewout ter Hoeven authored Oct 09, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7dea2890
- [Bugfix] Access `get_vocab` instead of `vocab` in tool parsers (#9188) · cfaa6008
  Cyrus Leung authored Oct 09, 2024
  
  cfaa6008
- [Bugfix] Fix lora loading for Compressed Tensors in #9120 (#9179) · 21906a6f
  Ahmad Fahadh Ilyas authored Oct 09, 2024
  
  21906a6f
- [Doc] Fix VLM prompt placeholder sample bug (#9170) · dc4aea67
  Jiangtao Hu authored Oct 09, 2024
  
  dc4aea67
- [ci][test] use load dummy for testing (#9165) · c8627cd4
  youkaichao authored Oct 09, 2024
  
  c8627cd4
- [Bugfix] fix composite weight loading and EAGLE weight loading (#9160) · 8bfaa4e3
  Cyrus Leung authored Oct 09, 2024
  
  8bfaa4e3
- [Frontend] Log the maximum supported concurrency (#8831) · 0b5b5d76
  AlpinDale authored Oct 09, 2024
  
  0b5b5d76
- [Model] Remap FP8 kv_scale in CommandR and DBRX (#9174) · cdc72e3c
  Hui Liu authored Oct 08, 2024
  
  cdc72e3c
- [Bugfix][Doc] Report neuron error in output (#9159) · 7627172b
  Joe Rowell authored Oct 09, 2024
  
  7627172b
- [Misc] Improve validation errors around best_of and n (#9167) · 480b7f40
  Travis Johnson authored Oct 08, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  480b7f40
- Update link to KServe deployment guide (#9173) · acce7630
  Yuan Tang authored Oct 08, 2024
  
  acce7630
- Add classifiers in setup.py (#9171) · ffc4b27e
  Yuan Tang authored Oct 08, 2024
  
  ffc4b27e
- support bitsandbytes quantization with more models (#9148) · 2f4117c3
  chenqianfzh authored Oct 08, 2024
  
  2f4117c3
- Add `lm-eval` directly to requirements-test.txt (#9161) · 9ba0bd6a
  Michael Goin authored Oct 08, 2024
  
  9ba0bd6a
08 Oct, 2024 9 commits
- mypy: check additional directories (#9162) · 2a131965
  Russell Bryant authored Oct 08, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  2a131965
- [Bugfix] Try to handle older versions of pytorch (#9086) · bd37b9fb
  bnellnm authored Oct 08, 2024
  
  bd37b9fb
- [Doc] Improve contributing and installation documentation (#9132) · de24046f
  Rafael Vasquez authored Oct 08, 2024
```
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
```
  de24046f
- [Doc] Update vlm.rst to include an example on videos (#9155) · 1874c6a1
  Sayak Paul authored Oct 08, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1874c6a1
- [Bugfix] fix OpenAI API server startup with --disable-frontend-multiprocessing (#8537) · 9a94ca4a
  Daniele authored Oct 08, 2024
  
  9a94ca4a
- [CI/Build] Add examples folder into Docker image so that we can leverage the... · cfba685b
  Peter Pan authored Oct 09, 2024
```
[CI/Build] Add examples folder into Docker image so that we can leverage the templates*.jinja when serving models (#8758)
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  cfba685b
- [Frontend] Add Early Validation For Chat Template / Tool Call Parser (#9151) · 069d3bd8
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  069d3bd8
- [Core][Frontend] Add Support for Inference Time mm_processor_kwargs (#9131) · a3691b6b
  Alex Brooks authored Oct 08, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  a3691b6b
- [Frontend] API support for beam search for MQLLMEngine (#9117) · 8c746226
  Brendan Wong authored Oct 07, 2024
  
  8c746226