Commits · 32c9eff2fff8ee91a60c9410c69042dc4c1cc5c8 · OpenDAS / vllm_cscc · GitLab

06 Jan, 2025 13 commits
- [Bugfix][V1] Fix molmo text-only inputs (#11676) · 32c9eff2
  Jee Jee Li authored Jan 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  32c9eff2
- [doc] explain how to add interleaving sliding window support (#11771) · 4ca5d40a
  youkaichao authored Jan 06, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  4ca5d40a
- [Bugfix] Fix max image size for LLaVA-Onevision (#11769) · 9279b9f8
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9279b9f8
- [Doc][2/N] Reorganize Models and Usage sections (#11755) · ee77fdb5
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee77fdb5
- [VLM] Separate out profiling-related logic (#11746) · 996357e4
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  996357e4
- k8s-config: Update the secret to use stringData (#11679) · 2a622d70
  Suraj Deshmukh authored Jan 06, 2025
```
Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
```
  2a622d70
- [mypy] Forward pass function type hints in lora (#11740) · 9c749713
  Lucas Tucker authored Jan 06, 2025
```
Signed-off-by: lucast2021 <lucast2021@headroyce.org>
Co-authored-by: lucast2021 <lucast2021@headroyce.org>
```
  9c749713
- [V1] Refactor get_executor_cls (#11754) · 022c5c69
  Rui Qiao authored Jan 05, 2025
  
  022c5c69
- [Misc] Fix typo for valid_tool_parses (#11753) · f8fcca10
  Rui Qiao authored Jan 05, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  f8fcca10
- [V1] Add BlockTable class (#11693) · 06bfb519
  Woosuk Kwon authored Jan 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  06bfb519
- [Bugfix] Remove block size constraint (#11723) · 408e5600
  Cody Yu authored Jan 05, 2025
  
  408e5600
- [Doc] [1/N] Reorganize Getting Started section (#11645) · 402d3783
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  402d3783
- [distributed] remove pynccl's redundant change_state (#11749) · 9e764e7b
  cennn authored Jan 06, 2025
  
  9e764e7b
05 Jan, 2025 4 commits
- [Frontend] Improve `StreamingResponse` Exception Handling (#11752) · 33fc1e2e
  Robert Shaw authored Jan 05, 2025
  
  33fc1e2e
- fix: [doc] fix typo (#11751) · eba17173
  Lancer authored Jan 06, 2025
```
Co-authored-by: Lancer <maruixiang6688@gmail.com>
```
  eba17173
- [distributed] remove pynccl's redundant stream (#11744) · 635b8972
  cennn authored Jan 05, 2025
  
  635b8972
- [MISC] Replace c10::optional with std::optional (#11730) · 4068f4b5
  Lu Fang authored Jan 04, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  4068f4b5
04 Jan, 2025 10 commits
- [Bugfix][V1] Fix test_kv_cache_utils.py (#11738) · 47831430
  Jee Jee Li authored Jan 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  47831430
- [Model] Remove unnecessary weight initialization logic (#11736) · 65c08928
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  65c08928
- [Bugfix] Fix precision error in LLaVA-NeXT (#11735) · ba214dff
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba214dff
- [VLM] Merged multi-modal processors for LLaVA-NeXT-Video and LLaVA-OneVision (#11717) · eed11ebe
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eed11ebe
- [Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233) · 300acb83
  Yan Burman authored Jan 04, 2025
```
Signed-off-by: Yan Burman <yanburman@users.noreply.github.com>
Signed-off-by: Ido Asraff <idoa@atero.ai>
```
  300acb83
- [V1] Add kv cache utils tests. (#11513) · d91457d5
  xcnick authored Jan 04, 2025
```
Signed-off-by: xcnick <xcnick0412@gmail.com>
```
  d91457d5
- [V1] Add `RayExecutor` support for `AsyncLLM` (api server) (#11712) · fbf25645
  Kunshang Ji authored Jan 04, 2025
  
  fbf25645
- Update bnb.md with example for OpenAI (#11718) · d1d49397
  Alberto Ferrer authored Jan 04, 2025
  
  d1d49397
- Update tool_calling.md (#11701) · 9c93636d
  Hust_YangXian authored Jan 04, 2025
  
  9c93636d
- [V1] log GPU blocks num for MultiprocExecutor (#11656) · e5d7ed0c
  WangErXiao authored Jan 04, 2025
  
  e5d7ed0c
03 Jan, 2025 10 commits
- [V1] Chore: cruft removal (#11724) · ad0d567e
  Robert Shaw authored Jan 03, 2025
  
  ad0d567e
- Update requirements-tpu.txt to support python 3.9 and 3.11 (#11695) · bf0d97d7
  Michael Goin authored Jan 03, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  bf0d97d7
- [Misc]Add BNB quantization for Qwen2VL (#11719) · a655eb30
  Jee Jee Li authored Jan 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  a655eb30
- [V1] Improve TP>1 Error Handling + Stack Trace (#11721) · 1543914c
  Robert Shaw authored Jan 03, 2025
```
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  1543914c
- [Bugfix] Fix ColumnParallelLinearWithLoRA slice (#11708) · 61fed92c
  ZincCat authored Jan 03, 2025
```
Signed-off-by: ZincCat <zincchloride@outlook.com>
```
  61fed92c
- [V1] Simplify Shutdown (#11659) · 80c751e7
  Robert Shaw authored Jan 03, 2025
  
  80c751e7
- [Model] Whisper model implementation (#11280) · e1a5c2f0
  Aurick Qiao authored Jan 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  e1a5c2f0
- [perf-benchmark] Fix dependency for steps in benchmark pipeline (#11710) · fd3a62a1
  Kevin H. Luu authored Jan 03, 2025
  
  fd3a62a1
- [Bugfix] Check chain_speculative_sampling before calling it (#11673) · 07064cb1
  Lu Fang authored Jan 02, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  07064cb1
- Update default max_num_batch_tokens for chunked prefill (#11694) · 2f1e8e8f
  Sachin Varghese authored Jan 02, 2025
  
  2f1e8e8f
02 Jan, 2025 3 commits
- [Misc] Minimum requirements for SageMaker compatibility (#11576) · 68d37809
  Nathan Azrak authored Jan 03, 2025
  
  68d37809
- Resolve race conditions in Marlin kernel (#11493) · 5dba2575
  wchen61 authored Jan 03, 2025
```
Signed-off-by: wchen61 <wchen61@foxmail.com>
```
  5dba2575
- [Bugfix] Change kv scaling factor by param json on nvidia gpu (#11688) · 187e3299
  bjmsong authored Jan 03, 2025
```
Signed-off-by: bjmsong <bjmsong@126.com>
Co-authored-by: bjmsong <bjmsong@126.com>
```
  187e3299