Commits · df76e5af2635dee68bbace85da6c0257f6ee74bb · OpenDAS / vllm_cscc · GitLab

22 Jan, 2025 1 commit
- [VLM] Simplify post-processing of replacement info (#12269) · df76e5af
  Cyrus Leung authored Jan 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  df76e5af
21 Jan, 2025 26 commits
- [Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf... · 09ccc9c8
  Hongxia Yang authored Jan 21, 2025
```
[Documentation][AMD] Add information about prebuilt ROCm vLLM docker for perf validation purpose (#12281)
Signed-off-by: Hongxia Yang <hongxyan@amd.com>
```
  09ccc9c8
- [BUGFIX] When skip_tokenize_init and multistep are set, execution crashes (#12277) · 69196a9b
  Aleksandr Malyshev authored Jan 21, 2025
```
Signed-off-by: maleksan85 <maleksan@amd.com>
Co-authored-by: maleksan85 <maleksan@amd.com>
```
  69196a9b
- [bugfix] moe tuning. rm is_navi() (#12273) · 2acba47d
  Divakar Verma authored Jan 21, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  2acba47d
- [Core] Free CPU pinned memory on environment cleanup (#10477) · 9c485d9e
  Jani Monoses authored Jan 21, 2025
  
  9c485d9e
- [Misc] Set default backend to SDPA for get_vit_attn_backend (#12235) · fa9ee081
  wangxiyuan authored Jan 22, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  fa9ee081
- [Misc] Remove experimental dep from tracing.py (#12007) · 347eeebe
  Adrian Cole authored Jan 21, 2025
```
Signed-off-by: Adrian Cole <adrian.cole@elastic.co>
```
  347eeebe
- [Bugfix] Multi-sequence broken (#11898) · 18fd4a83
  Andy Lo authored Jan 21, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  18fd4a83
- [v1][stats][1/n] Add RequestStatsUpdate and RequestStats types (#10907) · 132a1321
  Ricky Xu authored Jan 21, 2025
```
Signed-off-by: rickyx <rickyx@anyscale.com>
```
  132a1321
- [Kernel] fix moe_align_block_size error condition (#12239) · 1e60f87b
  Jinzhen Lin authored Jan 22, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  1e60f87b
- [Bugfix] fix race condition that leads to wrong order of token returned (#10802) · 9705b90b
  Jannis Schönleber authored Jan 21, 2025
```
Signed-off-by: Jannis Schönleber <joennlae@gmail.com>
```
  9705b90b
- [ci/build] update nightly torch for gh200 test (#12270) · 3aec49e5
  youkaichao authored Jan 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  3aec49e5
- [Platform] improve platforms getattr (#12264) · c6461280
  Mengqing Cao authored Jan 21, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  c6461280
- Remove pytorch comments for outlines + compressed-tensors (#12260) · 9a7c3a00
  Thomas Parnell authored Jan 21, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  9a7c3a00
- [V1][Bugfix] Fix data item ordering in mixed-modality inference (#12259) · b197a5cc
  Roger Wang authored Jan 21, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b197a5cc
- [torch.compile] transparent compilation with more logging (#12246) · c81081fe
  youkaichao authored Jan 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c81081fe
- [Bugfix] Fix mm_limits access for merged multi-modal processor (#12252) · a94eee44
  Cyrus Leung authored Jan 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a94eee44
- [Misc] Remove redundant TypeVar from base model (#12248) · f2e9f2a3
  Cyrus Leung authored Jan 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f2e9f2a3
- [Misc]Add BNB quantization for PaliGemmaForConditionalGeneration (#12237) · 1f1542af
  Jee Jee Li authored Jan 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1f1542af
- [Misc] Rename `MultiModalInputsV2 -> MultiModalInputs` (#12244) · 96912550
  Cyrus Leung authored Jan 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  96912550
- [ci/build] disable failed and flaky tests (#12240) · 2fc6944c
  youkaichao authored Jan 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  2fc6944c
- [BugFix] Fix GGUF tp>1 when vocab_size is not divisible by 64 (#12230) · 5fe6bf29
  Nicolò Lucchesi authored Jan 21, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5fe6bf29
- [AMD][Build] Porting dockerfiles from the ROCm/vllm fork (#11777) · d4b62d46
  Gregory Shtrasberg authored Jan 20, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  d4b62d46
- Add quantization and guided decoding CODEOWNERS (#12228) · ecf67814
  Michael Goin authored Jan 20, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  ecf67814
- [Kernel] optimize moe_align_block_size for cuda graph and large num_experts... · 750f4cab
  Jinzhen Lin authored Jan 21, 2025
```
[Kernel] optimize moe_align_block_size for cuda graph and large num_experts (e.g. DeepSeek-V3) (#12222)
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  750f4cab
- [bugfix] catch xgrammar unsupported array constraints (#12210) · 06a760d6
  Cheng Kuan Yong Jason authored Jan 21, 2025
```
Signed-off-by: Jason Cheng <jasoncky96@gmail.com>
```
  06a760d6
- [misc] add cuda runtime version to usage data (#12190) · da751221
  youkaichao authored Jan 21, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  da751221
20 Jan, 2025 13 commits
- fix: update platform detection for M-series arm based MacBook processors (#12227) · af69a6ad
  Işık authored Jan 20, 2025
```
Signed-off-by: isikhi <huseyin.isik000@gmail.com>
```
  af69a6ad
- [Misc] Update CODEOWNERS (#12229) · 7bd36300
  Roger Wang authored Jan 20, 2025
  
  7bd36300
- [CI] Pass local python version explicitly to pre-commit mypy.sh (#12224) · 96663699
  Chen Zhang authored Jan 20, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  96663699
- [Bugfix] Fix `HfExampleModels.find_hf_info` (#12223) · 18572e33
  Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  18572e33
- [Misc] Pass `attention` to impl backend (#12218) · 86bfb6db
  wangxiyuan authored Jan 20, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  86bfb6db
- [V1] Remove `_get_cache_block_size` (#12214) · 5f0ec393
  Chen Zhang authored Jan 20, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  5f0ec393
- [core][bugfix] configure env var during import vllm (#12209) · c222f479
  youkaichao authored Jan 20, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  c222f479
- [misc] print a message to suggest how to bypass commit hooks (#12217) · 170eb350
  youkaichao authored Jan 20, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  170eb350
- [Model] Upgrade Aria to transformers 4.48 (#12203) · b37d8279
  Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b37d8279
- [CI/Build] Make pre-commit faster (#12212) · 3127e975
  Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3127e975
- [CI/Build] Remove dummy CI steps (#12208) · 4001ea12
  Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4001ea12
- [misc] add placeholder format.sh (#12206) · 5c89a29c
  youkaichao authored Jan 20, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  5c89a29c
- [Core] Interface for accessing model from `VllmRunner` (#10353) · 59a0192f
  Cyrus Leung authored Jan 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59a0192f