Commits · 02798ecabed36f4c255f5a12ad6c271f95cd8c4e · OpenDAS / vllm_cscc · GitLab

18 Jan, 2025 1 commit
- [Model] Port deepseek-vl2 processor, remove dependency (#12169) · 02798eca
  Isotr0py authored Jan 18, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  02798eca
16 Jan, 2025 4 commits
- [Model] Add support for deepseek-vl2-tiny model (#12068) · 62b06ba2
  Isotr0py authored Jan 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  62b06ba2
- [Bugfix] Fix max image feature size for Llava-one-vision (#12104) · 874f7c29
  Roger Wang authored Jan 16, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  874f7c29
- [Bugfix] Remove hardcoded `head_size=256` for Deepseek v2 and v3 (#12067) · dd7c9ad8
  Isotr0py authored Jan 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  dd7c9ad8
- Various cosmetic/comment fixes (#12089) · 9aa1519f
  Michael Goin authored Jan 16, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  9aa1519f
15 Jan, 2025 3 commits
- [Misc][Quark] Upstream Quark format to VLLM (#10765) · de0526f6
  kewang-xlnx authored Jan 16, 2025
```
Signed-off-by: kewang-xlnx <kewang@xilinx.com>
Signed-off-by: kewang2 <kewang2@amd.com>
Co-authored-by: kewang2 <kewang2@amd.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  de0526f6
- [Model]: Support internlm3 (#12037) · 97eb97b5
  RunningLeon authored Jan 15, 2025
  
  97eb97b5
- [Kernel] Support MulAndSilu (#11624) · 42f5e7c5
  Jee Jee Li authored Jan 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  42f5e7c5
14 Jan, 2025 1 commit
- [Misc] Merge bitsandbytes_stacked_params_mapping and packed_modules_mapping (#11924) · a3a3ee4e
  Jee Jee Li authored Jan 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a3a3ee4e
13 Jan, 2025 4 commits
- [Misc] Fix Deepseek V2 fp8 kv-scale remapping (#11947) · cf6bbcb4
  Concurrensee authored Jan 13, 2025
```
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
```
  cf6bbcb4
- [CI][Spec Decode] fix: broken test for EAGLE model (#11972) · 80ea3af1
  Sungjae Lee authored Jan 13, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
```
  80ea3af1
- [Bug] Fix usage of `.transpose()` and `.view()` consecutively. (#11979) · 9dd02d85
  Siyuan Li authored Jan 13, 2025
  
  9dd02d85
- [Model] Support GGUF models newly added in `transformers` 4.46.0 (#9685) · d14e98d9
  Isotr0py authored Jan 13, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d14e98d9
12 Jan, 2025 1 commit
- [Model] Initialize support for Deepseek-VL2 models (#11578) · f967e51f
  Isotr0py authored Jan 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  f967e51f
11 Jan, 2025 3 commits
- [Model] Add cogagent model support vLLM (#11742) · 4b657d32
  sixgod authored Jan 12, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  4b657d32
- [Bugfix] Fix RobertaModel loading (#11940) · d697dc01
  Nicolò Lucchesi authored Jan 11, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d697dc01
- [Bugfix][SpecDecode] Adjust Eagle model architecture to align with intended design (#11672) · 2118d056
  Sungjae Lee authored Jan 11, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
```
  2118d056
10 Jan, 2025 5 commits
- [Bugfix] Check that number of images matches number of <|image|> tokens with mllama (#11939) · d45cbe70
  Travis Johnson authored Jan 10, 2025
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
```
  d45cbe70
- [Misc] Clean up debug code in Deepseek-V3 (#11930) · 46fa98cc
  Isotr0py authored Jan 11, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  46fa98cc
- [platform] support custom torch.compile backend key (#11318) · 20410b2f
  wangxiyuan authored Jan 10, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  20410b2f
- Replace "online inference" with "online serving" (#11923) · d85c47d6
  Harry Mellor authored Jan 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d85c47d6
- [VLM] Enable tokenized inputs for merged multi-modal processor (#11900) · b844b99a
  Cyrus Leung authored Jan 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b844b99a
09 Jan, 2025 2 commits

[Doc] Add model development API Reference (#11884) · 65097ca0
Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
65097ca0

[Misc] Move `print_*_once` from utils to logger (#11298) · d848800e

Cyrus Leung authored Jan 09, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>
Co-authored-by: Maxime Fournioux <55544262+mfournioux@users.noreply.github.com>

d848800e

08 Jan, 2025 3 commits
- [Misc] Move some model utils into vision file (#11848) · ca47e176
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca47e176
- [VLM] Reorganize profiling/processing-related code (#11812) · 2a0596bc
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2a0596bc
- [Bugfix] Fix image input for Pixtral-HF (#11741) · 91445c7b
  Cyrus Leung authored Jan 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91445c7b
07 Jan, 2025 6 commits
- [Bugfix] update the prefix for qwen2 (#11795) · c994223d
  jiangjiadi authored Jan 08, 2025
```
Co-authored-by: jiadi.jjd <jiadi.jjd@antgroup.com>
```
  c994223d
- [V1] Support audio language models on V1 (#11733) · 2de197bd
  Roger Wang authored Jan 07, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2de197bd
- [Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800) · 8f37be38
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8f37be38
- [Bugfix] Update attention interface in `Whisper` (#11784) · 0f3f3c86
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  0f3f3c86
- [Model] Future-proof Qwen2-Audio multi-modal processor (#11776) · d0169e1b
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d0169e1b
- [Bugfix] Fix LLaVA-NeXT feature size precision error (for real) (#11772) · 08fb75c7
  Cyrus Leung authored Jan 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  08fb75c7
06 Jan, 2025 5 commits
- [V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae
  Roger Wang authored Jan 06, 2025
```
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  91b361ae
- [Kernel] Move attn_type to Attention.__init__() (#11690) · e20c92bb
  Chen Zhang authored Jan 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  e20c92bb
- [Bugfix][V1] Fix molmo text-only inputs (#11676) · 32c9eff2
  Jee Jee Li authored Jan 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  32c9eff2
- [Bugfix] Fix max image size for LLaVA-Onevision (#11769) · 9279b9f8
  Roger Wang authored Jan 06, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9279b9f8
- [VLM] Separate out profiling-related logic (#11746) · 996357e4
  Cyrus Leung authored Jan 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  996357e4
04 Jan, 2025 2 commits
- [Model] Remove unnecessary weight initialization logic (#11736) · 65c08928
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  65c08928
- [Bugfix] Fix precision error in LLaVA-NeXT (#11735) · ba214dff
  Cyrus Leung authored Jan 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba214dff