Commits · db7c8ca910475d6cc4490d6a14dddc36c04b979b · OpenDAS / vllm_cscc · GitLab

18 Mar, 2025 5 commits
- [Misc] Embedding model support LoRA (#14935) · db7c8ca9
  Jee Jee Li authored Mar 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db7c8ca9
- [Mistral-Small 3.1] Update docs and tests (#14977) · f863ffc9
  Patrick von Platen authored Mar 18, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f863ffc9
- [Kernels] LoRA - Retire SGMV and BGMV Kernels (#14685) · 400d483e
  Varun Sundar Rabindranath authored Mar 18, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  400d483e
- [Doc][V1] Fix V1 APC doc (#14920) · d1695758
  Shanshan Shen authored Mar 18, 2025
  
  d1695758
- [Neuron] trim attention kernel tests to fit trn1.2x instance (#14988) · 53a0cf8b
  Liangfu Chen authored Mar 18, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  53a0cf8b
17 Mar, 2025 31 commits
- [Bugfix] Fix bnb quantization for models with both HF-format and Mistral-format weights (#14950) · 5eeabc2a
  Tristan Leclercq authored Mar 18, 2025
  
  5eeabc2a
- [V1] TPU - Fix CI/CD runner (#14974) · 18551e82
  Alexander Matveev authored Mar 17, 2025
  
  18551e82
- [V1] Guard Against Main Thread Usage (#14972) · e41e1602
  Robert Shaw authored Mar 17, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  e41e1602
- [CI/Build] Use `AutoModelForImageTextToText` to load VLMs in tests (#14945) · b89fb2a4
  Cyrus Leung authored Mar 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b89fb2a4
- [Bugfix] Fix interface for Olmo2 on V1 (#14976) · 5340b0e2
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  5340b0e2
- [Bugfix] Make Gemma3 MM V0 only for now (#14971) · 37e38061
  Roger Wang authored Mar 17, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  37e38061
- [Fix][Structured Output] using vocab_size to construct matcher (#14868) · c0efdd65
  Aaron Pham authored Mar 17, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  c0efdd65
- [Bugfix][Model] Mixtral: use unused head_dim config argument (#14961) · aaaec52a
  Quentin authored Mar 17, 2025
```
Signed-off-by: Quentin Torroba <quentin.torroba@mistral.ai>
```
  aaaec52a
- [Bugfix] Fix precommit - line too long in pixtral.py (#14960) · e1eb45d3
  Tyler Michael Smith authored Mar 17, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e1eb45d3
- [V1] Default MLA to V1 (#14921) · 89fca671
  Simon Mo authored Mar 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  89fca671
- Add patch merger (#14957) · d20b0c13
  Patrick von Platen authored Mar 17, 2025
  
  d20b0c13
- [Doc] Fix misleading log during multi-modal profiling (#14955) · 166a168b
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  166a168b
- [Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7
  vllmellm authored Mar 17, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  2bb0e1a7
- [Misc] Add `--seed` option to offline multi-modal examples (#14934) · 6eaf1e5c
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6eaf1e5c
- [Bugfix] Fix Ultravox on V1 (#14929) · 868a8c5b
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  868a8c5b
- [V1][TPU] Apply the ragged paged attention kernel fix and remove the padding. (#14846) · b4ad56c1
  iefgnoix authored Mar 17, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  b4ad56c1
- fix minor miscalled method (#14327) · 69698f25
  kushanam authored Mar 17, 2025
  
  69698f25
- [MISC] More AMD unused var clean up (#14926) · cd0cd851
  Lu Fang authored Mar 17, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  cd0cd851
- setup.py: drop assumption about local `main` branch (#14692) · 0a74bfce
  Russell Bryant authored Mar 17, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  0a74bfce
- [Doc] Add vLLM Beijing meetup slide (#14938) · dd3b8658
  Chen Zhang authored Mar 17, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  dd3b8658
- [Misc][XPU] Use None as device capacity for XPU (#14932) · 9b87a579
  Yan Ma authored Mar 17, 2025
```
Signed-off-by: yan ma <yan.ma@intel.com>
```
  9b87a579
- [V1] Remove input cache client (#14864) · b539222d
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  b539222d
- [V1] [Spec Decode] Support random sampling for spec decode (#13933) · 8d6cf895
  Lily Liu authored Mar 16, 2025
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8d6cf895
- [Benchmark] Do not save detailed info to json by default (#14879) · 583a9778
  Simon Mo authored Mar 16, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  583a9778
- [Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e
  Sibi authored Mar 17, 2025
```
Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  a73e183e
- [BugFix] Fix MLA + V1 + TP==1 causing reinitialization of cuda context (#14910) · 1e799b7e
  Lucas Wilkinson authored Mar 16, 2025
  
  1e799b7e
- [V1][Minor] Add __repr__ to ConstantList (#14907) · 7f6c5ee0
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f6c5ee0
- [V1] Optimize the overhead of rewinding (#14905) · faa02757
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  faa02757
- [CI/Build] Update defaults for test reproducibility (#14893) · 8a5a9b70
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a5a9b70
- [CI] Nightly Tests (#14898) · bb3aeddf
  Robert Shaw authored Mar 16, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  bb3aeddf
- [V1] Enable Entrypoints Tests (#14903) · aecc780d
  Robert Shaw authored Mar 16, 2025
  
  aecc780d
16 Mar, 2025 4 commits
- [Doc] Add guidance for using `ccache` with `pip install -e .` in doc (#14901) · 90df7f23
  Vadim Gimpelson authored Mar 17, 2025
  
  90df7f23
- [Misc] Catching Ray Compiled Graph PP test failures for V1 (#14847) · b9b5bdfc
  Rui Qiao authored Mar 16, 2025
  
  b9b5bdfc
- [V1][BugFix] Detect interleaved sliding window attention (#14896) · 31060b27
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  31060b27
- [BugFix][V1] Fix overhead related to bad_words sampling when not in use (#14894) · fc1f6771
  Nick Hill authored Mar 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  fc1f6771