Commits · 583a9778e0bc65b031bc3e430d8f13655f727ec7 · OpenDAS / vllm_cscc

"cacheflow/models/model_utils.py" did not exist on "ee9442518d88925e96c36f1a039d61893d224e78"

17 Mar, 2025 8 commits
- [Benchmark] Do not save detailed info to json by default (#14879) · 583a9778
  Simon Mo authored Mar 16, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  583a9778
- [Misc] Replace os environ to monkeypatch in test suite (#14516) · a73e183e
  Sibi authored Mar 17, 2025
```
Signed-off-by: sibi <85477603+t-sibiraj@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  a73e183e
- [BugFix] Fix MLA + V1 + TP==1 causing reinitialization of cuda context (#14910) · 1e799b7e
  Lucas Wilkinson authored Mar 16, 2025
  
  1e799b7e
- [V1][Minor] Add __repr__ to ConstantList (#14907) · 7f6c5ee0
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f6c5ee0
- [V1] Optimize the overhead of rewinding (#14905) · faa02757
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  faa02757
- [CI/Build] Update defaults for test reproducibility (#14893) · 8a5a9b70
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8a5a9b70
- [CI] Nightly Tests (#14898) · bb3aeddf
  Robert Shaw authored Mar 16, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
```
  bb3aeddf
- [V1] Enable Entrypoints Tests (#14903) · aecc780d
  Robert Shaw authored Mar 16, 2025
  
  aecc780d
16 Mar, 2025 13 commits
- [Doc] Add guidance for using `ccache` with `pip install -e .` in doc (#14901) · 90df7f23
  Vadim Gimpelson authored Mar 17, 2025
  
  90df7f23
- [Misc] Catching Ray Compiled Graph PP test failures for V1 (#14847) · b9b5bdfc
  Rui Qiao authored Mar 16, 2025
  
  b9b5bdfc
- [V1][BugFix] Detect interleaved sliding window attention (#14896) · 31060b27
  Woosuk Kwon authored Mar 16, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  31060b27
- [BugFix][V1] Fix overhead related to bad_words sampling when not in use (#14894) · fc1f6771
  Nick Hill authored Mar 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  fc1f6771
- Revert "[Bugfix] Limit profiling run sequence length by max_model_len (#14785) (#14892) · f6137adb
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6137adb
- [Bugfix] Explicitly disable Phi-4-multimodal in V1 (#14889) · e53b1350
  Cyrus Leung authored Mar 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e53b1350
- [Bugfix] Limit profiling run sequence length by max_model_len (#14785) · d30aa7e9
  Kyle Sayers authored Mar 16, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d30aa7e9
- [V1] [Spec Decode] Fix ngram tests (#14878) · d1ad2a57
  Lily Liu authored Mar 16, 2025
  
  d1ad2a57
- [BugFix] Fix torch distributed stateless PG backend init (#14870) · b82662d9
  Nick Hill authored Mar 15, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b82662d9
- [Kernel] Add more tuned configs (#14877) · 71c1e071
  Simon Mo authored Mar 15, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  71c1e071
- [V1] Remove V0 fallback for mistral-tokenizer (#14873) · b30c75dd
  Roger Wang authored Mar 15, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  b30c75dd
- [VLM] Clean up Phi-4-MM ViT implementation (#14812) · def232e1
  Isotr0py authored Mar 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  def232e1
- [Misc][Doc] Minor benchmark README update (#14874) · 3453b964
  Roger Wang authored Mar 15, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  3453b964
15 Mar, 2025 19 commits
- [VLM] Merged multi-modal processor for Pixtral (#12211) · 61c6a5a7
  Rémi Delacourt authored Mar 15, 2025
```
Signed-off-by: remi <remi@mistral.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61c6a5a7
- [Core] Expose API endpoint `/is_sleeping` (#14312) · 74bc397b
  Jun Duan authored Mar 15, 2025
```
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
```
  74bc397b
- [CI][Intel GPU] refine intel GPU ci docker build (#14860) · f58aea00
  Kunshang Ji authored Mar 15, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f58aea00
- [VLM] Limit multimodal input cache by memory (#14805) · 3556a414
  Cyrus Leung authored Mar 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3556a414
- [Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
  Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  9ed6ee92
- [Build/CI] Upgrade jinja2 to get 3 moderate CVE fixes (#14839) · ee3778d5
  Russell Bryant authored Mar 15, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ee3778d5
- [Doc] V1 user guide (#13991) · aaacf173
  Jennifer Zhao authored Mar 14, 2025
```
Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Jennifer Zhao <JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  aaacf173
- [V1][Structured Output] calculate vocab_size eagerly (#14851) · 4c7629ca
  Aaron Pham authored Mar 15, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  4c7629ca
- [CI/Build] Delete LoRA bias test (#14849) · e0fdfa16
  Jee Jee Li authored Mar 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e0fdfa16
- [Attention] Get rid of mla cache alignment (#14842) · 5952d8ab
  Lucas Wilkinson authored Mar 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  5952d8ab
- [CPU] Support FP8 KV cache (#14741) · a2ae4965
  Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a2ae4965
- [Docs] Add new East Coast vLLM Meetup slides to README and meetups.md (#14852) · 877e3522
  Simon Mo authored Mar 14, 2025
  
  877e3522
- [V1] V1 Enablement Oracle (#13726) · d4d93db2
  Robert Shaw authored Mar 15, 2025
```
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  d4d93db2
- [Misc][Easy] Annotate unused vars in the csrc files (#14798) · 8c0d15d5
  Lu Fang authored Mar 14, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8c0d15d5
- [Misc] Remove misleading message in gemma2 and gemma3 (#14850) · 97ac781c
  Isotr0py authored Mar 15, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  97ac781c
- Disable outlines cache by default (#14837) · 776dcec8
  Russell Bryant authored Mar 14, 2025
  
  776dcec8
- Revert "[Model] Mamba2 Prefill Performance Tweaks: Fixing Flurry of U… (#14848) · ccf02fcb
  Tyler Michael Smith authored Mar 14, 2025
  
  ccf02fcb
- [Bugfix][V1] Fix flashinfer sampling (#14815) · acaea3bb
  DefTruth authored Mar 15, 2025
  
  acaea3bb
- [Neuron][CI] update docker run command (#14829) · 9f374227
  Liangfu Chen authored Mar 14, 2025
```
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
```
  9f374227