Commits · 2c0f58203c111bcc331f931664400acfc94cb9bc · OpenDAS / vllm_cscc · GitLab

11 Feb, 2025 3 commits
- [Docs] Annouce Meta Meetup (#13065) · 2c0f5820
  Simon Mo authored Feb 10, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  2c0f5820
- [V1][Minor] Move scheduler outputs to a separate file (#13062) · 2ff48576
  Woosuk Kwon authored Feb 10, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2ff48576
- [misc] Fix setup.py condition to avoid AMD from being mistaken with CPU (#13022) · 91e87675
  Kevin H. Luu authored Feb 10, 2025
```
Signed-off-by: kevin <kevin@anyscale.com>
```
  91e87675
10 Feb, 2025 10 commits
- [Model] Ultravox Model: Support v0.5 Release (#12912) · 08b2d845
  Farzad Abdolhosseini authored Feb 10, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  08b2d845
- Fix seed parameter behavior in vLLM (#13007) · 2ae88905
  மனோஜ்குமார் பழனிச்சாமி authored Feb 10, 2025
```
Signed-off-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
```
  2ae88905
- [Bugfix] Clean up and fix multi-modal processors (#13012) · 51f0b5f7
  Cyrus Leung authored Feb 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0b5f7
- [misc] Add retries with exponential backoff for HF file existence check (#13008) · fde71262
  Kevin H. Luu authored Feb 10, 2025
  
  fde71262
- [Doc] Add link to tool_choice tracking issue in tool_calling.md (#13003) · 24313714
  Yuan Tang authored Feb 10, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  24313714
- [core] fix sleep mode and pytorch checkpoint compatibility (#13001) · b2496bb0
  youkaichao authored Feb 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b2496bb0
- Check if selected backend is None in get_attn_backend_cls() (#12975) · 44607e07
  Yuan Tang authored Feb 09, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  44607e07
- [V1] Use msgpack for core request serialization (#12918) · 67c4637c
  Nick Hill authored Feb 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67c4637c
- [core][rlhf] add colocate example for RLHF (#12984) · aa0ca5eb
  youkaichao authored Feb 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  aa0ca5eb
- [core] improve error handling when wake up from sleep mode (#12981) · 59fff4a0
  youkaichao authored Feb 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  59fff4a0
09 Feb, 2025 2 commits
- [MISC] Always import version library first in the vllm package (#12979) · 29f1d47e
  Lu Fang authored Feb 09, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  29f1d47e
- [core] port pynvml into vllm codebase (#12963) · cf797aa8
  youkaichao authored Feb 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  cf797aa8
08 Feb, 2025 23 commits
- [V1] Cache `uses_mrope` in GPUModelRunner (#12969) · 24700c34
  Woosuk Kwon authored Feb 08, 2025
  
  24700c34
- [RFC] [Mistral] FP8 format (#10130) · d366ccc4
  Patrick von Platen authored Feb 08, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  d366ccc4
- [V1][Minor] Remove outdated comment (#12968) · 870c3748
  Woosuk Kwon authored Feb 08, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  870c3748
- [VLM] Merged multi-modal processor for GLM4V (#12449) · 86222a3d
  Jee Jee Li authored Feb 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  86222a3d
- [bugfix] fix early import of flash attention (#12959) · fe743b79
  youkaichao authored Feb 09, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  fe743b79
- [Bugfix] Remove unused seq_group_metadata_list from ModelInputForGPU (#12935) · 913df14d
  shangmingc authored Feb 08, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  913df14d
- [CI/Build] Auto-fix Markdown files (#12941) · 8a69e0e2
  Cyrus Leung authored Feb 08, 2025
  
  8a69e0e2
- [Misc] Add qwen2.5-vl BNB support (#12944) · 4c8dd12e
  Isotr0py authored Feb 08, 2025
  
  4c8dd12e
- [Doc] Correct HF repository for TeleChat2 models (#12949) · 256a2d29
  Jun Duan authored Feb 08, 2025
  
  256a2d29
- [CI] Resolve transformers-neuronx version conflict (#12925) · c45d398e
  Liangfu Chen authored Feb 08, 2025
  
  c45d398e
- [Misc] Log time consumption on weight downloading (#12926) · 011e612d
  Jun Duan authored Feb 08, 2025
  
  011e612d
- [misc] Add LoRA to benchmark_serving (#12898) · 7e183767
  Varun Sundar Rabindranath authored Feb 08, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  7e183767
- [Hardware][Intel-Gaudi] Enable long-contexts + LoRA support for Intel Gaudi (#12812) · 2880e21e
  Sanju C Sudhakaran authored Feb 08, 2025
```
Signed-off-by: Sanju C Sudhakaran <scsudhakaran@habana.ai>
```
  2880e21e
- [Build] Make pypi install work on CPU platform (#12874) · 407b5537
  wangxiyuan authored Feb 08, 2025
  
  407b5537
- [V1][Minor] Move cascade attn logic outside _prepare_inputs (#12943) · 4ea48fb3
  Woosuk Kwon authored Feb 08, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4ea48fb3
- [Misc] Add offline test for disaggregated prefill (#12418) · e31498bd
  Shaoting authored Feb 08, 2025
  
  e31498bd
- [bugfix] respect distributed_executor_backend in world_size=1 (#12934) · 91dd8f7a
  youkaichao authored Feb 08, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  91dd8f7a
- [Bugfix] Fix multi-round chat error when mistral tokenizer is used (#12859) · d01f66b0
  zifeitong authored Feb 07, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  d01f66b0
- [Misc] Fix typo in the example file (#12896) · cc01223f
  Ke Zhao authored Feb 08, 2025
```
Signed-off-by: Zhao Ke <yingxiongraomingzk@gmail.com>
```
  cc01223f
- [Bugfix] Fix Qwen2_5_VLForConditionalGeneration packed_modules_mapping (#12905) · 306923da
  Jee Jee Li authored Feb 08, 2025
  
  306923da
- [V1] Move KV block hashes from Request to KVCacheManager (#12922) · 32431583
  Woosuk Kwon authored Feb 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  32431583
- [V1][Minor] Remove outdated comment (#12928) · b21f0f9d
  Woosuk Kwon authored Feb 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b21f0f9d
- [Bugfix] Fix disagg hang caused by the prefill and decode communication issues (#12723) · 45cbc499
  Lu Fang authored Feb 07, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  45cbc499
07 Feb, 2025 2 commits
- [V1] LM Eval With Streaming Integration Tests (#11590) · 932c6b74
  Robert Shaw authored Feb 07, 2025
  
  932c6b74
- [ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation... · eaa92d44
  TJian authored Feb 08, 2025
```
[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)
```
  eaa92d44