Commits · 6c4dbe23eb85e5d1da00ccaf4923a275d8769a7f · OpenDAS / vllm_cscc · GitLab

11 Feb, 2025 1 commit
- Set `torch_dtype` in `TransformersModel` (#13088) · ad977635
  Harry Mellor authored Feb 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ad977635
10 Feb, 2025 3 commits
- [Model] Ultravox Model: Support v0.5 Release (#12912) · 08b2d845
  Farzad Abdolhosseini authored Feb 10, 2025
```
Signed-off-by: Farzad Abdolhosseini <farzad@fixie.ai>
```
  08b2d845
- [Bugfix] Clean up and fix multi-modal processors (#13012) · 51f0b5f7
  Cyrus Leung authored Feb 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51f0b5f7
- [core] fix sleep mode and pytorch checkpoint compatibility (#13001) · b2496bb0
  youkaichao authored Feb 10, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  b2496bb0
08 Feb, 2025 6 commits
- [RFC] [Mistral] FP8 format (#10130) · d366ccc4
  Patrick von Platen authored Feb 08, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  d366ccc4
- [VLM] Merged multi-modal processor for GLM4V (#12449) · 86222a3d
  Jee Jee Li authored Feb 09, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  86222a3d
- [Misc] Add qwen2.5-vl BNB support (#12944) · 4c8dd12e
  Isotr0py authored Feb 08, 2025
  
  4c8dd12e
- [Misc] Log time consumption on weight downloading (#12926) · 011e612d
  Jun Duan authored Feb 08, 2025
  
  011e612d
- [Hardware][Intel-Gaudi] Enable long-contexts + LoRA support for Intel Gaudi (#12812) · 2880e21e
  Sanju C Sudhakaran authored Feb 08, 2025
```
Signed-off-by: Sanju C Sudhakaran <scsudhakaran@habana.ai>
```
  2880e21e
- [Bugfix] Fix Qwen2_5_VLForConditionalGeneration packed_modules_mapping (#12905) · 306923da
  Jee Jee Li authored Feb 08, 2025
  
  306923da
07 Feb, 2025 3 commits
- [ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation... · eaa92d44
  TJian authored Feb 08, 2025
```
[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)
```
  eaa92d44
- PR #12718 (#12718) · 538fab93
  Amit Garg authored Feb 07, 2025
  
  538fab93
- [Bugfix] Missing quant_config in deepseek embedding layer (#12836) · aa375dca
  Szymon Ożóg authored Feb 07, 2025
  
  aa375dca
06 Feb, 2025 11 commits
- [MISC] Check space in the file names in the pre commit checks (#12804) · 741429a4
  Lu Fang authored Feb 06, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  741429a4
- Add Bamba Model (#10909) · aff40457
  Yu Chin Fabian Lim authored Feb 07, 2025
```
Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  aff40457
- [V1] LoRA Support (#10957) · 467a96a5
  Varun Sundar Rabindranath authored Feb 06, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  467a96a5
- [Kernel] Make rotary_embedding ops more flexible with input shape (#12777) · 85ac82d2
  Isotr0py authored Feb 07, 2025
  
  85ac82d2
- [Misc] Update w2 scale loading for GPTQMarlinMoE (#12757) · 7ca9934f
  Dipika Sikka authored Feb 06, 2025
  
  7ca9934f
- [Misc] Remove duplicated DeepSeek V2/V3 model definition (#12793) · 449d1bce
  Michael Goin authored Feb 06, 2025
  
  449d1bce
- Improve `TransformersModel` UX (#12785) · 1a6fcad4
  Harry Mellor authored Feb 06, 2025
  
  1a6fcad4
- [Model] LoRA Support for Ultravox model (#11253) · d88506dd
  Sumit Vij authored Feb 05, 2025
  
  d88506dd
- [Misc][Easy] Remove the space from the file name · 9cdea30b
  Lu Fang authored Feb 05, 2025
  
  9cdea30b
- [Bugfix] Better FP8 supported defaults · 76abd0c8
  Lucas Wilkinson authored Feb 05, 2025
  
  76abd0c8
- [VLM] Update compatibility with transformers 4.49 · 75404d04
  Cyrus Leung authored Feb 06, 2025
  
  75404d04
05 Feb, 2025 8 commits
- [VLM] Qwen2.5-VL · bf3b79ef
  Roger Wang authored Feb 05, 2025
  
  bf3b79ef
- [VLM] Use shared field to pass token ids to model · a4ce74c1
  Cyrus Leung authored Feb 06, 2025
  
  a4ce74c1
- Add: Support for Sparse24Bitmask Compressed Models · 3b2005e1
  Rahul Tuli authored Feb 05, 2025
  
  3b2005e1
- [Bugfix] Fix OpenVINO model runner (#12750) · fcf2e3d7
  Harry Mellor authored Feb 05, 2025
  
  fcf2e3d7
- [Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634) · 7ff7a638
  Kyle Sayers authored Feb 05, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  7ff7a638
- [VLM] Add MLA with pure RoPE support for deepseek-vl2 models (#12729) · 98fd089f
  Isotr0py authored Feb 05, 2025
  
  98fd089f
- Refactor `Linear` handling in `TransformersModel` (#12727) · 249824c3
  Harry Mellor authored Feb 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  249824c3
- [Core] add and implement `VLLM_LOGITS_PROCESSOR_THREADS` (#12368) · b3a0d01e
  Aviv Keshet authored Feb 04, 2025
```
Signed-off-by: Aviv Keshet <akeshet@scaledcognition.com>
```
  b3a0d01e
04 Feb, 2025 8 commits
- [Bugfix] Fix loading of fine-tuned models based on Phi-3-Small (#12689) · 6469038b
  Michael Greenbaum authored Feb 04, 2025
```
Signed-off-by: Michael Greenbaum <mgreenbaum@microsoft.com>
Co-authored-by: Michael Greenbaum <mgreenbaum@microsoft.com>
```
  6469038b
- [VLM] merged multimodal processor and V1 support for idefics3 (#12660) · 815079de
  Isotr0py authored Feb 04, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  815079de
- [VLM] Merged multi-modal processor for InternVL-based models (#12553) · d1ca7df8
  Cyrus Leung authored Feb 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  d1ca7df8
- [Misc] Add BNB quantization for Whisper (#12381) · 96b23621
  Jee Jee Li authored Feb 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  96b23621
- [AMD][ROCm] Enable DeepSeek model on ROCm (#12662) · c36ac98d
  Hongxia Yang authored Feb 04, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  c36ac98d
- [Quant] Fix use_mla TypeError and support loading pure-sparsity Compressed Tensors configs (#12711) · 4896d0c2
  Kyle Sayers authored Feb 04, 2025
  
  4896d0c2
- [Doc] Replace ibm-fms with ibm-ai-platform (#12709) · bb392af4
  Thomas Parnell authored Feb 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  bb392af4
- Support Pixtral-Large HF by using llava multimodal_projector_bias config (#12710) · 5d98d560
  Michael Goin authored Feb 03, 2025
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  5d98d560