Commits · 6650e6a930dbdf1cd4def9b58e952376400ccfcf · OpenDAS / vllm_cscc · GitLab

26 Oct, 2024 3 commits
- [Model] Add classification Task with Qwen2ForSequenceClassification (#9704) · 6650e6a9
  kakao-kevin-us authored Oct 27, 2024
```
Signed-off-by: Kevin-Yang <ykcha9@gmail.com>
Co-authored-by: Kevin-Yang <ykcha9@gmail.com>
```
  6650e6a9
- [Frontend] Bad words sampling parameter (#9717) · 07e981fd
  Vasiliy Alekseev authored Oct 26, 2024
```
Signed-off-by: Vasily Alexeev <alvasian@yandex.ru>
```
  07e981fd
- [Hardware][openvino] is_openvino --> current_platform.is_openvino (#9716) · 5cbdccd1
  Mengqing Cao authored Oct 26, 2024
  
  5cbdccd1
25 Oct, 2024 3 commits
- [Bugfix] Fix crash with llama 3.2 vision models and guided decoding (#9631) · 6567e137
  Travis Johnson authored Oct 25, 2024
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Co-authored-by: pavlo-ruban <pavlo.ruban@servicenow.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
  6567e137
- [Bugfix] Fix compressed_tensors_moe bad config.strategy (#9677) · ca0d9222
  Michael Goin authored Oct 25, 2024
  
  ca0d9222
- [Model] add a lora module for granite 3.0 MoE models (#9673) · a6f37218
  Will Johnson authored Oct 25, 2024
  
  a6f37218
24 Oct, 2024 11 commits
- [Bugfix] Remove xformers requirement for Pixtral (#9597) · c91ed47c
  Michael Goin authored Oct 24, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  c91ed47c
- [Performance][Kernel] Fused_moe Performance Improvement (#9384) · 59449095
  Charlie Fu authored Oct 24, 2024
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  59449095
- [Model] Compute Llava Next Max Tokens / Dummy Data From Gridpoints (#9650) · 722d46ed
  Alex Brooks authored Oct 24, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  722d46ed
- [torch.compile] Adding torch compile annotations to some models (#9641) · d27cfbf7
  Yongzao authored Oct 25, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  d27cfbf7
- [Bugfix]Disable the post_norm layer of the vision encoder for LLaVA models (#9653) · f5845496
  litianjian authored Oct 24, 2024
  
  f5845496
- [torch.compile] expanding support and fix allgather compilation (#9637) · ad6f7805
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  ad6f7805
- [Kernel] add kernel for FATReLU (#9610) · 295a061f
  Jee Jee Li authored Oct 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  295a061f
- [torch.compile] Adding torch compile annotations to some models (#9639) · 8a02cd04
  Yongzao authored Oct 24, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8a02cd04
- [Bugfix] Fix PP for ChatGLM and Molmo (#9422) · 836e8ef6
  Cyrus Leung authored Oct 24, 2024
  
  836e8ef6
- [Bugfix] Use "vision_model" prefix for MllamaVisionModel (#9628) · b7df53cd
  Michael Goin authored Oct 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  b7df53cd
- [Bugfix][Model] Fix Mllama SDPA illegal memory access for batched multi-image (#9626) · bb01f291
  Michael Goin authored Oct 23, 2024
```
Signed-off-by: mgoin <michael@neuralmagic.com>
```
  bb01f291
23 Oct, 2024 9 commits
- [Model] Add Qwen2-Audio model support (#9248) · fc6c2746
  Yunfei Chu authored Oct 24, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fc6c2746
- [torch.compile] Adding torch compile annotations to some models (#9614) · 9013e24f
  Yongzao authored Oct 24, 2024
  
  9013e24f
- [misc] comment to avoid future confusion about baichuan (#9620) · dbdd3b5e
  youkaichao authored Oct 23, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  dbdd3b5e
- [Bugfix] Fix `_init_vision_model` in NVLM_D model (#9611) · e7116c01
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  e7116c01
- [Model] Add min_pixels / max_pixels to Qwen2VL as mm_processor_kwargs (#9612) · 31a08f5b
  Alex Brooks authored Oct 23, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  31a08f5b
- [VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217) · c18e1a34
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  c18e1a34
- [Model] Initialize Florence-2 language backbone support (#9555) · 3ff57ebf
  Isotr0py authored Oct 23, 2024
  
  3ff57ebf
- [Hardware][XPU] using current_platform.is_xpu (#9605) · 2394962d
  Mengqing Cao authored Oct 23, 2024
  
  2394962d
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
22 Oct, 2024 7 commits
- [torch.compile] auto infer dynamic_arg_dims from type annotation (#9589) · 17c79f3c
  youkaichao authored Oct 22, 2024
  
  17c79f3c
- [Bugfix] Eagle: change config name for fc bias (#9580) · 08075c34
  gopalsarda authored Oct 22, 2024
  
  08075c34
- [Model][VLM] Initialize support for Mono-InternVL model (#9528) · bb392ea2
  Isotr0py authored Oct 23, 2024
  
  bb392ea2
- [V1] Implement vLLM V1 [1/N] (#9289) · 6c5af09b
  Woosuk Kwon authored Oct 22, 2024
  
  6c5af09b
- [Hardware][CPU] using current_platform.is_cpu (#9536) · 3ddbe255
  wangshuai09 authored Oct 22, 2024
  
  3ddbe255
- support TP in qwen2 bnb (#9574) · 0d02747f
  chenqianfzh authored Oct 22, 2024
  
  0d02747f
- [Bugfix]: phi.py get rope_theta from config file (#9503) · 74692421
  Falko1 authored Oct 22, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  74692421
21 Oct, 2024 2 commits
- [Model][Bugfix] Fix batching with multi-image in PixtralHF (#9518) · 5241aa14
  Michael Goin authored Oct 21, 2024
  
  5241aa14
- [Model] FalconMamba Support (#9325) · f6b97293
  Dhia Eddine Rhaiem authored Oct 21, 2024
  
  f6b97293
20 Oct, 2024 1 commit
- [Model][Pixtral] Use memory_efficient_attention for PixtralHFVision (#9520) · 962d2c63
  Michael Goin authored Oct 20, 2024
  
  962d2c63
19 Oct, 2024 1 commit
- [Model][Pixtral] Optimizations for input_processor_for_pixtral_hf (#9514) · 8e3e7f27
  Michael Goin authored Oct 19, 2024
  
  8e3e7f27
18 Oct, 2024 3 commits
- [Model] Support Pixtral models in the HF Transformers format (#9036) · 3921a2f2
  Michael Goin authored Oct 18, 2024
  
  3921a2f2
- [Qwen2.5] Support bnb quant for Qwen2.5 (#9467) · 154a8ae8
  Haoyu Wang authored Oct 18, 2024
  
  154a8ae8
- [BugFix] Stop silent failures on compressed-tensors parsing (#9381) · 48138a84
  Dipika Sikka authored Oct 17, 2024
  
  48138a84