Commits · 27949354faa06035645aa908cc73922500a80b17 · OpenDAS / vllm_cscc · GitLab

01 Jul, 2025 1 commit

[Feature] A calibration-free RTN-based quantization for accurate and... · 27949354

Alex Kogan authored Jul 01, 2025


[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

27949354

29 Jun, 2025 1 commit
- [Quantization] Add compressed-tensors NVFP4 MoE Support (#19990) · 6f2f53a8
  Dipika Sikka authored Jun 30, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  6f2f53a8
23 Jun, 2025 2 commits
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
- [Bugfix] Fix CI bitsandbytes failure (#19969) · a6e6604d
  Jee Jee Li authored Jun 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a6e6604d
16 Jun, 2025 1 commit
- [Quantization] Remove FP4 emulation; Fall-back to marlin for device < 100 (#19563) · 6bc7b573
  Dipika Sikka authored Jun 16, 2025
  
  6bc7b573
12 Jun, 2025 1 commit
- Fix TorchAOConfig skip layers (#19265) · 96846bb3
  mobicham authored Jun 12, 2025
```
Signed-off-by: mobicham <hicham@mobiuslabs.com>
```
  96846bb3
08 Jun, 2025 1 commit
- [Quantization] Add compressed-tensors NVFP4 support (#18312) · c123bc33
  Dipika Sikka authored Jun 08, 2025
  
  c123bc33
06 Jun, 2025 2 commits
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- Fix AOPerModuleConfig name changes (#18869) · c8134bea
  Jerry Zhang authored Jun 05, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c8134bea
05 Jun, 2025 1 commit
- [Quantization] Skip Fp4 Test for `compressed-tensors` (#19217) · aa49f148
  Dipika Sikka authored Jun 05, 2025
  
  aa49f148
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
20 May, 2025 1 commit
- [Misc] Add LoRA code owner (#18387) · 6b35cb10
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6b35cb10
19 May, 2025 2 commits
- [Feature]Add support for models quantized with AutoRound (#17850) · e2ee1e8e
  Wenhua Cheng authored May 20, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  e2ee1e8e
- [Quantization] Pool model support bitsandbytes (#18087) · 6781af56
  Jee Jee Li authored May 20, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6781af56
14 May, 2025 1 commit
- Add support for loading torchao models with `AOPerModuleConfig` (#17826) · 79747367
  Jerry Zhang authored May 14, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  79747367
11 May, 2025 1 commit
- [Misc] Add compressed-tensors NVFP4A16 emulation support (#17914) · cd3edfc9
  Dipika Sikka authored May 11, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  cd3edfc9
08 May, 2025 1 commit

[Bugfix] Fix quark fp8 format loading on AMD GPUs (#12612) · bb239a73

fxmarty-amd authored May 08, 2025


Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: kewang2 <kewang2@amd.com>
Co-authored-by: kewang2 <kewang2@amd.com>

bb239a73

02 May, 2025 1 commit
- Add `pt_load_map_location` to allow loading to cuda (#16869) · 109e15a3
  Jerry Zhang authored May 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  109e15a3
30 Apr, 2025 1 commit
- Improve configs - `ModelConfig` (#17130) · 13698db6
  Harry Mellor authored Apr 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13698db6
15 Apr, 2025 1 commit
- [Misc] Update `compressed-tensors` WNA16 to support zero-points (#14211) · 54a66e5f
  Dipika Sikka authored Apr 15, 2025
  
  54a66e5f
11 Apr, 2025 1 commit
- [Bugfix] Fix bugs of running Quark quantized models (#16236) · 9e90c9f7
  chaow-amd authored Apr 11, 2025
```
Signed-off-by: chaow <chaow@amd.com>
```
  9e90c9f7
07 Apr, 2025 1 commit
- Torchao (#14231) · 652907b3
  Driss Guessous authored Apr 07, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  652907b3
05 Apr, 2025 1 commit
- [Misc] Auto detect bitsandbytes pre-quantized models (#16027) · 4285e423
  Tristan Leclercq authored Apr 05, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  4285e423
31 Mar, 2025 1 commit
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
29 Mar, 2025 1 commit
- [FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433) · 4965ec42
  TJian authored Mar 29, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  4965ec42
28 Mar, 2025 2 commits
- Fix cpu offload testing for gptq/awq/ct (#15648) · 47e9038d
  Michael Goin authored Mar 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  47e9038d
- [Quantization][V1] BitsAndBytes support V1 (#15611) · 726efc6a
  Jee Jee Li authored Mar 28, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  726efc6a
26 Mar, 2025 1 commit

[FEAT][ROCm] Integrate Fused MoE Kernels from AITER (#14967) · 5ebf6674

vllmellm authored Mar 26, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

5ebf6674

17 Mar, 2025 2 commits
- [Bugfix] Fix bnb quantization for models with both HF-format and Mistral-format weights (#14950) · 5eeabc2a
  Tristan Leclercq authored Mar 18, 2025
  
  5eeabc2a
- [Bugfix][ROCm] running new process using spawn method for rocm in tests. (#14810) · 2bb0e1a7
  vllmellm authored Mar 17, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  2bb0e1a7
15 Mar, 2025 1 commit

[V1] V1 Enablement Oracle (#13726) · d4d93db2

Robert Shaw authored Mar 15, 2025


Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

d4d93db2

11 Mar, 2025 1 commit
- dynamic distpatch of fp8 kernels (#14245) · a1c8f379
  Jeff Daily authored Mar 11, 2025
```
Signed-off-by: Jeff Daily <jeff.daily@amd.com>
```
  a1c8f379
03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
01 Mar, 2025 1 commit
- [Misc][Kernel]: Add GPTQAllSpark Quantization (#12931) · 6a92ff93
  YajieWang authored Mar 01, 2025
  
  6a92ff93
14 Feb, 2025 2 commits
- Consolidate Llama model usage in tests (#13094) · f2b20fe4
  Harry Mellor authored Feb 14, 2025
  
  f2b20fe4
- [Bugfix/CI] Turn test_compressed_tensors_2of4_sparse back on (#13250) · 09545c0a
  Tyler Michael Smith authored Feb 13, 2025
  
  09545c0a
12 Feb, 2025 2 commits
- [CI] Fix failing FP8 cpu offload test (#13170) · 14b7899d
  Michael Goin authored Feb 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  14b7899d
- [CORE] [QUANT] Support for GPTQModel's `dynamic` quantization per module override/control (#7086) · 36a08630
  Qubitium-ModelCloud authored Feb 13, 2025
  
  36a08630
07 Feb, 2025 1 commit

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation... · eaa92d44

TJian authored Feb 08, 2025

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

eaa92d44

05 Feb, 2025 1 commit
- Add: Support for Sparse24Bitmask Compressed Models · 3b2005e1
  Rahul Tuli authored Feb 05, 2025
  
  3b2005e1