Commits · 4851c202bbfb5dadc5a3b3b4409d3f083f4e8e90 · OpenDAS / vllm_cscc

10 Sep, 2024 2 commits
- [CI/Build][Kernel] Update CUTLASS to 3.5.1 tag (#8043) · 94144e72
  Tyler Michael Smith authored Sep 10, 2024
  
  94144e72
- update version and requirements-rocm.txt · 6897826e
  zhuwenwen authored Sep 10, 2024
  
  6897826e
06 Sep, 2024 1 commit
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
28 Aug, 2024 1 commit
- [Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651) · fdd9daaf
  Mor Zusman authored Aug 29, 2024
  
  fdd9daaf
27 Aug, 2024 1 commit
- [Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7766) · fc911880
  Dipika Sikka authored Aug 27, 2024
```
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
```
  fc911880
22 Aug, 2024 2 commits
- [Bugfix] Don't build machete on cuda <12.0 (#7757) · 55d63b12
  Lucas Wilkinson authored Aug 22, 2024
  
  55d63b12
- Revert "[Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7527)" (#7764) · aae74ef9
  Michael Goin authored Aug 21, 2024
  
  aae74ef9
21 Aug, 2024 3 commits
- [Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7527) · 8678a69a
  Dipika Sikka authored Aug 21, 2024
```
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
```
  8678a69a
- [Bugfix] Pass PYTHONPATH from setup.py to CMake (#7730) · 1b32e026
  sasha0552 authored Aug 21, 2024
  
  1b32e026
- Refactoring the optimized kernel · 0aa2480f
  zhuwenwen authored Aug 21, 2024
  
  0aa2480f
20 Aug, 2024 1 commit
- [Kernel] (1/N) Machete - Hopper Optimized Mixed Precision Linear Kernel (#7174) · 5288c06a
  Lucas Wilkinson authored Aug 20, 2024
  
  5288c06a
13 Aug, 2024 1 commit
- fix build error · d1787c31
  zhuwenwen authored Aug 13, 2024
  
  d1787c31
12 Aug, 2024 2 commits
- [CI/Build] bump minimum cmake version (#6999) · 774cd1d3
  Daniele authored Aug 13, 2024
  
  774cd1d3
- change self.get_tokenizer_for_seq to get_tokenizer_for_seq · 6b16ea2e
  zhuwenwen authored Aug 12, 2024
  
  6b16ea2e
05 Aug, 2024 3 commits
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
- [Bugfix][CI/Build] Fix CUTLASS FetchContent (#7171) · 4cf1dc39
  Tyler Michael Smith authored Aug 05, 2024
  
  4cf1dc39
- [Kernel] Update CUTLASS to 3.5.1 (#7085) · 8571ac46
  Tyler Michael Smith authored Aug 05, 2024
  
  8571ac46
02 Aug, 2024 2 commits
- [Misc] Disambiguate quantized types via a new ScalarType (#6396) · a8d604ca
  Lucas Wilkinson authored Aug 02, 2024
  
  a8d604ca
- [CI/Build] Add support for Python 3.12 (#7035) · b482b9a5
  Michael Goin authored Aug 02, 2024
  
  b482b9a5
01 Aug, 2024 3 commits
- [CI/Build][Bugfix] Fix CUTLASS header-only line (#7034) · 6a11fdfb
  Tyler Michael Smith authored Aug 01, 2024
  
  6a11fdfb
- [CI/Build] Update PyTorch to 2.4.0 (#6951) · 7e0861bd
  Sage Moore authored Aug 01, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  7e0861bd
- [Kernel][RFC] Refactor the punica kernel based on Triton (#5036) · 7ecee343
  Jee Jee Li authored Aug 01, 2024
  
  7ecee343
31 Jul, 2024 1 commit
- Support W4A8 quantization for vllm (#5218) · 6512937d
  HandH1998 authored Jul 31, 2024
  
  6512937d
23 Jul, 2024 2 commits
- optimize rmsnorm kernel · c62f8e9a
  zhuwenwen authored Jul 23, 2024
  
  c62f8e9a
- refactoring the transpose kernel and update supported model · b2dd1743
  zhuwenwen authored Jul 23, 2024
  
  b2dd1743
22 Jul, 2024 1 commit
- pa优化，编译选项优化 · 1be9a629
  zhangshao authored Jul 22, 2024
  
  1be9a629
21 Jul, 2024 1 commit
- [Kernel][Core] Add AWQ support to the Marlin kernel (#6612) · 396d92d5
  Alexander Matveev authored Jul 21, 2024
  
  396d92d5
20 Jul, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA,... · 06d6c5fe
  Matt Wong authored Jul 20, 2024
```
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
```
  06d6c5fe
17 Jul, 2024 2 commits
- [Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338) · e76466dd
  Alexander Matveev authored Jul 17, 2024
  
  e76466dd
- add rotary_embedding for tgi · e499f96c
  huangwb authored Jul 17, 2024
  
  e499f96c
12 Jul, 2024 1 commit
- [MISC] Upgrade dependency to PyTorch 2.3.1 (#5327) · aa48e502
  Cody Yu authored Jul 12, 2024
  
  aa48e502
03 Jul, 2024 1 commit
- [Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (#5975) · 47f0954a
  Michael Goin authored Jul 03, 2024
  
  47f0954a
26 Jun, 2024 1 commit

[Kernel] Adding bias epilogue support for `cutlass_scaled_mm` (#5560) · 5bfd1bbc

Luka Govedič authored Jun 26, 2024


Co-authored-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

5bfd1bbc

25 Jun, 2024 1 commit
- [Hardware][AMD][CI/Build][Doc] Upgrade to ROCm 6.1, Dockerfile improvements, test fixes (#5422) · dd793d1d
  Matt Wong authored Jun 25, 2024
  
  dd793d1d
13 Jun, 2024 1 commit

[Kernel] Factor out epilogues from cutlass kernels (#5391) · 85657b56

Tyler Michael Smith authored Jun 13, 2024


Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: zifeitong <zifei.tong@parasail.io>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

85657b56

12 Jun, 2024 1 commit
- skip fp8 · 103f3110
  zhuwenwen authored Jun 12, 2024
  
  103f3110
09 Jun, 2024 1 commit
- [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) · 5467ac31
  bnellnm authored Jun 09, 2024
  
  5467ac31
02 Jun, 2024 1 commit
- [Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927) · a66cf40b
  Divakar Verma authored Jun 02, 2024
```
This PR enables the fused topk_softmax kernel used in moe layer for HIP
```
  a66cf40b
31 May, 2024 2 commits
- add int8 · 0de4f1dc
  zhuwenwen authored May 31, 2024
  
  0de4f1dc
- Fix cutlass sm_90a vesrion in CMakeList · 533c2177
  simon-mo authored May 31, 2024
  
  533c2177