Commits · 422af7270ebcf5c73e6b68232d52c9bd2cb72c94 · OpenDAS / vllm_cscc

24 Sep, 2024 1 commit
- [Kernel] Split Marlin MoE kernels into multiple files (#8661) · a928ded9
  ElizaWszola authored Sep 24, 2024
```
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  a928ded9
23 Sep, 2024 2 commits
- [Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701) · 86e9c8df
  Lucas Wilkinson authored Sep 23, 2024
```
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  86e9c8df
- [Bugfix] Avoid some bogus messages RE CUTLASS's revision when building (#8702) · 3dda7c22
  Tyler Michael Smith authored Sep 22, 2024
  
  3dda7c22
22 Sep, 2024 1 commit
- [ci][build] fix vllm-flash-attn (#8699) · 0e40ac9b
  youkaichao authored Sep 21, 2024
  
  0e40ac9b
21 Sep, 2024 1 commit
- [Kernel] Build flash-attn from source (#8245) · 71c60491
  Luka Govedič authored Sep 21, 2024
  
  71c60491
14 Sep, 2024 1 commit
- [Kernel][Hardware][Amd]Custom paged attention kernel for rocm (#8310) · 1ef0d2ef
  Charlie Fu authored Sep 13, 2024
  
  1ef0d2ef
13 Sep, 2024 1 commit
- update torch version and support lm_head nn layout · aa1e273a
  zhuwenwen authored Sep 13, 2024
  
  aa1e273a
10 Sep, 2024 2 commits
- [CI/Build][Kernel] Update CUTLASS to 3.5.1 tag (#8043) · 94144e72
  Tyler Michael Smith authored Sep 10, 2024
  
  94144e72
- update version and requirements-rocm.txt · 6897826e
  zhuwenwen authored Sep 10, 2024
  
  6897826e
06 Sep, 2024 1 commit
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
28 Aug, 2024 1 commit
- [Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651) · fdd9daaf
  Mor Zusman authored Aug 29, 2024
  
  fdd9daaf
27 Aug, 2024 1 commit
- [Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7766) · fc911880
  Dipika Sikka authored Aug 27, 2024
```
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
```
  fc911880
22 Aug, 2024 2 commits
- [Bugfix] Don't build machete on cuda <12.0 (#7757) · 55d63b12
  Lucas Wilkinson authored Aug 22, 2024
  
  55d63b12
- Revert "[Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7527)" (#7764) · aae74ef9
  Michael Goin authored Aug 21, 2024
  
  aae74ef9
21 Aug, 2024 3 commits
- [Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7527) · 8678a69a
  Dipika Sikka authored Aug 21, 2024
```
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
```
  8678a69a
- [Bugfix] Pass PYTHONPATH from setup.py to CMake (#7730) · 1b32e026
  sasha0552 authored Aug 21, 2024
  
  1b32e026
- Refactoring the optimized kernel · 0aa2480f
  zhuwenwen authored Aug 21, 2024
  
  0aa2480f
20 Aug, 2024 1 commit
- [Kernel] (1/N) Machete - Hopper Optimized Mixed Precision Linear Kernel (#7174) · 5288c06a
  Lucas Wilkinson authored Aug 20, 2024
  
  5288c06a
13 Aug, 2024 1 commit
- fix build error · d1787c31
  zhuwenwen authored Aug 13, 2024
  
  d1787c31
12 Aug, 2024 2 commits
- [CI/Build] bump minimum cmake version (#6999) · 774cd1d3
  Daniele authored Aug 13, 2024
  
  774cd1d3
- change self.get_tokenizer_for_seq to get_tokenizer_for_seq · 6b16ea2e
  zhuwenwen authored Aug 12, 2024
  
  6b16ea2e
05 Aug, 2024 3 commits
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
- [Bugfix][CI/Build] Fix CUTLASS FetchContent (#7171) · 4cf1dc39
  Tyler Michael Smith authored Aug 05, 2024
  
  4cf1dc39
- [Kernel] Update CUTLASS to 3.5.1 (#7085) · 8571ac46
  Tyler Michael Smith authored Aug 05, 2024
  
  8571ac46
02 Aug, 2024 2 commits
- [Misc] Disambiguate quantized types via a new ScalarType (#6396) · a8d604ca
  Lucas Wilkinson authored Aug 02, 2024
  
  a8d604ca
- [CI/Build] Add support for Python 3.12 (#7035) · b482b9a5
  Michael Goin authored Aug 02, 2024
  
  b482b9a5
01 Aug, 2024 3 commits
- [CI/Build][Bugfix] Fix CUTLASS header-only line (#7034) · 6a11fdfb
  Tyler Michael Smith authored Aug 01, 2024
  
  6a11fdfb
- [CI/Build] Update PyTorch to 2.4.0 (#6951) · 7e0861bd
  Sage Moore authored Aug 01, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  7e0861bd
- [Kernel][RFC] Refactor the punica kernel based on Triton (#5036) · 7ecee343
  Jee Jee Li authored Aug 01, 2024
  
  7ecee343
31 Jul, 2024 1 commit
- Support W4A8 quantization for vllm (#5218) · 6512937d
  HandH1998 authored Jul 31, 2024
  
  6512937d
23 Jul, 2024 2 commits
- optimize rmsnorm kernel · c62f8e9a
  zhuwenwen authored Jul 23, 2024
  
  c62f8e9a
- refactoring the transpose kernel and update supported model · b2dd1743
  zhuwenwen authored Jul 23, 2024
  
  b2dd1743
22 Jul, 2024 1 commit
- pa优化，编译选项优化 · 1be9a629
  zhangshao authored Jul 22, 2024
  
  1be9a629
21 Jul, 2024 1 commit
- [Kernel][Core] Add AWQ support to the Marlin kernel (#6612) · 396d92d5
  Alexander Matveev authored Jul 21, 2024
  
  396d92d5
20 Jul, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA,... · 06d6c5fe
  Matt Wong authored Jul 20, 2024
```
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
```
  06d6c5fe
17 Jul, 2024 2 commits
- [Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338) · e76466dd
  Alexander Matveev authored Jul 17, 2024
  
  e76466dd
- add rotary_embedding for tgi · e499f96c
  huangwb authored Jul 17, 2024
  
  e499f96c
12 Jul, 2024 1 commit
- [MISC] Upgrade dependency to PyTorch 2.3.1 (#5327) · aa48e502
  Cody Yu authored Jul 12, 2024
  
  aa48e502
03 Jul, 2024 1 commit
- [Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (#5975) · 47f0954a
  Michael Goin authored Jul 03, 2024
  
  47f0954a
26 Jun, 2024 1 commit

[Kernel] Adding bias epilogue support for `cutlass_scaled_mm` (#5560) · 5bfd1bbc

Luka Govedič authored Jun 26, 2024


Co-authored-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

5bfd1bbc