Commits · 59449095ab536febe9ff341b2a88a4fed572a70f · OpenDAS / vllm_cscc · GitLab

24 Oct, 2024 1 commit
- [Performance][Kernel] Fused_moe Performance Improvement (#9384) · 59449095
  Charlie Fu authored Oct 24, 2024
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  59449095
23 Oct, 2024 1 commit
- [Build] Fix `FetchContent` multiple build issue (#9596) · 51c24c97
  Luka Govedič authored Oct 23, 2024
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  51c24c97
22 Oct, 2024 1 commit
- [Bugfix] Fix spurious "No compiled cutlass_scaled_mm ..." for W8A8 on Turing (#9487) · d1e82408
  Lucas Wilkinson authored Oct 22, 2024
  
  d1e82408
17 Oct, 2024 1 commit
- [Bugfix] Fix support for dimension like integers and ScalarType (#9299) · eca2c5f7
  bnellnm authored Oct 17, 2024
  
  eca2c5f7
16 Oct, 2024 1 commit
- [Bugfix][CI/Build] Fix CUDA 11.8 Build (#9386) · 717a5f82
  Lucas Wilkinson authored Oct 15, 2024
  
  717a5f82
11 Oct, 2024 1 commit
- [Bugfix][CI/Build] Fix docker build where CUDA archs < 7.0 are being detected (#9254) · de9fb4be
  Lucas Wilkinson authored Oct 11, 2024
  
  de9fb4be
04 Oct, 2024 3 commits
- [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) · 05d68643
  ElizaWszola authored Oct 04, 2024
```
Co-authored-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Dipika Sikka <ds3822@columbia.edu>
```
  05d68643
- [Bugfix] Flash attention arches not getting set properly (#9062) · 22482e49
  Lucas Wilkinson authored Oct 04, 2024
  
  22482e49
- [CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845) · aeb37c2a
  Lucas Wilkinson authored Oct 03, 2024
  
  aeb37c2a
29 Sep, 2024 1 commit
- [Build/CI] Set FETCHCONTENT_BASE_DIR to one location for better caching (#8930) · 2e7fe7e7
  Tyler Michael Smith authored Sep 28, 2024
  
  2e7fe7e7
24 Sep, 2024 1 commit
- [Kernel] Split Marlin MoE kernels into multiple files (#8661) · a928ded9
  ElizaWszola authored Sep 24, 2024
```
Co-authored-by: mgoin <michael@neuralmagic.com>
```
  a928ded9
23 Sep, 2024 2 commits
- [Kernel] (2/N) Machete - Integrate into CompressedTensorsWNA16 and GPTQMarlin (#7701) · 86e9c8df
  Lucas Wilkinson authored Sep 23, 2024
```
Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  86e9c8df
- [Bugfix] Avoid some bogus messages RE CUTLASS's revision when building (#8702) · 3dda7c22
  Tyler Michael Smith authored Sep 22, 2024
  
  3dda7c22
22 Sep, 2024 1 commit
- [ci][build] fix vllm-flash-attn (#8699) · 0e40ac9b
  youkaichao authored Sep 21, 2024
  
  0e40ac9b
21 Sep, 2024 1 commit
- [Kernel] Build flash-attn from source (#8245) · 71c60491
  Luka Govedič authored Sep 21, 2024
  
  71c60491
14 Sep, 2024 1 commit
- [Kernel][Hardware][Amd]Custom paged attention kernel for rocm (#8310) · 1ef0d2ef
  Charlie Fu authored Sep 13, 2024
  
  1ef0d2ef
10 Sep, 2024 1 commit
- [CI/Build][Kernel] Update CUTLASS to 3.5.1 tag (#8043) · 94144e72
  Tyler Michael Smith authored Sep 10, 2024
  
  94144e72
06 Sep, 2024 1 commit
- [Misc] Remove `SqueezeLLM` (#8220) · 23f32229
  Dipika Sikka authored Sep 06, 2024
  
  23f32229
28 Aug, 2024 1 commit
- [Kernel/Model] Migrate mamba_ssm and causal_conv1d kernels to vLLM (#7651) · fdd9daaf
  Mor Zusman authored Aug 29, 2024
  
  fdd9daaf
27 Aug, 2024 1 commit
- [Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7766) · fc911880
  Dipika Sikka authored Aug 27, 2024
```
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
```
  fc911880
22 Aug, 2024 2 commits
- [Bugfix] Don't build machete on cuda <12.0 (#7757) · 55d63b12
  Lucas Wilkinson authored Aug 22, 2024
  
  55d63b12
- Revert "[Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7527)" (#7764) · aae74ef9
  Michael Goin authored Aug 21, 2024
  
  aae74ef9
21 Aug, 2024 2 commits
- [Kernel] Expand MoE weight loading + Add Fused Marlin MoE Kernel (#7527) · 8678a69a
  Dipika Sikka authored Aug 21, 2024
```
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
```
  8678a69a
- [Bugfix] Pass PYTHONPATH from setup.py to CMake (#7730) · 1b32e026
  sasha0552 authored Aug 21, 2024
  
  1b32e026
20 Aug, 2024 1 commit
- [Kernel] (1/N) Machete - Hopper Optimized Mixed Precision Linear Kernel (#7174) · 5288c06a
  Lucas Wilkinson authored Aug 20, 2024
  
  5288c06a
12 Aug, 2024 1 commit
- [CI/Build] bump minimum cmake version (#6999) · 774cd1d3
  Daniele authored Aug 13, 2024
  
  774cd1d3
05 Aug, 2024 3 commits
- [Core] Support loading GGUF model (#5191) · 360bd67c
  Isotr0py authored Aug 06, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  360bd67c
- [Bugfix][CI/Build] Fix CUTLASS FetchContent (#7171) · 4cf1dc39
  Tyler Michael Smith authored Aug 05, 2024
  
  4cf1dc39
- [Kernel] Update CUTLASS to 3.5.1 (#7085) · 8571ac46
  Tyler Michael Smith authored Aug 05, 2024
  
  8571ac46
02 Aug, 2024 2 commits
- [Misc] Disambiguate quantized types via a new ScalarType (#6396) · a8d604ca
  Lucas Wilkinson authored Aug 02, 2024
  
  a8d604ca
- [CI/Build] Add support for Python 3.12 (#7035) · b482b9a5
  Michael Goin authored Aug 02, 2024
  
  b482b9a5
01 Aug, 2024 3 commits
- [CI/Build][Bugfix] Fix CUTLASS header-only line (#7034) · 6a11fdfb
  Tyler Michael Smith authored Aug 01, 2024
  
  6a11fdfb
- [CI/Build] Update PyTorch to 2.4.0 (#6951) · 7e0861bd
  Sage Moore authored Aug 01, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  7e0861bd
- [Kernel][RFC] Refactor the punica kernel based on Triton (#5036) · 7ecee343
  Jee Jee Li authored Aug 01, 2024
  
  7ecee343
31 Jul, 2024 1 commit
- Support W4A8 quantization for vllm (#5218) · 6512937d
  HandH1998 authored Jul 31, 2024
  
  6512937d
21 Jul, 2024 1 commit
- [Kernel][Core] Add AWQ support to the Marlin kernel (#6612) · 396d92d5
  Alexander Matveev authored Jul 21, 2024
  
  396d92d5
20 Jul, 2024 1 commit
- [Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA,... · 06d6c5fe
  Matt Wong authored Jul 20, 2024
```
[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)
```
  06d6c5fe
17 Jul, 2024 1 commit
- [Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338) · e76466dd
  Alexander Matveev authored Jul 17, 2024
  
  e76466dd
12 Jul, 2024 1 commit
- [MISC] Upgrade dependency to PyTorch 2.3.1 (#5327) · aa48e502
  Cody Yu authored Jul 12, 2024
  
  aa48e502
03 Jul, 2024 1 commit
- [Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin (#5975) · 47f0954a
  Michael Goin authored Jul 03, 2024
  
  47f0954a