Commits · be0967c1c2b881c7072e0dcabdf8e4a37b40b637 · OpenDAS / vllm_cscc

05 Sep, 2024 1 commit
- update benchmark_throughput.py · 2d660ae3
  zhuwenwen authored Sep 05, 2024
  
  2d660ae3
02 Sep, 2024 1 commit
- fix error in test_long_context.py::test_batched_rope_kernel and add a demo · 5e19cdef
  zhuwenwen authored Sep 02, 2024
  
  5e19cdef
30 Aug, 2024 1 commit
- fix error in test_long_context.py::test_batched_rope_kernel · 65d20f7f
  wangmin6 authored Aug 30, 2024
  
  65d20f7f
23 Aug, 2024 1 commit
- [Bugfix] adding chunking mechanism to fused_moe to handle large inputs · 4ac087d9
  zhuwenwen authored Aug 23, 2024
  
  4ac087d9
22 Aug, 2024 2 commits
- use opt layernorm_kernels · 4440e8c0
  zhuwenwen authored Aug 22, 2024
  
  4440e8c0
- use ori layernorm_kernels · bf278a88
  zhuwenwen authored Aug 22, 2024
  
  bf278a88
21 Aug, 2024 7 commits
- Update refactoring operation · 668ec4ef
  zhuwenwen authored Aug 21, 2024
  
  668ec4ef
- Refactoring the optimized kernel · 0aa2480f
  zhuwenwen authored Aug 21, 2024
  
  0aa2480f
- update VLLM_USE_OPT_OP to use opt kernels · 8a325c18
  zhuwenwen authored Aug 21, 2024
  
  8a325c18
- Add VLLM_USE_PA_PRINT_PARAM flag to print pa size · 2f9e0bad
  zhuwenwen authored Aug 21, 2024
  
  2f9e0bad
- Add VLLM_USE_PA_PRINT_PARAM flag to print pa size · ef037256
  zhuwenwen authored Aug 21, 2024
  
  ef037256
- fix tests and update the usage of fa · 1c18cce0
  zhuwenwen authored Aug 21, 2024
  
  1c18cce0
- Update refactoring operation · bd93e661
  zhuwenwen authored Aug 21, 2024
  
  bd93e661
20 Aug, 2024 2 commits
- Refactoring the optimized kernel · 4405f82c
  zhuwenwen authored Aug 20, 2024
  
  4405f82c
- fix fa and triton tests · 3a6764a4
  zhuwenwen authored Aug 20, 2024
  
  3a6764a4
19 Aug, 2024 3 commits
- update log of seq_len · c7c03f73
  zhuwenwen authored Aug 19, 2024
  
  c7c03f73
- Add fa pad conditions and automatic switching strategy · b40f2ffc
  zhuwenwen authored Aug 19, 2024
  
  b40f2ffc
- Add fa pad conditions and automatic switching strategy · fa973559
  zhuwenwen authored Aug 19, 2024
  
  fa973559
17 Aug, 2024 2 commits
- update fp16 model layout conversion conditions · 4d821524
  zhuwenwen authored Aug 17, 2024
  
  4d821524
- update fp16 model layout conversion conditions · a528f350
  zhuwenwen authored Aug 17, 2024
  
  a528f350
16 Aug, 2024 2 commits
- 添加要使用rocblas所需要的模块导入 · 10668f52
  zhuwenwen authored Aug 16, 2024
  
  10668f52
- 添加要使用rocbla所需要的模块导入 · 1057935a
  gaoqiong authored Aug 16, 2024
  
  1057935a
15 Aug, 2024 8 commits
- 修改awq workspace 申请 · 8cd246bd
  zhuwenwen authored Aug 15, 2024
  
  8cd246bd
- 修改awq workspace 申请 · 70267267
  gaoqiong authored Aug 15, 2024
  
  70267267
- 修改awq workspace 申请 · 8376cc41
  gaoqiong authored Aug 15, 2024
  
  8376cc41
- update benchmark_throughput.py · 17928589
  zhuwenwen authored Aug 15, 2024
  
  17928589
- update triton fa config for head_dim>128 · 3b2b3046
  zhuwenwen authored Aug 15, 2024
  
  3b2b3046
- update triton fa config for head_dim>128 · 8ae929fb
  zhuwenwen authored Aug 15, 2024
  
  8ae929fb
- 修改awq 申请sharememshapce方式 · 6172b158
  zhuwenwen authored Aug 15, 2024
  
  6172b158
- 修改awq 申请sharememshapce方式 · 2d250236
  gaoqiong authored Aug 15, 2024
  
  2d250236
14 Aug, 2024 2 commits
- update the configuration of triton fa · 33290303
  zhuwenwen authored Aug 14, 2024
  
  33290303
- update the configuration of triton fa · 3e2c63a7
  zhuwenwen authored Aug 14, 2024
  
  3e2c63a7
13 Aug, 2024 2 commits
- update prefix_prefill params · e658bf7f
  zhuwenwen authored Aug 13, 2024
  
  e658bf7f
- update prefix_prefill params · f39feef5
  zhuwenwen authored Aug 13, 2024
  
  f39feef5
12 Aug, 2024 1 commit
- change self.get_tokenizer_for_seq to get_tokenizer_for_seq · 6b16ea2e
  zhuwenwen authored Aug 12, 2024
  
  6b16ea2e
10 Aug, 2024 2 commits
- Revert feat:optimize act_and_mul_kernel · 880b2e41
  zhuwenwen authored Aug 10, 2024
  
  880b2e41
- add benchmarks to vllm and add env of VLLM_USE_FLASH_ATTN_AUTO · efb2f75f
  zhuwenwen authored Aug 10, 2024
  
  efb2f75f
09 Aug, 2024 1 commit
- 增添lmslim gptq支持 · dcaabcf7
  gaoqiong authored Aug 09, 2024
  
  dcaabcf7
08 Aug, 2024 2 commits
- fix awq index of qwen · 04633c47
  zhuwenwen authored Aug 08, 2024
  
  04633c47
- Fix multiprocessing shutdown errors · 708d897e
  zhuwenwen authored Aug 08, 2024
  
  708d897e