Commits · 3146b529fd61985a6d8f51fbf056f06c13b66ec8 · OpenDAS / vllm_cscc

19 Nov, 2025 2 commits
- test2适配 · 3146b529
  guanyu1 authored Nov 19, 2025
  
  3146b529
- test2-1119 · fda84b29
  guanyu1 authored Nov 19, 2025
  
  fda84b29
18 Nov, 2025 3 commits
- version · f2db436a
  guanyu1 authored Nov 18, 2025
  
  f2db436a
- test2修改 · 71d04ddc
  guanyu1 authored Nov 18, 2025
  
  71d04ddc
- test2 · 3908ec24
  guanyu1 authored Nov 18, 2025
  
  3908ec24
17 Nov, 2025 2 commits
- prompts+tokenid · 3c29e139
  guanyu1 authored Nov 17, 2025
  
  3c29e139
- benchmark_hunyuan.py · e28b0086
  guanyu1 authored Nov 17, 2025
  
  e28b0086
15 Nov, 2025 2 commits
- hunyuan-offline · 0746a2bb
  guanyu1 authored Nov 15, 2025
  
  0746a2bb
- hunyuan分类模型适配 · 70fdd8a2
  guanyu1 authored Nov 15, 2025
  
  70fdd8a2
31 Oct, 2025 4 commits
- fix pp1 rank error · e0ba5f60
  zhuwenwen authored Oct 31, 2025
  
  e0ba5f60
- update moe configs name · 28021d6e
  zhuwenwen authored Oct 31, 2025
  
  28021d6e
- remove fp8_e5m2 error · 653b799b
  zhuwenwen authored Oct 31, 2025
  
  653b799b
- 删除DPSK_FP16_QUICK · 1851782d
  zhuwenwen authored Oct 31, 2025
  
  1851782d
30 Oct, 2025 1 commit
- skip lmslim import when infer non quantized models · 8e22ded2
  zhuwenwen authored Oct 30, 2025
  
  8e22ded2
29 Oct, 2025 5 commits
- update triton and lightop · 492c5dea
  zhuwenwen authored Oct 29, 2025
  
  492c5dea
- remove major and minor of torch · c18b113d
  zhuwenwen authored Oct 29, 2025
  
  c18b113d
- 增加pd分离单实例跨机第二个ip通过配置文件获取。配置文件上设置如下： · 09639eec
  zhuwenwen authored Oct 29, 2025
```
# 第一个ip为D的第一个节点，第二个ip为D的第二个节点,配置:export IP_CONFIG_FILE=/data/xiabo/w4a8_1/ip_config.txt
192.168.1.1 192.168.1.100
192.168.1.2 192.168.1.101
192.168.1.3 192.168.1.102
10.16.1.75 10.16.1.76
```
  09639eec
- update fa backend on gfx926 and gfx928 · 2b4f2bc3
  zhuwenwen authored Oct 29, 2025
  
  2b4f2bc3
- Revert "Add Qwen3-Omni moe thinker" · 58117664
  zhuwenwen authored Oct 29, 2025
```
This reverts commit e9cb2241.
```
  58117664
28 Oct, 2025 2 commits
- remove redundant fused_topk_bias · c16e075a
  zhuwenwen authored Oct 28, 2025
  
  c16e075a
- Add Qwen3-Omni moe thinker · e9cb2241
  zhuwenwen authored Oct 28, 2025
  
  e9cb2241
27 Oct, 2025 2 commits
- update num_expert_group · f007cd06
  zhuwenwen authored Oct 27, 2025
  
  f007cd06
- update scaling_alpha · b01011d2
  zhuwenwen authored Oct 27, 2025
  
  b01011d2
25 Oct, 2025 1 commit
- [Models] support HunYuanForCausalLM · f386ba88
  zhuwenwen authored Oct 25, 2025
  
  f386ba88
22 Oct, 2025 3 commits
- init is_quantization of load_column_parallel_weight (BasevLLMParameter) · a9c37628
  zhuwenwen authored Oct 22, 2025
  
  a9c37628
- init is_quantization of load_row_parallel_weight (BasevLLMParameter) · 3efb2e1c
  zhuwenwen authored Oct 22, 2025
  
  3efb2e1c
- remove redundant routed_scaling_factor · 39380c86
  zhuwenwen authored Oct 22, 2025
  
  39380c86
21 Oct, 2025 1 commit
- update qwen3_vl conv layout (ncdhw to ndhwc) · 6eb5b12c
  zhuwenwen authored Oct 21, 2025
  
  6eb5b12c
20 Oct, 2025 3 commits
- switching to the implementation of MHA in FA · 7f417161
  zhuwenwen authored Oct 20, 2025
  
  7f417161
- update the layout of load_column_parallel_weight and load_row_parallel_weight · f3731273
  zhuwenwen authored Oct 20, 2025
  
  f3731273
- remove tbo and zero_overhead envs · 5db8533c
  zhuwenwen authored Oct 20, 2025
  
  5db8533c
15 Oct, 2025 3 commits
- support --no-enable-chunked-prefill of v1 · 573531eb
  zhuwenwen authored Oct 15, 2025
  
  573531eb
- update the layout of weight_loader_v2 in ColumnParallelLinear and update the... · 33f37e9f
  zhuwenwen authored Oct 15, 2025
```
update the layout of weight_loader_v2 in ColumnParallelLinear and update the initialization of is_quantification
```
  33f37e9f
- update linear to matmul · e35a9e99
  zhuwenwen authored Oct 15, 2025
  
  e35a9e99
14 Oct, 2025 1 commit
- update linear apply · 7e5aa0c5
  zhuwenwen authored Oct 14, 2025
  
  7e5aa0c5
13 Oct, 2025 3 commits
- update moe_sum and moe_align · b35a518a
  zhuwenwen authored Oct 13, 2025
  
  b35a518a
- remove --no-enable-chunked-prefill of v1 · 2cf181fd
  zhuwenwen authored Oct 13, 2025
  
  2cf181fd
- disable cascade_attn · 6791e80c
  zhuwenwen authored Oct 13, 2025
  
  6791e80c
12 Oct, 2025 2 commits
- add use_int4_w4a8 of fused_experts · 048f7316
  zhuwenwen authored Oct 12, 2025
  
  048f7316
- remove two_batch_overlap of moe and update use_mla · 11b94900
  zhuwenwen authored Oct 12, 2025
  
  11b94900