GitLab

Mixtral模型的gemm由TN改为NN

See merge request dcutoolkit/deeplearing/vllm!32

修复medusa多卡推理和其他模型推理报错的问题

See merge request dcutoolkit/deeplearing/vllm!31

2.examples中添加medusa readme
3.修复model_runner中input_positions配置错误的笔误，解决多个模型运行失败问题

# Conflicts:
#	csrc/attention/static_switch_tc.h
#	vllm/model_executor/layers/vocab_parallel_embedding.py
#	vllm/model_executor/model_loader/utils.py
#	vllm/model_executor/models/llama.py

增加w8a8的triton环境变量控制

See merge request dcutoolkit/deeplearing/vllm!28