Commits · 83452dbb4a19c6a2461e972eb2b64a2df9a466b8 · zhaoyu6 / sglang

"...sambert-hifigan_pytorch.git" did not exist on "ee10550aa499a0edf56a4c253343a65126d5af37"

18 Jan, 2025 5 commits
- [Feature] Support minicpmv v2.6 (#2785) · 3d93f84a
  Mick authored Jan 19, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  3d93f84a
- feat: remove vllm get_rope (#2964) · 2add697d
  Yineng Zhang authored Jan 18, 2025
  
  2add697d
- Remove fp8 monkey patch (#2960) · 656dcc1a
  Ke Bao authored Jan 18, 2025
  
  656dcc1a
- Query remaining memory dynamically for PrefillAdder (#2941) · 8af7048d
  Zhiqiang Xie authored Jan 17, 2025
  
  8af7048d
- support e4m3 kvcache in qwen2 & add kv scaling facotr json (#2894) · d3024f4f
  bjmsong authored Jan 18, 2025
```
Co-authored-by: bjmsong <bjmsong@126.com>
```
  d3024f4f
17 Jan, 2025 6 commits
- feat: use get_rope for gemma2 (#2954) · 78e5b22f
  Yineng Zhang authored Jan 18, 2025
  
  78e5b22f
- cleanup models unused import 2/n (#2952) · 7a15e9ad
  Yineng Zhang authored Jan 18, 2025
  
  7a15e9ad
- cleanup models dependencies 1/n (#2948) · 033c715b
  Yineng Zhang authored Jan 17, 2025
  
  033c715b
- Fix qwen accuracy issue (#2945) · 53e6552f
  Ke Bao authored Jan 17, 2025
  
  53e6552f
- feat: remove vllm distributed (#2907) · 5dc54f1a
  Yineng Zhang authored Jan 17, 2025
```
Co-authored-by: Zhangyi <1109276519@qq.com>
```
  5dc54f1a
- Enable CPU device on SGLang (#2806) · 63051738
  Chunyuan WU authored Jan 17, 2025
  
  63051738
16 Jan, 2025 9 commits
- [Frontend] Fix request length check and add option to disallow auto truncation in scheduler (#2876) · a8ccacc8
  Chang Su authored Jan 16, 2025
  
  a8ccacc8
- Fix zmq binding (#2930) · 0427416b
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
```
  0427416b
- Improve type annotation and styles (#2926) · bc6915e3
  Lianmin Zheng authored Jan 16, 2025
  
  bc6915e3
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
- Simplify the process launch code in server.py (#2923) · 93d69061
  Lianmin Zheng authored Jan 16, 2025
  
  93d69061
- add profiling to bench_one_batch script (#2821) · e00e5385
  Yun Dai authored Jan 16, 2025
  
  e00e5385
- fixed lm_head.weight error for quantized qwen (#2910) · a2f602b5
  Rin Intachuen authored Jan 16, 2025
  
  a2f602b5
- Improve benchmark scripts and error message printing (#2922) · 8f2c522a
  Lianmin Zheng authored Jan 16, 2025
  
  8f2c522a
- feat: patch linear base (#2915) · bf8d07a6
  Yineng Zhang authored Jan 16, 2025
  
  bf8d07a6
15 Jan, 2025 4 commits
- adapt custom allreduce for tensorrt llm (#2511) · 767c9dec
  yizhang2077 authored Jan 16, 2025
  
  767c9dec
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
- Disable graceful shutdown of tokenizer manager when not in the main thread (#2872) · b803b395
  Cody Yu authored Jan 15, 2025
  
  b803b395
- chore: bump v0.4.1.post6 (#2899) · b3e99dfb
  Yineng Zhang authored Jan 15, 2025
  
  b3e99dfb
14 Jan, 2025 3 commits
- feat: support internlm 3 dense (#2888) · f5c6c667
  Yineng Zhang authored Jan 14, 2025
  
  f5c6c667
- Support w8a8 int8 quantization config (#2881) · cc0485be
  Ke Bao authored Jan 14, 2025
  
  cc0485be
- Adjust flashinfer workspace size for Qwen2 models (#2879) · c19d8482
  Ke Bao authored Jan 14, 2025
  
  c19d8482
13 Jan, 2025 13 commits
- Add a new api configure_logging to allow dumping the requests (#2875) · 46d44318
  Lianmin Zheng authored Jan 13, 2025
  
  46d44318
- CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630) · 923f5183
  fzyzcjy authored Jan 14, 2025
  
  923f5183
- Sampling penalties memory interface (#2870) · d08c77c4
  Xiaoyu Zhang authored Jan 13, 2025
  
  d08c77c4
- Revert "Dump requests to a folder" (#2869) · c1e097ca
  Lianmin Zheng authored Jan 13, 2025
  
  c1e097ca
- add qwen2 eagle model (#2863) · 6ec75e62
  Lzhang-hub authored Jan 13, 2025
  
  6ec75e62
- Fix typos in io_struct.py (#2867) · 336ff5b9
  Lianmin Zheng authored Jan 13, 2025
  
  336ff5b9
- Dump requests (#2862) · 3b141e15
  Lianmin Zheng authored Jan 13, 2025
  
  3b141e15
- Revert "Integration of TurboMind AWQ" (#2866) · 6249e4a1
  Lianmin Zheng authored Jan 13, 2025
  
  6249e4a1
- Fix quant kernel accuracy issue (#2865) · f3516c28
  Ke Bao authored Jan 13, 2025
  
  f3516c28
- Integration of TurboMind AWQ (#2828) · 17de02f9
  bjmsong authored Jan 13, 2025
```
Co-authored-by: root <bjmsong@126.com>
```
  17de02f9
- Collect more metrics: num_requests_total (#2859) · 51ab3ccf
  Lianmin Zheng authored Jan 13, 2025
  
  51ab3ccf
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7
- Unify sglang coding style (#2856) · 42f39099
  kk authored Jan 13, 2025
```
Co-authored-by: Lin, Soga <soga.lin@amd.com>
```
  42f39099