Commits · 05471f210318fa72570ccb6af3c56cdcde86e55a · change / sglang

24 Jun, 2024 1 commit
- Update test_flashinfer (#560) · 05471f21
  Liangsheng Yin authored Jun 24, 2024
  
  05471f21
22 Jun, 2024 4 commits
- Add LlamaForClassification (#559) · 1fa15099
  Lianmin Zheng authored Jun 22, 2024
  
  1fa15099
- Clean up logits processor (#558) · 303ef888
  Lianmin Zheng authored Jun 22, 2024
  
  303ef888
- Fix latency benchmark (#557) · 92cb93f3
  Liangsheng Yin authored Jun 22, 2024
  
  92cb93f3
- make flashinfer workspace larger · e94e60d6
  Lianmin Zheng authored Jun 21, 2024
  
  e94e60d6
21 Jun, 2024 2 commits
- Follow-up fixes for flashinfer 0.0.5 (#556) · d2f8bfb2
  Lianmin Zheng authored Jun 20, 2024
  
  d2f8bfb2
- Update flashinfer to 0.0.5 (#554) · b7e2f800
  Lianmin Zheng authored Jun 20, 2024
  
  b7e2f800
18 Jun, 2024 1 commit
- Multi-node Tensor Parallelism (#550) · 09593e9b
  Ying Sheng authored Jun 17, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  09593e9b
17 Jun, 2024 1 commit
- Update fused_moe (#553) · 53a7ebd8
  Lianmin Zheng authored Jun 17, 2024
  
  53a7ebd8
16 Jun, 2024 1 commit
- Fix the Jump-Forward with Chinese (#551) · ad5f04d6
  Liangsheng Yin authored Jun 16, 2024
  
  ad5f04d6
15 Jun, 2024 1 commit
- Fix tp worker only checking req[0] for stream (#546) · bbec01c9
  Qubitium-modelcloud authored Jun 15, 2024
  
  bbec01c9
13 Jun, 2024 3 commits
- Add disk cache for loading ShareGPT dataset. (#542) · 40e53d65
  Liangsheng Yin authored Jun 13, 2024
  
  40e53d65
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
- Fix dependency & crash issues (#539) · 1374334d
  Ying Sheng authored Jun 12, 2024
  
  1374334d
12 Jun, 2024 3 commits
- Fix dependency (#538) · 94aead9e
  Lianmin Zheng authored Jun 12, 2024
  
  94aead9e
- Decode Incrementally (#517) · 9c902b19
  Liangsheng Yin authored Jun 12, 2024
  
  9c902b19
- Fix Regression: Disable p2p for 4090 (#531) · 111991fe
  ZhouXingg authored Jun 12, 2024
```
Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
```
  111991fe
11 Jun, 2024 3 commits
- Add ChatGLM Model Support (#516) · a8c787d2
  Qubitium authored Jun 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
```
  a8c787d2
- [Minor] Correct Optional type hints in api (#526) · 5f283991
  Fabian Preiß authored Jun 12, 2024
  
  5f283991
- Fix RAG nb, parea setup (parea -> parea-ai) (#525) · b6667a53
  Fabian Preiß authored Jun 12, 2024
  
  b6667a53
10 Jun, 2024 1 commit
- Fix missing numpy dependency in pyproject.toml (#524) · 542bc733
  Fabian Preiß authored Jun 10, 2024
  
  542bc733
08 Jun, 2024 3 commits
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
- Update version to 0.1.17 (#515) · e8a2327d
  Lianmin Zheng authored Jun 07, 2024
  
  e8a2327d
- Crash the server when error or OOM happens (#514) · 91f93f14
  Lianmin Zheng authored Jun 07, 2024
  
  91f93f14
07 Jun, 2024 5 commits
- Fix rid state map leak + Refractor .finished (#505) · f70f7258
  Qubitium authored Jun 08, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
```
  f70f7258
- Improve logging & fix litellm dependency. (#512) · c0ae70c8
  Lianmin Zheng authored Jun 07, 2024
  
  c0ae70c8
- Litellm Backend (#502) · 87260b7b
  胡译文 authored Jun 08, 2024
  
  87260b7b
- remove redundant pad_input_ids function (#500) · 651a23ee
  Amos You authored Jun 07, 2024
  
  651a23ee
- Update vllm to v0.4.3 (#511) · bf3e271f
  Lianmin Zheng authored Jun 07, 2024
```
Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
Co-authored-by: ZX <zx@lbx.dev>
```
  bf3e271f
04 Jun, 2024 1 commit
- [Minor] improve code style · 3bc01ac1
  Lianmin Zheng authored Jun 03, 2024
  
  3bc01ac1
01 Jun, 2024 3 commits
- Improve docs · 9f009261
  Lianmin Zheng authored Jun 01, 2024
  
  9f009261
- Make the server random by default (#493) · 159cc741
  Lianmin Zheng authored May 31, 2024
  
  159cc741
- update the script: examples/usage/llava_video/srt_example_llava_v.sh (#491) · 7d1ebc2d
  Yuanhan Zhang authored Jun 01, 2024
  
  7d1ebc2d
31 May, 2024 1 commit
- Revert "Make the server random by default" (#492) · 83525a1d
  Ying Sheng authored May 31, 2024
  
  83525a1d
29 May, 2024 1 commit
- Do not set the default value of global random seed (#488) · 80a33ce8
  Lianmin Zheng authored May 29, 2024
  
  80a33ce8
28 May, 2024 3 commits
- do not launch workers in parallel · 1a57e416
  Lianmin Zheng authored May 27, 2024
  
  1a57e416
- Update docs (#486) · adc97426
  Lianmin Zheng authored May 27, 2024
  
  adc97426
- Support data parallelism (static) (#480) · 0463f7fb
  Ying Sheng authored May 27, 2024
```
Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  0463f7fb
27 May, 2024 2 commits
- improve logging & fix vllm version · 565d7274
  Lianmin Zheng authored May 27, 2024
  
  565d7274
- Improve benchmark scripts & add more models (#484) · 09de730d
  Lianmin Zheng authored May 27, 2024
  
  09de730d