Commits · 8abd3e77feca9ed740356c1b879e524d09482fb2 · change / sglang

23 Jul, 2025 1 commit
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77
19 Jul, 2025 1 commit
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
14 Jul, 2025 1 commit
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
28 Jun, 2025 1 commit
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
21 Jun, 2025 1 commit
- Refactor LoRAManager and LoRAMemoryPool state management logic for dynamic... · 1998ce40
  Lifu Huang authored Jun 21, 2025
```
Refactor LoRAManager and LoRAMemoryPool state management logic for dynamic LoRA loading support (#7412)
```
  1998ce40
11 Jun, 2025 1 commit
- [Perf] Refactor LoRAManager to eliminate stream syncs and redundant computations (#6994) · 021f76e4
  Lifu Huang authored Jun 11, 2025
  
  021f76e4
27 May, 2025 1 commit
- Refactor LoRA handling to support adapter tensors in fused format (#6585) · 477a101c
  Lifu Huang authored May 26, 2025
  
  477a101c
15 May, 2025 1 commit
- Fix lora bench (#6302) · cd8d4b9d
  Qiaolin Yu authored May 15, 2025
  
  cd8d4b9d
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
04 May, 2025 1 commit
- Fix flaky issues of lora and add multi batch tests (#5957) · 3042f1da
  Qiaolin Yu authored May 04, 2025
  
  3042f1da
01 May, 2025 1 commit
- Fix lora batch processing when input lora_path contains None (#5930) · 7bcd8b1c
  Qiaolin Yu authored Apr 30, 2025
  
  7bcd8b1c
29 Apr, 2025 1 commit
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
28 Mar, 2025 2 commits
- [Feature] add multi-rank support for Lora (#4492) · ef9a378a
  chaobo jia authored Mar 29, 2025
```
Co-authored-by: rudy152 <czh1137892874@gmail.com>
```
  ef9a378a
- Fix the lora adapter when lora path is none (#4799) · 9fdc6d6a
  Qiaolin Yu authored Mar 28, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  9fdc6d6a
19 Mar, 2025 1 commit
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
20 Feb, 2025 1 commit
- [Fix] Fix bugs and refactor codes in lora for better scalability. (#3652) · e79f7420
  aoshen524 authored Feb 20, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  e79f7420
10 Feb, 2025 1 commit
- [Fix] Fix accuracy bug and refactor codes for lora (#3413) · c45cab1c
  Baizhou Zhang authored Feb 09, 2025
  
  c45cab1c
04 Feb, 2025 1 commit
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
07 Oct, 2024 1 commit
- Use is_flashinfer_available to replace is_hip for flashinfer check (#1596) · 6a5b352a
  Lianmin Zheng authored Oct 06, 2024
```
Co-authored-by: Zhang Liangang <liangang.zhang@intel.com>
```
  6a5b352a
06 Oct, 2024 1 commit
- [LoRA, Performance] Speedup multi-LoRA serving - Step 1 (#1587) · 9c064bf7
  Ying Sheng authored Oct 06, 2024
  
  9c064bf7
03 Oct, 2024 1 commit

[Fix] Fix AttributeError in Qwen2.5 LoRA: 'Qwen2ForCausalLM' object has no... · e6852b0d

Minsang Song authored Oct 03, 2024


[Fix] Fix AttributeError in Qwen2.5 LoRA: 'Qwen2ForCausalLM' object has no attribute 'get_hidden_dim' (#1536)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>

e6852b0d

30 Sep, 2024 2 commits
- Rename InputMetadata -> ForwardBatch (#1543) · 36d5acfc
  Lianmin Zheng authored Sep 30, 2024
  
  36d5acfc
- Let ModelRunner take InputMetadata as input, instead of ScheduleBatch (#1541) · 3f0fe08d
  Lianmin Zheng authored Sep 29, 2024
  
  3f0fe08d
17 Sep, 2024 1 commit
- [Feature, Hardware] Enable SGLang on AMD GPUs via PyTorch for ROCm (#1420) · 3a6e0418
  HAI authored Sep 17, 2024
  
  3a6e0418
15 Sep, 2024 1 commit
- [Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433) · 37963394
  Ying Sheng authored Sep 15, 2024
  
  37963394
12 Sep, 2024 1 commit
- [Feature] Initial support for multi-LoRA serving (#1307) · 71221692
  Ying Sheng authored Sep 12, 2024
  
  71221692