examples/runtime/engine/fastapi_engine_inference.py · 2716830802ae8c2428fdacde7c4041b6f7852d68 · change / sglang · GitLab

Find file Blame History Permalink

Add example to use sgl engine with fastapi (#5648) · d2b8d0b8
Ravi Theja authored Apr 24, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
d2b8d0b8

fastapi_engine_inference.py 6.19 KB