fix: update flashinfer to 0.1.2 to fix sampling for cu118 (#803)

87064015 · Yineng Zhang · GitHub · 7cd4f244 · 87064015
Unverified Commit 87064015 authored Jul 30, 2024 by Yineng Zhang Committed by GitHub Jul 29, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

python/sglang/srt/server.py python/sglang/srt/server.py +1 -1

No files found.
--- a/python/sglang/srt/server.py
+++ b/python/sglang/srt/server.py
@@ -226,7 +226,7 @@ def launch_server(
    if not server_args.disable_flashinfer:
        assert_pkg_version(
            "flashinfer",
-            "0.1.1",
+            "0.1.2",
            "Please uninstall the old version and "
            "reinstall the latest version by following the instructions "
            "at https://docs.flashinfer.ai/installation.html.",