Skip to content

GitLab

"git@developer.sourcefind.cn:OpenDAS/ollama.git" did not exist on "0cb78a2fc2a5463ce8e84b56388f28e02e1c1d06"
Commit 723f0421 authored by Lianmin Zheng's avatar Lianmin Zheng
Browse files

release v0.1.7 & fix bugs

parent 585eabab
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
python/pyproject.toml
View file @ 723f0421
...@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta" ...@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
[project] [project]
name = "sglang" name = "sglang"
version = "0.1.6" version = "0.1.7"
description = "A structured generation langauge for LLMs." description = "A structured generation langauge for LLMs."
readme = "README.md" readme = "README.md"
requires-python = ">=3.8" requires-python = ">=3.8"
......
python/sglang/__init__.py
View file @ 723f0421
__version__ = "0.1.6" __version__ = "0.1.7"
from sglang.api import * from sglang.api import *
from sglang.global_config import global_config from sglang.global_config import global_config
python/sglang/lang/interpreter.py
View file @ 723f0421
...@@ -80,7 +80,7 @@ def run_program_batch( ...@@ -80,7 +80,7 @@ def run_program_batch(
# Run all programs # Run all programs
if num_threads == "auto": if num_threads == "auto":
num_threads = min(64, multiprocessing.cpu_count() * 8) num_threads = max(64, multiprocessing.cpu_count() * 8)
num_threads = min(num_threads, len(batch_arguments)) num_threads = min(num_threads, len(batch_arguments))
if num_threads == 1: if num_threads == 1:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment