Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
Commits
6c4496a1
Unverified
Commit
6c4496a1
authored
Mar 22, 2024
by
OlivierDehaene
Committed by
GitHub
Mar 22, 2024
Browse files
v1.4.4 (#1668)
parent
1e9bcd9d
Changes
10
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
10 changed files
with
176 additions
and
181 deletions
+176
-181
Cargo.lock
Cargo.lock
+167
-172
Cargo.toml
Cargo.toml
+1
-1
docs/openapi.json
docs/openapi.json
+1
-1
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_no_tools.json
..._/test_tools_llama/test_flash_llama_grammar_no_tools.json
+1
-1
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools.json
...ts__/test_tools_llama/test_flash_llama_grammar_tools.json
+1
-1
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools_auto.json
...test_tools_llama/test_flash_llama_grammar_tools_auto.json
+1
-1
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools_choice.json
...st_tools_llama/test_flash_llama_grammar_tools_choice.json
+1
-1
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools_stream.json
...st_tools_llama/test_flash_llama_grammar_tools_stream.json
+1
-1
integration-tests/pyproject.toml
integration-tests/pyproject.toml
+1
-1
server/pyproject.toml
server/pyproject.toml
+1
-1
No files found.
Cargo.lock
View file @
6c4496a1
This diff is collapsed.
Click to expand it.
Cargo.toml
View file @
6c4496a1
...
...
@@ -9,7 +9,7 @@ members = [
resolver
=
"2"
[workspace.package]
version
=
"1.4.
3
"
version
=
"1.4.
4
"
edition
=
"2021"
authors
=
[
"Olivier Dehaene"
]
homepage
=
"https://github.com/huggingface/text-generation-inference"
...
...
docs/openapi.json
View file @
6c4496a1
...
...
@@ -10,7 +10,7 @@
"name"
:
"Apache 2.0"
,
"url"
:
"https://www.apache.org/licenses/LICENSE-2.0"
},
"version"
:
"1.4.
3
"
"version"
:
"1.4.
4
"
},
"paths"
:
{
"/"
:
{
...
...
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_no_tools.json
View file @
6c4496a1
...
...
@@ -17,7 +17,7 @@
"id"
:
""
,
"model"
:
"TinyLlama/TinyLlama-1.1B-Chat-v1.0"
,
"object"
:
"text_completion"
,
"system_fingerprint"
:
"1.4.
3
-native"
,
"system_fingerprint"
:
"1.4.
4
-native"
,
"usage"
:
{
"completion_tokens"
:
100
,
"prompt_tokens"
:
60
,
...
...
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools.json
View file @
6c4496a1
...
...
@@ -31,7 +31,7 @@
"id"
:
""
,
"model"
:
"TinyLlama/TinyLlama-1.1B-Chat-v1.0"
,
"object"
:
"text_completion"
,
"system_fingerprint"
:
"1.4.
3
-native"
,
"system_fingerprint"
:
"1.4.
4
-native"
,
"usage"
:
{
"completion_tokens"
:
29
,
"prompt_tokens"
:
316
,
...
...
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools_auto.json
View file @
6c4496a1
...
...
@@ -31,7 +31,7 @@
"id"
:
""
,
"model"
:
"TinyLlama/TinyLlama-1.1B-Chat-v1.0"
,
"object"
:
"text_completion"
,
"system_fingerprint"
:
"1.4.
3
-native"
,
"system_fingerprint"
:
"1.4.
4
-native"
,
"usage"
:
{
"completion_tokens"
:
29
,
"prompt_tokens"
:
316
,
...
...
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools_choice.json
View file @
6c4496a1
...
...
@@ -30,7 +30,7 @@
"id"
:
""
,
"model"
:
"TinyLlama/TinyLlama-1.1B-Chat-v1.0"
,
"object"
:
"text_completion"
,
"system_fingerprint"
:
"1.4.
3
-native"
,
"system_fingerprint"
:
"1.4.
4
-native"
,
"usage"
:
{
"completion_tokens"
:
21
,
"prompt_tokens"
:
187
,
...
...
integration-tests/models/__snapshots__/test_tools_llama/test_flash_llama_grammar_tools_stream.json
View file @
6c4496a1
...
...
@@ -23,5 +23,5 @@
"id"
:
""
,
"model"
:
"TinyLlama/TinyLlama-1.1B-Chat-v1.0"
,
"object"
:
"text_completion"
,
"system_fingerprint"
:
"1.4.
3
-native"
"system_fingerprint"
:
"1.4.
4
-native"
}
integration-tests/pyproject.toml
View file @
6c4496a1
[tool.poetry]
name
=
"text-generation-integration-tests"
version
=
"1.4.
3
"
version
=
"1.4.
4
"
description
=
"Text Generation Inference integration tests"
authors
=
[
"Nicolas Patry <nicolas@huggingface.co>"
]
...
...
server/pyproject.toml
View file @
6c4496a1
[tool.poetry]
name
=
"text-generation-server"
version
=
"1.4.
3
"
version
=
"1.4.
4
"
description
=
"Text Generation Inference Python gRPC Server"
authors
=
[
"Olivier Dehaene <olivier@huggingface.co>"
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment