Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
Commits
9122e7bd
"tests/git@developer.sourcefind.cn:OpenDAS/fairscale.git" did not exist on "e65833a0e4a3d5b0fad6128032746a03a733d275"
Unverified
Commit
9122e7bd
authored
Apr 04, 2023
by
Guspan Tanadi
Committed by
GitHub
Apr 04, 2023
Browse files
docs(readme): provide link Logits Warper README (#154)
parent
c0aeb325
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
9122e7bd
...
...
@@ -46,7 +46,7 @@ to power LLMs api-inference widgets.
-
Quantization with
[
bitsandbytes
](
https://github.com/TimDettmers/bitsandbytes
)
-
[
Safetensors
](
https://github.com/huggingface/safetensors
)
weight loading
-
Watermarking with
[
A Watermark for Large Language Models
](
https://arxiv.org/abs/2301.10226
)
-
Logits warper
s
(temperature scaling, topk, repetition penalty
...
)
-
Logits warper (temperature scaling, top
-p, top-
k, repetition penalty
, more details see
[
transformers.LogitsProcessor
](
https://huggingface.co/docs/transformers/internal/generation_utils#transformers.LogitsProcessor
)
)
-
Stop sequences
-
Log probabilities
-
Production ready (distributed tracing with Open Telemetry, Prometheus metrics)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment