"tests/git@developer.sourcefind.cn:OpenDAS/fairscale.git" did not exist on "e65833a0e4a3d5b0fad6128032746a03a733d275"
Unverified Commit 9122e7bd authored by Guspan Tanadi's avatar Guspan Tanadi Committed by GitHub
Browse files

docs(readme): provide link Logits Warper README (#154)

parent c0aeb325
......@@ -46,7 +46,7 @@ to power LLMs api-inference widgets.
- Quantization with [bitsandbytes](https://github.com/TimDettmers/bitsandbytes)
- [Safetensors](https://github.com/huggingface/safetensors) weight loading
- Watermarking with [A Watermark for Large Language Models](https://arxiv.org/abs/2301.10226)
- Logits warpers (temperature scaling, topk, repetition penalty ...)
- Logits warper (temperature scaling, top-p, top-k, repetition penalty, more details see [transformers.LogitsProcessor](https://huggingface.co/docs/transformers/internal/generation_utils#transformers.LogitsProcessor))
- Stop sequences
- Log probabilities
- Production ready (distributed tracing with Open Telemetry, Prometheus metrics)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment