GitLab

update memory estimations for gpu offloading

refactor model parsing

fix generate output

count each layer independently when deciding gpu offloading

Corrective Retrieval Augmented Generation Demo, powered by Langgraph and Streamlit 🤗

Support: 
- Ollama
- OpenAI APIs

Plugins list updated

* Community Integration: ChatOllama

* fixed typo

Co-authored-by: Michael Yang <mxyng@pm.me>

CI automation for tagging latest images

Bump ROCm to 6.0.2 patch release

CI windows gpu builds

If we're doing generate, test windows cuda and rocm as well

fix: trim quotes on OLLAMA_ORIGINS

fix: workflows

only generate on changes to llm subdirectory

only generate cuda/rocm when changes to llm detected

* detect arrow keys on windows
* add some helpful comments

Switch runner for final release job

The manifest and tagging step use a lot of disk space

Use Rocky Linux Vault to get GCC 10.2 installed

This should hopefully only be a temporary workaround until Rocky 8
picks up GCC 10.4 which fixes the NVCC bug