Unverified Commit 7e58f9d2 authored by ZiWei Yuan's avatar ZiWei Yuan Committed by GitHub
Browse files

Merge pull request #165 from kvcache-ai/KMSorSMS-patch-1

Update FAQ.md
parents 370b21e5 193d6300
...@@ -16,4 +16,10 @@ from-https://github.com/kvcache-ai/ktransformers/issues/117#issuecomment-2647542 ...@@ -16,4 +16,10 @@ from-https://github.com/kvcache-ai/ktransformers/issues/117#issuecomment-2647542
So we fix this by manually adding "\<think>\n" token at prompt end (you can check out at local_chat.py), So we fix this by manually adding "\<think>\n" token at prompt end (you can check out at local_chat.py),
and pass the arg `--force_think true ` can let the local_chat initiate the response with "\<think>\n" and pass the arg `--force_think true ` can let the local_chat initiate the response with "\<think>\n"
from-https://github.com/kvcache-ai/ktransformers/issues/129#issue-2842799552 from-https://github.com/kvcache-ai/ktransformers/issues/129#issue-2842799552
\ No newline at end of file
### 3 version `GLIBCXX_3.4.30' not found
The detailed error:
>ImportError: /mnt/data/miniconda3/envs/xxx/bin/../lib/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /home/xxx/xxx/ktransformers/./cpuinfer_ext.cpython-312-x86_64-linux-gnu.so)
It may because of your conda env have no this version. Your can first exit your conda env by `conda deactivate` and use `whereis libstdc++.so.6` to find the path. And re enter your conda env and copy the .so by `cp <path of outter libstdc++> <path of your conda env libstdc++>`
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment