mirror of
https://github.com/nextcloud/documentation.git
synced 2025-10-26 11:18:02 +00:00
Update admin_manual/ai/app_llm2.rst
Co-authored-by: Josh <josh.t.richards@gmail.com> Signed-off-by: Marcel Klehr <mklehr@gmx.net>
This commit is contained in:
parent
5c881f087c
commit
2995d98bf3
@ -24,7 +24,7 @@ Requirements
|
||||
|
||||
* You will need a GPU with enough VRAM to hold the model you choose
|
||||
|
||||
* here are some examples:
|
||||
* Some examples:
|
||||
|
||||
* for 8B parameter models, 5bit-quantized variants and lower should fit on a 8GB VRAM, but of course have slightly lower quality
|
||||
* for 8B parameter models, 6bit-quantized variants and up will need 12GB VRAM
|
||||
|
||||
Loading…
Reference in New Issue
Block a user