all
/
g
/
s
/
fur
/
art
/
ai
/
3dcg
/
f
/
rp
/
req
/
p2p
/
dis
/
lit
/
kaki
chat
GUROchan!
This list is WIP...
1
2
3
So use the classic menu
Link 4
Link 5
Link 6
Link 7
List 3
Link 8
Link 9
[
Settings
]
[
Home
] [
Catalog
] [
Search
] [
Thread list
] [
Stats
] [
Reports
] [
Watcher
] [
PMs
] [
Admin
]
Literature
[
Return
]
Report a post
Preview
Onix
2023/09/17
(Sun)
11:41:44
No.
25042
[
Report
]
▶
>>25040
I doubt if such a small model will be able to write anything decent without your help and editing.
but you can try like I described above
download this model for example
https://huggingface.co/TheBloke/Kuchiki-L2-7B-GGUF/resolve/main/kuchiki-l2-7b.Q5_K_M.gguf
drop it into models folder
and try it with llama.cpp
You can split it between cpu and gpu
you can also use model downloader where you
chose model tab download model
put
TheBloke/Kuchiki-L2-7B-GGUF/
into first line press get file list then
copy
kuchiki-l2-7b.Q5_K_M.gguf
into the second line for filename
Post number
No.
25042
Board
Literature
Reason
Optional. Describe what's wrong with it.
Style: