[Return]

Report a post

Preview
I will run those prompts a bit later as this requires to turn off almost all apps that use GPU to save memory

>>24525
I use "text generation UI" but kobold is also possible
I can't tell why it gives error for you from what you said.

to make AI write stuff on it own you will need at least 30b model (maybe 13b will also work to some extent ut quality will be worse). unfortunately we can't run 65B models unless you gave two 3090 cards but that woud be pretty good.

If you manage to run AI on your PC you may want to try different models from huggingface new loras are being trained all the time so even I don't know which is the best for now
Post number No.24526
Board Literature
Optional. Describe what's wrong with it.