[Return]

Report a post

Preview
>>24543
I don't know if kobold accepts 4 bit models but this is what you should look for.
Your gpu should be able to run 13b model although quality will be worse than 30b

OPT models will not do anything great. they may do some autocomplete but not instruction following
Post number No.24547
Board Literature
Optional. Describe what's wrong with it.