all
/
g
/
s
/
fur
/
art
/
ai
/
3dcg
/
f
/
rp
/
req
/
p2p
/
dis
/
lit
/
kaki
chat
GUROchan!
This list is WIP...
1
2
3
So use the classic menu
Link 4
Link 5
Link 6
Link 7
List 3
Link 8
Link 9
[
Settings
]
[
Home
] [
Catalog
] [
Search
] [
Thread list
] [
Stats
] [
Reports
] [
Watcher
] [
PMs
] [
Admin
]
Literature
[
Return
]
Report a post
Preview
Onix
2023/09/12
(Tue)
12:58:25
No.
25019
[
Report
]
▶
>>25015
If some human writers are willing to compete or maybe improve any of the stories That woud be nice to see.
>>25016
There is not much required to do:
get one click installer from here
https://github.com/oobabooga/text-generation-webui
and select some AI model
The problem is that with 8gb 3050 it will not be able to do much and you may even get comparable performance with CPU inference if slightly larger model especially if you split it between CPU and GPU
all this process is not so much computationally but memory bandwidth limited
since entire model has to be processed every time for each token.
Post number
No.
25019
Board
Literature
Reason
Optional. Describe what's wrong with it.
Style: