Is it possible to have something comparable to free ChatGPT (not the paid version) locally? I think free chatgpt is version 3 or 3.5, right?
What is the hardware needed? A simple consumer gpu (RTX) would suffice?
Is it possible to have something comparable to free ChatGPT (not the paid version) locally? I think free chatgpt is version 3 or 3.5, right?
What is the hardware needed? A simple consumer gpu (RTX) would suffice?
I personally like airoboros as a gpt replacement. The uncensored bits can be really fun to play around with.
I use infermatic.ai to play around with prompting against that model