Well the code quality has gotten pretty bad so I think it’s time to cancel my subscription to ChatGPT Plus. I have an RX 6600 and an GTX 1650 Super so I don’t think local models are a possible choise (at least for the same style of coding that is done with GPT-4). But I decided to post here anyway since you guys are very knowledgeable. I was looking at cursor.ai and it seemed pretty good. I don’t know how good it’s now since OpenAI has decreased the performance of GPT-4 but I have heard that the API is still ok. Also there is refract which could be a similar choise too. What do you recommend? I do coding in mostly Python and sometimes C++.
Deepseek Coder 33B worked well for me, I asked it to make the game snake and it did it the first time with the 4bit GPTQ - https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GPTQ
Other models are available to run on CPU/GPU - https://huggingface.co/models?search=deepseek 33b
What specs? Didn’t have enough memory to run it. I have an RX 6600 and a Ryzen 5 5600x also 16gb of ram.
Game Snake will be included in all models.
What UI do you use with Deepseek Coder? I need one that can format markdown text well.
use LM Studio
Not FOSS
I use oobabooga, I’m actually testing out using it with Language Agent Tree Search to see if it can make better outputs -https://github.com/andyz245/LanguageAgentTreeSearch