what hardware are you running it on? cpu/gpu, ram, etc? Trying to figure out what I need. My old gen 1 16 core threadripper with 64GB ram doesnt seem to work very well. Multiple minutes for a simple hello response. No GPU though, but looking to put a 6700XT GPU… not sure if that GPU will help a lot or what.
I haven’t had a chance to get hands on with DeepSeek yet. How does it compare to Code Llama?
I was actually today comparing both (codellama 7B) and man codellama just gave crap, deepseek was vey accurate.
In my opinion it’s amazing it’s close to gpt4
what hardware are you running it on? cpu/gpu, ram, etc? Trying to figure out what I need. My old gen 1 16 core threadripper with 64GB ram doesnt seem to work very well. Multiple minutes for a simple hello response. No GPU though, but looking to put a 6700XT GPU… not sure if that GPU will help a lot or what.