I’m currently using 1650 4GB, AMD 5600, 32GB RAM.
I got some spare cash to throw to learn more about local llm.
Should I get: A. 64 GB RAM (2 X 32GB) B. 3060 12GB C. Intel A770 16GB.
I’m using openhermes 2.5 Mistral 7b q5k_m gguf, ok-ish Performace for Silly tavern with koboldcpp. But when context goes above 3k, it crawled.
Please let advise which option you think I should take first. Thanks bunch.
Well, it depends.
You can not run 70B models with RTX 3060, but you can with 64Gb of memory.