Hi everyone, just received my new macbook pro with M3 pro (36GO) and I’m willing to have fun with a local Llama now that I finally have a machine able to run it !
Main question is : wich version can I run without burning my chimp ? 13b ? 70b ?
Also if you have any usefulls ressources you can suggest to get into this game feel free to share I’m a real beginner in LLM. I’m a young python dev for fun and a javascript dev for food and mainly want to have a local llama to assist me on web dev !
Thanks to guys like Alex Ziskind I’m aware it’s not really reliable for coding assist for now but I’m really curious about what it can do, if you have better tool I could set up on my machine to assist me feel free to share and I’m really willing to devour some ressources about this subject.
Thank you all for your help and advises !
I dont know if Exllama 2 supports Mac, but if it does, 70B.
It doesn’t