As requested, this is the subreddit’s second megathread for model discussion. This thread will now be hosted at least once a month to keep the discussion updated and help reduce identical posts.
I also saw that we hit 80,000 members recently! Thanks to every member for joining and making this happen.
Welcome to the r/LocalLLaMA Models Megathread
What models are you currently using and why? Do you use 7B, 13B, 33B, 34B, or 70B? Share any and all recommendations you have!
Examples of popular categories:
-
Assistant chatting
-
Chatting
-
Coding
-
Language-specific
-
Misc. professional use
-
Role-playing
-
Storytelling
-
Visual instruction
Have feedback or suggestions for other discussion topics? All suggestions are appreciated and can be sent to modmail.
^(P.S. LocalLLaMA is looking for someone who can manage Discord. If you have experience modding Discord servers, your help would be welcome. Send a message if interested.)
I’m really late on this one, but dolphin 2.0 mistral 7b. I did a little extra training on it for some automation and the thing’s ridiculously solid, fast, and light on resource usage. I’m still cleaning up the output a bit after it’s chugging away at night. But to a pretty minor degree.
Though if failures count then Yi 34b’s up there in terms of usage this week too. As I fail a million times over just to train a simple, single, usable, lora for it.