As requested, this is the subreddit’s second megathread for model discussion. This thread will now be hosted at least once a month to keep the discussion updated and help reduce identical posts.

I also saw that we hit 80,000 members recently! Thanks to every member for joining and making this happen.

Welcome to the r/LocalLLaMA Models Megathread

What models are you currently using and why? Do you use 7B, 13B, 33B, 34B, or 70B? Share any and all recommendations you have!

Examples of popular categories:

  • Assistant chatting

  • Chatting

  • Coding

  • Language-specific

  • Misc. professional use

  • Role-playing

  • Storytelling

  • Visual instruction

Have feedback or suggestions for other discussion topics? All suggestions are appreciated and can be sent to modmail.

^(P.S. LocalLLaMA is looking for someone who can manage Discord. If you have experience modding Discord servers, your help would be welcome. Send a message if interested.)

Previous Thread | New Models

  • roselan@alien.topBEnglish
    1·
    1 year ago

    Yi-34B-Chat

    It’s not the most uncensored, and probably not the best, but I really like it’s prose and coherence.

    And Q4_K_M guff runs on my 32gb ram laptop.

    (and yes it’s slow)

      • roselan@alien.topBEnglish
        1·
        1 year ago

        stupid stuff and silly scenarios. My latest:

        Jane, Marc bratty over energetic sister, really wants to borrow Marc shiny new convertible. Marc is not so sure…

        Write their over the top bickering. Jane is relentless and stops at nothing, to the exasperation of Marc.

        For all serious stuff I use gpt4 of course.