I use in both cases q4_K_M

  • tomccc@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I had very bad experiences using all the Yi models until recently. Going to chalk it up as user error on my part. LoneStriker_Capybara-Tess-Yi-34B-200K-DARE-Ties-4.0bpw-h6-exl2 is really good. I made sure to have all the right settings.