Looking for any model that can run with 20 GB VRAM. Thanks!

  • Sweet_Protection_163@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    34B Nous-capybara was the only model I could use reliably for complicated nlp and json output. My go to for any real work. The first, really.