I’m confused by all these prefixes that appear in the finetunes of base models. Is there a glossary of all these words and similar ones?

  • irregardless@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I’ll go out on a limb and say that no one has compiled a glossary or encyclopedia of the various fine-tunes that seem to get published every day (if I’m wrong I’m sure someone will correct me). If you’re not connected to “the scene”, or working with these models academically/professionally, it can be hard to become and stay initiated into the “secret” jargon that’s developed around local LLM. You can pick up a lot just by hanging out here, but you’ll still run into quite a few things that make you ask “wtf does that mean?”.