I’m confused by all these prefixes that appear in the finetunes of base models. Is there a glossary of all these words and similar ones?

  • vicks9880@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    These are just names, LLaMA originally meant ( Large language model Meta AI), but it appears that its also the name of South American animal, thus creative people of internet who download those weights, fine-tuned it and published it with the other animals of same family like alpaca, vicuna, dalai (llama) etc.

    There are more important information in these model names, which are suffix, like parameter counts13B, quantization methods GGUF/GGML, fine-tuning techniques like LoRA, fine-tuning parameters like Q6_K_M etc are used.

    • prtt@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      the other animals of same family like alpaca, vicuna, dalai (llama)

      One of these is definitely not like the others.