is there a way to get a zero knowledge model that only knows how to chat. and from there fine tune it with specialized knowledge? and do this on consumer hardware (mac M1/16 gig) or free colab hardware?

i want to do this so as to prevent the model from hallucinating outside of the domain knowledge it is fed…like passing in a textbook and it only knows how to answer questions from it

  • Ok_Post_149@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Is home hardware a requirement for this project? I guess I’m a little confused what that has to do with model hallucinations.