Curious if it can be connected to, or set up to update fine tunings on a schedule? Admittedly I’ve only slightly paid attention RAG so far, but not sure if this is a step further, or already a current capability.
You must log in or register to comment.
Fine tune + RAG seems to be the method we’re expected to go in. Need to fine tune for terminology and RAG for policy and procedure knowledge.
My two cents. Unless you have jargon in your field you just need RAG. Fine-tuning is for adjusting the token associations to predict the most likely next token.
Ok, so I’ll look more into RAG. I just saw Mathew Bermans video on creating agents with YouAI, but I’m hoping for something that’ll connect to our database (or even just a couple specific tables) instead of having to manually export csv files from my db to then upload.
You have to do some type of search for the correct information for the question. It doesn’t matter how you get the information.
I agree with the other guy, you just need semantic search of some flavor unless you have industry specific language that the LLM won’t understand well enough to write
Ok great. So if we aren’t getting great results with RAG, then fine tune with our own dataset on our language to see if that helps.
I’m hoping to find an automated way to RAG, ideally with a db connection but maybe could set up an api script to export data from the db and upload to the model. I assume at least the second option exists, so I’ll be looking.