IamFuckinTomato@alien.topBtoLocalLLaMA•Can't handle efficiently RAG with large PDFEnglish
1·
1 year agoMake a parents retriever (chunk 2000) and input it child retriever (chunk 400), 0 overlap
Can you please elaborate.
Make a parents retriever (chunk 2000) and input it child retriever (chunk 400), 0 overlap
Can you please elaborate.
Hey. Love this model and the self-rag idea.Is there a way I can hook this up with my own RAG database?
Have you tried installing the missing package files it shows when u tried installing the openai extension?
I had the same issue and installing those missing packages via the cmd_windows in the same folder.
Does mistral also have something like this in their ToS.
I’m planning on using mistral generated data to fine-tune a model.
Have you tried to chunk it based on headings or did you just chunk the pdfs into chunks with fixed token sizes?