hi folks,

simple question really - what model (finetuned or otherwise) have you found that can extract data from a bunch of text.

I’m happy to finetune, so if there are any successes there, would really appreciate some pointers in the right direction.

Really looking for a starting point here. I’m aware of the DETR class of models and how Microsoft trained table-transformers on DETR. Wondering if that can be done on llama2,etc models ?

P.S. cannot use GPT because of sensitive PII data.

  • georgejrjrjr@alien.topBEnglish
    1·
    1 year ago

    I’ve wondered this, and hope you get better answers.

    One thing you could do if it fit your use-case: align GDELT entries and news stories in realnews dataset on huggingface, train a model to output the extracted info from the article.

    Another is have GPT-4 so some examples on lightly faked / anonymized data and then distill that into a model that does well on information extraction evals (which are a thing iirc).