I overfitted the Phi 1.5 model on a riddle dataset found here:
https://huggingface.co/datasets/Ermarrero/riddles_v1
I just wanted to see how it behaves and I gotta say the output is interesting since it thinks everything is a riddle and tries to break it down logically.
It’s weird but it is kind of refreshing to see a model overthink it and dig too deep into things. I dunno, what do you guys think?
if you want to play around with the model I can upload it to hugginface.
May I know the LoRA parameters, if you used q/LoRA?