Eric Hartford, the author of dolphin models, released dolphin-2.2-yi-34b.
This is one of the earliest community finetunes of the yi-34B.
yi-34B was developed by a Chinese company and they claim sota performance that are on par with gpt-3.5
HF: https://huggingface.co/ehartford/dolphin-2_2-yi-34b
Announcement: https://x.com/erhartford/status/1723940171991663088?s=20
It seems like sally test is included in the training set nowadays?
https://preview.redd.it/248fongjm80c1.png?width=901&format=png&auto=webp&s=1944b2dfcda2c84fb29d69520f54bc35fda2dbb9
It seems it’s in the ‘base’ model. As I came up with the ‘(a girl)’ part I’ve had something immortalized in a Chinese AI model. I suppose.
Without the prompt dolphin uses, I get his (using rep pen 1.1, not sure why that affects it)
The answer is Sally has 1 sister.
Here’s the reasoning:
That’s it! The answer is that Sally has 1 sister.
Today the Yi chat model is released, I just done the sally test and here is the result:
https://preview.redd.it/nft8z38pz22c1.png?width=928&format=png&auto=webp&s=8fb90685cfc43f30fd17e2957aa2161fabbf3e4a
I had nous capy34 get it right a couple of days ago with these settings
https://www.reddit.com/r/LocalLLaMA/comments/17uskx7/comment/k9c1wcc/?utm_source=share&utm_medium=web2x&context=3
Which is interesting. I want to test this new yi chat because apparently it can do decent ASCII?! Need a gguf though.