Look at this, apart Llama1, all the other “base” models will likely answer “language” after “As an AI”. That means Meta, Mistral AI and 01-ai (the company that made Yi) likely trained the “base” models with GPT instruct datasets to inflate the benchmark scores and make it look like the “base” models had a lot of potential, we got duped hard on that one.
GPT slop gonna GPT slop.
I hate that phrase so much too. Even if they used anything else. Some think they’re being clever and change it to “as an AI”.