Wondering what everyone thinks in case this is true. It seems they’re already beating all open source models including Llama-2 70B. Is this all due to data quality? Will Mistral be able to beat it next year?
Edit: Link to the paper -> https://arxiv.org/abs/2310.17680
People used to confuse the different GPT-__s all the time. The author probably read something about NeoX-20b and thought it was 3.5.