That’s the prevailing idea based on all the info we have so far:
Llama 1 training was from around July 2022 to January 2023, Llama 2 from January 2023 to July 2023, so Llama 3 could plausibly be from July 2023 to January 2024.
In August, a credible rumor from an OpenAI researcher claimed that Meta talked about having the compute to train Llama 3 and Llama 4, with Llama 3 being as good as GPT-4.
In an interview with Lex Fridman published Sept. 28, Mark Zuckerberg has said they’re always training another model and already working on the next generation when talking about Llama.
At Meta Connect on Sept. 27 - 28, they said more news about Llama will be put out next year.
WSJ published an exclusive on Sept. 10 that said Meta’s next LLM won’t start training until early 2024, meaning a release wouldn’t happen until much later, but they may have been mistaken since this seems to contradict Mark’s recent words. Meta could have also accelerated their plans to stay relevant in the LLM race, especially since leaks about their LLM development have shown they’ve put more emphasis on productizing Llama and incorporating it within their apps.
That’s the prevailing idea based on all the info we have so far:
WSJ published an exclusive on Sept. 10 that said Meta’s next LLM won’t start training until early 2024, meaning a release wouldn’t happen until much later, but they may have been mistaken since this seems to contradict Mark’s recent words. Meta could have also accelerated their plans to stay relevant in the LLM race, especially since leaks about their LLM development have shown they’ve put more emphasis on productizing Llama and incorporating it within their apps.