You must log in or register to comment.
is there 13 b ?
There’s been lots of Arabic investment in Cerebras:
They’re probably training a lot more than that with all the CS-2s they are shipping.
Yeah you’re right, Falcon also Arabian.
I wouldn’t call it “Arabic”. It doesn’t handle Arabic text well.
Introducing Jais 30B, the latest open source Arabic-English model developed by Core42 & Cerebras. It sets a new benchmark in Arabic LLM accuracy and outperforms Llama 30B in English. Trained on 16x Cerebras CS-2s using only data parallelism.