https://huggingface.co/deepnight-research
I’m not affiliated with this group at all, I was just randomly looking for any new big merges and found these.
100B model: https://huggingface.co/deepnight-research/saily_100B
220B model: https://huggingface.co/deepnight-research/Saily_220B
600B model: https://huggingface.co/deepnight-research/ai1
They have some big claims about the capabilities of their models, but the two best ones are unavailable to download. Maybe we can help convince them to release them publicly?
wait the 100B one says it’s based on llama2-chat? did they take the llama 2 foundational model, up the parameter count, and just continue training?