Did you use one of the example servers or just executre the default one at ./server ?

Thank you for your excellent work as always! I was waiting for this one. I didn’t now the rp calibrated version of goliath existed. I stick to exclusively GGUF since I run my models on a Mac Studio though 😭

Thanks for the great write up (as usual). I’m looking forward to the 70b post!