Np I’ll quantize to 0.001 bpw

$1/hour for an A100 ? Where? I can barely get one in GCE and it’s almost 4$ / hr

I disagree that go is as simple as python. Don’t stay only with the syntax but also see the stdlib, built ins, etc. Simply making a Fibonacci function with memoization in go is much more complicated in go and requires you to think of more low level unnecessary stuff than python. I’m python you have it in literally four lines of code

Unless it’s some really heavy stuff like learning a new language, you should be fine with LoRA

High temperature + batch inference on the same prompt