Same experience here. I got excellent results from quantized models of Intel-Neural-7B and Mistral-7B but bad results with quantized model of Yi-34B.

Best part for me was Security. Security issues Andrej shown are really eye opening. But may be that would create new opportunities in LLM security just like Cyber security.

On HuggingFace you can find many fine-tuned/quantized models. Look for models from TheBloke on HuggingFace.

I am interested to see if new leadership of OpenAI would be more LLM dev friendly and stop conspiring with politicians to hinder open source LLM community innovations.

I second this. Mistral-7B gave me good results. After fine-tuning it’s result is even better.