a nice blog post about this https://simonwillison.net/2023/Nov/29/llamafile/

excited to try this thing!

if someone converts to gguf files and uploads them before bloke please post here thanks. (looking for q8).

depepseek is one of my fav, i use it everyday for code generation. its got an extra option for the chat now at the link you shared, just general chat about anything, pretty good at it

much needed change! thanks. hope they merge the change quick.

I dont know what the repo maintainers have in mind, but will they allow it to be changed to look like the oai playground, like the controls on the right and center page is completely chat etc?

this is so needed

try here https://chat.deepseek.com/coder also phind.com

ok so ilya tweeted this: " I deeply regret my participation in the board’s actions. I never intended to harm OpenAI. I love everything we’ve built together and I will do everything I can to reunite the company. " i think its some positive news! and sama made hearts to it <33

https://x.com/ilyasut/status/1726590052392956028?s=20

i am running tinyllama and deepseek 1.3B on a almost 3 year old cheap Poco X3 (snapdragon 732G) and its great. Will post the video soon. So the new phones, and high-end ones, well i am sure some people can run mistral on those. But i also wish that phones gets some of its prices reduced, high-end phones are becoming more expensive the most laptops i cant afford.

embrace! extend! terminate! << Microsoft

but jokes aside, this is crazy. Sam becomes the head of OpenAI again since Microsoft has a lot of say into OpenAI and it will do anything to support its customers and keep the AI integration going into its products with no obstacles.

but i dont know OAI doesnt seem to have a future. What a stupid blunder by the people who built it. Microsoft is going to get a butter smooth transition behind the scenes, they get all the talent, the gpt-4 (and 5 too) and will throw OAI into the dustbin once the transition is over. Right now Sam being part of MS gives assurance to all customers that Microsoft will keep the ship flowing without or without OAI. Once MS is on its own, Sam will also leave to do his own thing as he is.

good progress. waiting for gguf files.

didnt know about phind.com, great model and great website, thanks for sharing.

also check https://coder.deepseek.com/chat, pretty large context and blazing fast.

llama.cpp mostly, just on console with main.exe. Wrote a simple python file to talk to the llama.cpp server which also works great. LM Studio is good and i have it installed but i dont use it, i have a 8gb vram laptop gpu at office and 6gb vram laptop gpu at home so i make myself keep used to using the console to save memory where ever i can. My experience with text gen web ui has not been great, its takes far far too long to update, and sometimes it gets the torch installation right and sometimes torch is not installed with cuda. I really dont want to waste my time on that. I like to install everything manually and want some really light weight web ui to just use the server hosted with llama.cpp.

interesting!

the future is looking exciting! lets hope that people like max tegmark don’t succeed in convincing the governments to stop companies from sharing weights with open source.