Those models can’t be accessed, they say it’s “too dangerous to be released”

You are right but I think a big part of Open source is being able to modify it however you like.

You can’t really modify anything here except for fine tuning without the og dataset

In general, you have two options:

Running the model on your graphics card, or running it using your CPU.

On your graphics card, you put the model in your VRAM, and your graphics card does the processing.

If you use your CPU, you put the model in your normal RAM and the cpu does all the processing.

The graphics card will be faster, but graphics cards are more expensive.

You can even mix the two if you can’t fit your model in your VRAM, where you put as much as possible on your VRAM and whatever left over on RAM and CPU. But this won’t be as fast as running it fully on your graphics card.

Mac has a different kind of architecture where it’s a mix of the two, and can be incredibly fast, but I haven’t used it so can’t speak too much on it.

u/faldore

Does this mean Dolphin2 coming? I’m hoping so! I love the current dolphin models

Dolphin man please!

Doesn’t this method free up context?

How do you know the start up isn’t providing value? Isn’t the whole point of making ai is to integrate it with other software/stuff?

Ai can be much more powerful than a chatbot

Wow! Exciting! Are these uncensored models or does the training data include refusals? Does anyone know? What was orca 1?

Satya already made the announcement that Sam is joining Microsoft, so it’s pretty much impossible for OpenAI board to reinstate Sam as ceo.

The board can resign but they won’t get Sam back, so I think at this point OpenAI is going to crumble and Microsoft will take in everyone

Microsoft has been working with OAI on integrating GPT into products, and there has probably been a lot of technical knowledge spread back and forth.

Now Microsoft has the leadership team from OAI, as well as whatever information OAI wasn’t sharing with Microsoft before, and they can probably start transitioning away from their reliance on OAI.

Could you link me for some more info on that?

I’m not sure why he is being very vague with this model. He said it’s fine tuned to be better at instruct? I think

Wow, Greg giving the breakdown of what happened was nice. Very sudden even internally.

I thought this might have been brewing over a week or so and it seems like it was, since Dev Day.

How does this compare with dolphin 2.2 mistral 7b?

Passing it proprietary code is probably on the top of the list.

Is it possible to switch out the usb cables for something faster? I am new to hardware for GPU’s so I’d love more insight.

I tried to rent from LambdaLabs yesterday but there was no availability for any gpu