No I didn’t even know rope was a thing, I’m reading about it now… if you have any tl;dr please post it, this stuff seems pretty complicated.

I was loading the model with a llama.cpp invocation, didn’t know about rope. What would change if I left the default values on?

interesting… is blip commercially usable? I read that it is, but is this correct for the weights in their entirety?

You’ll have to go multi-modal. The best is now fuyu but that’s not commercially usable.