mistral-7b-openorca.Q5_K_M.gguf:

> I have three apples. I eat two pears. How many apples do I have left?

You have one apple left.

I tried helping it out with the prompt (in a new session):

> I have three apples. I eat two pears. How many apples do I have left? Let’s think this out, step-by-step:

First, we need to find out how many apples and pears I had before eating the pears. Since I have three apples initially, that means I had a total of three apples + zero pears = three apples.

Next, I eat two pears. After eating those pears, I am left with my original number of apples, which is three. So now, I have three apples - two pears = one apple left.

Therefore, after eating the two pears, I have one apple left.

Yeah, not great. It is just a 7B model though. Which lead me to a pleasant surprise…

zephyr-7b-beta.Q5_K_M.gguf:

> I have three apples. I eat two pears. How many apples do I have left?

You started with three apples, but you didn’t say anything about how many apples you ate. So we don’t know how many apples you have left.

To find out, we need to subtract the number of pears you ate from the total number of fruits you had at the beginning (which includes both apples and pears). Let’s say you ate two pears, so you still have three apples left:

Total fruits at the beginning = 3 apples + 2 pears = 5 fruits

Fruits left after eating pears = 3 apples

So, you have 3 apples left.

Alternatively, we could subtract the number of pears you ate from the total number of fruits you had at the beginning (which includes both apples and pears), and then find how many apples are left by separating them out:

Total fruits at the beginning = 3 apples + 2 pears = 5 fruits

Fruits left after eating pears = 5 fruits - 2 pears = 3 apples + 1 pear

Apples left = 3 apples

Either way, you have 3 apples left.

Definite error on the “fruits left after eating pears” bit, but still very good overall.

So i decided to try another question (in a new session):

> I have 5 US dollars. I spend 2 Canadian dollars. How much money do I have left?

To convert 2 Canadian dollars to US dollars, we need to know the exchange rate. As of my last check, the exchange rate was approximately 1 USD = 1.30 CAD.

So, 2 Canadian dollars is equivalent to about 1.54 US dollars (2 CAD / 1.30 CAD per USD).

Now that we know this, let’s calculate how much money you have left:

Original amount: $5

Amount spent: -$2 (in Canadian dollars)

Converted to US dollars: -$1.54

New total: $3.46 ($5 - $1.54)

So, after spending 2 Canadian dollars, you have approximately $3.46 left in US dollars.

I’m not sure what I was expecting, but it wasn’t that. I can’t find any mistake there other than the exchange rate not being current, and it even mentions that possibility.