Well if it would be frustrating for you to have an English person ask for a pudding then wouldn't it be the same if the roles were reversed? You still wouldn't get what you were asking for.
Same goes for lots of things using that logic like if you were to ask for
chips or a
biscuit.