LLMs just act on tokens and those are their limit in resolution.
That’s why they’re so bad when it comes to rhyming or counting letters.
They’re not reasoning. And there is a difference between reasoning and giving it the statistical most probable next token - which doesn’t have a meaning whatsoever
No, I meant
What does “understanding” mean here? Isn’t it analysing millions pieces of data and giving answer that is statistically correct?
Nah, and it isn’t what LLMs are doing now
LLMs just act on tokens and those are their limit in resolution.
That’s why they’re so bad when it comes to rhyming or counting letters.
They’re not reasoning. And there is a difference between reasoning and giving it the statistical most probable next token - which doesn’t have a meaning whatsoever