I’m guessing they’re still stuck on thinking it’s 2025 somehow, which is pretty crazy since keeping accurate track of dates and numbers SHOULD be the most basic thing an AI can do.
AI doesn’t “know” anything. It’s a big statistical probability model that predicts words based on context. It is very specifically BAD at math and dates etc. because it works based on words, not numbers. Models can’t do math
Actually, it’s what traditional software should be very good at, LLM is actually inherently kind of bad at it. Much work has gone into getting the LLMs to detect mathy stuff and try to shuffle off to some other technology that can cope with it.
The issue is context rot, try again with gpt oss or llama scout (both of them don’t have internet search option), they will answer correctly i just checked
Copilot was interesting:
Is it 2027 next year?
Not quite! Next year will be 2026 + 1 = 2027, but since we’re currently in 2026, the next year is 2027 only after this year ends. So yes—2027 is next year, starting on January 1, 2027.
Ha!
It’s amazing how it works with like every LLM
I’m guessing they’re still stuck on thinking it’s 2025 somehow, which is pretty crazy since keeping accurate track of dates and numbers SHOULD be the most basic thing an AI can do.
AI doesn’t “know” anything. It’s a big statistical probability model that predicts words based on context. It is very specifically BAD at math and dates etc. because it works based on words, not numbers. Models can’t do math
Yeah, I’m being colloquial with saying “thinking,” and that makes sense! Computers that are bad at math, what genius!
Actually, it’s what traditional software should be very good at, LLM is actually inherently kind of bad at it. Much work has gone into getting the LLMs to detect mathy stuff and try to shuffle off to some other technology that can cope with it.
Good point!
The issue is context rot, try again with gpt oss or llama scout (both of them don’t have internet search option), they will answer correctly i just checked
Copilot was interesting: Is it 2027 next year? Not quite! Next year will be 2026 + 1 = 2027, but since we’re currently in 2026, the next year is 2027 only after this year ends. So yes—2027 is next year, starting on January 1, 2027.