Ironically enough that’s is exactly the kind of seemingly “simple” question a 4 years old could answer… but LLMs can’t.
Asked my better half to test DeepSeek locally few months ago and they, without trying to “trick” it (as I would have tried) genuinely tried “What time is it in Sri Lanka?”. That made me smile because I was rather sure there was no way the model could answer that. It would need to know the current time on any time zone then, if it’s not in Sri Lanka already (which it wasn’t on my local system) would have to convert it. That would be very basic arithmetic (that some 4 years old could also do) but not “just” spitting back words related to the question.
Guess what… it failed exactly as expected. The model replied back “information” (which is being generous for a string of words arguably related to the topic, which was mostly about Sri Lanka, not time) and yet was basically irrelevant and thus useless.
So… yes I’m not actually sure CoPilot could even help there unless there is a lot of custom made handling of this kind of queries upstream!
While true; do curl http://copilot/?query=what+is+the+time; sleep 10; doneBet the AI can’t see through this.
Ironically enough that’s is exactly the kind of seemingly “simple” question a 4 years old could answer… but LLMs can’t.
Asked my better half to test DeepSeek locally few months ago and they, without trying to “trick” it (as I would have tried) genuinely tried “What time is it in Sri Lanka?”. That made me smile because I was rather sure there was no way the model could answer that. It would need to know the current time on any time zone then, if it’s not in Sri Lanka already (which it wasn’t on my local system) would have to convert it. That would be very basic arithmetic (that some 4 years old could also do) but not “just” spitting back words related to the question.
Guess what… it failed exactly as expected. The model replied back “information” (which is being generous for a string of words arguably related to the topic, which was mostly about Sri Lanka, not time) and yet was basically irrelevant and thus useless.
So… yes I’m not actually sure CoPilot could even help there unless there is a lot of custom made handling of this kind of queries upstream!
Need to throw in a randomizer:
while true; do curl http://copilot/?query=what+is+the+time+in+RANDOM+seconds sleep 10; done done