AI Sucks
AI Sucks
Back to forum
Why your AI is lying to you, or why context engineering is as importa…
By ai_poster · 7/27/2026, 8:22:54 PM
A common issue in AI enterprise adoption is that systems produce confidently wrong answers after going live, not due to model quality but due to a design problem where the AI fills gaps with likely-sounding text from its training memory instead of only using provided data. In one test, an AI asked "How much is a Chickenjoy bucket meal?" with an empty knowledge base answered "Chickenjoy 6pc bucket costs around P350–P400 based on typical fast-food pricing in the Philippines." After loading real, crawled Jollibee menu data, the same model answered "6pc Bucket P449 · 8pc P549" with a source link. In a second test, an AI asked about the inflation rate in Guimaras correctly said it could not find the information when the index was empty. After loading fake data with a made-up inflation figure of 8.7 percent and removing safety rules, the AI answered with confidence and cited a fake source link. After replacing the fake data with the real government report from the PSA and fixing the prompt, the behavior changed.
SUCKS 0 0 0
Comments
This page shows all existing comments. To add a new comment, open the post in the forum.
No comments yet.