As the title says, I really like this app. It’s a great idea, easy to use, and I’ve learned some interesting stuff from it. However, once I had been using it for a few weeks, I noticed a troubling pattern: it was hallucinating entire topics and occasionally giving me lessons that were utterly incoherent. For some reason, this seems to be a particularly heinous problem in the “Crime” category. Weird prompts I’ve been given include “The Murder of Steve Irwin,” “The Murder of John McCain,” and perhaps most jarringly of all, “The Guilty Conscience of Ad**f H**ler.” Whenever these prompts come up for me, the text of the lesson inevitably devolves into the app arguing with itself, saying things like “there is no evidence that this actually happened” or “present lesson to user in conversational, educational tone.” In each case, it clarified that Steve Irwin and John McCain, respectively, were not murdered; it also clarified that there’s no evidence H**ler felt any remorse.The most baffling one was when I got a lesson called “The Kidnapping of Edna K,” in which the app immediately acknowledged it had no idea of such an event ever occurring. It proceeded to create a five page lesson listing various criminal cases from various countries that could be related, before repeatedly determining that there was no “kidnapping of Edna K” that it could identify. A very user friendly app and great concept, but the content needs a lot of work. When the entire purpose of your product is to share knowledge, fake AI hallucinations are just about the worst thing you could have happen.
Hi! Thank you for the kind words, and for this incredibly detailed report. You're absolutely right, and we take this seriously.We're actively working on improving our content validation to catch and eliminate these before they ever reach users. Your examples are genuinely useful for us to investigate.If you come across more, please send them our way at hello@genk.app. It makes a real difference. We appreciate your patience and hope to earn back your full trust. 🙏
