I watched a video recently about AI text generation that neatly summarized the problem for me. He asked it to write a murder mystery, and he was genuinely engrossed in the story until the ending. He didn't know who the murderer was, but neither did the AI. It was just following the paths laid out for it on a sentence-by-sentence basis, but it wasn't reading what it wrote and had no context for what was going on. It was a mystery without a solution.