People -- such as USG decision makers -- don't seem to understand what these crappy LLM tools do. They don't know anything. They don't think. They're not smart. They don't reason. They just replicate patterns with whatever's in their training set. They'll plug bits and pieces of that together and might spit out something true, or might spit out something that's complete bullshit but fits a trained pattern. Someone has to get this through the brains of people in govt who spend money on this snake oil and use it to make very consequential decisions affecting people's lives.
