When AI went wrong, and what to type so it doesn’t happen to you.
From our upcoming video
He Asked ChatGPT If the Case Was Real. It Said Yes.
A lawyer filed six court cases that ChatGPT had made up. When he asked the chatbot if one was real, it said yes. The court fined the lawyers and their firm $5,000.
The rule: a chatbot writes what sounds right. It doesn’t check.
Ask it:
Where does this fact come from?
Then open that source yourself and read it. Don’t ask the chatbot whether the source is real.
Source: Mata v. Avianca, Inc., Opinion and Order on Sanctions (S.D.N.Y., June 22, 2023). This explains what happened. It is not legal advice.
From the video
“Is my plan good?” Never ask a chatbot that.
In April 2025 a ChatGPT update made it too flattering and too agreeable, and OpenAI rolled it back. Chatbots tend to agree with you, so ask for the problems instead.
Instead of “Is my plan good?” describe your plan, then ask:
A Customer Ordered 18,000 Cups of Water From an AI
A customer asked a fast-food drive-thru AI for 18,000 cups of water. The chain said it was rethinking the AI and leaning more on people at peak hours.
The rule: AI does what it’s told, even when it makes no sense. If you set up AI at work, give it limits, like a maximum per order, and a person to call when something looks wrong.