Protect

AI Chat Risks and How to Stay Safe

The more helpful a chat feels, the easier it is to overshare. A family story, a school name, a photo. AI is not a vault.

What exactly are "AI chat risks"?

AI chat risks fall into four main categories: "personal data leaks," "wrong answers," "overuse," and "being used to harm others." These risks coexist with all the convenience, and they're active at the same time.

One important starting point: the goal isn't "don't use AI chat" — it's "use it knowing the risks." Staying away entirely out of fear is less useful than understanding how it works and using it wisely. That's a real life skill.

Overview of the 4 risks

The diagram below maps the main risks you should know when using AI chat.

4 AI Chat Risks: Frequency & Severity (2023–2025) Source: NPA "Cyber Threat Landscape" / IPA "Top 10 Information Security Threats" / OpenAI hallucination research Risk Frequency Severity ① Personal data leak Hundreds reported per year at companies High ② Misinformation (hallucination) 3–15% of responses affected Medium ③ Overuse / dependency 10–15% of young people (US survey) Medium–High ④ Impersonation / fraud 1,000+ cases per year in Japan High ★ ① and ④ are "High" severity. Never enter personal info — and always verify suspicious messages through a separate channel. ※ Hallucination (confidently wrong answers) hasn't been eliminated even in GPT-4, but is improving year by year.
Fig. 1: Of the 4 risks, ① personal data leaks and ④ impersonation are rated "High severity." Specific precautions are essential.

8 things you should never do

These 8 items are patterns every teen using AI chat should always avoid.

8 Things NOT to Do with AI Chat: Risk Level & Response Source: NPA "Cyber Threats" / IPA "Top 10 Security Threats" / JDLA Usage Guidelines Don't do this Risk level What to do instead ① Full name, address, phone number ★★★ Maximum Anonymize: "grade 9 student" "from Tokyo" ② Family members' names / relationships ★★★ Maximum "my family" or "my older sibling" is fine ③ School name, class, club name ★★★ Maximum Keep it to "a middle school in Tokyo" ④ Passwords / PINs ★★★ Absolute no Never share with AI under any circumstances ⑤ Sharing deep personal problems fully ★★ High Use dedicated counseling services (24-hour lines) ⑥ Trusting answers 100% ★★ High Always verify names, dates, and stats ⑦ Using it all night / skipping sleep ★★ Medium Set a daily limit (e.g. 30–60 min) ⑧ Using AI to impersonate someone ★★★ Criminal Violates unauthorized access laws / anti-bullying laws
Fig. 2: Of the 8 items, ①–④ and ⑧ are maximum risk. Verify suspicious AI voice/video messages via a separate channel (phone call).

Inside each risk and how to handle it

① Don't enter personal information

Full name, address, phone number, your school name, class, or photos — none of these belong in an AI chat. Depending on the service, your input may be used to train the AI or stored as a log inside the company. Solution: If context is needed, anonymize it — "9th grader," "high school student in Tokyo."

② Don't believe answers blindly

AI states wrong things with total confidence. Facts about people, dates, and statistics are frequently wrong. Solution: For proper nouns, dates, and recent information, always verify in at least one source — a textbook, official site, or search.

③ Watch out for overuse and dependency

AI is available 24/7 and never pushes back. Reports are growing of teens chatting all night, pulling away from real friendships, and stopping to think for themselves. Solution: Set a daily limit (e.g. 30–60 minutes). Don't sacrifice sleep. Don't ask AI before thinking it through yourself first.

④ Don't get caught up in impersonation or fraud

AI can convincingly mimic someone else's writing style or voice. Fake LINE-style scam messages, impersonation of celebrities, messages pretending to be a friend — real incidents of AI-powered impersonation are already happening. Solution: Don't take suspicious messages or audio at face value. If unsure, confirm through a separate channel — a phone call or talking in person.

Another thing to be careful about: presenting AI-generated text as your own opinion. For school assignments or reports, this may count as academic dishonesty depending on your school's rules. Use AI to help you understand concepts, brainstorm structure, or check for typos — but make sure your own thinking is in the final result.

A good safety check before entering anything: "Would I be okay if a friend, teacher, or stranger at a company saw this?" If not, don't type it. If unsure, anonymize it. Don't make important decisions based on AI alone — ask a real person. Following these three rules prevents most problems.

If something feels off

3 steps when you're in trouble
  • If a long AI chat session leaves you feeling low — stop, close the screen, and talk to a family member or friend.
  • If you accidentally entered personal info — tell a parent/guardian, delete the chat history. Check settings for an option to stop your input from being used for training.
  • If you receive a suspicious AI voice or video from someone unknown — don't respond. Talk to a parent or teacher.

The key to safe AI chat is deciding upfront: "If anything feels wrong, I'll tell a trusted adult." That single rule prevents most of the risks from escalating.

Why does this matter for your future?

Around the world, companies are dealing with data leaks caused by employees entering confidential business information into AI chat tools. Teaching employees "what's okay to input" is becoming a standard part of onboarding. If you build the habits "never enter personal data," "always verify answers," and "don't overuse" while you're a teen, you'll start your professional life already trusted on day one of using AI at work.

People who can use AI safely will be increasingly important in schools and workplaces. Rather than banning useful tools outright, what's needed are people who can explain risks, set rules, and model correct usage for others. If you can articulate safe AI practices as a teen, you're on your way to becoming an AI safety leader.

What you can do starting today

Today: make a do-not-type list
  1. Write name, school, address, photos, passwords on paper
  2. Check the official age rule with a parent
  3. Review a recent prompt for personal details

Summary

AI chat carries four main risks: personal data leaks, misinformation, dependency, and impersonation. Don't avoid it out of fear — aim to use it safely knowing the risks. Don't enter personal info, verify answers, don't overuse it, and talk to a trusted adult if anything goes wrong. Master these four habits and AI chat becomes a safe and powerful tool.

Check What must you never put in an AI chat?