Skip to main content
← ExitAI Fluency Foundations
0 / 14 lessons0 XP
Lesson8of 14

0of15read0 XP

Verification + sourcing literacy: how to check what AI told you

Check AI-generated claims by breaking them into specific facts, finding the official sources those facts should come from (vendor docs, government sites, published research), and seeing whether the sources actually say…

Time
20–25 min
Type
exercise
Bloom
Apply → Create
XP
100
Concept architecture for Verification + sourcing literacy: how to check what AI told you

Architecture diagram for Verification + sourcing literacy: how to check what AI told you. Flowchart diagram showing the AI output verification workflow in four sequential swim-lanes: (1) AI Response Received (purple box with sample claim), (2) Claim Extraction (yellow boxes breaking statement into discrete factual assertions), (3) Multi-Source Verification (three parallel green paths labeled "Primary Sources," "Vendor Documentation," and "Peer-Reviewed Literature" with magnifying glass icons), and (4) Confidence Assessment (red-to-green gradient scale showing "Hallucinated," "Partially Grounded," and "Fully Verified"). Include decision diamonds asking "Sources agree?" and "Primary source found?" with arrows looping back to "Flag for manual review" or forward to "Accept with citation." Add small icons: database for authoritative sources, warning triangle for conflicts, checkmark for verified claims. Use clean technical style with sans-serif labels.

Lesson 2.8 — concept architecture

You'll be able to

  • Check AI-generated claims by breaking them into specific facts, finding the official sources those facts should come from (vendor docs, government sites, published research), and seeing whether the sources actually say what the AI claimed.
  • Sort information sources by trustworthiness: official documentation and original research beat blog posts and summaries; recognize when AI outputs might reflect commercial interests, training-data gaps, or made-up details that need independent confirmation.
  • Trace AI answers back to their roots: pull out specific numbers or technical claims, search for them in known-good places, check multiple independent sources, and flag mismatches or invented citations before you use the information in production.
  • Build a verification record for high-stakes AI outputs: write down the original claim, the authoritative sources you checked, what you found (supported, contradicted, or missing), and any corrections you made, so the next person can see where the information came from and whether it's solid.

Key concepts · tap to reveal

1/15·Watch·Beat 1 · Hook

0%

Hook

An AI tells you something that sounds authoritative. Before you memorize it, you need a process to check whether it's real.

Prompt Labruns here · claude

Your task  Write a prompt that asks Claude to recommend the right AI setup for a real task you're facing — then weigh its answer against this lesson, "Verification + sourcing literacy: how to check what AI told you."

a strong prompt:role · context · task · format · example

⌘↵ to run
Flowchart diagram showing the AI output verification workflow in four sequential swim-lanes: (1) AI Response Received (purple box with sample claim), (2) Claim Extraction (yellow boxes breaking statement into discrete factual assertions), (3) Multi-S
Diagram · generated brief

Exercise · scenario

A municipal water utility engineer receives an AI-generated summary claiming that 'EPA Maximum Contaminant Levels for lead in drinking water were revised to 10 ppb in 2023, down from the previous 15 ppb standard.' The engineer needs to incorporate this into a compliance report due tomorrow. She opens a new browser tab and searches 'EPA lead MCL 2023' and finds the official EPA.gov page showing the action level remains 15 ppb with no 2023 revision. She also checks the Federal Register and finds no recent lead MCL rule changes.

Deliverable

Produce a **Verification Audit Report** as a markdown document that demonstrates your ability to systematically check AI-generated claims against primary sources. Select one AI-generated answer you received during this course (from a chatbot, code assistant, or documentation tool) and decompose it into three to five atomic claims.

Reveal model answer

Primary source verification with authoritative government databases

Practice · Scenarios

0 of 8 revealed

Scenario 1 of 8

A nonprofit advocacy director is preparing testimony for a state legislative hearing on housing policy. An AI tool generates talking points including 'According to HUD's 2023 Annual Homeless Assessment Report, chronic homelessness increased 28% nationally, with the steepest rises in rural counties.' The director visits HUD.gov, downloads the actual 2023 AHAR, and finds that chronic homelessness increased 12% (not 28%), and the report explicitly states urban areas saw the largest increases, not rural counties. The director removes the AI-generated claim and replaces it with direct quotes from the HUD report, including page numbers. What verification literacy practice did the director demonstrate, and why does this matter for policy advocacy?

Step 1 · Classify

Common misconceptions

  • If an AI provides a citation or a reference, the claim is verified and trustworthy

    AI systems can fabricate citations that look real but point to nonexistent documents, or they can cite real documents that do not actually support the claim. You must independently retrieve the cited source and confirm that the relevant passage says what the AI claims it says. Research on financial AI systems found that large language models invent citations as part of the same hallucination process that produces fabricated facts. Verification means checking the source yourself, not trusting that the AI checked it for you.

Quiz · adaptive · 3 items

Mastery check

Match each term to its definition. Pass at 80% to earn the lesson's XP and unlock the next.

Sources

  1. [1]OpenAlex API·OpenAlex API > “Your argumentation is good”, says the AI vs humans, The role of feedback providers and personalised language for feedb > Abs (2025) · Research
  2. [2]arXiv API·arXiv API > FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification > Abstract (2025) · Research
  3. [3]DigComp 2.2 (EU Digital Competence Framework, JRC128415)·DigComp 2.2 (EU Digital Competence Framework, JRC128415) (2025) · Research
  4. [4]OpenAlex API·OpenAlex API > Guidelines for Human-AI Interaction > INTRODUCTION (2025) · Research
  5. [5]OpenAlex API·OpenAlex API > Mindstorms: Children, Computers, and Powerful Ideas (foreword + intro) > limitations (2025) · Research
  6. [6]OpenAlex API·OpenAlex API > Lessons of Mastery Learning > Abstract (2025) · Research
Capstone artifact · auto-graded

Submit your work for review

Paste your capstone artifact below. You'll get back a 4-level rubric grade, per-criterion feedback, and three concrete edits to strengthen it.

0 chars · minimum 50