INFRASTRUCTURE LEARNINGINFRASTRUCTURE LEARNING
インフラ大全インフラ大全IT INFRASTRUCTURE / LEARNING
Infrastructure learning guide
Find a lesson or lab/

Esc to close · Search terms stay on your device

LEARNING日本語

Topic lessonTopic: Applied container, data, cost and AI labs

Exercise RAG evaluation|Citation, version and support

Retrieved documents, displayed citations and generated claims provide different evidence.

What you will learn

Identify an unsupported answer even when a citation appears.

Prerequisite

The cases use fictional inputs.

Start the exercise →

What to predict

Retrieved documents, displayed citations and generated claims provide different evidence.

From conditions to the decision
From conditions to the decision1: Retrieved evidence — Align conditions — Source version. 2: Source version — Compare outcomes — Evidence for claim. 3: Evidence for claim — Verify the decision — Decision123Retrieved evidenceSource versionEvidence for claimDecisionFrom conditions to the decision1: Retrieved evidence — Align conditions — Source version. 2: Source version — Compare outcomes — Evidence for claim. 3: Evidence for claim — Verify the decision — Decision123RetrievedevidenceSource versionEvidence forclaimDecision
  1. Retrieved evidence → Source versionAlign conditions
  2. Source version → Evidence for claimCompare outcomes
  3. Evidence for claim → DecisionVerify the decision
Retrieved evidence
Citation source present / No matching source
Source version
Intended version / Older version
Evidence for claim
Passage supports claim / Passage support unverified
Decision
Identify an unsupported answer even when a citation appears.

Compare the cases

Synthetic observations
CaseConditionsDecision
Trial 1Retrieved evidence Citation source present, Source version Intended version, Evidence for claim Passage supports claimThis synthetic claim is supported. Check additional claims individually.
Trial 2Retrieved evidence No matching source, Source version Intended version, Evidence for claim Passage supports claimNo retrieved evidence. Do not accept the answer as verified.
Trial 3Retrieved evidence Citation source present, Source version Older version, Evidence for claim Passage supports claimA citation exists but uses an older version. Recheck the intended version.
Trial 4Retrieved evidence Citation source present, Source version Intended version, Evidence for claim Passage support unverifiedThe citation is present but the passage does not substantiate the claim.

Acceptance and limits

Compares predefined evidence states. It does not connect to an LLM or retrieve real documents.

Read the initial conditions and operational goal.

Change one condition and compare the decision.

Record the model boundary and outstanding checks.

Change a condition

Compares predefined evidence states. It does not connect to an LLM or retrieve real documents.

This synthetic claim is supported. Check additional claims individually.

Check your understanding

Choose an option to see the result and explanation.

What happens in trial 1?
Read the answer and reason

Answer: This synthetic claim is supported. Check additional claims individually. · Retrieved evidence Citation source present, Source version Intended version, Evidence for claim Passage supports claim → This synthetic claim is supported. Check additional claims individually.

What happens in trial 2?
Read the answer and reason

Answer: No retrieved evidence. Do not accept the answer as verified. · Retrieved evidence No matching source, Source version Intended version, Evidence for claim Passage supports claim → No retrieved evidence. Do not accept the answer as verified.

What happens in trial 3?
Read the answer and reason

Answer: A citation exists but uses an older version. Recheck the intended version. · Retrieved evidence Citation source present, Source version Older version, Evidence for claim Passage supports claim → A citation exists but uses an older version. Recheck the intended version.

Check, then explain in your own words

  1. Read the initial conditions and operational goal.
  2. Change one condition and compare the decision.
  3. Record the model boundary and outstanding checks.
Check your understanding: Identify an unsupported answer even when a citation appears.

Compares predefined evidence states. It does not connect to an LLM or retrieve real documents.

Record the model boundary and outstanding checks.

Sources and conditions checked

The official references used in this lesson are collected here with their scope, conditions and corresponding sections. Independent expert review and live AWS comparison have not been performed.